[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:12:42.771329  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:45901
I20260709 12:12:42.772764  8907 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:12:42.773736  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:42.789902  8914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:42.789940  8913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:42.792047  8907 server_base.cc:1061] running on GCE node
W20260709 12:12:42.790059  8916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:43.893328  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:43.893568  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:43.893718  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599163893701 us; error 0 us; skew 500 ppm
I20260709 12:12:43.894562  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:43.899756  8907 webserver.cc:533] Webserver started at http://127.8.178.254:42021/ using document root <none> and password file <none>
I20260709 12:12:43.900597  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:43.900794  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:43.901185  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:43.907105  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "020a77f90b1c4d08b297d58c0f155de3"
format_stamp: "Formatted at 2026-07-09 12:12:43 on dist-test-slave-jlx4"
I20260709 12:12:43.915066  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:43.920384  8922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:43.921593  8907 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:12:43.921952  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "020a77f90b1c4d08b297d58c0f155de3"
format_stamp: "Formatted at 2026-07-09 12:12:43 on dist-test-slave-jlx4"
I20260709 12:12:43.922307  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:43.967563  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:43.969141  8907 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:12:43.969616  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.039598  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:45901
I20260709 12:12:44.039706  8973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:45901 every 8 connection(s)
I20260709 12:12:44.047438  8974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:44.069404  8974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: Bootstrap starting.
I20260709 12:12:44.075343  8974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:44.077118  8974 log.cc:826] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: Log is configured to *not* fsync() on all Append() calls
I20260709 12:12:44.081650  8974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: No bootstrap required, opened a new log
I20260709 12:12:44.102654  8974 raft_consensus.cc:359] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER }
I20260709 12:12:44.103240  8974 raft_consensus.cc:385] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:44.103453  8974 raft_consensus.cc:740] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020a77f90b1c4d08b297d58c0f155de3, State: Initialized, Role: FOLLOWER
I20260709 12:12:44.104282  8974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER }
I20260709 12:12:44.104763  8974 raft_consensus.cc:399] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:44.105011  8974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:44.105316  8974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:44.109494  8974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER }
I20260709 12:12:44.110251  8974 leader_election.cc:304] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 020a77f90b1c4d08b297d58c0f155de3; no voters: 
I20260709 12:12:44.111941  8974 leader_election.cc:290] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:44.112277  8977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:44.114348  8977 raft_consensus.cc:697] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 1 LEADER]: Becoming Leader. State: Replica: 020a77f90b1c4d08b297d58c0f155de3, State: Running, Role: LEADER
I20260709 12:12:44.115309  8977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER }
I20260709 12:12:44.116355  8974 sys_catalog.cc:565] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:44.125264  8979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 020a77f90b1c4d08b297d58c0f155de3. Latest consensus state: current_term: 1 leader_uuid: "020a77f90b1c4d08b297d58c0f155de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER } }
I20260709 12:12:44.125224  8978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "020a77f90b1c4d08b297d58c0f155de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020a77f90b1c4d08b297d58c0f155de3" member_type: VOTER } }
I20260709 12:12:44.126046  8979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.126343  8978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.129580  8986 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:44.141695  8986 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:44.143800  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:44.157325  8986 catalog_manager.cc:1383] Generated new cluster ID: 2dfc6d886ffc4e99af2cb56975f583a3
I20260709 12:12:44.157658  8986 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:44.189978  8986 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:44.191599  8986 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:44.209719  8986 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: Generated new TSK 0
I20260709 12:12:44.210698  8986 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:44.275241  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.285010  8996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.288641  8997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.298115  8907 server_base.cc:1061] running on GCE node
W20260709 12:12:44.298151  9000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.299255  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.299528  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.299731  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599164299706 us; error 0 us; skew 500 ppm
I20260709 12:12:44.300498  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.304512  8907 webserver.cc:533] Webserver started at http://127.8.178.193:44211/ using document root <none> and password file <none>
I20260709 12:12:44.305208  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.305449  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.305776  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.307271  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "a545c5f9265e4fb1b8c772ed88288b91"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.322868  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:44.328648  9004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.329615  8907 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:12:44.329969  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "a545c5f9265e4fb1b8c772ed88288b91"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.330521  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.376355  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.378194  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.380998  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.386649  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.386991  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.387318  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.387539  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.480238  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:36499
I20260709 12:12:44.480360  9066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:36499 every 8 connection(s)
I20260709 12:12:44.487133  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.500722  9071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.507071  9072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.523422  9067 heartbeater.cc:344] Connected to a master server at 127.8.178.254:45901
I20260709 12:12:44.523975  9067 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.524611  8907 server_base.cc:1061] running on GCE node
W20260709 12:12:44.524860  9074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.525341  9067 heartbeater.cc:507] Master 127.8.178.254:45901 requested a full tablet report, sending...
I20260709 12:12:44.526075  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.526356  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.526604  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599164526583 us; error 0 us; skew 500 ppm
I20260709 12:12:44.527369  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.529000  8939 ts_manager.cc:194] Registered new tserver with Master: a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499)
I20260709 12:12:44.531559  8907 webserver.cc:533] Webserver started at http://127.8.178.194:37371/ using document root <none> and password file <none>
I20260709 12:12:44.532090  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.532023  8939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52364
I20260709 12:12:44.532364  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.532713  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.534160  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "3512001e18a94daea43a763a406ef5c3"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.540030  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:12:44.544251  9079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.545137  8907 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:12:44.545418  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "3512001e18a94daea43a763a406ef5c3"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.545706  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.573524  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.574869  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.577203  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.580295  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.580524  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.580780  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.580927  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.669140  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:32949
I20260709 12:12:44.669395  9141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:32949 every 8 connection(s)
I20260709 12:12:44.676148  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.688078  9145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.689253  9146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.692590  9142 heartbeater.cc:344] Connected to a master server at 127.8.178.254:45901
I20260709 12:12:44.692991  9142 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.693969  9142 heartbeater.cc:507] Master 127.8.178.254:45901 requested a full tablet report, sending...
I20260709 12:12:44.696105  8907 server_base.cc:1061] running on GCE node
I20260709 12:12:44.696484  8939 ts_manager.cc:194] Registered new tserver with Master: 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
W20260709 12:12:44.697721  9148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.697911  8939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52368
I20260709 12:12:44.698832  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.699082  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.699285  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599164699266 us; error 0 us; skew 500 ppm
I20260709 12:12:44.699849  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.702294  8907 webserver.cc:533] Webserver started at http://127.8.178.195:46539/ using document root <none> and password file <none>
I20260709 12:12:44.702795  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.702977  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.703220  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.704253  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "a6d7e5adece54725a7438686f70dc5e8"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.708771  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:44.712247  9153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.713083  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:44.713378  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "a6d7e5adece54725a7438686f70dc5e8"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-jlx4"
I20260709 12:12:44.713661  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.741036  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.742321  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.744032  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.746547  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.746750  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.746995  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.747139  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.839326  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:38331
I20260709 12:12:44.839560  9215 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:38331 every 8 connection(s)
I20260709 12:12:44.857065  9216 heartbeater.cc:344] Connected to a master server at 127.8.178.254:45901
I20260709 12:12:44.857452  9216 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.858239  9216 heartbeater.cc:507] Master 127.8.178.254:45901 requested a full tablet report, sending...
I20260709 12:12:44.860225  8939 ts_manager.cc:194] Registered new tserver with Master: a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:44.860707  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014480237s
I20260709 12:12:44.861533  8939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52376
I20260709 12:12:44.914779  8939 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52386:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:44.918484  8939 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:45.010461  9181 tablet_service.cc:1511] Processing CreateTablet for tablet 10364ae4206c4c959ba6e099e09556a6 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:45.011699  9179 tablet_service.cc:1511] Processing CreateTablet for tablet 63feb8fd989e4d13b6d9c6d5a46238d2 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:45.013458  9181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10364ae4206c4c959ba6e099e09556a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.016568  9180 tablet_service.cc:1511] Processing CreateTablet for tablet 25fe4933424c428daff6b8f2077b51f4 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:45.017633  9178 tablet_service.cc:1511] Processing CreateTablet for tablet a291b882428545c39e1238c33043d89e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:45.019459  9177 tablet_service.cc:1511] Processing CreateTablet for tablet 6f51aeabcc1f4746af40008c2a6da929 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:45.021699  9179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63feb8fd989e4d13b6d9c6d5a46238d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.021063  9176 tablet_service.cc:1511] Processing CreateTablet for tablet a2505074b0a149ac9b57d7a8f6d6e0fb (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:45.023718  9177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f51aeabcc1f4746af40008c2a6da929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.024497  9180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fe4933424c428daff6b8f2077b51f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.025132  9176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2505074b0a149ac9b57d7a8f6d6e0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.026800  9178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a291b882428545c39e1238c33043d89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.042073  9175 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad6c1340f1d42af8518d01e14cce35c (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:45.043792  9175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad6c1340f1d42af8518d01e14cce35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.057261  9107 tablet_service.cc:1511] Processing CreateTablet for tablet 10364ae4206c4c959ba6e099e09556a6 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:45.061136  9107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10364ae4206c4c959ba6e099e09556a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.059247  9104 tablet_service.cc:1511] Processing CreateTablet for tablet a291b882428545c39e1238c33043d89e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:45.063531  9104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a291b882428545c39e1238c33043d89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.051944  9105 tablet_service.cc:1511] Processing CreateTablet for tablet 63feb8fd989e4d13b6d9c6d5a46238d2 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:45.060529  9106 tablet_service.cc:1511] Processing CreateTablet for tablet 25fe4933424c428daff6b8f2077b51f4 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:45.067553  9105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63feb8fd989e4d13b6d9c6d5a46238d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.071897  9106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fe4933424c428daff6b8f2077b51f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.073786  9102 tablet_service.cc:1511] Processing CreateTablet for tablet a2505074b0a149ac9b57d7a8f6d6e0fb (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:45.064436  9103 tablet_service.cc:1511] Processing CreateTablet for tablet 6f51aeabcc1f4746af40008c2a6da929 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:45.088614  9101 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad6c1340f1d42af8518d01e14cce35c (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:45.092633  9103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f51aeabcc1f4746af40008c2a6da929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.100329  9031 tablet_service.cc:1511] Processing CreateTablet for tablet 25fe4933424c428daff6b8f2077b51f4 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:45.100772  9101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad6c1340f1d42af8518d01e14cce35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.087387  9174 tablet_service.cc:1511] Processing CreateTablet for tablet fab8edd383ff407d8c48e8ead1c58b4e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:45.107254  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fe4933424c428daff6b8f2077b51f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.104106  9032 tablet_service.cc:1511] Processing CreateTablet for tablet 10364ae4206c4c959ba6e099e09556a6 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:45.114861  9234 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.105635  9100 tablet_service.cc:1511] Processing CreateTablet for tablet fab8edd383ff407d8c48e8ead1c58b4e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:45.118069  9099 tablet_service.cc:1511] Processing CreateTablet for tablet 213c44a4cc364788865ecc904259e678 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:45.119274  9029 tablet_service.cc:1511] Processing CreateTablet for tablet a291b882428545c39e1238c33043d89e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:45.120254  9100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8edd383ff407d8c48e8ead1c58b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.123366  9174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8edd383ff407d8c48e8ead1c58b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.120074  9030 tablet_service.cc:1511] Processing CreateTablet for tablet 63feb8fd989e4d13b6d9c6d5a46238d2 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:45.125025  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a291b882428545c39e1238c33043d89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.128954  9102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2505074b0a149ac9b57d7a8f6d6e0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.133056  9032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10364ae4206c4c959ba6e099e09556a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.124910  9180 tablet_service.cc:1511] Processing CreateTablet for tablet 213c44a4cc364788865ecc904259e678 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:45.137900  9099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213c44a4cc364788865ecc904259e678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.150084  9180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213c44a4cc364788865ecc904259e678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.141000  9025 tablet_service.cc:1511] Processing CreateTablet for tablet fab8edd383ff407d8c48e8ead1c58b4e (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:45.153208  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63feb8fd989e4d13b6d9c6d5a46238d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.158460  9027 tablet_service.cc:1511] Processing CreateTablet for tablet a2505074b0a149ac9b57d7a8f6d6e0fb (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:45.153308  9024 tablet_service.cc:1511] Processing CreateTablet for tablet 213c44a4cc364788865ecc904259e678 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:45.160235  9028 tablet_service.cc:1511] Processing CreateTablet for tablet 6f51aeabcc1f4746af40008c2a6da929 (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:12:45.161775  8987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:45.155222  9026 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad6c1340f1d42af8518d01e14cce35c (DEFAULT_TABLE table=test-workload [id=f7a4400973034894864644d7049b7f84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:45.167512  9025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab8edd383ff407d8c48e8ead1c58b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.169725  9027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2505074b0a149ac9b57d7a8f6d6e0fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.183156  9024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213c44a4cc364788865ecc904259e678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.204394  9028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f51aeabcc1f4746af40008c2a6da929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.211256  9026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad6c1340f1d42af8518d01e14cce35c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.283406  9235 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.294854  9234 tablet_bootstrap.cc:654] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.330193  9236 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.366554  9234 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.369243  9236 tablet_bootstrap.cc:654] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.367960  9235 tablet_bootstrap.cc:654] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.367058  9234 ts_tablet_manager.cc:1403] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.009s
I20260709 12:12:45.380620  9234 raft_consensus.cc:359] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.381538  9236 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:45.381551  9234 raft_consensus.cc:385] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.382007  9234 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.382112  9236 ts_tablet_manager.cc:1403] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260709 12:12:45.382932  9234 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.383865  9235 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.384855  9235 ts_tablet_manager.cc:1403] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.004s
I20260709 12:12:45.385735  9236 raft_consensus.cc:359] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.386494  9236 raft_consensus.cc:385] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.386833  9236 raft_consensus.cc:740] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.387697  9236 consensus_queue.cc:260] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.387816  9235 raft_consensus.cc:359] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.388898  9235 raft_consensus.cc:385] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.389206  9235 raft_consensus.cc:740] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.390146  9067 heartbeater.cc:499] Master 127.8.178.254:45901 was elected leader, sending a full tablet report...
I20260709 12:12:45.390038  9235 consensus_queue.cc:260] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.392004  9142 heartbeater.cc:499] Master 127.8.178.254:45901 was elected leader, sending a full tablet report...
I20260709 12:12:45.392318  9234 ts_tablet_manager.cc:1434] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.009s
I20260709 12:12:45.393034  9216 heartbeater.cc:499] Master 127.8.178.254:45901 was elected leader, sending a full tablet report...
I20260709 12:12:45.393486  9234 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.402899  9234 tablet_bootstrap.cc:654] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.403024  9236 ts_tablet_manager.cc:1434] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:45.404174  9236 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.405668  9235 ts_tablet_manager.cc:1434] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:12:45.407284  9235 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.415108  9234 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.415604  9234 ts_tablet_manager.cc:1403] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:12:45.418493  9234 raft_consensus.cc:359] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.419221  9234 raft_consensus.cc:385] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.419517  9234 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.413726  9236 tablet_bootstrap.cc:654] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.420243  9234 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.423967  9234 ts_tablet_manager.cc:1434] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:45.424973  9234 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
W20260709 12:12:45.426162  9143 tablet.cc:2406] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:45.421950  9235 tablet_bootstrap.cc:654] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.434089  9234 tablet_bootstrap.cc:654] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.445537  9235 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.446125  9235 ts_tablet_manager.cc:1403] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 12:12:45.449226  9235 raft_consensus.cc:359] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.450047  9235 raft_consensus.cc:385] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.450345  9235 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.457677  9235 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.459687  9236 tablet_bootstrap.cc:492] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:45.459841  9235 ts_tablet_manager.cc:1434] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:45.460173  9236 ts_tablet_manager.cc:1403] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.031s
I20260709 12:12:45.460821  9235 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.461018  9234 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.461426  9234 ts_tablet_manager.cc:1403] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.017s
I20260709 12:12:45.463034  9236 raft_consensus.cc:359] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.463783  9236 raft_consensus.cc:385] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.464084  9236 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.464195  9234 raft_consensus.cc:359] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.464957  9234 raft_consensus.cc:385] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.464962  9236 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.465456  9234 raft_consensus.cc:740] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.466482  9234 consensus_queue.cc:260] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.467428  9236 ts_tablet_manager.cc:1434] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:45.468333  9236 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.468864  9234 ts_tablet_manager.cc:1434] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:45.469722  9234 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.475567  9236 tablet_bootstrap.cc:654] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.475935  9234 tablet_bootstrap.cc:654] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.484509  9241 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.485049  9241 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.475935  9235 tablet_bootstrap.cc:654] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.487349  9234 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.487890  9234 ts_tablet_manager.cc:1403] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:12:45.489681  9241 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.491533  9234 raft_consensus.cc:359] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:45.492439  9234 raft_consensus.cc:385] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.492733  9234 raft_consensus.cc:740] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.493470  9234 consensus_queue.cc:260] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:45.495894  9234 ts_tablet_manager.cc:1434] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:45.496821  9234 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.504273  9234 tablet_bootstrap.cc:654] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.505066  9235 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.505575  9235 ts_tablet_manager.cc:1403] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.009s
I20260709 12:12:45.508632  9235 raft_consensus.cc:359] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.509441  9235 raft_consensus.cc:385] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.509737  9235 raft_consensus.cc:740] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.510469  9235 consensus_queue.cc:260] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.512746  9235 ts_tablet_manager.cc:1434] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:12:45.513752  9235 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.516342  9234 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.516822  9234 ts_tablet_manager.cc:1403] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:12:45.517248  9236 tablet_bootstrap.cc:492] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:45.517797  9236 ts_tablet_manager.cc:1403] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.007s
I20260709 12:12:45.519745  9234 raft_consensus.cc:359] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.520507  9234 raft_consensus.cc:385] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.520824  9234 raft_consensus.cc:740] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.520663  9236 raft_consensus.cc:359] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.521443  9236 raft_consensus.cc:385] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.521740  9236 raft_consensus.cc:740] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.521834  9234 consensus_queue.cc:260] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.522562  9236 consensus_queue.cc:260] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.524572  9234 ts_tablet_manager.cc:1434] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:45.525617  9234 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.530321  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
W20260709 12:12:45.532539  9008 leader_election.cc:343] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.532943  9191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.534024  9241 raft_consensus.cc:493] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.534518  9241 raft_consensus.cc:515] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
W20260709 12:12:45.534826  9005 leader_election.cc:343] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.535307  9005 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91; no voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:45.536674  9241 leader_election.cc:290] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.537206  9241 raft_consensus.cc:2749] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.539114  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:45.539440  9234 tablet_bootstrap.cc:654] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.539837  9117 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 0.
I20260709 12:12:45.541297  9008 leader_election.cc:304] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:45.542163  9241 raft_consensus.cc:2804] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.542574  9241 raft_consensus.cc:493] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.542912  9241 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.549703  9240 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.549976  9241 raft_consensus.cc:515] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.550226  9240 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.550741  9235 tablet_bootstrap.cc:654] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.552858  9240 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.555917  9234 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.556027  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:45.556533  9234 ts_tablet_manager.cc:1403] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.007s
I20260709 12:12:45.556689  9117 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.559424  9234 raft_consensus.cc:359] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.561064  9234 raft_consensus.cc:385] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.561362  9234 raft_consensus.cc:740] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.562212  9234 consensus_queue.cc:260] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.564697  9234 ts_tablet_manager.cc:1434] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:45.565606  9234 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.568889  9236 ts_tablet_manager.cc:1434] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:12:45.569278  9235 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.569763  9235 ts_tablet_manager.cc:1403] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.003s
I20260709 12:12:45.569927  9236 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.572602  9235 raft_consensus.cc:359] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.573348  9235 raft_consensus.cc:385] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.573577  9235 raft_consensus.cc:740] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.574151  9235 consensus_queue.cc:260] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.565769  9117 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 1.
I20260709 12:12:45.579890  9235 ts_tablet_manager.cc:1434] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:12:45.580034  9008 leader_election.cc:304] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:45.573051  9234 tablet_bootstrap.cc:654] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.581471  9235 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.596463  9235 tablet_bootstrap.cc:654] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.586326  9241 leader_election.cc:290] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.600200  9240 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.600706  9240 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.602375  9241 raft_consensus.cc:2804] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.606349  9240 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.606935  9241 raft_consensus.cc:697] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
W20260709 12:12:45.607101  9005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:38331, user_credentials={real_user=slave}} blocked reactor thread for 72441.3us
I20260709 12:12:45.614573  9191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.621827  9191 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 0.
I20260709 12:12:45.622182  9242 raft_consensus.cc:493] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.614069  9241 consensus_queue.cc:237] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.623234  9234 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.623128  9242 raft_consensus.cc:515] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.624151  9234 ts_tablet_manager.cc:1403] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.014s
I20260709 12:12:45.626765  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:45.628209  9242 leader_election.cc:290] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.637100  9236 tablet_bootstrap.cc:654] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.637101  9190 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.643787  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
W20260709 12:12:45.646453  9157 leader_election.cc:343] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.646107  9253 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.642467  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.647274  9253 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.651456  9253 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.652107  9042 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 0.
I20260709 12:12:45.652148  9191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.652917  9191 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 0.
I20260709 12:12:45.654357  9005 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.655265  9253 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.655623  9253 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.655954  9253 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.655773  9157 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.656718  9240 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.657073  9240 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.657387  9240 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.662760  9242 raft_consensus.cc:493] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.663344  9242 raft_consensus.cc:515] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.664001  9234 raft_consensus.cc:359] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.664867  9234 raft_consensus.cc:385] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.665160  9234 raft_consensus.cc:740] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.667193  9242 leader_election.cc:290] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.673450  9253 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.665902  9234 consensus_queue.cc:260] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.675372  9190 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 1.
I20260709 12:12:45.668263  9240 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.678473  9235 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.680433  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.681926  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.686388  9235 ts_tablet_manager.cc:1403] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.011s
I20260709 12:12:45.714818  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:45.715600  9117 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 0.
I20260709 12:12:45.716257  9253 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.717778  9235 raft_consensus.cc:359] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.718597  9235 raft_consensus.cc:385] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.718725  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:45.689507  8938 catalog_manager.cc:5697] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.719733  9190 raft_consensus.cc:2393] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a545c5f9265e4fb1b8c772ed88288b91 in current term 1: Already voted for candidate a6d7e5adece54725a7438686f70dc5e8 in this term.
I20260709 12:12:45.720958  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:45.721639  9116 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.718927  9235 raft_consensus.cc:740] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
W20260709 12:12:45.708246  9083 leader_election.cc:343] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:45.723148  9083 leader_election.cc:343] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.722988  9235 consensus_queue.cc:260] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.723739  9240 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.724466  9240 raft_consensus.cc:493] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.724889  9240 raft_consensus.cc:515] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.726442  9235 ts_tablet_manager.cc:1434] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:12:45.727420  9235 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.728434  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:45.728628  9240 leader_election.cc:290] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
W20260709 12:12:45.730257  9157 leader_election.cc:343] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.730736  9157 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6d7e5adece54725a7438686f70dc5e8; no voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.730938  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.732089  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
W20260709 12:12:45.733304  9157 leader_election.cc:343] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.732796  9117 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 0.
I20260709 12:12:45.734871  9157 leader_election.cc:304] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.736167  9236 tablet_bootstrap.cc:492] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:45.736654  9236 ts_tablet_manager.cc:1403] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.004s
I20260709 12:12:45.736419  9115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:45.735234  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:45.732230  9266 raft_consensus.cc:2749] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.738945  9266 raft_consensus.cc:2804] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.739323  9266 raft_consensus.cc:493] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.739641  9266 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.739918  9116 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 1.
I20260709 12:12:45.708734  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:45.741372  9236 raft_consensus.cc:359] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.742105  9236 raft_consensus.cc:385] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.742388  9236 raft_consensus.cc:740] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.742798  9157 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.743104  9236 consensus_queue.cc:260] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.743582  9240 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.743417  9008 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91; no voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:45.744264  9240 raft_consensus.cc:697] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:45.745085  9240 consensus_queue.cc:237] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.743422  9234 ts_tablet_manager.cc:1434] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.022s
I20260709 12:12:45.741539  9042 raft_consensus.cc:2393] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6d7e5adece54725a7438686f70dc5e8 in current term 1: Already voted for candidate a545c5f9265e4fb1b8c772ed88288b91 in this term.
I20260709 12:12:45.749181  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.751947  9253 raft_consensus.cc:2749] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.757359  9190 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 0.
I20260709 12:12:45.758996  9234 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.761276  9235 tablet_bootstrap.cc:654] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.762722  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.764766  9236 ts_tablet_manager.cc:1434] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.007s
I20260709 12:12:45.766194  9080 leader_election.cc:304] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.768528  9262 raft_consensus.cc:2804] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.768976  9262 raft_consensus.cc:493] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.769284  9262 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.768158  9236 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.768519  9266 raft_consensus.cc:515] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.775099  9266 leader_election.cc:290] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.776726  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:45.776990  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:45.777355  9042 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.777483  9116 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.781545  9190 raft_consensus.cc:2393] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3512001e18a94daea43a763a406ef5c3 in current term 1: Already voted for candidate a6d7e5adece54725a7438686f70dc5e8 in this term.
I20260709 12:12:45.784015  9080 leader_election.cc:304] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3; no voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:45.791038  9236 tablet_bootstrap.cc:654] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.797964  9116 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 1.
I20260709 12:12:45.798537  9242 raft_consensus.cc:2749] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.799612  9157 leader_election.cc:304] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.800725  9266 raft_consensus.cc:2804] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.800498  9262 raft_consensus.cc:515] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.801429  9266 raft_consensus.cc:697] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:45.803982  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:45.804265  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:45.804893  9190 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:45.808516  9083 leader_election.cc:343] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.802539  9266 consensus_queue.cc:237] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.812065  9190 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 1.
I20260709 12:12:45.813519  9080 leader_election.cc:304] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.814378  9242 raft_consensus.cc:2804] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.814519  9262 leader_election.cc:290] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.822657  9042 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 1.
I20260709 12:12:45.826318  9240 raft_consensus.cc:493] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.826859  9240 raft_consensus.cc:515] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:45.835135  9234 tablet_bootstrap.cc:654] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.834591  8939 catalog_manager.cc:5697] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.836505  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
W20260709 12:12:45.840452  9157 leader_election.cc:343] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.840870  9240 leader_election.cc:290] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.842181  9242 raft_consensus.cc:697] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:45.847419  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:45.849344  9242 consensus_queue.cc:237] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
W20260709 12:12:45.849967  9157 leader_election.cc:343] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.851048  9157 leader_election.cc:304] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6d7e5adece54725a7438686f70dc5e8; no voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.852412  9240 raft_consensus.cc:2749] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.852900  9235 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.853370  9235 ts_tablet_manager.cc:1403] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.009s
I20260709 12:12:45.858960  9236 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:45.857481  9235 raft_consensus.cc:359] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.859445  9236 ts_tablet_manager.cc:1403] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.003s
I20260709 12:12:45.859820  9235 raft_consensus.cc:385] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.862136  9235 raft_consensus.cc:740] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.868216  9235 consensus_queue.cc:260] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.870669  9235 ts_tablet_manager.cc:1434] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
I20260709 12:12:45.871580  9235 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.871749  9234 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:45.872136  9234 ts_tablet_manager.cc:1403] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.014s
I20260709 12:12:45.878645  9234 raft_consensus.cc:359] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.879454  9234 raft_consensus.cc:385] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.879833  9234 raft_consensus.cc:740] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.880614  9234 consensus_queue.cc:260] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.881829  9236 raft_consensus.cc:359] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.883044  9235 tablet_bootstrap.cc:654] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.883129  9234 ts_tablet_manager.cc:1434] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:12:45.883275  9236 raft_consensus.cc:385] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.883764  9236 raft_consensus.cc:740] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.884600  9234 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: Bootstrap starting.
I20260709 12:12:45.884626  9236 consensus_queue.cc:260] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.888657  9242 raft_consensus.cc:493] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.889137  9242 raft_consensus.cc:515] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.891129  9242 leader_election.cc:290] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.893129  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.893728  9190 raft_consensus.cc:2468] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 0.
I20260709 12:12:45.894471  9234 tablet_bootstrap.cc:654] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.894943  9235 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.895397  9235 ts_tablet_manager.cc:1403] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 12:12:45.896517  8939 catalog_manager.cc:5697] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.898161  9235 raft_consensus.cc:359] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.898911  9235 raft_consensus.cc:385] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.899215  9235 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.899801  9080 leader_election.cc:304] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.900003  9240 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.899893  9235 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.900457  9240 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.901122  9272 raft_consensus.cc:2804] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.901479  9272 raft_consensus.cc:493] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.901779  9272 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.902441  9240 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.904558  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
W20260709 12:12:45.906132  9157 leader_election.cc:343] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.911423  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.912148  9041 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 0.
I20260709 12:12:45.898461  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.913421  9235 ts_tablet_manager.cc:1434] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:12:45.913941  9157 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:45.914577  9235 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.915117  9240 raft_consensus.cc:2804] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.915640  9240 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.915982  9240 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.911723  9272 raft_consensus.cc:515] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
W20260709 12:12:45.920533  9083 leader_election.cc:343] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.922008  9272 leader_election.cc:290] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.929417  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:45.930040  9190 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.938982  9235 tablet_bootstrap.cc:654] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.940475  9240 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.943279  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:45.943888  9042 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.949827  9235 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:45.950299  9235 ts_tablet_manager.cc:1403] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.020s
I20260709 12:12:45.953188  9235 raft_consensus.cc:359] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:45.953883  9235 raft_consensus.cc:385] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.954149  9235 raft_consensus.cc:740] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.954974  9235 consensus_queue.cc:260] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:45.956449  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:45.957245  9235 ts_tablet_manager.cc:1434] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:12:45.958123  9083 leader_election.cc:343] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.958655  9235 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: Bootstrap starting.
I20260709 12:12:45.960484  9272 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.960955  9272 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.962478  9242 raft_consensus.cc:493] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.962918  9242 raft_consensus.cc:515] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.963027  9272 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.965353  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
W20260709 12:12:45.968325  9083 leader_election.cc:343] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.968521  9242 leader_election.cc:290] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:45.969554  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:45.969987  9191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.970201  9041 raft_consensus.cc:2468] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 0.
I20260709 12:12:45.970714  9191 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 0.
I20260709 12:12:45.971539  9083 leader_election.cc:304] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:45.972043  9080 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.972373  9242 raft_consensus.cc:2804] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.970507  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:45.972967  9272 raft_consensus.cc:2804] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.973574  9272 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.972652  9042 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 1.
I20260709 12:12:45.973944  9242 raft_consensus.cc:493] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.974761  9242 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.975412  9157 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:45.974368  9272 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:45.977000  9080 leader_election.cc:343] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.977149  9240 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:45.977718  9240 raft_consensus.cc:2804] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.974084  9236 ts_tablet_manager.cc:1434] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.000s
I20260709 12:12:45.967531  8935 catalog_manager.cc:5697] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.963934  9190 raft_consensus.cc:2468] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 1.
I20260709 12:12:45.978169  9240 raft_consensus.cc:697] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:45.979858  9236 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:45.979827  9240 consensus_queue.cc:237] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:45.983883  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:45.984287  9235 tablet_bootstrap.cc:654] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:45.986544  9157 leader_election.cc:343] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.988344  9080 leader_election.cc:304] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:45.990334  9262 raft_consensus.cc:2804] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.000262  9236 tablet_bootstrap.cc:654] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.001588  9262 raft_consensus.cc:697] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:46.007988  9234 tablet_bootstrap.cc:492] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: No bootstrap required, opened a new log
I20260709 12:12:46.008466  9234 ts_tablet_manager.cc:1403] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: Time spent bootstrapping tablet: real 0.124s	user 0.041s	sys 0.037s
I20260709 12:12:46.008466  9272 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.002494  9262 consensus_queue.cc:237] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.011497  9272 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.010891  8935 catalog_manager.cc:5697] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.013837  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:46.014420  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:46.015012  9190 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.016167  9235 tablet_bootstrap.cc:492] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: No bootstrap required, opened a new log
I20260709 12:12:46.016578  9235 ts_tablet_manager.cc:1403] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.001s
I20260709 12:12:46.018685  9242 raft_consensus.cc:515] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.019400  9235 raft_consensus.cc:359] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.020045  9235 raft_consensus.cc:385] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.020306  9235 raft_consensus.cc:740] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.021234  9242 leader_election.cc:290] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.020968  9235 consensus_queue.cc:260] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.021764  9234 raft_consensus.cc:359] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.022413  9234 raft_consensus.cc:385] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.022697  9234 raft_consensus.cc:740] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.023252  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
W20260709 12:12:46.018191  9083 leader_election.cc:343] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.023432  9234 consensus_queue.cc:260] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.023852  9235 ts_tablet_manager.cc:1434] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:46.024616  9189 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.025240  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:46.025810  9042 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.032400  9042 raft_consensus.cc:2468] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 1.
I20260709 12:12:46.033708  9083 leader_election.cc:304] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:46.034648  9272 raft_consensus.cc:2804] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.035192  9272 raft_consensus.cc:697] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:46.035841  9234 ts_tablet_manager.cc:1434] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:12:46.036087  9272 consensus_queue.cc:237] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.042745  9189 raft_consensus.cc:2468] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 1.
I20260709 12:12:46.043553  9190 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 1.
I20260709 12:12:46.046751  9080 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:46.048877  9242 raft_consensus.cc:2804] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.049401  9242 raft_consensus.cc:697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:46.050282  9242 consensus_queue.cc:237] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.056809  9236 tablet_bootstrap.cc:492] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:46.057343  9236 ts_tablet_manager.cc:1403] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.078s	user 0.001s	sys 0.021s
I20260709 12:12:46.058050  8938 catalog_manager.cc:5697] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.060364  9236 raft_consensus.cc:359] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.061164  9236 raft_consensus.cc:385] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.061465  9236 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.062369  9236 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.064610  9236 ts_tablet_manager.cc:1434] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:46.065593  9236 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:46.071777  9236 tablet_bootstrap.cc:654] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.084765  9236 tablet_bootstrap.cc:492] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:46.085209  9236 ts_tablet_manager.cc:1403] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 12:12:46.087769  8935 catalog_manager.cc:5697] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.087944  9236 raft_consensus.cc:359] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:46.088691  9236 raft_consensus.cc:385] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.088976  9236 raft_consensus.cc:740] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.089212  8935 catalog_manager.cc:5697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.089653  9236 consensus_queue.cc:260] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:46.092315  9236 ts_tablet_manager.cc:1434] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:12:46.093233  9236 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:46.093894  9253 consensus_queue.cc:1048] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.099675  9236 tablet_bootstrap.cc:654] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.120998  9236 tablet_bootstrap.cc:492] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:46.121443  9236 ts_tablet_manager.cc:1403] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 12:12:46.125730  9253 consensus_queue.cc:1048] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.130857  9236 raft_consensus.cc:359] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.131554  9236 raft_consensus.cc:385] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.131841  9236 raft_consensus.cc:740] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.132607  9236 consensus_queue.cc:260] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.134755  9236 ts_tablet_manager.cc:1434] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:12:46.135706  9236 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: Bootstrap starting.
I20260709 12:12:46.142076  9236 tablet_bootstrap.cc:654] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.160646  9236 tablet_bootstrap.cc:492] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: No bootstrap required, opened a new log
I20260709 12:12:46.161100  9236 ts_tablet_manager.cc:1403] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.015s
I20260709 12:12:46.163578  9236 raft_consensus.cc:359] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.164062  9236 raft_consensus.cc:385] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:46.164170  8987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:46.164292  9236 raft_consensus.cc:740] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.164960  9236 consensus_queue.cc:260] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.166903  9236 ts_tablet_manager.cc:1434] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:12:46.183266  9241 raft_consensus.cc:493] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.183807  9241 raft_consensus.cc:515] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.185431  9292 raft_consensus.cc:493] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.185922  9292 raft_consensus.cc:515] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:46.186337  9241 leader_election.cc:290] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.187301  9272 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.187837  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:46.188050  9292 leader_election.cc:290] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:46.187762  9272 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.188635  9189 raft_consensus.cc:2393] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a545c5f9265e4fb1b8c772ed88288b91 in current term 1: Already voted for candidate 3512001e18a94daea43a763a406ef5c3 in this term.
I20260709 12:12:46.189755  9272 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.190936  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:46.191236  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91" is_pre_election: true
I20260709 12:12:46.192358  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:46.192931  9042 raft_consensus.cc:2393] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3512001e18a94daea43a763a406ef5c3 in current term 1: Already voted for candidate a6d7e5adece54725a7438686f70dc5e8 in this term.
I20260709 12:12:46.191905  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8" is_pre_election: true
I20260709 12:12:46.191937  9189 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 0.
I20260709 12:12:46.192978  9117 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 0.
I20260709 12:12:46.194661  9080 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3; no voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:46.190907  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3" is_pre_election: true
I20260709 12:12:46.194875  9005 leader_election.cc:304] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:46.195711  9292 raft_consensus.cc:2804] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.195734  9272 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.196141  9292 raft_consensus.cc:493] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.196648  9292 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.197041  9008 leader_election.cc:304] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91; no voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:46.198588  9241 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.202646  9272 raft_consensus.cc:2749] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.203234  9292 raft_consensus.cc:515] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:46.204736  9240 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.206911  9241 raft_consensus.cc:2749] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.207098  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:46.207685  9189 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.211370  9292 leader_election.cc:290] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Requested vote from peers a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:46.216411  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:46.217056  9116 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.225090  9266 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.226110  9116 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 1.
I20260709 12:12:46.227116  9008 leader_election.cc:304] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:46.228207  9241 raft_consensus.cc:2804] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.228668  9241 raft_consensus.cc:697] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:12:46.229431  9241 consensus_queue.cc:237] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:12:46.230552  9189 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 1.
I20260709 12:12:46.241714  8938 catalog_manager.cc:5697] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.282184  9240 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.293704  9266 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.309584  9272 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.328488  9042 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.337126  9272 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.439028  9041 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.439724  9264 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.450795  9266 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.452732  9272 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.456830  9242 consensus_queue.cc:1048] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.472126  9262 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.494242  9242 consensus_queue.cc:1048] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.537021  9116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:59572
I20260709 12:12:46.537770  9116 raft_consensus.cc:606] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Received request to transfer leadership to TS a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:46.539255  9242 consensus_queue.cc:1048] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.553761  9190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
mode: GRACEFUL
new_leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:12:46.554522  9190 raft_consensus.cc:606] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Received request to transfer leadership to TS a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:12:46.563587  9191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:12:46.564188  9191 raft_consensus.cc:606] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:46.564463  9262 consensus_queue.cc:1048] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.580734  9189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:12:46.581233  9189 raft_consensus.cc:606] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:46.588416  9116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213c44a4cc364788865ecc904259e678"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:59572
I20260709 12:12:46.588892  9116 raft_consensus.cc:606] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Received request to transfer leadership to TS a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:46.613758  9264 raft_consensus.cc:993] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: : Instructing follower a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:12:46.614270  9266 raft_consensus.cc:1081] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Signalling peer a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:12:46.616158  9040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:32912
I20260709 12:12:46.616840  9040 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:46.617300  9040 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.624406  9040 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.626636  9040 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.627730  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:46.627734  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:46.628443  9116 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.628512  9189 raft_consensus.cc:3055] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.628911  9189 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:46.629732  9189 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.631165  9189 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.633267  9116 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:12:46.634337  9008 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:46.634995  9241 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:46.635373  9241 raft_consensus.cc:697] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:12:46.636132  9241 consensus_queue.cc:237] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.637663  9189 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:12:46.643411  8938 catalog_manager.cc:5697] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 1 to 2, leader changed from a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195) to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.783994  9241 consensus_queue.cc:1048] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.797365  9292 consensus_queue.cc:1048] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.875428  9264 raft_consensus.cc:993] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:46.875847  9266 raft_consensus.cc:1081] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:46.877208  9116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40478
I20260709 12:12:46.877710  9116 raft_consensus.cc:493] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:46.878013  9116 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.882268  9116 raft_consensus.cc:515] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.884014  9116 leader_election.cc:290] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.884860  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:46.885444  9040 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.885403  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:46.886070  9189 raft_consensus.cc:3055] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.886394  9189 raft_consensus.cc:740] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:46.887228  9189 consensus_queue.cc:260] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.888379  9189 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.890233  9040 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:12:46.891525  9083 leader_election.cc:304] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:46.892408  9272 raft_consensus.cc:2804] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:46.892854  9272 raft_consensus.cc:697] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:46.893590  9272 consensus_queue.cc:237] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.895159  9189 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:12:46.902314  8938 catalog_manager.cc:5697] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 1 to 2, leader changed from a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.917323  9240 raft_consensus.cc:993] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:46.917835  9266 raft_consensus.cc:1081] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:46.919293  9116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40478
I20260709 12:12:46.919806  9116 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:46.920117  9116 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.924983  9116 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.927237  9116 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:46.927641  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:46.927956  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:46.928277  9040 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.928673  9189 raft_consensus.cc:3055] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:46.928959  9189 raft_consensus.cc:740] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:46.929605  9189 consensus_queue.cc:260] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.930527  9189 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:46.935062  9189 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:12:46.934952  9040 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:12:46.936344  9083 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:46.937242  9262 raft_consensus.cc:2804] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:46.937870  9262 raft_consensus.cc:697] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:46.938908  9262 consensus_queue.cc:237] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:46.945988  8938 catalog_manager.cc:5697] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 1 to 2, leader changed from a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.011029  9272 raft_consensus.cc:993] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:12:47.011423  9262 raft_consensus.cc:1081] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Signalling peer a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:12:47.013074  9040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:32914
I20260709 12:12:47.013532  9040 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:47.013823  9040 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.018522  9040 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.021461  9040 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:47.022462  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:47.022516  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:47.023137  9190 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.023233  9116 raft_consensus.cc:3055] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:47.023624  9116 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:47.024411  9116 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.025620  9116 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.028321  9190 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:12:47.029985  9005 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:47.031052  9292 raft_consensus.cc:2804] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:47.031659  9292 raft_consensus.cc:697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:12:47.032694  9292 consensus_queue.cc:237] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.034754  9116 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:12:47.042889  8938 catalog_manager.cc:5697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 1 to 2, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.042572  9190 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.048837  9292 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.056159  9242 raft_consensus.cc:993] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:47.056625  9242 raft_consensus.cc:1081] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Signalling peer a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:47.058404  9190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213c44a4cc364788865ecc904259e678"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:48374
I20260709 12:12:47.058986  9190 raft_consensus.cc:493] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:47.059352  9190 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.062474  9116 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.063820  9241 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.066140  9190 raft_consensus.cc:515] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.071313  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:47.071893  9040 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.072314  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213c44a4cc364788865ecc904259e678" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:47.072880  9116 raft_consensus.cc:3055] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:47.073187  9116 raft_consensus.cc:740] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:47.073819  9190 leader_election.cc:290] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 2 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:47.075052  9116 consensus_queue.cc:260] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.078402  9116 raft_consensus.cc:3060] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.080744  9040 raft_consensus.cc:2468] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 2.
I20260709 12:12:47.081699  9157 leader_election.cc:304] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:47.082535  9266 raft_consensus.cc:2804] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:47.082904  9266 raft_consensus.cc:697] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:47.083556  9266 consensus_queue.cc:237] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:47.084976  9116 raft_consensus.cc:2468] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 2.
I20260709 12:12:47.089767  8935 catalog_manager.cc:5697] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 1 to 2, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.397269  9040 raft_consensus.cc:1275] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.398463  9272 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.400624  9190 raft_consensus.cc:1275] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.401901  9272 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.447926  9190 raft_consensus.cc:1275] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.449050  9272 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.457398  9040 raft_consensus.cc:1275] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.458916  9272 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.463212  9116 raft_consensus.cc:1275] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.464314  9266 consensus_queue.cc:1048] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.473308  9040 raft_consensus.cc:1275] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.475131  9240 consensus_queue.cc:1048] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.605180  9116 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.606380  9241 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:47.611713  9190 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:47.613639  9241 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.618216  8907 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:12:49.619037  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.633601  9116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:12:49.634089  9116 raft_consensus.cc:606] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Received request to transfer leadership to TS a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:49.644526  9040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
mode: GRACEFUL
new_leader_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:47988
I20260709 12:12:49.645015  9040 raft_consensus.cc:606] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Received request to transfer leadership to TS a6d7e5adece54725a7438686f70dc5e8
I20260709 12:12:49.646026  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:49.646513  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:50.148563  9241 raft_consensus.cc:993] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: : Instructing follower a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:50.148978  9330 raft_consensus.cc:1081] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Signalling peer a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:50.150384  9190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:48368
I20260709 12:12:50.150892  9190 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.151185  9190 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.155716  9190 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.157364  9190 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:50.158248  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:50.158356  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:50.158756  9040 raft_consensus.cc:3055] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:50.158926  9116 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.159042  9040 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:12:50.159757  9040 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.160619  9040 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.163473  9116 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:12:50.164470  9157 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:50.165102  9325 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:50.165171  9040 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:12:50.166249  9325 raft_consensus.cc:697] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:50.167053  9325 consensus_queue.cc:237] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.173122  8937 catalog_manager.cc:5697] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 2 to 3, leader changed from a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193) to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.202354  9337 raft_consensus.cc:993] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:50.202804  9272 raft_consensus.cc:1081] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Signalling peer a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:12:50.204331  9190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:48374
I20260709 12:12:50.204932  9190 raft_consensus.cc:493] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.205304  9190 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.210198  9190 raft_consensus.cc:515] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.211820  9190 leader_election.cc:290] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 2 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:12:50.212760  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:12:50.212674  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:50.213296  9116 raft_consensus.cc:3055] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.213455  9040 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.213593  9116 raft_consensus.cc:740] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:50.214236  9116 consensus_queue.cc:260] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.215044  9116 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.218222  9040 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 2.
I20260709 12:12:50.219097  9116 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 2.
I20260709 12:12:50.219313  9157 leader_election.cc:304] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:50.220109  9325 raft_consensus.cc:2804] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.220495  9325 raft_consensus.cc:697] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:50.221170  9325 consensus_queue.cc:237] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:50.228293  8937 catalog_manager.cc:5697] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 1 to 2, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.554986  9116 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:50.556154  9331 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:50.567759  9040 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:50.569128  9325 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:50.634924  9040 raft_consensus.cc:1275] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.636044  9325 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.644181  9116 raft_consensus.cc:1275] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.645789  9325 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.647621  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:50.656730  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:50.657143  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.658075  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.663457  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:51.663836  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:52.664675  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:52.670823  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:52.671267  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:53.672482  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.677632  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:53.678076  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:54.679003  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:54.683758  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:54.684194  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:55.685091  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.690060  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:55.690502  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:56.691342  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:56.696777  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:56.697142  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:57.697955  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.702840  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:57.703267  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:58.704128  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:58.709555  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:58.709969  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:59.736618  8907 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:59.753700  9040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:57558
I20260709 12:12:59.754562  9040 raft_consensus.cc:606] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:59.759343  9040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:57558
I20260709 12:12:59.759770  9040 raft_consensus.cc:606] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:59.764038  9040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:57558
I20260709 12:12:59.764468  9040 raft_consensus.cc:606] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:59.768839  9189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:12:59.769346  9189 raft_consensus.cc:606] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:59.776052  9189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
mode: GRACEFUL
new_leader_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:59174
I20260709 12:12:59.776616  9189 raft_consensus.cc:606] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Received request to transfer leadership to TS 3512001e18a94daea43a763a406ef5c3
I20260709 12:12:59.829350  9350 raft_consensus.cc:993] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:59.829839  9353 raft_consensus.cc:1081] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:59.831414  9117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40462
I20260709 12:12:59.831893  9117 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.832209  9117 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.837299  9117 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.839198  9117 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 3 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:59.840029  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:59.840209  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:59.840803  9040 raft_consensus.cc:3055] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:59.840873  9189 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.841073  9040 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:12:59.841747  9040 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.842679  9040 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.845829  9189 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 3.
I20260709 12:12:59.846685  9040 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 3.
I20260709 12:12:59.847055  9080 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:12:59.847934  9348 raft_consensus.cc:2804] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.848731  9348 raft_consensus.cc:697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:59.849465  9348 consensus_queue.cc:237] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.856688  8935 catalog_manager.cc:5697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 2 to 3, leader changed from a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.928066  9342 raft_consensus.cc:993] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:59.928547  9360 raft_consensus.cc:1081] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:12:59.930080  9117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40478
I20260709 12:12:59.930615  9117 raft_consensus.cc:493] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.930895  9117 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.935580  9117 raft_consensus.cc:515] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.937107  9117 leader_election.cc:290] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 3 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:12:59.937878  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:12:59.937978  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2505074b0a149ac9b57d7a8f6d6e0fb" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:12:59.938349  9040 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.938520  9189 raft_consensus.cc:3055] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:59.938879  9189 raft_consensus.cc:740] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:12:59.939519  9189 consensus_queue.cc:260] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.940410  9189 raft_consensus.cc:3060] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.942602  9040 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 3.
I20260709 12:12:59.943683  9083 leader_election.cc:304] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:12:59.944444  9348 raft_consensus.cc:2804] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.944809  9348 raft_consensus.cc:697] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:12:59.945182  9189 raft_consensus.cc:2468] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 3.
I20260709 12:12:59.945561  9348 consensus_queue.cc:237] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:12:59.951788  8935 catalog_manager.cc:5697] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 2 to 3, leader changed from a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.143677  9353 raft_consensus.cc:993] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.144074  9350 raft_consensus.cc:1081] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.145426  9117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40462
I20260709 12:13:00.145865  9117 raft_consensus.cc:493] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:00.146121  9117 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.151144  9117 raft_consensus.cc:515] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.152958  9117 leader_election.cc:290] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:13:00.153589  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:13:00.154198  9040 raft_consensus.cc:3055] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:00.154321  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fe4933424c428daff6b8f2077b51f4" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:00.154531  9040 raft_consensus.cc:740] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:13:00.154860  9190 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.155220  9040 consensus_queue.cc:260] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.156107  9040 raft_consensus.cc:3060] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.159157  9190 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:13:00.159929  9040 raft_consensus.cc:2468] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:13:00.160004  9080 leader_election.cc:304] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:00.160674  9348 raft_consensus.cc:2804] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:00.161124  9348 raft_consensus.cc:697] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:00.161816  9348 consensus_queue.cc:237] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.168435  8935 catalog_manager.cc:5697] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 1 to 2, leader changed from a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.200519  9342 raft_consensus.cc:993] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.200984  9360 raft_consensus.cc:1081] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.202320  9117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40478
I20260709 12:13:00.202805  9117 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:00.203109  9117 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:00.208001  9117 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.209633  9117 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 4 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:13:00.210376  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:13:00.210647  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:00.210887  9040 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:00.211138  9190 raft_consensus.cc:3055] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:00.211372  9190 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:13:00.211989  9190 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.212805  9190 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:00.215029  9040 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 4.
I20260709 12:13:00.215941  9083 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:13:00.216562  9348 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:00.216758  9190 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 4.
I20260709 12:13:00.216910  9348 raft_consensus.cc:697] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:00.217790  9348 consensus_queue.cc:237] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:00.223978  8935 catalog_manager.cc:5697] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 3 to 4, leader changed from a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 4 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.266291  9040 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:00.267515  9348 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.278348  9350 raft_consensus.cc:993] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: : Instructing follower 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.279208  9190 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:00.279330  9353 raft_consensus.cc:1081] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Signalling peer 3512001e18a94daea43a763a406ef5c3 to start an election
I20260709 12:13:00.281281  9117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
 from {username='slave'} at 127.0.0.1:40462
I20260709 12:13:00.281965  9117 raft_consensus.cc:493] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:00.282312  9117 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.281271  9366 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:00.289168  9117 raft_consensus.cc:515] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:13:00.292450  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:00.293105  9189 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.298458  9189 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:13:00.300032  9080 leader_election.cc:304] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:00.301112  9354 raft_consensus.cc:2804] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:00.301635  9354 raft_consensus.cc:697] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Leader. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:00.302479  9354 consensus_queue.cc:237] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:13:00.305670  9117 leader_election.cc:290] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [CANDIDATE]: Term 2 election: Requested vote from peers a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331), a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499)
I20260709 12:13:00.307837  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10364ae4206c4c959ba6e099e09556a6" candidate_uuid: "3512001e18a94daea43a763a406ef5c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:13:00.308439  9040 raft_consensus.cc:3055] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:00.308768  9040 raft_consensus.cc:740] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:13:00.309463  9040 consensus_queue.cc:260] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } }
I20260709 12:13:00.311398  9040 raft_consensus.cc:3060] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:00.314076  8935 catalog_manager.cc:5697] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 reported cstate change: term changed from 1 to 2, leader changed from a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193) to 3512001e18a94daea43a763a406ef5c3 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3512001e18a94daea43a763a406ef5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.319758  9040 raft_consensus.cc:2468] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3512001e18a94daea43a763a406ef5c3 in term 2.
I20260709 12:13:00.340456  9190 raft_consensus.cc:1275] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:00.341475  9366 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.349604  9040 raft_consensus.cc:1275] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:00.351678  9354 consensus_queue.cc:1048] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.615955  9190 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:00.617008  9354 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.619233  9040 raft_consensus.cc:1275] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.620486  9354 consensus_queue.cc:1048] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:00.627770  9042 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:00.629272  9354 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.632306  9189 raft_consensus.cc:1275] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.633934  9354 consensus_queue.cc:1048] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:00.843951  9042 raft_consensus.cc:1275] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.845275  9354 consensus_queue.cc:1048] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:00.853523  9189 raft_consensus.cc:1275] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer 3512001e18a94daea43a763a406ef5c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.855060  9354 consensus_queue.cc:1048] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.810463  8907 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:13:02.811137  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:02.836776  9117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:13:02.838376  9117 raft_consensus.cc:606] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Received request to transfer leadership to TS a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:13:02.843868  9117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:13:02.844347  9117 raft_consensus.cc:606] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Received request to transfer leadership to TS a6d7e5adece54725a7438686f70dc5e8
I20260709 12:13:02.846619  9117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:13:02.847244  9117 raft_consensus.cc:606] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Received request to transfer leadership to TS a6d7e5adece54725a7438686f70dc5e8
I20260709 12:13:02.849680  9117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:13:02.850281  9117 raft_consensus.cc:606] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 LEADER]: Received request to transfer leadership to TS a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:13:02.852471  9117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e"
dest_uuid: "3512001e18a94daea43a763a406ef5c3"
mode: GRACEFUL
new_leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:59588
I20260709 12:13:02.852999  9117 raft_consensus.cc:606] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Received request to transfer leadership to TS a545c5f9265e4fb1b8c772ed88288b91
I20260709 12:13:02.854223  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:02.855149  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:02.866966  9354 raft_consensus.cc:993] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:13:02.867481  9381 raft_consensus.cc:1081] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Signalling peer a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:13:02.869273  9190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:48374
I20260709 12:13:02.869767  9190 raft_consensus.cc:493] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:02.870194  9190 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.877938  9190 raft_consensus.cc:515] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.879845  9381 raft_consensus.cc:993] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:02.880316  9381 raft_consensus.cc:1081] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 LEADER]: Signalling peer a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:02.881493  9190 leader_election.cc:290] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:13:02.881596  9040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:13:02.882097  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ad6c1340f1d42af8518d01e14cce35c" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:13:02.882449  9040 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.882730  9117 raft_consensus.cc:3055] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:02.883126  9117 raft_consensus.cc:740] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:02.883689  9042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a291b882428545c39e1238c33043d89e"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:32914
I20260709 12:13:02.883929  9117 consensus_queue.cc:260] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.884299  9042 raft_consensus.cc:493] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:02.884733  9042 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:02.885053  9117 raft_consensus.cc:3060] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.889766  9117 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:13:02.890020  9040 raft_consensus.cc:2468] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:13:02.891809  9157 leader_election.cc:304] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:02.891855  9042 raft_consensus.cc:515] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.893117  9360 raft_consensus.cc:2804] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:02.894552  9360 raft_consensus.cc:697] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:13:02.895810  9360 consensus_queue.cc:237] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.896384  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:13:02.895810  9042 leader_election.cc:290] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 5 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:13:02.897022  9117 raft_consensus.cc:3055] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:02.897370  9117 raft_consensus.cc:740] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:02.896443  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a291b882428545c39e1238c33043d89e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:02.898340  9190 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:02.898267  9117 consensus_queue.cc:260] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.899322  9117 raft_consensus.cc:3060] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:02.906325  9190 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 5.
I20260709 12:13:02.906723  8937 catalog_manager.cc:5697] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 2 to 3, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.907724  9005 leader_election.cc:304] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:02.909382  9385 raft_consensus.cc:2804] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:02.909845  9117 raft_consensus.cc:2468] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 5.
I20260709 12:13:02.910750  9385 raft_consensus.cc:697] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 5 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:13:02.911628  9385 consensus_queue.cc:237] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:02.920295  8938 catalog_manager.cc:5697] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 4 to 5, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 5 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.185668  9354 raft_consensus.cc:993] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:13:03.186079  9381 raft_consensus.cc:1081] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Signalling peer a6d7e5adece54725a7438686f70dc5e8 to start an election
I20260709 12:13:03.187472  9190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929"
dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
 from {username='slave'} at 127.0.0.1:48374
I20260709 12:13:03.187888  9190 raft_consensus.cc:493] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.188123  9190 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.192062  9190 raft_consensus.cc:515] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.193467  9190 leader_election.cc:290] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Requested vote from peers a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499), 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949)
I20260709 12:13:03.194324  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
I20260709 12:13:03.194684  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f51aeabcc1f4746af40008c2a6da929" candidate_uuid: "a6d7e5adece54725a7438686f70dc5e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:13:03.194972  9042 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.195191  9117 raft_consensus.cc:3055] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:03.195497  9117 raft_consensus.cc:740] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:03.196209  9117 consensus_queue.cc:260] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.197381  9117 raft_consensus.cc:3060] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.201529  9042 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:13:03.202682  9157 leader_election.cc:304] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:03.203239  9117 raft_consensus.cc:2468] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6d7e5adece54725a7438686f70dc5e8 in term 3.
I20260709 12:13:03.203344  9360 raft_consensus.cc:2804] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:03.203882  9360 raft_consensus.cc:697] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Becoming Leader. State: Replica: a6d7e5adece54725a7438686f70dc5e8, State: Running, Role: LEADER
I20260709 12:13:03.204692  9360 consensus_queue.cc:237] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.211552  8938 catalog_manager.cc:5697] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 reported cstate change: term changed from 2 to 3, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "a6d7e5adece54725a7438686f70dc5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.230188  9354 raft_consensus.cc:993] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:03.230535  9393 raft_consensus.cc:993] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: : Instructing follower a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:03.230782  9381 raft_consensus.cc:1081] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Signalling peer a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:03.231033  9354 raft_consensus.cc:1081] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Signalling peer a545c5f9265e4fb1b8c772ed88288b91 to start an election
I20260709 12:13:03.232347  9040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:32914
I20260709 12:13:03.232602  9042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e"
dest_uuid: "a545c5f9265e4fb1b8c772ed88288b91"
 from {username='slave'} at 127.0.0.1:32914
I20260709 12:13:03.232859  9040 raft_consensus.cc:493] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.233099  9042 raft_consensus.cc:493] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.233217  9040 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.233430  9042 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.238387  9040 raft_consensus.cc:515] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.238790  9042 raft_consensus.cc:515] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.240636  9042 leader_election.cc:290] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:13:03.241243  9117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:13:03.241667  9189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:03.241971  9116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab8edd383ff407d8c48e8ead1c58b4e" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3512001e18a94daea43a763a406ef5c3"
I20260709 12:13:03.242170  9189 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.241778  9117 raft_consensus.cc:3055] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:03.242504  9116 raft_consensus.cc:3055] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:03.242589  9117 raft_consensus.cc:740] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:03.242835  9116 raft_consensus.cc:740] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3512001e18a94daea43a763a406ef5c3, State: Running, Role: LEADER
I20260709 12:13:03.243276  9117 consensus_queue.cc:260] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.243584  9116 consensus_queue.cc:260] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.244072  9117 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.244779  9116 raft_consensus.cc:3060] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.249240  9189 raft_consensus.cc:2468] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:13:03.249851  9117 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 4.
I20260709 12:13:03.250751  9005 leader_election.cc:304] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a545c5f9265e4fb1b8c772ed88288b91, a6d7e5adece54725a7438686f70dc5e8; no voters: 
I20260709 12:13:03.251773  9385 raft_consensus.cc:2804] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.252130  9116 raft_consensus.cc:2468] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 2.
I20260709 12:13:03.252254  9385 raft_consensus.cc:697] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:13:03.252231  9190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63feb8fd989e4d13b6d9c6d5a46238d2" candidate_uuid: "a545c5f9265e4fb1b8c772ed88288b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a6d7e5adece54725a7438686f70dc5e8"
I20260709 12:13:03.253204  9385 consensus_queue.cc:237] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.253959  9190 raft_consensus.cc:3060] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.253219  9008 leader_election.cc:304] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3512001e18a94daea43a763a406ef5c3, a545c5f9265e4fb1b8c772ed88288b91; no voters: 
I20260709 12:13:03.256572  9386 raft_consensus.cc:2804] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:03.257992  9386 raft_consensus.cc:697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 4 LEADER]: Becoming Leader. State: Replica: a545c5f9265e4fb1b8c772ed88288b91, State: Running, Role: LEADER
I20260709 12:13:03.259186  9040 leader_election.cc:290] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [CANDIDATE]: Term 4 election: Requested vote from peers 3512001e18a94daea43a763a406ef5c3 (127.8.178.194:32949), a6d7e5adece54725a7438686f70dc5e8 (127.8.178.195:38331)
I20260709 12:13:03.258957  9386 consensus_queue.cc:237] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } }
I20260709 12:13:03.259029  9190 raft_consensus.cc:2468] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a545c5f9265e4fb1b8c772ed88288b91 in term 4.
I20260709 12:13:03.266314  8938 catalog_manager.cc:5697] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 1 to 2, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.276782  8938 catalog_manager.cc:5697] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 reported cstate change: term changed from 3 to 4, leader changed from 3512001e18a94daea43a763a406ef5c3 (127.8.178.194) to a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193). New cstate: current_term: 4 leader_uuid: "a545c5f9265e4fb1b8c772ed88288b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.298590  9190 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 5 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:03.299814  9386 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:03.309435  9117 raft_consensus.cc:1275] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 5 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:03.310945  9385 consensus_queue.cc:1048] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:03.360366  9040 raft_consensus.cc:1275] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:03.361439  9360 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.369894  9117 raft_consensus.cc:1275] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:03.371976  9404 consensus_queue.cc:1048] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.584828  9040 raft_consensus.cc:1275] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:03.585939  9404 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a545c5f9265e4fb1b8c772ed88288b91" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.594915  9117 raft_consensus.cc:1275] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Refusing update from remote peer a6d7e5adece54725a7438686f70dc5e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:03.598152  9407 consensus_queue.cc:1048] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:03.734974  9190 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:03.736142  9385 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:03.740921  9189 raft_consensus.cc:1275] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:03.742403  9409 consensus_queue.cc:1048] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6d7e5adece54725a7438686f70dc5e8" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.748239  9117 raft_consensus.cc:1275] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:03.749504  9395 consensus_queue.cc:1048] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:03.758874  9117 raft_consensus.cc:1275] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Refusing update from remote peer a545c5f9265e4fb1b8c772ed88288b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:03.760387  9395 consensus_queue.cc:1048] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3512001e18a94daea43a763a406ef5c3" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.856509  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:03.861274  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:03.861651  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:04.862640  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:04.867833  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:04.868294  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:05.869213  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:05.874177  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:05.874619  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:06.875579  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.880848  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:06.881393  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:07.882397  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:07.887746  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:07.888181  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:08.889118  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:08.894107  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:08.894659  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:09.895795  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:09.902041  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:09.902498  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:10.903702  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:10.908680  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:10.909078  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:11.910027  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:11.914921  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:11.915342  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:12.947716  8907 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:13:12.948382  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
W20260709 12:13:12.974103  9083 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:12.979779  9083 consensus_peers.cc:597] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 -> Peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Couldn't send request to peer a545c5f9265e4fb1b8c772ed88288b91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.982872  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:12.983690  8907 tablet_replica.cc:333] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:12.984541  8907 raft_consensus.cc:2243] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:12.985263  8907 raft_consensus.cc:2272] T a2505074b0a149ac9b57d7a8f6d6e0fb P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:12.987763  8907 tablet_replica.cc:333] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:12.988310  8907 raft_consensus.cc:2243] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:12.989454  8907 raft_consensus.cc:2272] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a545c5f9265e4fb1b8c772ed88288b91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:12.991256  8907 tablet_replica.cc:333] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:12.991744  8907 raft_consensus.cc:2243] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:12.992205  8907 raft_consensus.cc:2272] T 10364ae4206c4c959ba6e099e09556a6 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:12.993917  8907 tablet_replica.cc:333] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:12.994382  8907 raft_consensus.cc:2243] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:12.995290  8907 raft_consensus.cc:2272] T fab8edd383ff407d8c48e8ead1c58b4e P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:12.996924  8907 tablet_replica.cc:333] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:12.997366  8907 raft_consensus.cc:2243] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:12.997834  8907 raft_consensus.cc:2272] T 7ad6c1340f1d42af8518d01e14cce35c P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:12.999644  8907 tablet_replica.cc:333] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:13.000078  8907 raft_consensus.cc:2243] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.000506  8907 raft_consensus.cc:2272] T 25fe4933424c428daff6b8f2077b51f4 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.002081  8907 tablet_replica.cc:333] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:13.002559  8907 raft_consensus.cc:2243] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.002967  8907 raft_consensus.cc:2272] T 213c44a4cc364788865ecc904259e678 P a545c5f9265e4fb1b8c772ed88288b91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.004480  8907 tablet_replica.cc:333] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:13.004896  8907 raft_consensus.cc:2243] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.005636  8907 raft_consensus.cc:2272] T a291b882428545c39e1238c33043d89e P a545c5f9265e4fb1b8c772ed88288b91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.007251  8907 tablet_replica.cc:333] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91: stopping tablet replica
I20260709 12:13:13.007637  8907 raft_consensus.cc:2243] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.008020  8907 raft_consensus.cc:2272] T 6f51aeabcc1f4746af40008c2a6da929 P a545c5f9265e4fb1b8c772ed88288b91 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:13.107501  9083 consensus_peers.cc:597] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 -> Peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Couldn't send request to peer a545c5f9265e4fb1b8c772ed88288b91. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:13.107939  9157 consensus_peers.cc:597] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 -> Peer a545c5f9265e4fb1b8c772ed88288b91 (127.8.178.193:36499): Couldn't send request to peer a545c5f9265e4fb1b8c772ed88288b91. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.115765  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
I20260709 12:13:13.135409  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:13:13.163328  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:13.164091  8907 tablet_replica.cc:333] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.164681  8907 raft_consensus.cc:2243] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.165201  8907 raft_consensus.cc:2272] T 63feb8fd989e4d13b6d9c6d5a46238d2 P 3512001e18a94daea43a763a406ef5c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.167158  8907 tablet_replica.cc:333] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.167723  8907 raft_consensus.cc:2243] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.168581  8907 raft_consensus.cc:2272] T 10364ae4206c4c959ba6e099e09556a6 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.170229  8907 tablet_replica.cc:333] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.170761  8907 raft_consensus.cc:2243] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.171182  8907 raft_consensus.cc:2272] T fab8edd383ff407d8c48e8ead1c58b4e P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.172838  8907 tablet_replica.cc:333] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.173310  8907 raft_consensus.cc:2243] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.173763  8907 raft_consensus.cc:2272] T a291b882428545c39e1238c33043d89e P 3512001e18a94daea43a763a406ef5c3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.175381  8907 tablet_replica.cc:333] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.175830  8907 raft_consensus.cc:2243] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.176222  8907 raft_consensus.cc:2272] T 213c44a4cc364788865ecc904259e678 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.177757  8907 tablet_replica.cc:333] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.178222  8907 raft_consensus.cc:2243] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.178660  8907 raft_consensus.cc:2272] T 6f51aeabcc1f4746af40008c2a6da929 P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.180238  8907 tablet_replica.cc:333] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.180814  8907 raft_consensus.cc:2243] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.181722  8907 raft_consensus.cc:2272] T a2505074b0a149ac9b57d7a8f6d6e0fb P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.183290  8907 tablet_replica.cc:333] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.183727  8907 raft_consensus.cc:2243] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.184115  8907 raft_consensus.cc:2272] T 7ad6c1340f1d42af8518d01e14cce35c P 3512001e18a94daea43a763a406ef5c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.185603  8907 tablet_replica.cc:333] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3: stopping tablet replica
I20260709 12:13:13.186025  8907 raft_consensus.cc:2243] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.187088  8907 raft_consensus.cc:2272] T 25fe4933424c428daff6b8f2077b51f4 P 3512001e18a94daea43a763a406ef5c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.214700  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
I20260709 12:13:13.232300  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
I20260709 12:13:13.253813  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:13.254451  8907 tablet_replica.cc:333] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.255136  8907 raft_consensus.cc:2243] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.255728  8907 raft_consensus.cc:2272] T a2505074b0a149ac9b57d7a8f6d6e0fb P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.257493  8907 tablet_replica.cc:333] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.257967  8907 raft_consensus.cc:2243] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.258797  8907 raft_consensus.cc:2272] T 6f51aeabcc1f4746af40008c2a6da929 P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.260486  8907 tablet_replica.cc:333] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.260985  8907 raft_consensus.cc:2243] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.261418  8907 raft_consensus.cc:2272] T fab8edd383ff407d8c48e8ead1c58b4e P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.263046  8907 tablet_replica.cc:333] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.263492  8907 raft_consensus.cc:2243] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.263882  8907 raft_consensus.cc:2272] T 10364ae4206c4c959ba6e099e09556a6 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.265435  8907 tablet_replica.cc:333] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.265884  8907 raft_consensus.cc:2243] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.266738  8907 raft_consensus.cc:2272] T 7ad6c1340f1d42af8518d01e14cce35c P a6d7e5adece54725a7438686f70dc5e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.268254  8907 tablet_replica.cc:333] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.268695  8907 raft_consensus.cc:2243] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.269073  8907 raft_consensus.cc:2272] T 25fe4933424c428daff6b8f2077b51f4 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.270686  8907 tablet_replica.cc:333] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.271097  8907 raft_consensus.cc:2243] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.271797  8907 raft_consensus.cc:2272] T 213c44a4cc364788865ecc904259e678 P a6d7e5adece54725a7438686f70dc5e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.273255  8907 tablet_replica.cc:333] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.273674  8907 raft_consensus.cc:2243] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.274081  8907 raft_consensus.cc:2272] T a291b882428545c39e1238c33043d89e P a6d7e5adece54725a7438686f70dc5e8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.275652  8907 tablet_replica.cc:333] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8: stopping tablet replica
I20260709 12:13:13.276049  8907 raft_consensus.cc:2243] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.276492  8907 raft_consensus.cc:2272] T 63feb8fd989e4d13b6d9c6d5a46238d2 P a6d7e5adece54725a7438686f70dc5e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.302771  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:13:13.320374  8907 master.cc:562] Master@127.8.178.254:45901 shutting down...
I20260709 12:13:13.489949  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.490562  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.490846  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P 020a77f90b1c4d08b297d58c0f155de3: stopping tablet replica
I20260709 12:13:13.509454  8907 master.cc:584] Master@127.8.178.254:45901 shutdown complete.
3512001e18a94daea43a763a406ef5c3  4
a545c5f9265e4fb1b8c772ed88288b91  4
a6d7e5adece54725a7438686f70dc5e8  1
3512001e18a94daea43a763a406ef5c3  3
a545c5f9265e4fb1b8c772ed88288b91  3
a6d7e5adece54725a7438686f70dc5e8  3
3512001e18a94daea43a763a406ef5c3  8
a545c5f9265e4fb1b8c772ed88288b91  0
a6d7e5adece54725a7438686f70dc5e8  1
3512001e18a94daea43a763a406ef5c3  3
a545c5f9265e4fb1b8c772ed88288b91  3
a6d7e5adece54725a7438686f70dc5e8  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30779 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:13:13.548089  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:43977
I20260709 12:13:13.549232  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.554385  9425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.554760  9426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.556077  9428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.557014  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:13.557905  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.558099  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.558254  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599193558235 us; error 0 us; skew 500 ppm
I20260709 12:13:13.559034  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.561437  8907 webserver.cc:533] Webserver started at http://127.8.178.254:45721/ using document root <none> and password file <none>
I20260709 12:13:13.561914  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.562084  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.562343  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.563500  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "b4156ee518754e2a94f9873be52cd9d9"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.567836  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:13.571105  9433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.571774  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:13.572034  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "b4156ee518754e2a94f9873be52cd9d9"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.572311  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.582041  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.583302  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.619935  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:43977
I20260709 12:13:13.620021  9484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:43977 every 8 connection(s)
I20260709 12:13:13.623700  9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.632844  9485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9: Bootstrap starting.
I20260709 12:13:13.637418  9485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.641510  9485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9: No bootstrap required, opened a new log
I20260709 12:13:13.643695  9485 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER }
I20260709 12:13:13.644127  9485 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.644349  9485 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4156ee518754e2a94f9873be52cd9d9, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.644882  9485 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER }
I20260709 12:13:13.645330  9485 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:13.645533  9485 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:13.645780  9485 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.649748  9485 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER }
I20260709 12:13:13.650283  9485 leader_election.cc:304] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4156ee518754e2a94f9873be52cd9d9; no voters: 
I20260709 12:13:13.651377  9485 leader_election.cc:290] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:13.651767  9488 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.652953  9488 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 1 LEADER]: Becoming Leader. State: Replica: b4156ee518754e2a94f9873be52cd9d9, State: Running, Role: LEADER
I20260709 12:13:13.653635  9488 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER }
I20260709 12:13:13.654140  9485 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:13.657863  9489 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4156ee518754e2a94f9873be52cd9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER } }
I20260709 12:13:13.658627  9489 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:13.658605  9490 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4156ee518754e2a94f9873be52cd9d9. Latest consensus state: current_term: 1 leader_uuid: "b4156ee518754e2a94f9873be52cd9d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4156ee518754e2a94f9873be52cd9d9" member_type: VOTER } }
I20260709 12:13:13.659394  9490 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:13.662292  9495 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:13.669880  9495 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:13.670795  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:13.678998  9495 catalog_manager.cc:1383] Generated new cluster ID: 5a5a9c2e98054b1291e6e633d2716688
I20260709 12:13:13.679309  9495 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:13.708176  9495 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:13.709384  9495 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:13.721066  9495 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9: Generated new TSK 0
I20260709 12:13:13.721706  9495 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:13.737075  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.742988  9506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.743920  9507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.745196  9509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.745347  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:13.746495  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.746681  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.746801  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599193746790 us; error 0 us; skew 500 ppm
I20260709 12:13:13.747267  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.749481  8907 webserver.cc:533] Webserver started at http://127.8.178.193:38593/ using document root <none> and password file <none>
I20260709 12:13:13.749919  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.750074  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.750293  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.751333  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "5193f3489bb7451b9429372b46a5dfac"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.755621  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:13.758988  9514 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.759694  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:13:13.759963  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "5193f3489bb7451b9429372b46a5dfac"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.760238  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.789469  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.790800  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.792315  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:13.794610  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:13.794797  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.795033  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:13.795200  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.833484  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:38503
I20260709 12:13:13.833578  9576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:38503 every 8 connection(s)
I20260709 12:13:13.838084  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.845149  9581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.847124  9582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.849768  9584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.849879  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:13.851037  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.851228  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.851363  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599193851347 us; error 0 us; skew 500 ppm
I20260709 12:13:13.851820  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.854317  8907 webserver.cc:533] Webserver started at http://127.8.178.194:35195/ using document root <none> and password file <none>
I20260709 12:13:13.854807  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.855062  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.855379  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.856297  9577 heartbeater.cc:344] Connected to a master server at 127.8.178.254:43977
I20260709 12:13:13.856608  9577 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:13.856671  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "6ee898db7b444800a068bb7f94392297"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.857280  9577 heartbeater.cc:507] Master 127.8.178.254:43977 requested a full tablet report, sending...
I20260709 12:13:13.859386  9450 ts_manager.cc:194] Registered new tserver with Master: 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503)
I20260709 12:13:13.861460  9450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50064
I20260709 12:13:13.861646  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:13:13.864871  9589 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.865556  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:13.865804  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "6ee898db7b444800a068bb7f94392297"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.866027  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.910176  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.911610  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.913455  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:13.915935  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:13.916138  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.916389  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:13.916538  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.953825  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:38885
I20260709 12:13:13.953925  9651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:38885 every 8 connection(s)
I20260709 12:13:13.958271  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.964310  9655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.964937  9656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.968346  9659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.969282  9652 heartbeater.cc:344] Connected to a master server at 127.8.178.254:43977
I20260709 12:13:13.969619  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:13.969758  9652 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:13.970486  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.970707  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.970642  9652 heartbeater.cc:507] Master 127.8.178.254:43977 requested a full tablet report, sending...
I20260709 12:13:13.970958  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599193970937 us; error 0 us; skew 500 ppm
I20260709 12:13:13.971561  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.972679  9450 ts_manager.cc:194] Registered new tserver with Master: 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:13.974058  9450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50078
I20260709 12:13:13.974272  8907 webserver.cc:533] Webserver started at http://127.8.178.195:38025/ using document root <none> and password file <none>
I20260709 12:13:13.974848  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.975085  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.975412  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.976745  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "173779f83e2449a88d7f1ac79b06fe40"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.980934  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:13.983955  9663 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.984666  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:13.985066  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "173779f83e2449a88d7f1ac79b06fe40"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-jlx4"
I20260709 12:13:13.985360  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.997682  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.999001  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:14.000414  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:14.002631  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:14.002895  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:14.003193  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:14.003368  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:14.040277  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:42849
I20260709 12:13:14.040383  9725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:42849 every 8 connection(s)
I20260709 12:13:14.053279  9726 heartbeater.cc:344] Connected to a master server at 127.8.178.254:43977
I20260709 12:13:14.053632  9726 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:14.054370  9726 heartbeater.cc:507] Master 127.8.178.254:43977 requested a full tablet report, sending...
I20260709 12:13:14.056362  9450 ts_manager.cc:194] Registered new tserver with Master: 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.056478  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013171377s
I20260709 12:13:14.058097  9450 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50080
I20260709 12:13:14.081033  9450 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50092:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:14.083891  9450 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:14.164855  9542 tablet_service.cc:1511] Processing CreateTablet for tablet a41d04acb275420a9df2f99a3d0f86af (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:14.166369  9542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41d04acb275420a9df2f99a3d0f86af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.168659  9540 tablet_service.cc:1511] Processing CreateTablet for tablet 992fd6452244482ba4c7efbbd5e9188a (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:14.169322  9539 tablet_service.cc:1511] Processing CreateTablet for tablet ba59a00f645e42738f59f777eab7d807 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:14.169981  9540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992fd6452244482ba4c7efbbd5e9188a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.170696  9539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba59a00f645e42738f59f777eab7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.167093  9537 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3b84832ead4530a2412de18d146be7 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:14.167546  9541 tablet_service.cc:1511] Processing CreateTablet for tablet 880e783510f144b4a4401560bf7269df (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:14.171844  9537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3b84832ead4530a2412de18d146be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.167549  9536 tablet_service.cc:1511] Processing CreateTablet for tablet 881656bdc4f844ef87291dca92fd8809 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:14.173404  9536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881656bdc4f844ef87291dca92fd8809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.174739  9541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880e783510f144b4a4401560bf7269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.177856  9617 tablet_service.cc:1511] Processing CreateTablet for tablet a41d04acb275420a9df2f99a3d0f86af (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:14.179287  9617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41d04acb275420a9df2f99a3d0f86af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.181018  9611 tablet_service.cc:1511] Processing CreateTablet for tablet 881656bdc4f844ef87291dca92fd8809 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:14.183645  9616 tablet_service.cc:1511] Processing CreateTablet for tablet 880e783510f144b4a4401560bf7269df (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:14.186120  9615 tablet_service.cc:1511] Processing CreateTablet for tablet 992fd6452244482ba4c7efbbd5e9188a (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:14.188377  9614 tablet_service.cc:1511] Processing CreateTablet for tablet ba59a00f645e42738f59f777eab7d807 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:14.190701  9613 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:14.192059  9610 tablet_service.cc:1511] Processing CreateTablet for tablet 763567ac9be747bb89cc3cf976bf818c (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:14.192993  9612 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3b84832ead4530a2412de18d146be7 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:14.195333  9535 tablet_service.cc:1511] Processing CreateTablet for tablet 763567ac9be747bb89cc3cf976bf818c (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:14.196641  9535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763567ac9be747bb89cc3cf976bf818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.168335  9538 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:14.182348  9611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881656bdc4f844ef87291dca92fd8809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.199240  9538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.200817  9610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763567ac9be747bb89cc3cf976bf818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.202754  9614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba59a00f645e42738f59f777eab7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.206854  9612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3b84832ead4530a2412de18d146be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.207412  9609 tablet_service.cc:1511] Processing CreateTablet for tablet a9237adf4f6144e6854899b087584084 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:14.208141  9539 tablet_service.cc:1511] Processing CreateTablet for tablet a9237adf4f6144e6854899b087584084 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:14.209939  9539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9237adf4f6144e6854899b087584084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.213907  9534 tablet_service.cc:1511] Processing CreateTablet for tablet e444fbe781a643c1a0b2d221c39ae515 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:14.215376  9534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e444fbe781a643c1a0b2d221c39ae515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.215198  9608 tablet_service.cc:1511] Processing CreateTablet for tablet e444fbe781a643c1a0b2d221c39ae515 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:14.208701  9609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9237adf4f6144e6854899b087584084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.218230  9613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.219928  9616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880e783510f144b4a4401560bf7269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.220696  9608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e444fbe781a643c1a0b2d221c39ae515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.228811  9615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992fd6452244482ba4c7efbbd5e9188a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.276418  9691 tablet_service.cc:1511] Processing CreateTablet for tablet a41d04acb275420a9df2f99a3d0f86af (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:14.277751  9691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41d04acb275420a9df2f99a3d0f86af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.279616  9690 tablet_service.cc:1511] Processing CreateTablet for tablet 880e783510f144b4a4401560bf7269df (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:14.280988  9690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880e783510f144b4a4401560bf7269df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.280864  9684 tablet_service.cc:1511] Processing CreateTablet for tablet 763567ac9be747bb89cc3cf976bf818c (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:14.283149  9683 tablet_service.cc:1511] Processing CreateTablet for tablet a9237adf4f6144e6854899b087584084 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:14.283633  9689 tablet_service.cc:1511] Processing CreateTablet for tablet 992fd6452244482ba4c7efbbd5e9188a (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:14.285405  9682 tablet_service.cc:1511] Processing CreateTablet for tablet e444fbe781a643c1a0b2d221c39ae515 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:14.285743  9688 tablet_service.cc:1511] Processing CreateTablet for tablet ba59a00f645e42738f59f777eab7d807 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:14.278270  9686 tablet_service.cc:1511] Processing CreateTablet for tablet 9d3b84832ead4530a2412de18d146be7 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:14.287578  9687 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:14.279620  9685 tablet_service.cc:1511] Processing CreateTablet for tablet 881656bdc4f844ef87291dca92fd8809 (DEFAULT_TABLE table=test-workload [id=d61e2a1722f0425c9f99dc58fb31fda4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:14.320926  9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763567ac9be747bb89cc3cf976bf818c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.324084  9683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9237adf4f6144e6854899b087584084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.324808  9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba59a00f645e42738f59f777eab7d807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.326503  9686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d3b84832ead4530a2412de18d146be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.330734  9689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992fd6452244482ba4c7efbbd5e9188a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.331358  9682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e444fbe781a643c1a0b2d221c39ae515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.334105  9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8b264f541b4800b7eea2b4c8a4ecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.338723  9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881656bdc4f844ef87291dca92fd8809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.344539  9743 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.366415  9742 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.367584  9741 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.374056  9741 tablet_bootstrap.cc:654] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.383625  9743 tablet_bootstrap.cc:654] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.387871  9741 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.388249  9741 ts_tablet_manager.cc:1403] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 12:13:14.388515  9742 tablet_bootstrap.cc:654] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.390256  9741 raft_consensus.cc:359] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.390934  9741 raft_consensus.cc:385] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.391225  9741 raft_consensus.cc:740] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.391891  9743 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.391826  9741 consensus_queue.cc:260] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.392334  9743 ts_tablet_manager.cc:1403] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:13:14.393889  9577 heartbeater.cc:499] Master 127.8.178.254:43977 was elected leader, sending a full tablet report...
I20260709 12:13:14.394733  9743 raft_consensus.cc:359] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.395205  9743 raft_consensus.cc:385] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.395426  9743 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.395982  9743 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.397338  9741 ts_tablet_manager.cc:1434] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:14.398043  9741 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.399243  9726 heartbeater.cc:499] Master 127.8.178.254:43977 was elected leader, sending a full tablet report...
I20260709 12:13:14.398909  9742 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.402292  9742 ts_tablet_manager.cc:1403] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:13:14.402413  9741 tablet_bootstrap.cc:654] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.405279  9742 raft_consensus.cc:359] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.406080  9742 raft_consensus.cc:385] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.406419  9742 raft_consensus.cc:740] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.408387  9743 ts_tablet_manager.cc:1434] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:13:14.409116  9741 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.409366  9743 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.409571  9741 ts_tablet_manager.cc:1403] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:13:14.410579  9742 consensus_queue.cc:260] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.412262  9741 raft_consensus.cc:359] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.412947  9741 raft_consensus.cc:385] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.413239  9741 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.414090  9741 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.415683  9743 tablet_bootstrap.cc:654] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.416086  9741 ts_tablet_manager.cc:1434] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:14.416946  9741 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.423028  9741 tablet_bootstrap.cc:654] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.430444  9747 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.431007  9747 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.440732  9741 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.441959  9741 ts_tablet_manager.cc:1403] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:13:14.444752  9753 raft_consensus.cc:493] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.441414  9742 ts_tablet_manager.cc:1434] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.019s
I20260709 12:13:14.445299  9753 raft_consensus.cc:515] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.445760  9652 heartbeater.cc:499] Master 127.8.178.254:43977 was elected leader, sending a full tablet report...
I20260709 12:13:14.446158  9742 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.447206  9747 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.447731  9753 leader_election.cc:290] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.449160  9754 raft_consensus.cc:493] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.449666  9754 raft_consensus.cc:515] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.444957  9741 raft_consensus.cc:359] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.452944  9741 raft_consensus.cc:385] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.453248  9741 raft_consensus.cc:740] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.455858  9742 tablet_bootstrap.cc:654] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.453931  9741 consensus_queue.cc:260] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.459640  9754 leader_election.cc:290] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.461120  9741 ts_tablet_manager.cc:1434] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:13:14.462225  9741 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.468246  9741 tablet_bootstrap.cc:654] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.472528  9743 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.473037  9743 ts_tablet_manager.cc:1403] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.012s
I20260709 12:13:14.476167  9743 raft_consensus.cc:359] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.476913  9743 raft_consensus.cc:385] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.477293  9743 raft_consensus.cc:740] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.478051  9743 consensus_queue.cc:260] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.479858  9741 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.480471  9741 ts_tablet_manager.cc:1403] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:13:14.483979  9743 ts_tablet_manager.cc:1434] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:14.483839  9741 raft_consensus.cc:359] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.488108  9741 raft_consensus.cc:385] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.487654  9743 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.489025  9741 raft_consensus.cc:740] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.490159  9741 consensus_queue.cc:260] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.494053  9741 ts_tablet_manager.cc:1434] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:14.496601  9741 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.503621  9741 tablet_bootstrap.cc:654] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.515311  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:14.516765  9552 raft_consensus.cc:2468] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 0.
I20260709 12:13:14.527897  9593 leader_election.cc:304] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:14.528847  9754 raft_consensus.cc:2804] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.529224  9754 raft_consensus.cc:493] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.529549  9754 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.536489  9743 tablet_bootstrap.cc:654] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.538802  9748 raft_consensus.cc:493] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.539301  9748 raft_consensus.cc:515] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.540699  9742 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.541163  9742 ts_tablet_manager.cc:1403] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.095s	user 0.041s	sys 0.023s
I20260709 12:13:14.542279  9626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
W20260709 12:13:14.544037  9516 leader_election.cc:343] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.546267  9742 raft_consensus.cc:359] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.547003  9742 raft_consensus.cc:385] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.547299  9742 raft_consensus.cc:740] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.547894  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:14.548034  9742 consensus_queue.cc:260] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
W20260709 12:13:14.550454  9516 leader_election.cc:343] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.553743  9742 ts_tablet_manager.cc:1434] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:14.554797  9742 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.555246  9748 leader_election.cc:290] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.560935  9742 tablet_bootstrap.cc:654] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.561267  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
W20260709 12:13:14.562971  9665 leader_election.cc:343] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.577740  9754 raft_consensus.cc:515] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.581434  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:14.582132  9552 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.591459  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
W20260709 12:13:14.593240  9667 leader_election.cc:343] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.593689  9667 leader_election.cc:304] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40; no voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:14.593899  9552 raft_consensus.cc:2468] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 1.
I20260709 12:13:14.594288  9743 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.594870  9743 ts_tablet_manager.cc:1403] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.108s	user 0.027s	sys 0.015s
I20260709 12:13:14.594882  9748 raft_consensus.cc:2749] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.595093  9593 leader_election.cc:304] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:14.596007  9750 raft_consensus.cc:2804] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.597110  9750 raft_consensus.cc:697] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:14.597949  9750 consensus_queue.cc:237] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.598219  9743 raft_consensus.cc:359] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.599040  9743 raft_consensus.cc:385] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.599342  9743 raft_consensus.cc:740] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.600107  9743 consensus_queue.cc:260] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.602377  9743 ts_tablet_manager.cc:1434] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:14.603039  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:14.603506  9743 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.609236  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:14.610299  9743 tablet_bootstrap.cc:654] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.612848  9753 raft_consensus.cc:493] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.613494  9517 leader_election.cc:343] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.613348  9753 raft_consensus.cc:515] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.613961  9517 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac; no voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:14.614193  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:14.614281  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:14.614854  9754 leader_election.cc:290] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.615445  9753 leader_election.cc:290] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
W20260709 12:13:14.615710  9592 leader_election.cc:343] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.616888  9753 raft_consensus.cc:2749] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:14.617103  9592 leader_election.cc:343] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.617213  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
W20260709 12:13:14.618044  9517 leader_election.cc:343] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:14.618413  9516 leader_election.cc:343] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.619560  9517 leader_election.cc:304] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac; no voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:14.626039  9741 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.626636  9741 ts_tablet_manager.cc:1403] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.130s	user 0.063s	sys 0.038s
I20260709 12:13:14.627530  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:14.625579  9450 catalog_manager.cc:5697] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.629659  9753 raft_consensus.cc:2749] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.629858  9743 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.630378  9743 ts_tablet_manager.cc:1403] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 12:13:14.629429  9741 raft_consensus.cc:359] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
W20260709 12:13:14.630807  9517 leader_election.cc:343] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.631161  9741 raft_consensus.cc:385] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.631516  9741 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.631374  9517 leader_election.cc:304] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac; no voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:14.632309  9747 raft_consensus.cc:2749] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.632340  9741 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.633205  9743 raft_consensus.cc:359] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.633872  9743 raft_consensus.cc:385] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.634137  9743 raft_consensus.cc:740] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.634672  9741 ts_tablet_manager.cc:1434] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:14.634887  9743 consensus_queue.cc:260] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.635632  9741 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.636967  9743 ts_tablet_manager.cc:1434] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:14.637988  9743 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.642179  9741 tablet_bootstrap.cc:654] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.644032  9742 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.644675  9742 ts_tablet_manager.cc:1403] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.005s
I20260709 12:13:14.647610  9742 raft_consensus.cc:359] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.648363  9742 raft_consensus.cc:385] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.648641  9742 raft_consensus.cc:740] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.649359  9742 consensus_queue.cc:260] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.651530  9742 ts_tablet_manager.cc:1434] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:13:14.652460  9742 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.644074  9743 tablet_bootstrap.cc:654] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.655308  9741 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.655822  9741 ts_tablet_manager.cc:1403] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:13:14.658629  9741 raft_consensus.cc:359] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.659332  9741 raft_consensus.cc:385] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.659621  9741 raft_consensus.cc:740] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.660543  9741 consensus_queue.cc:260] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.664830  9742 tablet_bootstrap.cc:654] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.665191  9741 ts_tablet_manager.cc:1434] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 12:13:14.665838  9498 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:14.666163  9741 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.671103  9748 raft_consensus.cc:493] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.671617  9748 raft_consensus.cc:515] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.672966  9741 tablet_bootstrap.cc:654] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.673926  9748 leader_election.cc:290] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.675647  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:14.676306  9552 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:14.676956  9743 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.677500  9743 ts_tablet_manager.cc:1403] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.008s
I20260709 12:13:14.679044  9667 leader_election.cc:304] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:14.678143  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
W20260709 12:13:14.680961  9665 leader_election.cc:343] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.681871  9748 raft_consensus.cc:2804] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.682248  9748 raft_consensus.cc:493] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.682601  9748 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.683661  9742 tablet_bootstrap.cc:492] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.684190  9742 ts_tablet_manager.cc:1403] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.008s
I20260709 12:13:14.686584  9741 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.687076  9741 ts_tablet_manager.cc:1403] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:13:14.686969  9742 raft_consensus.cc:359] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.687688  9742 raft_consensus.cc:385] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.687981  9742 raft_consensus.cc:740] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.680662  9743 raft_consensus.cc:359] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.688710  9743 raft_consensus.cc:385] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.689010  9743 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.689755  9741 raft_consensus.cc:359] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.689868  9743 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.690641  9741 raft_consensus.cc:385] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.690340  9748 raft_consensus.cc:515] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.690990  9741 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.691484  9742 consensus_queue.cc:260] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.691736  9741 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.693724  9742 ts_tablet_manager.cc:1434] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:14.693615  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:14.693945  9747 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.694247  9552 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.694723  9742 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.694394  9747 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.696148  9741 ts_tablet_manager.cc:1434] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:14.696537  9747 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.697067  9741 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.699211  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:14.700980  9552 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:14.701380  9742 tablet_bootstrap.cc:654] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.702135  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
W20260709 12:13:14.702500  9516 leader_election.cc:343] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.702135  9667 leader_election.cc:304] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:14.703609  9741 tablet_bootstrap.cc:654] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.709640  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
W20260709 12:13:14.712808  9665 leader_election.cc:343] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.713945  9748 leader_election.cc:290] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.715154  9741 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.715677  9741 ts_tablet_manager.cc:1403] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:13:14.718348  9741 raft_consensus.cc:359] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.718801  9748 raft_consensus.cc:2804] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.719102  9741 raft_consensus.cc:385] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.719406  9741 raft_consensus.cc:740] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.719903  9748 raft_consensus.cc:697] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:14.720161  9741 consensus_queue.cc:260] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.721088  9742 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.722949  9742 ts_tablet_manager.cc:1403] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 12:13:14.724406  9741 ts_tablet_manager.cc:1434] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:14.725298  9741 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.725229  9776 raft_consensus.cc:493] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.725306  9517 leader_election.cc:343] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.726871  9517 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac; no voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:14.727445  9743 ts_tablet_manager.cc:1434] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.014s
I20260709 12:13:14.727908  9747 raft_consensus.cc:2749] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.728440  9743 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.726387  9776 raft_consensus.cc:515] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.720767  9748 consensus_queue.cc:237] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.731217  9741 tablet_bootstrap.cc:654] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.732376  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
W20260709 12:13:14.733777  9667 leader_election.cc:343] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.735877  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:14.736560  9627 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:14.737820  9665 leader_election.cc:304] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:14.738215  9743 tablet_bootstrap.cc:654] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.738866  9775 raft_consensus.cc:2804] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.739276  9775 raft_consensus.cc:493] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.739650  9775 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.741755  9741 tablet_bootstrap.cc:492] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.725920  9742 raft_consensus.cc:359] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.742211  9741 ts_tablet_manager.cc:1403] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:13:14.742159  9742 raft_consensus.cc:385] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.742636  9742 raft_consensus.cc:740] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.743468  9742 consensus_queue.cc:260] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.745899  9742 ts_tablet_manager.cc:1434] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:13:14.747030  9742 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.747309  9450 catalog_manager.cc:5697] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.750281  9776 leader_election.cc:290] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.753089  9741 raft_consensus.cc:359] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.753813  9741 raft_consensus.cc:385] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.754065  9741 raft_consensus.cc:740] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.754845  9741 consensus_queue.cc:260] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.757674  9775 raft_consensus.cc:515] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.763104  9775 leader_election.cc:290] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.757647  9741 ts_tablet_manager.cc:1434] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:14.764133  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:14.764535  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:14.764708  9627 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.765105  9552 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.765894  9742 tablet_bootstrap.cc:654] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.767148  9743 tablet_bootstrap.cc:492] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.767632  9743 ts_tablet_manager.cc:1403] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.008s
I20260709 12:13:14.770670  9743 raft_consensus.cc:359] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.771468  9743 raft_consensus.cc:385] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.771780  9743 raft_consensus.cc:740] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.771929  9552 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:14.772223  9627 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:14.772790  9743 consensus_queue.cc:260] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.773201  9667 leader_election.cc:304] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:14.774695  9775 raft_consensus.cc:2804] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.775230  9775 raft_consensus.cc:697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:14.764552  9741 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: Bootstrap starting.
I20260709 12:13:14.776096  9775 consensus_queue.cc:237] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.781481  9741 tablet_bootstrap.cc:654] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.781754  9743 ts_tablet_manager.cc:1434] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:13:14.782936  9743 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.796790  9743 tablet_bootstrap.cc:654] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.798780  9741 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: No bootstrap required, opened a new log
I20260709 12:13:14.799258  9741 ts_tablet_manager.cc:1403] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 12:13:14.799361  9742 tablet_bootstrap.cc:492] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.799885  9742 ts_tablet_manager.cc:1403] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.007s
I20260709 12:13:14.801793  9741 raft_consensus.cc:359] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.802469  9741 raft_consensus.cc:385] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.802752  9741 raft_consensus.cc:740] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.803501  9741 consensus_queue.cc:260] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.804378  9742 raft_consensus.cc:359] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.805140  9742 raft_consensus.cc:385] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.805446  9742 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.805761  9741 ts_tablet_manager.cc:1434] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:14.806329  9742 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.806406  9449 catalog_manager.cc:5697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.812728  9742 ts_tablet_manager.cc:1434] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:14.813846  9742 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.820727  9742 tablet_bootstrap.cc:654] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.824456  9743 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.824965  9743 ts_tablet_manager.cc:1403] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.019s
I20260709 12:13:14.827888  9742 tablet_bootstrap.cc:492] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.827596  9743 raft_consensus.cc:359] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.828357  9742 ts_tablet_manager.cc:1403] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 12:13:14.828317  9743 raft_consensus.cc:385] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.828760  9743 raft_consensus.cc:740] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.829540  9743 consensus_queue.cc:260] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.831224  9742 raft_consensus.cc:359] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.831696  9743 ts_tablet_manager.cc:1434] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:14.831920  9742 raft_consensus.cc:385] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.832238  9742 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.832569  9743 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.832945  9742 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.835188  9742 ts_tablet_manager.cc:1434] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:14.836102  9742 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.838948  9743 tablet_bootstrap.cc:654] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.846320  9742 tablet_bootstrap.cc:654] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.847999  9743 tablet_bootstrap.cc:492] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.848420  9743 ts_tablet_manager.cc:1403] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.009s
I20260709 12:13:14.850835  9743 raft_consensus.cc:359] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.851445  9743 raft_consensus.cc:385] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.851604  9742 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.851713  9743 raft_consensus.cc:740] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.852041  9742 ts_tablet_manager.cc:1403] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:13:14.852398  9743 consensus_queue.cc:260] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.854315  9743 ts_tablet_manager.cc:1434] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:14.854476  9742 raft_consensus.cc:359] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.855072  9742 raft_consensus.cc:385] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.855274  9743 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.855355  9742 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.856066  9742 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.857832  9742 ts_tablet_manager.cc:1434] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:14.858842  9742 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.861116  9743 tablet_bootstrap.cc:654] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.864660  9742 tablet_bootstrap.cc:654] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.868045  9743 tablet_bootstrap.cc:492] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.868455  9743 ts_tablet_manager.cc:1403] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 12:13:14.869640  9742 tablet_bootstrap.cc:492] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.869977  9742 ts_tablet_manager.cc:1403] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:14.870903  9743 raft_consensus.cc:359] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.871536  9743 raft_consensus.cc:385] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.871790  9743 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.871922  9742 raft_consensus.cc:359] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.872404  9742 raft_consensus.cc:385] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.872689  9742 raft_consensus.cc:740] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.872363  9743 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.873203  9742 consensus_queue.cc:260] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:14.874182  9743 ts_tablet_manager.cc:1434] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:14.875036  9743 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: Bootstrap starting.
I20260709 12:13:14.875051  9742 ts_tablet_manager.cc:1434] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:14.876000  9742 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: Bootstrap starting.
I20260709 12:13:14.880550  9743 tablet_bootstrap.cc:654] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.880635  9775 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.881000  9742 tablet_bootstrap.cc:654] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.881075  9775 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.886140  9775 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.887952  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:14.888646  9552 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:14.889968  9667 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:14.891728  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:14.892601  9627 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:14.893684  9750 raft_consensus.cc:493] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.894179  9750 raft_consensus.cc:515] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.894771  9775 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.895166  9775 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.895490  9775 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.896497  9750 leader_election.cc:290] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.899222  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9237adf4f6144e6854899b087584084" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:14.899931  9700 raft_consensus.cc:2468] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 0.
I20260709 12:13:14.901388  9592 leader_election.cc:304] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:14.902709  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9237adf4f6144e6854899b087584084" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:14.903430  9552 raft_consensus.cc:2468] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 0.
I20260709 12:13:14.904706  9775 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.905311  9750 raft_consensus.cc:2804] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.906013  9750 raft_consensus.cc:493] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.906416  9750 raft_consensus.cc:3060] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.907799  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:14.908389  9552 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.915570  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:14.916288  9627 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.917243  9750 raft_consensus.cc:515] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.922181  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9237adf4f6144e6854899b087584084" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:14.922884  9551 raft_consensus.cc:3060] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.924767  9775 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.929513  9552 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:14.931524  9667 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:14.932477  9775 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.932688  9551 raft_consensus.cc:2468] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 1.
I20260709 12:13:14.934244  9593 leader_election.cc:304] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:14.935171  9754 raft_consensus.cc:2804] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.935631  9754 raft_consensus.cc:697] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:14.935907  9775 raft_consensus.cc:697] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:14.936460  9754 consensus_queue.cc:237] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.936832  9775 consensus_queue.cc:237] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.942934  9627 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:14.944304  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9237adf4f6144e6854899b087584084" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:14.944782  9700 raft_consensus.cc:3060] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.946549  9742 tablet_bootstrap.cc:492] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: No bootstrap required, opened a new log
I20260709 12:13:14.946978  9742 ts_tablet_manager.cc:1403] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: Time spent bootstrapping tablet: real 0.071s	user 0.030s	sys 0.034s
I20260709 12:13:14.948040  9743 tablet_bootstrap.cc:492] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: No bootstrap required, opened a new log
I20260709 12:13:14.948479  9743 ts_tablet_manager.cc:1403] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: Time spent bootstrapping tablet: real 0.074s	user 0.043s	sys 0.026s
I20260709 12:13:14.949487  9750 leader_election.cc:290] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:14.951792  9743 raft_consensus.cc:359] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.952447  9743 raft_consensus.cc:385] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.952687  9743 raft_consensus.cc:740] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.953456  9743 consensus_queue.cc:260] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.955091  9700 raft_consensus.cc:2468] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 1.
I20260709 12:13:14.955775  9743 ts_tablet_manager.cc:1434] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:13:14.956962  9742 raft_consensus.cc:359] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.957589  9742 raft_consensus.cc:385] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.957841  9742 raft_consensus.cc:740] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.958904  9742 consensus_queue.cc:260] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.960172  9449 catalog_manager.cc:5697] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.960952  9742 ts_tablet_manager.cc:1434] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:13:14.970083  9449 catalog_manager.cc:5697] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.995792  9775 raft_consensus.cc:493] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.996239  9775 raft_consensus.cc:515] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:14.997910  9775 leader_election.cc:290] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:14.998786  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:14.998956  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:14.999480  9627 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:14.999478  9551 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.000737  9665 leader_election.cc:304] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.001370  9775 raft_consensus.cc:2804] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.001675  9775 raft_consensus.cc:493] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.001929  9775 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.006321  9775 raft_consensus.cc:515] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.007875  9775 leader_election.cc:290] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.008719  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.008836  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.009191  9551 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.009327  9627 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.013633  9551 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.013640  9627 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.014869  9667 leader_election.cc:304] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.015523  9775 raft_consensus.cc:2804] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.015972  9775 raft_consensus.cc:697] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.016709  9775 consensus_queue.cc:237] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.023286  9449 catalog_manager.cc:5697] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.027709  9775 raft_consensus.cc:493] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.028157  9775 raft_consensus.cc:515] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.030509  9775 leader_election.cc:290] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.030884  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:15.031569  9551 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.031872  9747 raft_consensus.cc:493] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.031594  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:15.032414  9747 raft_consensus.cc:515] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.032658  9627 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.032641  9667 leader_election.cc:304] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.033501  9775 raft_consensus.cc:2804] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.033865  9775 raft_consensus.cc:493] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.034197  9775 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.034929  9626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:15.034215  9747 leader_election.cc:290] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.035460  9626 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 0.
I20260709 12:13:15.035631  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:15.035961  9776 raft_consensus.cc:493] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.036656  9516 leader_election.cc:304] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.036437  9776 raft_consensus.cc:515] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.037288  9747 raft_consensus.cc:2804] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.037447  9700 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 0.
I20260709 12:13:15.037683  9747 raft_consensus.cc:493] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.038051  9747 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.038578  9776 leader_election.cc:290] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.040854  9626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:15.041287  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:15.041440  9626 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.041383  9775 raft_consensus.cc:515] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.042799  9665 leader_election.cc:304] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.043583  9775 leader_election.cc:290] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.044126  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.043592  9776 raft_consensus.cc:2804] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.044595  9626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.044615  9552 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.044607  9776 raft_consensus.cc:493] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.045280  9626 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.045362  9776 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.046355  9747 raft_consensus.cc:515] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.047446  9551 raft_consensus.cc:2393] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 173779f83e2449a88d7f1ac79b06fe40 in current term 1: Already voted for candidate 5193f3489bb7451b9429372b46a5dfac in this term.
I20260709 12:13:15.050706  9750 consensus_queue.cc:1048] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.051599  9552 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.051968  9775 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.052448  9775 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.053369  9667 leader_election.cc:304] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.054227  9748 raft_consensus.cc:2804] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.054347  9775 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.055105  9626 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.057216  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:15.057878  9551 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.059298  9667 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.060247  9775 raft_consensus.cc:493] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.060952  9776 raft_consensus.cc:515] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.060715  9775 raft_consensus.cc:515] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.063408  9626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.063949  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:15.064862  9775 leader_election.cc:290] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.065337  9775 raft_consensus.cc:2804] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.065693  9775 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.065825  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:15.066059  9775 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.063949  9626 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.068734  9665 leader_election.cc:304] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40; no voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:15.062242  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297" is_pre_election: true
I20260709 12:13:15.069274  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.070988  9627 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 0.
I20260709 12:13:15.072356  9700 raft_consensus.cc:2393] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5193f3489bb7451b9429372b46a5dfac in current term 1: Already voted for candidate 173779f83e2449a88d7f1ac79b06fe40 in this term.
I20260709 12:13:15.072671  9775 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.074645  9796 raft_consensus.cc:2749] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.074132  9776 leader_election.cc:290] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.074663  9775 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.075853  9550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.075918  9552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.076324  9550 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.076501  9552 raft_consensus.cc:2393] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 173779f83e2449a88d7f1ac79b06fe40 in current term 1: Already voted for candidate 5193f3489bb7451b9429372b46a5dfac in this term.
I20260709 12:13:15.077164  9748 raft_consensus.cc:697] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.077975  9748 consensus_queue.cc:237] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.081252  9550 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.082224  9747 leader_election.cc:290] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.082408  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.082468  9667 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.083103  9625 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.083360  9775 raft_consensus.cc:2804] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.083850  9775 raft_consensus.cc:697] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.084782  9775 consensus_queue.cc:237] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.086323  9700 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.098268  9626 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 1.
I20260709 12:13:15.099732  9516 leader_election.cc:304] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:15.099653  9764 consensus_queue.cc:1048] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.100620  9747 raft_consensus.cc:2804] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.101105  9747 raft_consensus.cc:697] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.101460  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.102222  9627 raft_consensus.cc:2393] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 173779f83e2449a88d7f1ac79b06fe40 in current term 1: Already voted for candidate 5193f3489bb7451b9429372b46a5dfac in this term.
I20260709 12:13:15.101915  9747 consensus_queue.cc:237] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.103228  9665 leader_election.cc:304] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40; no voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297
I20260709 12:13:15.104328  9748 raft_consensus.cc:2749] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.105718  9625 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 1.
I20260709 12:13:15.107458  9449 catalog_manager.cc:5697] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.110623  9748 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.120390  9448 catalog_manager.cc:5697] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 0 to 1, leader changed from <none> to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 1 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.127091  9625 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.129087  9449 catalog_manager.cc:5697] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.133695  9796 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.194877  9796 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.204192  9775 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.223151  9764 raft_consensus.cc:493] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.223662  9764 raft_consensus.cc:515] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.225200  9764 leader_election.cc:290] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.226055  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac" is_pre_election: true
I20260709 12:13:15.226154  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40" is_pre_election: true
I20260709 12:13:15.226604  9551 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 0.
I20260709 12:13:15.226670  9700 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 0.
I20260709 12:13:15.227550  9593 leader_election.cc:304] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.228160  9764 raft_consensus.cc:2804] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.228488  9764 raft_consensus.cc:493] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.228739  9764 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.233325  9764 raft_consensus.cc:515] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.234987  9764 leader_election.cc:290] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.235736  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.235934  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.236212  9551 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.236402  9700 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.240702  9700 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 1.
I20260709 12:13:15.240698  9551 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 1.
I20260709 12:13:15.241677  9592 leader_election.cc:304] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.242271  9764 raft_consensus.cc:2804] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.242728  9764 raft_consensus.cc:697] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:15.243394  9764 consensus_queue.cc:237] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.249450  9449 catalog_manager.cc:5697] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.335182  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.335732  9700 raft_consensus.cc:606] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:15.340305  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.340785  9700 raft_consensus.cc:606] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:15.352871  9625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:59552
I20260709 12:13:15.353379  9625 raft_consensus.cc:606] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:15.357998  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.358654  9700 raft_consensus.cc:606] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:15.363232  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.363819  9700 raft_consensus.cc:606] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:15.365267  9775 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.370754  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.371555  9700 raft_consensus.cc:606] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 6ee898db7b444800a068bb7f94392297
I20260709 12:13:15.371837  9748 raft_consensus.cc:993] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.372273  9748 raft_consensus.cc:1081] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.376262  9776 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.378602  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:15.379189  9550 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.379482  9550 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.385190  9550 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.386121  9551 raft_consensus.cc:1240] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Rejecting Update request from peer 173779f83e2449a88d7f1ac79b06fe40 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:15.378269  9700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:15.388254  9700 raft_consensus.cc:606] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Received request to transfer leadership to TS 6ee898db7b444800a068bb7f94392297
I20260709 12:13:15.388640  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.389276  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.389325  9701 raft_consensus.cc:3055] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.390084  9701 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.391191  9625 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.390928  9701 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.391752  9775 consensus_queue.cc:1059] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.392652  9701 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.392987  9550 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.397087  9764 consensus_queue.cc:1048] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.398226  9625 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.399427  9516 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.400327  9753 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.401463  9753 raft_consensus.cc:697] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.402168  9753 consensus_queue.cc:237] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.403303  9701 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.413129  9764 consensus_queue.cc:1048] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.416397  9449 catalog_manager.cc:5697] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.434237  9550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:44238
I20260709 12:13:15.434907  9550 raft_consensus.cc:606] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 LEADER]: Received request to transfer leadership to TS 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:15.469520  9775 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.480062  9776 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.487179  9775 raft_consensus.cc:993] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:15.487613  9776 raft_consensus.cc:1081] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:15.489027  9625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:59544
I20260709 12:13:15.489501  9625 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.489884  9625 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.494726  9625 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.495872  9776 consensus_queue.cc:1048] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.497087  9625 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 2 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.497435  9550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.497541  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.498103  9550 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.498167  9701 raft_consensus.cc:3055] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.498615  9701 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.499363  9701 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.500357  9701 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.506687  9550 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 2.
I20260709 12:13:15.507081  9775 raft_consensus.cc:993] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.507041  9701 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 2.
I20260709 12:13:15.507618  9775 raft_consensus.cc:1081] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.508159  9593 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.509330  9764 raft_consensus.cc:2804] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.509677  9551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:15.510324  9551 raft_consensus.cc:493] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.509791  9764 raft_consensus.cc:697] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:15.510805  9551 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.511386  9764 consensus_queue.cc:237] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.512687  9775 consensus_queue.cc:1048] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.519583  9551 raft_consensus.cc:515] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.519404  9448 catalog_manager.cc:5697] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.520849  9550 raft_consensus.cc:1240] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Rejecting Update request from peer 173779f83e2449a88d7f1ac79b06fe40 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:15.522619  9551 leader_election.cc:290] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.524088  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.524739  9625 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.524775  9775 consensus_queue.cc:1059] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.525755  9776 raft_consensus.cc:3055] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.526096  9776 raft_consensus.cc:740] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.526715  9796 raft_consensus.cc:993] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.527204  9796 raft_consensus.cc:1081] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.526872  9776 consensus_queue.cc:260] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.528038  9776 raft_consensus.cc:3060] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.529078  9551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:15.529692  9551 raft_consensus.cc:493] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.530095  9551 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.531853  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41d04acb275420a9df2f99a3d0f86af" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.533915  9625 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.535072  9516 leader_election.cc:304] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.535854  9753 raft_consensus.cc:2804] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.536327  9753 raft_consensus.cc:697] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.537038  9551 raft_consensus.cc:515] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.537114  9753 consensus_queue.cc:237] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } }
I20260709 12:13:15.539903  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.540544  9625 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.541610  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.542114  9700 raft_consensus.cc:3055] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.542451  9700 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.543251  9700 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.544292  9700 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.545326  9448 catalog_manager.cc:5697] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.547421  9625 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.547421  9701 raft_consensus.cc:2468] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.548949  9516 leader_election.cc:304] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.549760  9753 raft_consensus.cc:2804] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.550182  9753 raft_consensus.cc:697] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.550803  9700 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.550979  9551 leader_election.cc:290] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.551002  9753 consensus_queue.cc:237] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.553987  9776 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.563032  9448 catalog_manager.cc:5697] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.565013  9748 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.574584  9776 raft_consensus.cc:993] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:15.575011  9748 raft_consensus.cc:1081] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:15.576799  9625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:59544
I20260709 12:13:15.577356  9625 raft_consensus.cc:493] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.577744  9625 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.583003  9625 raft_consensus.cc:515] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.584792  9625 leader_election.cc:290] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 2 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.585541  9550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.585867  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.586156  9550 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.586372  9700 raft_consensus.cc:3055] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.586768  9700 raft_consensus.cc:740] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.587544  9700 consensus_queue.cc:260] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.588769  9700 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.591652  9550 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 2.
I20260709 12:13:15.592696  9593 leader_election.cc:304] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.593454  9764 raft_consensus.cc:2804] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.593775  9700 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 2.
I20260709 12:13:15.593847  9764 raft_consensus.cc:697] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:15.594790  9764 consensus_queue.cc:237] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.600642  9449 catalog_manager.cc:5697] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.627537  9796 raft_consensus.cc:993] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.627954  9748 raft_consensus.cc:1081] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.629349  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:15.629773  9550 raft_consensus.cc:493] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.630069  9550 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.634370  9550 raft_consensus.cc:515] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.636008  9550 leader_election.cc:290] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.636718  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.636984  9700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.637203  9625 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.637483  9700 raft_consensus.cc:3055] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.637737  9700 raft_consensus.cc:740] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.638365  9700 consensus_queue.cc:260] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.639235  9700 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.641698  9625 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.642719  9516 leader_election.cc:304] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.643458  9753 raft_consensus.cc:2804] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.643816  9753 raft_consensus.cc:697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.643869  9700 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.644584  9753 consensus_queue.cc:237] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.650408  9449 catalog_manager.cc:5697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.654399  9753 consensus_queue.cc:1048] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.661173  9815 raft_consensus.cc:993] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:15.661619  9747 raft_consensus.cc:1081] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 LEADER]: Signalling peer 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:15.663606  9701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:37986
I20260709 12:13:15.664175  9701 raft_consensus.cc:493] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.664542  9701 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.666792  9815 consensus_queue.cc:1048] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.671799  9764 raft_consensus.cc:993] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.672290  9764 raft_consensus.cc:1081] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:15.672008  9701 raft_consensus.cc:515] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.674474  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44226
I20260709 12:13:15.674899  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:15.675103  9550 raft_consensus.cc:493] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.675485  9551 raft_consensus.cc:3055] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.675541  9550 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.676043  9551 raft_consensus.cc:740] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.676870  9551 consensus_queue.cc:260] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.677773  9551 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.684459  9550 raft_consensus.cc:515] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.687115  9550 leader_election.cc:290] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:15.687491  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.688077  9625 raft_consensus.cc:3055] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.688421  9625 raft_consensus.cc:740] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:15.688735  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992fd6452244482ba4c7efbbd5e9188a" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:15.689307  9699 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.689093  9625 consensus_queue.cc:260] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.690080  9625 raft_consensus.cc:3060] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.691828  9700 raft_consensus.cc:1240] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Rejecting Update request from peer 5193f3489bb7451b9429372b46a5dfac for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:15.693660  9701 leader_election.cc:290] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 2 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:15.694295  9627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e444fbe781a643c1a0b2d221c39ae515" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:15.694900  9627 raft_consensus.cc:3060] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.695600  9625 raft_consensus.cc:2468] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.696090  9551 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 2.
I20260709 12:13:15.696463  9699 raft_consensus.cc:2468] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:15.697336  9516 leader_election.cc:304] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:15.697953  9815 raft_consensus.cc:2804] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.698408  9815 raft_consensus.cc:697] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:15.698947  9667 leader_election.cc:304] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:15.699270  9815 consensus_queue.cc:237] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.699719  9748 raft_consensus.cc:2804] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.700263  9748 raft_consensus.cc:697] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:15.701109  9627 raft_consensus.cc:2468] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 2.
I20260709 12:13:15.701066  9748 consensus_queue.cc:237] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:15.708156  9449 catalog_manager.cc:5697] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 6ee898db7b444800a068bb7f94392297 (127.8.178.194) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.708587  9450 catalog_manager.cc:5697] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 1 to 2, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.735075  9764 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.744547  9750 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.822562  9701 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.823762  9815 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.831312  9627 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.832895  9815 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.921202  9701 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.922326  9750 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.930284  9551 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.931535  9764 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.054222  9701 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.055491  9753 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.057907  9701 raft_consensus.cc:1275] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.059201  9753 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.065049  9627 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.066712  9747 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.070166  9627 raft_consensus.cc:1275] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.072237  9747 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.075837  9625 raft_consensus.cc:1275] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.077443  9747 consensus_queue.cc:1048] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.090333  9699 raft_consensus.cc:1275] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.091660  9747 consensus_queue.cc:1048] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.115525  9625 raft_consensus.cc:1275] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.116714  9748 consensus_queue.cc:1048] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.124264  9551 raft_consensus.cc:1275] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.125957  9748 consensus_queue.cc:1048] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.144879  9699 raft_consensus.cc:1275] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.146152  9764 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.153642  9551 raft_consensus.cc:1275] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.155054  9754 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.155519  9625 raft_consensus.cc:1275] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.157663  9747 consensus_queue.cc:1048] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.168195  9699 raft_consensus.cc:1275] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.169704  9747 consensus_queue.cc:1048] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.465446  8907 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:13:18.466146  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.482997  9551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:18.483506  9551 raft_consensus.cc:606] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Received request to transfer leadership to TS 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:18.485698  9551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:18.486171  9551 raft_consensus.cc:606] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Received request to transfer leadership to TS 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:18.487239  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:18.487828  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:18.561987  9753 raft_consensus.cc:993] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:18.562438  9836 raft_consensus.cc:1081] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Signalling peer 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:18.563791  9701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:37986
I20260709 12:13:18.564213  9701 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.564488  9701 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.568818  9701 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.570735  9701 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:18.571077  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:18.571295  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:18.571643  9551 raft_consensus.cc:3055] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:18.571784  9625 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.571947  9551 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:18.572646  9551 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.573489  9551 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.576293  9625 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:18.577276  9665 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:18.578039  9832 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:18.578656  9551 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:18.579936  9832 raft_consensus.cc:697] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:18.580753  9832 consensus_queue.cc:237] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.586932  9449 catalog_manager.cc:5697] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 2 to 3, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.676623  9753 raft_consensus.cc:993] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:18.677853  9753 raft_consensus.cc:1081] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Signalling peer 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:18.679412  9699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:37986
I20260709 12:13:18.679970  9699 raft_consensus.cc:493] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.680341  9699 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.685022  9699 raft_consensus.cc:515] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.686772  9699 leader_election.cc:290] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:18.687536  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:18.687824  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:18.688086  9551 raft_consensus.cc:3055] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:18.688295  9625 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.688410  9551 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:18.689136  9551 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.689991  9551 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.692422  9625 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:18.693329  9665 leader_election.cc:304] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:18.693951  9832 raft_consensus.cc:2804] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:18.694319  9832 raft_consensus.cc:697] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:18.694968  9551 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:18.695003  9832 consensus_queue.cc:237] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:18.701424  9449 catalog_manager.cc:5697] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 2 to 3, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.965250  9625 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.966298  9832 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.981792  9551 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:18.984093  9832 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:19.153757  9551 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:19.154858  9832 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:19.162755  9625 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:19.164203  9848 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:19.488763  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.493867  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:19.494221  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.495059  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.501360  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:20.501732  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.502732  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.508857  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:21.509276  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:22.510185  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.515532  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:22.515980  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.517154  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.523226  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:23.523658  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:24.524652  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.529783  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:24.530239  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.531167  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.536326  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:25.536775  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.537724  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.543156  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:26.543572  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:27.544513  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.549769  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:27.550212  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.580408  8907 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:13:28.586920  9701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:28.587541  9701 raft_consensus.cc:606] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:28.594547  9701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:38000
I20260709 12:13:28.595002  9701 raft_consensus.cc:606] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:28.601778  9625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:59552
I20260709 12:13:28.602252  9625 raft_consensus.cc:606] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:28.606498  9625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:59552
I20260709 12:13:28.606958  9625 raft_consensus.cc:606] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:28.611151  9625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
mode: GRACEFUL
new_leader_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:59552
I20260709 12:13:28.611618  9625 raft_consensus.cc:606] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Received request to transfer leadership to TS 5193f3489bb7451b9429372b46a5dfac
I20260709 12:13:28.848023  9866 raft_consensus.cc:993] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.848603  9864 raft_consensus.cc:1081] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.850196  9551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44226
I20260709 12:13:28.850656  9551 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.850912  9551 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.855643  9551 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.857161  9551 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 3 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:28.858248  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:28.858143  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:28.858970  9699 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.859028  9625 raft_consensus.cc:3055] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:28.859423  9625 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:28.860258  9625 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.861545  9625 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.866657  9699 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 3.
I20260709 12:13:28.868021  9517 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:28.868237  9625 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 3.
I20260709 12:13:28.869143  9863 raft_consensus.cc:2804] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:28.869616  9863 raft_consensus.cc:697] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:28.870359  9863 consensus_queue.cc:237] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.877171  9450 catalog_manager.cc:5697] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 2 to 3, leader changed from 6ee898db7b444800a068bb7f94392297 (127.8.178.194) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 3 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.935153  9856 raft_consensus.cc:993] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.935541  9856 raft_consensus.cc:1081] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.936901  9551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:28.937415  9551 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.937740  9551 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.943035  9866 raft_consensus.cc:993] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.943558  9874 raft_consensus.cc:1081] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.943986  9551 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.945055  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44226
I20260709 12:13:28.945519  9551 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 4 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:28.945573  9550 raft_consensus.cc:493] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.946183  9550 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.946305  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:28.946900  9625 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.946628  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:28.947403  9699 raft_consensus.cc:3055] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:28.947639  9699 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:28.948398  9699 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.949309  9699 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.953220  9625 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 4.
I20260709 12:13:28.953254  9550 raft_consensus.cc:515] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.953949  9699 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 4.
I20260709 12:13:28.954874  9516 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:28.955482  9550 leader_election.cc:290] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:28.955724  9863 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:28.956247  9863 raft_consensus.cc:697] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:28.956889  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:28.957434  9625 raft_consensus.cc:3055] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.957082  9863 consensus_queue.cc:237] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.957707  9625 raft_consensus.cc:740] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:28.958465  9625 consensus_queue.cc:260] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.959018  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:28.959581  9699 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.959667  9625 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.966444  9699 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:28.966847  9625 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 2.
I20260709 12:13:28.967935  9517 leader_election.cc:304] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:28.968530  9873 raft_consensus.cc:993] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.968858  9867 raft_consensus.cc:2804] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.969030  9873 raft_consensus.cc:1081] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:28.970533  9867 raft_consensus.cc:697] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:28.970734  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "880e783510f144b4a4401560bf7269df"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44236
I20260709 12:13:28.971333  9550 raft_consensus.cc:493] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.971761  9550 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.971416  9867 consensus_queue.cc:237] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.974093  9450 catalog_manager.cc:5697] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 3 to 4, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 4 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.978405  9550 raft_consensus.cc:515] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.980270  9550 leader_election.cc:290] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 4 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:28.980928  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:28.981446  9625 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.981534  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880e783510f144b4a4401560bf7269df" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:28.982132  9699 raft_consensus.cc:3055] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:28.982385  9699 raft_consensus.cc:740] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:28.983235  9699 consensus_queue.cc:260] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.984398  9699 raft_consensus.cc:3060] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:28.986011  9625 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 4.
I20260709 12:13:28.986879  9516 leader_election.cc:304] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5193f3489bb7451b9429372b46a5dfac, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:28.987629  9867 raft_consensus.cc:2804] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:28.988117  9867 raft_consensus.cc:697] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:28.988818  9867 consensus_queue.cc:237] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:28.990075  9450 catalog_manager.cc:5697] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 1 to 2, leader changed from 6ee898db7b444800a068bb7f94392297 (127.8.178.194) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 2 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.990998  9699 raft_consensus.cc:2468] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 4.
I20260709 12:13:29.001299  9450 catalog_manager.cc:5697] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 3 to 4, leader changed from 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 4 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.066511  9866 raft_consensus.cc:993] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: : Instructing follower 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:29.066936  9874 raft_consensus.cc:1081] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Signalling peer 5193f3489bb7451b9429372b46a5dfac to start an election
I20260709 12:13:29.068392  9550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
 from {username='slave'} at 127.0.0.1:44226
I20260709 12:13:29.068874  9550 raft_consensus.cc:493] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.069166  9550 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.073829  9550 raft_consensus.cc:515] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:29.075506  9550 leader_election.cc:290] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 3 election: Requested vote from peers 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:29.076231  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:29.076529  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881656bdc4f844ef87291dca92fd8809" candidate_uuid: "5193f3489bb7451b9429372b46a5dfac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:29.076709  9625 raft_consensus.cc:3055] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.076982  9625 raft_consensus.cc:740] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:29.077013  9699 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.077615  9625 consensus_queue.cc:260] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:29.078548  9625 raft_consensus.cc:3060] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.081631  9699 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 3.
I20260709 12:13:29.082654  9625 raft_consensus.cc:2468] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5193f3489bb7451b9429372b46a5dfac in term 3.
I20260709 12:13:29.082623  9517 leader_election.cc:304] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 5193f3489bb7451b9429372b46a5dfac; no voters: 
I20260709 12:13:29.083484  9867 raft_consensus.cc:2804] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.083865  9867 raft_consensus.cc:697] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Becoming Leader. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:29.084592  9867 consensus_queue.cc:237] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:29.091459  9450 catalog_manager.cc:5697] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac reported cstate change: term changed from 2 to 3, leader changed from 6ee898db7b444800a068bb7f94392297 (127.8.178.194) to 5193f3489bb7451b9429372b46a5dfac (127.8.178.193). New cstate: current_term: 3 leader_uuid: "5193f3489bb7451b9429372b46a5dfac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.393925  9699 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.394969  9867 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.405553  9625 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.406981  9699 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:29.407524  9876 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:29.408591  9867 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.422333  9625 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:29.424568  9876 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.432438  9699 raft_consensus.cc:1275] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.434145  9876 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.436097  9625 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:29.437075  9876 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.443594  9627 raft_consensus.cc:1275] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.445336  9867 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:29.455071  9699 raft_consensus.cc:1275] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:29.456218  9876 consensus_queue.cc:1048] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.540746  9699 raft_consensus.cc:1275] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.541805  9876 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.549906  9625 raft_consensus.cc:1275] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Refusing update from remote peer 5193f3489bb7451b9429372b46a5dfac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.551633  9863 consensus_queue.cc:1048] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.644351  8907 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:13:31.644984  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.651947  9550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:31.652453  9550 raft_consensus.cc:606] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Received request to transfer leadership to TS 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:31.654891  9550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:31.655351  9550 raft_consensus.cc:606] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Received request to transfer leadership to TS 6ee898db7b444800a068bb7f94392297
I20260709 12:13:31.657554  9550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:31.658011  9550 raft_consensus.cc:606] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Received request to transfer leadership to TS 173779f83e2449a88d7f1ac79b06fe40
I20260709 12:13:31.660065  9550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
mode: GRACEFUL
new_leader_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:50184
I20260709 12:13:31.660519  9550 raft_consensus.cc:606] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Received request to transfer leadership to TS 6ee898db7b444800a068bb7f94392297
I20260709 12:13:31.661448  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:31.661867  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.676496  9863 raft_consensus.cc:993] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:31.676919  9894 raft_consensus.cc:1081] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Signalling peer 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:31.678141  9625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:59542
I20260709 12:13:31.678562  9625 raft_consensus.cc:493] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.678793  9625 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:31.683257  9625 raft_consensus.cc:515] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.684267  9863 raft_consensus.cc:993] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:31.684722  9894 raft_consensus.cc:1081] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Signalling peer 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:31.685329  9625 leader_election.cc:290] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 5 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:31.686322  9701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:31.686368  9699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:37986
I20260709 12:13:31.686323  9550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba59a00f645e42738f59f777eab7d807" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:31.687052  9699 raft_consensus.cc:493] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.687119  9550 raft_consensus.cc:3055] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:31.686918  9701 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:31.687572  9699 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.687654  9550 raft_consensus.cc:740] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:31.688477  9550 consensus_queue.cc:260] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.689641  9550 raft_consensus.cc:3060] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:31.692544  9701 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 5.
I20260709 12:13:31.693537  9592 leader_election.cc:304] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:31.693732  9699 raft_consensus.cc:515] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.694154  9874 raft_consensus.cc:2804] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:31.695272  9874 raft_consensus.cc:697] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 5 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:31.696058  9874 consensus_queue.cc:237] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.696471  9550 raft_consensus.cc:2468] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 5.
I20260709 12:13:31.696599  9699 leader_election.cc:290] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:31.697356  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:31.697890  9551 raft_consensus.cc:3055] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.698050  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8b264f541b4800b7eea2b4c8a4ecb5" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:31.698189  9551 raft_consensus.cc:740] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:31.698557  9625 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.698956  9551 consensus_queue.cc:260] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.700062  9551 raft_consensus.cc:3060] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.702338  9625 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:31.703518  9665 leader_election.cc:304] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:31.704365  9856 raft_consensus.cc:2804] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.705214  9856 raft_consensus.cc:697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:31.706147  9551 raft_consensus.cc:2468] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 3.
I20260709 12:13:31.706017  9856 consensus_queue.cc:237] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.707580  9448 catalog_manager.cc:5697] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 4 to 5, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 5 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.713413  9450 catalog_manager.cc:5697] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 2 to 3, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.846567  9863 raft_consensus.cc:993] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:31.847111  9894 raft_consensus.cc:1081] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Signalling peer 6ee898db7b444800a068bb7f94392297 to start an election
I20260709 12:13:31.848531  9625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c"
dest_uuid: "6ee898db7b444800a068bb7f94392297"
 from {username='slave'} at 127.0.0.1:59542
I20260709 12:13:31.849069  9625 raft_consensus.cc:493] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.849411  9625 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.854560  9625 raft_consensus.cc:515] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.856076  9625 leader_election.cc:290] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 3 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195:42849)
I20260709 12:13:31.856791  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:31.856969  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763567ac9be747bb89cc3cf976bf818c" candidate_uuid: "6ee898db7b444800a068bb7f94392297" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
I20260709 12:13:31.857313  9551 raft_consensus.cc:3055] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.857434  9699 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.857609  9551 raft_consensus.cc:740] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:31.858266  9551 consensus_queue.cc:260] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.859134  9551 raft_consensus.cc:3060] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.862619  9699 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 3.
I20260709 12:13:31.863559  9592 leader_election.cc:304] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:31.864148  9874 raft_consensus.cc:2804] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.864249  9551 raft_consensus.cc:2468] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ee898db7b444800a068bb7f94392297 in term 3.
I20260709 12:13:31.864554  9874 raft_consensus.cc:697] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 3 LEADER]: Becoming Leader. State: Replica: 6ee898db7b444800a068bb7f94392297, State: Running, Role: LEADER
I20260709 12:13:31.865324  9874 consensus_queue.cc:237] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:31.871649  9450 catalog_manager.cc:5697] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 reported cstate change: term changed from 2 to 3, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 6ee898db7b444800a068bb7f94392297 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "6ee898db7b444800a068bb7f94392297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.993544  9863 raft_consensus.cc:993] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: : Instructing follower 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:31.993956  9894 raft_consensus.cc:1081] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Signalling peer 173779f83e2449a88d7f1ac79b06fe40 to start an election
I20260709 12:13:31.995229  9699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7"
dest_uuid: "173779f83e2449a88d7f1ac79b06fe40"
 from {username='slave'} at 127.0.0.1:37986
I20260709 12:13:31.995654  9699 raft_consensus.cc:493] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.995909  9699 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.000066  9699 raft_consensus.cc:515] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:32.001503  9699 leader_election.cc:290] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 4 election: Requested vote from peers 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503), 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885)
I20260709 12:13:32.002244  9551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5193f3489bb7451b9429372b46a5dfac"
I20260709 12:13:32.002539  9625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d3b84832ead4530a2412de18d146be7" candidate_uuid: "173779f83e2449a88d7f1ac79b06fe40" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ee898db7b444800a068bb7f94392297"
I20260709 12:13:32.002772  9551 raft_consensus.cc:3055] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:32.003000  9625 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.003036  9551 raft_consensus.cc:740] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5193f3489bb7451b9429372b46a5dfac, State: Running, Role: LEADER
I20260709 12:13:32.003720  9551 consensus_queue.cc:260] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:32.004505  9551 raft_consensus.cc:3060] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.007203  9625 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 4.
I20260709 12:13:32.008131  9665 leader_election.cc:304] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173779f83e2449a88d7f1ac79b06fe40, 6ee898db7b444800a068bb7f94392297; no voters: 
I20260709 12:13:32.008411  9551 raft_consensus.cc:2468] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173779f83e2449a88d7f1ac79b06fe40 in term 4.
I20260709 12:13:32.008956  9856 raft_consensus.cc:2804] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:32.009408  9856 raft_consensus.cc:697] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 LEADER]: Becoming Leader. State: Replica: 173779f83e2449a88d7f1ac79b06fe40, State: Running, Role: LEADER
I20260709 12:13:32.010221  9856 consensus_queue.cc:237] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } }
I20260709 12:13:32.016901  9450 catalog_manager.cc:5697] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 reported cstate change: term changed from 3 to 4, leader changed from 5193f3489bb7451b9429372b46a5dfac (127.8.178.193) to 173779f83e2449a88d7f1ac79b06fe40 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "173779f83e2449a88d7f1ac79b06fe40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.117933  9551 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 5 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:32.119092  9874 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.128651  9699 raft_consensus.cc:1275] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 5 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:32.130729  9874 consensus_queue.cc:1048] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:32.167616  9551 raft_consensus.cc:1275] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.168676  9856 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.177615  9625 raft_consensus.cc:1275] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.179227  9897 consensus_queue.cc:1048] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.388065  9551 raft_consensus.cc:1275] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.389144  9874 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.397089  9699 raft_consensus.cc:1275] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Refusing update from remote peer 6ee898db7b444800a068bb7f94392297: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.398671  9895 consensus_queue.cc:1048] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173779f83e2449a88d7f1ac79b06fe40" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.468448  9551 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:32.469566  9897 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5193f3489bb7451b9429372b46a5dfac" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.476933  9625 raft_consensus.cc:1275] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Refusing update from remote peer 173779f83e2449a88d7f1ac79b06fe40: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:32.478222  9897 consensus_queue.cc:1048] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee898db7b444800a068bb7f94392297" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.662793  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.668249  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:32.668622  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.669646  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.675859  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:33.676257  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:34.677186  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.684713  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:34.685137  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:35.686082  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.691448  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:35.691876  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:36.692795  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.698060  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:36.698523  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:37.699357  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.704838  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:37.705258  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:38.706344  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.712463  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:38.712872  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:39.713878  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:39.719172  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:39.719612  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:40.720418  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.725878  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:40.726285  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:41.755229  8907 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:13:41.755671  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
I20260709 12:13:41.782460  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:41.783195  8907 tablet_replica.cc:333] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.783840  8907 raft_consensus.cc:2243] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.784448  8907 raft_consensus.cc:2272] T 763567ac9be747bb89cc3cf976bf818c P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.786471  8907 tablet_replica.cc:333] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.787223  8907 raft_consensus.cc:2243] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.787707  8907 raft_consensus.cc:2272] T e444fbe781a643c1a0b2d221c39ae515 P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.789686  8907 tablet_replica.cc:333] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.790205  8907 raft_consensus.cc:2243] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:13:41.790556  9667 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:13:41.791288  8907 raft_consensus.cc:2272] T 880e783510f144b4a4401560bf7269df P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.793632  8907 tablet_replica.cc:333] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
W20260709 12:13:41.793619  9667 consensus_peers.cc:597] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 -> Peer 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503): Couldn't send request to peer 5193f3489bb7451b9429372b46a5dfac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.794356  8907 raft_consensus.cc:2243] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.794811  8907 raft_consensus.cc:2272] T 9d3b84832ead4530a2412de18d146be7 P 5193f3489bb7451b9429372b46a5dfac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.796521  8907 tablet_replica.cc:333] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.797003  8907 raft_consensus.cc:2243] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.797705  8907 raft_consensus.cc:2272] T 881656bdc4f844ef87291dca92fd8809 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.799425  8907 tablet_replica.cc:333] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.799901  8907 raft_consensus.cc:2243] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.800262  8907 raft_consensus.cc:2272] T ba59a00f645e42738f59f777eab7d807 P 5193f3489bb7451b9429372b46a5dfac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.801867  8907 tablet_replica.cc:333] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.802304  8907 raft_consensus.cc:2243] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.802712  8907 raft_consensus.cc:2272] T a9237adf4f6144e6854899b087584084 P 5193f3489bb7451b9429372b46a5dfac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.804181  8907 tablet_replica.cc:333] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.804628  8907 raft_consensus.cc:2243] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.805352  8907 raft_consensus.cc:2272] T 992fd6452244482ba4c7efbbd5e9188a P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.806942  8907 tablet_replica.cc:333] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.807395  8907 raft_consensus.cc:2243] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.807787  8907 raft_consensus.cc:2272] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 5193f3489bb7451b9429372b46a5dfac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.809378  8907 tablet_replica.cc:333] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac: stopping tablet replica
I20260709 12:13:41.809811  8907 raft_consensus.cc:2243] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.810527  8907 raft_consensus.cc:2272] T a41d04acb275420a9df2f99a3d0f86af P 5193f3489bb7451b9429372b46a5dfac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.839450  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
I20260709 12:13:41.859858  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:13:41.881788  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:41.882481  8907 tablet_replica.cc:333] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.883338  8907 raft_consensus.cc:2243] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.884251  8907 raft_consensus.cc:2272] T 763567ac9be747bb89cc3cf976bf818c P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.886128  8907 tablet_replica.cc:333] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.886649  8907 raft_consensus.cc:2243] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.887127  8907 raft_consensus.cc:2272] T 880e783510f144b4a4401560bf7269df P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.888873  8907 tablet_replica.cc:333] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.889369  8907 raft_consensus.cc:2243] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.890050  8907 raft_consensus.cc:2272] T ba59a00f645e42738f59f777eab7d807 P 6ee898db7b444800a068bb7f94392297 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.891700  8907 tablet_replica.cc:333] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.892158  8907 raft_consensus.cc:2243] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.892547  8907 raft_consensus.cc:2272] T 9d3b84832ead4530a2412de18d146be7 P 6ee898db7b444800a068bb7f94392297 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.894078  8907 tablet_replica.cc:333] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.894544  8907 raft_consensus.cc:2243] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.894879  8907 raft_consensus.cc:2272] T 881656bdc4f844ef87291dca92fd8809 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.896349  8907 tablet_replica.cc:333] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.896768  8907 raft_consensus.cc:2243] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.897109  8907 raft_consensus.cc:2272] T 992fd6452244482ba4c7efbbd5e9188a P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.898666  8907 tablet_replica.cc:333] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.899075  8907 raft_consensus.cc:2243] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.899750  8907 raft_consensus.cc:2272] T a9237adf4f6144e6854899b087584084 P 6ee898db7b444800a068bb7f94392297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.901249  8907 tablet_replica.cc:333] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.901639  8907 raft_consensus.cc:2243] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.901970  8907 raft_consensus.cc:2272] T e444fbe781a643c1a0b2d221c39ae515 P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.903611  8907 tablet_replica.cc:333] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.903996  8907 raft_consensus.cc:2243] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.904389  8907 raft_consensus.cc:2272] T a41d04acb275420a9df2f99a3d0f86af P 6ee898db7b444800a068bb7f94392297 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.906172  8907 tablet_replica.cc:333] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297: stopping tablet replica
I20260709 12:13:41.906615  8907 raft_consensus.cc:2243] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.906980  8907 raft_consensus.cc:2272] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 6ee898db7b444800a068bb7f94392297 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:41.925503  9667 consensus_peers.cc:597] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 -> Peer 5193f3489bb7451b9429372b46a5dfac (127.8.178.193:38503): Couldn't send request to peer 5193f3489bb7451b9429372b46a5dfac. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:41.931735  9665 consensus_peers.cc:597] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 -> Peer 6ee898db7b444800a068bb7f94392297 (127.8.178.194:38885): Couldn't send request to peer 6ee898db7b444800a068bb7f94392297. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:38885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.936236  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
I20260709 12:13:41.956068  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
I20260709 12:13:41.978729  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:41.979349  8907 tablet_replica.cc:333] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.979987  8907 raft_consensus.cc:2243] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.980552  8907 raft_consensus.cc:2272] T 881656bdc4f844ef87291dca92fd8809 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.982350  8907 tablet_replica.cc:333] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.982908  8907 raft_consensus.cc:2243] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.983632  8907 raft_consensus.cc:2272] T 9d3b84832ead4530a2412de18d146be7 P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.985219  8907 tablet_replica.cc:333] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.985680  8907 raft_consensus.cc:2243] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.986366  8907 raft_consensus.cc:2272] T e444fbe781a643c1a0b2d221c39ae515 P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.988145  8907 tablet_replica.cc:333] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.988600  8907 raft_consensus.cc:2243] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.988966  8907 raft_consensus.cc:2272] T 992fd6452244482ba4c7efbbd5e9188a P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.990538  8907 tablet_replica.cc:333] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.990988  8907 raft_consensus.cc:2243] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.991392  8907 raft_consensus.cc:2272] T a9237adf4f6144e6854899b087584084 P 173779f83e2449a88d7f1ac79b06fe40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.992956  8907 tablet_replica.cc:333] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.993420  8907 raft_consensus.cc:2243] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.993804  8907 raft_consensus.cc:2272] T ba59a00f645e42738f59f777eab7d807 P 173779f83e2449a88d7f1ac79b06fe40 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.995455  8907 tablet_replica.cc:333] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.995891  8907 raft_consensus.cc:2243] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.996282  8907 raft_consensus.cc:2272] T a41d04acb275420a9df2f99a3d0f86af P 173779f83e2449a88d7f1ac79b06fe40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.997854  8907 tablet_replica.cc:333] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:41.998337  8907 raft_consensus.cc:2243] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.999312  8907 raft_consensus.cc:2272] T 4c8b264f541b4800b7eea2b4c8a4ecb5 P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:42.001044  8907 tablet_replica.cc:333] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:42.001552  8907 raft_consensus.cc:2243] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:42.001977  8907 raft_consensus.cc:2272] T 763567ac9be747bb89cc3cf976bf818c P 173779f83e2449a88d7f1ac79b06fe40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:42.003670  8907 tablet_replica.cc:333] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40: stopping tablet replica
I20260709 12:13:42.004089  8907 raft_consensus.cc:2243] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:42.004468  8907 raft_consensus.cc:2272] T 880e783510f144b4a4401560bf7269df P 173779f83e2449a88d7f1ac79b06fe40 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:42.032871  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:13:42.051285  8907 master.cc:562] Master@127.8.178.254:43977 shutting down...
I20260709 12:13:42.072551  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:42.073105  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:42.073377  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4156ee518754e2a94f9873be52cd9d9: stopping tablet replica
I20260709 12:13:42.091701  8907 master.cc:584] Master@127.8.178.254:43977 shutdown complete.
173779f83e2449a88d7f1ac79b06fe40  1
5193f3489bb7451b9429372b46a5dfac  5
6ee898db7b444800a068bb7f94392297  4
173779f83e2449a88d7f1ac79b06fe40  3
5193f3489bb7451b9429372b46a5dfac  3
6ee898db7b444800a068bb7f94392297  4
173779f83e2449a88d7f1ac79b06fe40  1
5193f3489bb7451b9429372b46a5dfac  8
6ee898db7b444800a068bb7f94392297  1
173779f83e2449a88d7f1ac79b06fe40  3
5193f3489bb7451b9429372b46a5dfac  4
6ee898db7b444800a068bb7f94392297  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28581 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:13:42.129935  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:37497
I20260709 12:13:42.131045  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:42.136055  9928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.137095  9929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.137282  9931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.137773  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:42.138852  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:42.139042  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:42.139191  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599222139174 us; error 0 us; skew 500 ppm
I20260709 12:13:42.139689  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:42.141981  8907 webserver.cc:533] Webserver started at http://127.8.178.254:37707/ using document root <none> and password file <none>
I20260709 12:13:42.142465  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:42.142642  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:42.142935  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:42.144032  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "f9411c2085cc41508a7b355517791fc1"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.148383  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:42.151467  9936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.152118  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:42.152379  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "f9411c2085cc41508a7b355517791fc1"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.152634  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:42.163959  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:42.165074  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:42.200047  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:37497
I20260709 12:13:42.200139  9987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:37497 every 8 connection(s)
I20260709 12:13:42.203761  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.212900  9988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Bootstrap starting.
I20260709 12:13:42.217183  9988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.221024  9988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: No bootstrap required, opened a new log
I20260709 12:13:42.223101  9988 raft_consensus.cc:359] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER }
I20260709 12:13:42.223510  9988 raft_consensus.cc:385] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:42.223717  9988 raft_consensus.cc:740] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9411c2085cc41508a7b355517791fc1, State: Initialized, Role: FOLLOWER
I20260709 12:13:42.224273  9988 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER }
I20260709 12:13:42.224735  9988 raft_consensus.cc:399] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:42.224934  9988 raft_consensus.cc:493] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:42.225178  9988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:42.229234  9988 raft_consensus.cc:515] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER }
I20260709 12:13:42.229751  9988 leader_election.cc:304] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9411c2085cc41508a7b355517791fc1; no voters: 
I20260709 12:13:42.230799  9988 leader_election.cc:290] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:42.231163  9991 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:42.232333  9991 raft_consensus.cc:697] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 1 LEADER]: Becoming Leader. State: Replica: f9411c2085cc41508a7b355517791fc1, State: Running, Role: LEADER
I20260709 12:13:42.233006  9991 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER }
I20260709 12:13:42.233479  9988 sys_catalog.cc:565] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:42.237617  9993 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9411c2085cc41508a7b355517791fc1. Latest consensus state: current_term: 1 leader_uuid: "f9411c2085cc41508a7b355517791fc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER } }
I20260709 12:13:42.238225  9993 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:42.238463  9992 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9411c2085cc41508a7b355517791fc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9411c2085cc41508a7b355517791fc1" member_type: VOTER } }
I20260709 12:13:42.239101  9992 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:42.240356  9998 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:42.245628  9998 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:42.250911  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:42.254923  9998 catalog_manager.cc:1383] Generated new cluster ID: d9772929459c40a8a1c2604ce70253e9
I20260709 12:13:42.255216  9998 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:42.287472  9998 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:42.288672  9998 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:42.300573  9998 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Generated new TSK 0
I20260709 12:13:42.301141  9998 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:42.318380  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:42.324580 10009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.325455 10010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.328182  8907 server_base.cc:1061] running on GCE node
W20260709 12:13:42.328151 10012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.329195  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:42.329368  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:42.329484  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599222329473 us; error 0 us; skew 500 ppm
I20260709 12:13:42.329928  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:42.331934  8907 webserver.cc:533] Webserver started at http://127.8.178.193:39977/ using document root <none> and password file <none>
I20260709 12:13:42.332358  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:42.332504  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:42.332718  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:42.333663  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.337790  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:13:42.340771 10017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.341467  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:42.341741  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.341991  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:42.353703  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:42.354986  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:42.356356  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:42.358512  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:42.358701  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.358918  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:42.359077  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.395856  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:45801
I20260709 12:13:42.395944 10079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:45801 every 8 connection(s)
I20260709 12:13:42.400511  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:42.407434 10084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.408727 10085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.411449 10087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.412231  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:42.413486  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:42.413697  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:42.413847  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599222413831 us; error 0 us; skew 500 ppm
I20260709 12:13:42.414322  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:42.416805  8907 webserver.cc:533] Webserver started at http://127.8.178.194:36213/ using document root <none> and password file <none>
I20260709 12:13:42.417402  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:42.417635  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:42.417922  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:42.418355 10080 heartbeater.cc:344] Connected to a master server at 127.8.178.254:37497
I20260709 12:13:42.418815 10080 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:42.419344  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "a29bed9eb81541dba9ec7a447986e01e"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.419512 10080 heartbeater.cc:507] Master 127.8.178.254:37497 requested a full tablet report, sending...
I20260709 12:13:42.421530  9953 ts_manager.cc:194] Registered new tserver with Master: 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:13:42.423240  9953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42606
I20260709 12:13:42.424000  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:42.427279 10092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.427999  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:42.428259  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "a29bed9eb81541dba9ec7a447986e01e"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.428521  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:42.441228  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:42.442396  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:42.443868  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:42.445977  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:42.446174  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.446362  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:42.446520  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:13:42.484371  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:34999
I20260709 12:13:42.484467 10154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:34999 every 8 connection(s)
I20260709 12:13:42.488821  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:42.495630 10158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:42.496803 10159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.500068  8907 server_base.cc:1061] running on GCE node
W20260709 12:13:42.500597 10161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:42.501121 10155 heartbeater.cc:344] Connected to a master server at 127.8.178.254:37497
I20260709 12:13:42.501508 10155 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:42.501660  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:42.501907  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:42.502101  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599222502081 us; error 0 us; skew 500 ppm
I20260709 12:13:42.502391 10155 heartbeater.cc:507] Master 127.8.178.254:37497 requested a full tablet report, sending...
I20260709 12:13:42.502894  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:42.504619  9953 ts_manager.cc:194] Registered new tserver with Master: a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:42.505407  8907 webserver.cc:533] Webserver started at http://127.8.178.195:43943/ using document root <none> and password file <none>
I20260709 12:13:42.505913  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:42.506110  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:42.506042  9953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42612
I20260709 12:13:42.506518  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:42.507790  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.512094  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:13:42.515311 10166 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.516022  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:42.516302  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
format_stamp: "Formatted at 2026-07-09 12:13:42 on dist-test-slave-jlx4"
I20260709 12:13:42.516580  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:42.536906  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:42.538115  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:42.539614  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:42.541797  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:42.541993  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.542209  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:42.542363  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:42.580770  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:33595
I20260709 12:13:42.580862 10228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:33595 every 8 connection(s)
I20260709 12:13:42.593894 10229 heartbeater.cc:344] Connected to a master server at 127.8.178.254:37497
I20260709 12:13:42.594266 10229 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:42.594945 10229 heartbeater.cc:507] Master 127.8.178.254:37497 requested a full tablet report, sending...
I20260709 12:13:42.596712  9953 ts_manager.cc:194] Registered new tserver with Master: 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:42.597783  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013963493s
I20260709 12:13:42.598120  9953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42618
I20260709 12:13:42.621979  9953 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42620:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:42.627911  9953 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:42.812850 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 4e741e9b5dcb4305b7be8692e35b1441 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.814246 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e741e9b5dcb4305b7be8692e35b1441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.817554 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 4e741e9b5dcb4305b7be8692e35b1441 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.818997 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.820320 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.820180 10044 tablet_service.cc:1511] Processing CreateTablet for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.822121 10040 tablet_service.cc:1511] Processing CreateTablet for tablet 01ee41f44fe24909bc0f087cbbc6213e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.823455 10042 tablet_service.cc:1511] Processing CreateTablet for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.825537 10191 tablet_service.cc:1511] Processing CreateTablet for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.822288 10041 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0b2763b8154a7392dcbe6c6acfec0c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.822278 10043 tablet_service.cc:1511] Processing CreateTablet for tablet eb4fb909f689401989cfc1a22c46c6cd (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.826859 10191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.828125 10192 tablet_service.cc:1511] Processing CreateTablet for tablet eb4fb909f689401989cfc1a22c46c6cd (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.829381 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4fb909f689401989cfc1a22c46c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.831905 10190 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0b2763b8154a7392dcbe6c6acfec0c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.833182 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0b2763b8154a7392dcbe6c6acfec0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.818953 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e741e9b5dcb4305b7be8692e35b1441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.835634 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 4e741e9b5dcb4305b7be8692e35b1441 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:42.836757 10042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.836879 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e741e9b5dcb4305b7be8692e35b1441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.839587 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 01ee41f44fe24909bc0f087cbbc6213e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.840910 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee41f44fe24909bc0f087cbbc6213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.842867 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0b2763b8154a7392dcbe6c6acfec0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.843621 10119 tablet_service.cc:1511] Processing CreateTablet for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:42.844261 10044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.844885 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.846753 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4fb909f689401989cfc1a22c46c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.846894 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 77943463ebc54e5183b2d6477b6de047 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.848096 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77943463ebc54e5183b2d6477b6de047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.849964 10118 tablet_service.cc:1511] Processing CreateTablet for tablet eb4fb909f689401989cfc1a22c46c6cd (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:42.852097 10187 tablet_service.cc:1511] Processing CreateTablet for tablet f0eadcb623c84a7daa48999c60decbe2 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:42.853302 10187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eadcb623c84a7daa48999c60decbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.855507 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:42.857550 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 6d0b2763b8154a7392dcbe6c6acfec0c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:42.859714 10186 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6facad3f04ffd8eb02fda673b5455 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.860980 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6facad3f04ffd8eb02fda673b5455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.863581 10185 tablet_service.cc:1511] Processing CreateTablet for tablet e42a5811b7f7484186df2c558a4f6769 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.864810 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a5811b7f7484186df2c558a4f6769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.867697 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 77943463ebc54e5183b2d6477b6de047 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.868920 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77943463ebc54e5183b2d6477b6de047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.873142 10038 tablet_service.cc:1511] Processing CreateTablet for tablet f0eadcb623c84a7daa48999c60decbe2 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:42.875645 10114 tablet_service.cc:1511] Processing CreateTablet for tablet 77943463ebc54e5183b2d6477b6de047 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:42.878296 10113 tablet_service.cc:1511] Processing CreateTablet for tablet f0eadcb623c84a7daa48999c60decbe2 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:42.880534 10036 tablet_service.cc:1511] Processing CreateTablet for tablet e42a5811b7f7484186df2c558a4f6769 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.882702 10111 tablet_service.cc:1511] Processing CreateTablet for tablet e42a5811b7f7484186df2c558a4f6769 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:42.885860 10037 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6facad3f04ffd8eb02fda673b5455 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.885860 10112 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed6facad3f04ffd8eb02fda673b5455 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:42.871587 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 01ee41f44fe24909bc0f087cbbc6213e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:42.890359 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eadcb623c84a7daa48999c60decbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.891045 10040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee41f44fe24909bc0f087cbbc6213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.891642 10036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a5811b7f7484186df2c558a4f6769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.892237 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6facad3f04ffd8eb02fda673b5455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.892689 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4fb909f689401989cfc1a22c46c6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.893313 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.894337 10112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed6facad3f04ffd8eb02fda673b5455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.898214 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0b2763b8154a7392dcbe6c6acfec0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.901908 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee41f44fe24909bc0f087cbbc6213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.904242 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42a5811b7f7484186df2c558a4f6769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.906771 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eadcb623c84a7daa48999c60decbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.910827 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77943463ebc54e5183b2d6477b6de047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.957365 10045 tablet_service.cc:1511] Processing CreateTablet for tablet bc69f8e7f4804e73bc970c103ca90e60 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:42.959301 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc69f8e7f4804e73bc970c103ca90e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.963238 10038 tablet_service.cc:1511] Processing CreateTablet for tablet 03649ca7b822435188aa9ef044bc52b0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:42.964540 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03649ca7b822435188aa9ef044bc52b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.973534 10041 tablet_service.cc:1511] Processing CreateTablet for tablet eb932976ca8b44ffb6eab1f93c14a4bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:42.973788 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e50f262594b84bcbdf34c6b162436 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:42.959237 10244 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:42.994302 10185 tablet_service.cc:1511] Processing CreateTablet for tablet bc69f8e7f4804e73bc970c103ca90e60 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:42.997298 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc69f8e7f4804e73bc970c103ca90e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.995954 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e50f262594b84bcbdf34c6b162436 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:42.997066 10120 tablet_service.cc:1511] Processing CreateTablet for tablet bc69f8e7f4804e73bc970c103ca90e60 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:43.005019 10245 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:43.007651 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e50f262594b84bcbdf34c6b162436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.009696 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad3dc473b284687afcc907cd7aea9ea (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:43.009886 10191 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebc329a9274f3595e703104efa64c0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:43.011053 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad3dc473b284687afcc907cd7aea9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.012349 10191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebc329a9274f3595e703104efa64c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.016315 10192 tablet_service.cc:1511] Processing CreateTablet for tablet 76e7629206124e6390a9baab062635eb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:43.017056 10244 tablet_bootstrap.cc:654] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.017609 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e7629206124e6390a9baab062635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.021567 10247 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:42.994302 10190 tablet_service.cc:1511] Processing CreateTablet for tablet 03649ca7b822435188aa9ef044bc52b0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:43.048050 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb932976ca8b44ffb6eab1f93c14a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.048985 10042 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad3dc473b284687afcc907cd7aea9ea (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:43.019692 10188 tablet_service.cc:1511] Processing CreateTablet for tablet eb932976ca8b44ffb6eab1f93c14a4bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:43.071599 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc69f8e7f4804e73bc970c103ca90e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.083073 10187 tablet_service.cc:1511] Processing CreateTablet for tablet 35b1b33f7d314aa08131a968c515f3c6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:43.094161 10038 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebc329a9274f3595e703104efa64c0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:43.094164 10044 tablet_service.cc:1511] Processing CreateTablet for tablet 76e7629206124e6390a9baab062635eb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:43.094830 10042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad3dc473b284687afcc907cd7aea9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.062094 10114 tablet_service.cc:1511] Processing CreateTablet for tablet 03649ca7b822435188aa9ef044bc52b0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:43.098793 10043 tablet_service.cc:1511] Processing CreateTablet for tablet 35b1b33f7d314aa08131a968c515f3c6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:43.099215 10044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e7629206124e6390a9baab062635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.099623 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03649ca7b822435188aa9ef044bc52b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.100247 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebc329a9274f3595e703104efa64c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.101086 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad3dc473b284687afcc907cd7aea9ea (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:43.102281 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad3dc473b284687afcc907cd7aea9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.105543 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e50f262594b84bcbdf34c6b162436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.078281 10118 tablet_service.cc:1511] Processing CreateTablet for tablet eb932976ca8b44ffb6eab1f93c14a4bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:43.048986 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03649ca7b822435188aa9ef044bc52b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.110945 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb932976ca8b44ffb6eab1f93c14a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.112231 10112 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebc329a9274f3595e703104efa64c0 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:43.116218 10187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b1b33f7d314aa08131a968c515f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.117913 10245 tablet_bootstrap.cc:654] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.123499 10039 tablet_service.cc:1511] Processing CreateTablet for tablet a0518529c52b4f2ca715288c1fcccbaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:43.124327 10189 tablet_service.cc:1511] Processing CreateTablet for tablet a0518529c52b4f2ca715288c1fcccbaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:43.124775 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb932976ca8b44ffb6eab1f93c14a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.126004 10112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebc329a9274f3595e703104efa64c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.128527 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 76e7629206124e6390a9baab062635eb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:43.129849 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e7629206124e6390a9baab062635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.135087 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e50f262594b84bcbdf34c6b162436 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:43.140712 10247 tablet_bootstrap.cc:654] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.157795 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e50f262594b84bcbdf34c6b162436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.142179 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 35b1b33f7d314aa08131a968c515f3c6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:43.162065 10186 tablet_service.cc:1511] Processing CreateTablet for tablet 29ce21faad84430d93ec2445ba64030b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:43.163350 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b1b33f7d314aa08131a968c515f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.163892  9939 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44828.3us
I20260709 12:13:43.168602 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b1b33f7d314aa08131a968c515f3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.170678 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0518529c52b4f2ca715288c1fcccbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.144598 10120 tablet_service.cc:1511] Processing CreateTablet for tablet a0518529c52b4f2ca715288c1fcccbaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:43.171639 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0518529c52b4f2ca715288c1fcccbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.154922 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0518529c52b4f2ca715288c1fcccbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.175287 10244 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:43.175961 10244 ts_tablet_manager.cc:1403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.217s	user 0.006s	sys 0.008s
I20260709 12:13:43.181712 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ce21faad84430d93ec2445ba64030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.198925 10192 tablet_service.cc:1511] Processing CreateTablet for tablet ea142dcb28a347418ddf5a7c14fc8885 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:43.200709 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 29ce21faad84430d93ec2445ba64030b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:43.201905 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ce21faad84430d93ec2445ba64030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.201148 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea142dcb28a347418ddf5a7c14fc8885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.212194 10037 tablet_service.cc:1511] Processing CreateTablet for tablet 29ce21faad84430d93ec2445ba64030b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:43.213436 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ce21faad84430d93ec2445ba64030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.215920 10115 tablet_service.cc:1511] Processing CreateTablet for tablet ea142dcb28a347418ddf5a7c14fc8885 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:43.216043 10041 tablet_service.cc:1511] Processing CreateTablet for tablet 3496631dbf3b49519fbc5604f6834f3e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:43.217165 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea142dcb28a347418ddf5a7c14fc8885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.217338 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3496631dbf3b49519fbc5604f6834f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.220345 10045 tablet_service.cc:1511] Processing CreateTablet for tablet ea142dcb28a347418ddf5a7c14fc8885 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:43.224152 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea142dcb28a347418ddf5a7c14fc8885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.235972 10118 tablet_service.cc:1511] Processing CreateTablet for tablet 3496631dbf3b49519fbc5604f6834f3e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:43.237200 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3496631dbf3b49519fbc5604f6834f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.239929 10244 raft_consensus.cc:359] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.241019 10244 raft_consensus.cc:385] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.241322 10244 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.242244 10244 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.245627 10247 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:43.246145 10247 ts_tablet_manager.cc:1403] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.225s	user 0.000s	sys 0.020s
W20260709 12:13:43.248342 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:43.248906 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 3496631dbf3b49519fbc5604f6834f3e (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:43.258895 10038 tablet_service.cc:1511] Processing CreateTablet for tablet 6596abeb975142149ebfb7b9d1b7d100 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:43.259155 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 6596abeb975142149ebfb7b9d1b7d100 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:43.260170 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596abeb975142149ebfb7b9d1b7d100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.260380 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596abeb975142149ebfb7b9d1b7d100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.264869 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3496631dbf3b49519fbc5604f6834f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.265506 10192 tablet_service.cc:1511] Processing CreateTablet for tablet 6596abeb975142149ebfb7b9d1b7d100 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:43.266346 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 3687623d905944cb972fbfff21e2d729 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:43.266795 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596abeb975142149ebfb7b9d1b7d100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.267619 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3687623d905944cb972fbfff21e2d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.289155 10245 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:43.290257 10245 ts_tablet_manager.cc:1403] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.286s	user 0.003s	sys 0.020s
I20260709 12:13:43.293462 10245 raft_consensus.cc:359] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.295133 10245 raft_consensus.cc:385] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.295508 10245 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.296469 10245 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.296864 10247 raft_consensus.cc:359] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.297580 10247 raft_consensus.cc:385] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.297873 10247 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.298633 10247 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.298764 10192 tablet_service.cc:1511] Processing CreateTablet for tablet 3687623d905944cb972fbfff21e2d729 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:43.300058 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3687623d905944cb972fbfff21e2d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.304390 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaadb6c64c344b186ed9c3e3630b660 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:43.305603 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaadb6c64c344b186ed9c3e3630b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.305424 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaadb6c64c344b186ed9c3e3630b660 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:43.308780 10229 heartbeater.cc:499] Master 127.8.178.254:37497 was elected leader, sending a full tablet report...
I20260709 12:13:43.309243 10245 ts_tablet_manager.cc:1434] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:13:43.311404 10245 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:43.315464 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaadb6c64c344b186ed9c3e3630b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.316996 10247 ts_tablet_manager.cc:1434] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 12:13:43.326900 10080 heartbeater.cc:499] Master 127.8.178.254:37497 was elected leader, sending a full tablet report...
I20260709 12:13:43.327121 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 4aaadb6c64c344b186ed9c3e3630b660 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:43.328545 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaadb6c64c344b186ed9c3e3630b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.330996 10155 heartbeater.cc:499] Master 127.8.178.254:37497 was elected leader, sending a full tablet report...
W20260709 12:13:43.335258 10230 tablet.cc:2406] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:43.335186 10244 ts_tablet_manager.cc:1434] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.159s	user 0.012s	sys 0.006s
I20260709 12:13:43.336588 10244 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:43.343890 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 95fdf558c4914764bc33fc57324bdaf5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:43.345119 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95fdf558c4914764bc33fc57324bdaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.355787 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 95fdf558c4914764bc33fc57324bdaf5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:43.356407 10037 tablet_service.cc:1511] Processing CreateTablet for tablet f08623f87ec8442c961120bdd44e9b08 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:43.357071 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95fdf558c4914764bc33fc57324bdaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.357576 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08623f87ec8442c961120bdd44e9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.324626 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 3687623d905944cb972fbfff21e2d729 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:43.358927 10114 tablet_service.cc:1511] Processing CreateTablet for tablet f08623f87ec8442c961120bdd44e9b08 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:43.359475 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3687623d905944cb972fbfff21e2d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.360106 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08623f87ec8442c961120bdd44e9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.360704 10254 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.361224 10254 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.366686 10254 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:43.370707 10043 tablet_service.cc:1511] Processing CreateTablet for tablet 95fdf558c4914764bc33fc57324bdaf5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:43.372114 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95fdf558c4914764bc33fc57324bdaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.385262 10188 tablet_service.cc:1511] Processing CreateTablet for tablet f08623f87ec8442c961120bdd44e9b08 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:43.386766 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08623f87ec8442c961120bdd44e9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.395046 10247 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:43.405100 10037 tablet_service.cc:1511] Processing CreateTablet for tablet a7109c20f60c433bbfea17052252d2e4 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:43.406459 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7109c20f60c433bbfea17052252d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.412521 10244 tablet_bootstrap.cc:654] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.419440 10245 tablet_bootstrap.cc:654] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.424929 10244 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:43.427737 10192 tablet_service.cc:1511] Processing CreateTablet for tablet a7109c20f60c433bbfea17052252d2e4 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:43.429286 10043 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff855a4bf854fbd9207ae909021d6bf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:43.430269 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7109c20f60c433bbfea17052252d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.430500 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff855a4bf854fbd9207ae909021d6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.438690 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:43.439402 10247 tablet_bootstrap.cc:654] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:43.440579 10095 leader_election.cc:343] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.434919 10244 ts_tablet_manager.cc:1403] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.099s	user 0.002s	sys 0.011s
I20260709 12:13:43.446306 10045 tablet_service.cc:1511] Processing CreateTablet for tablet aedf82824d3c4883ad33ed154a6a08a1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:43.447552 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedf82824d3c4883ad33ed154a6a08a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.448734 10244 raft_consensus.cc:359] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.463775 10244 raft_consensus.cc:385] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.448819 10245 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:43.465874 10244 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.458561 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff855a4bf854fbd9207ae909021d6bf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:43.471251 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff855a4bf854fbd9207ae909021d6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.471076 10244 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.472404 10041 tablet_service.cc:1511] Processing CreateTablet for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:43.472496 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:43.473778 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.473950 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.474900 10251 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.475353 10251 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.461455 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 51714cf4d10d45a685fc2c669f03df9c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:43.477566 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51714cf4d10d45a685fc2c669f03df9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.459220 10113 tablet_service.cc:1511] Processing CreateTablet for tablet aedf82824d3c4883ad33ed154a6a08a1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:43.481739 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedf82824d3c4883ad33ed154a6a08a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.460036 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7a23860d1449c94c3bf85f8dee617 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:43.483157 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7a23860d1449c94c3bf85f8dee617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.461452 10114 tablet_service.cc:1511] Processing CreateTablet for tablet a7109c20f60c433bbfea17052252d2e4 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:43.464253 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:43.450232 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7a23860d1449c94c3bf85f8dee617 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:43.487164 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7109c20f60c433bbfea17052252d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.487888 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7a23860d1449c94c3bf85f8dee617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.465176 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff855a4bf854fbd9207ae909021d6bf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:43.465667 10186 tablet_service.cc:1511] Processing CreateTablet for tablet 51714cf4d10d45a685fc2c669f03df9c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:43.466372 10245 ts_tablet_manager.cc:1403] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.000s
I20260709 12:13:43.457542 10185 tablet_service.cc:1511] Processing CreateTablet for tablet aedf82824d3c4883ad33ed154a6a08a1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:43.468317 10038 tablet_service.cc:1511] Processing CreateTablet for tablet f85bc37908cc412eb5ffe5d0318140ee (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:43.469972 10247 tablet_bootstrap.cc:492] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:43.469790 10190 tablet_service.cc:1511] Processing CreateTablet for tablet f85bc37908cc412eb5ffe5d0318140ee (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:43.501657 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85bc37908cc412eb5ffe5d0318140ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.494761 10251 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:43.503115 10247 ts_tablet_manager.cc:1403] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 12:13:43.503427 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedf82824d3c4883ad33ed154a6a08a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.503717 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85bc37908cc412eb5ffe5d0318140ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.505332 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51714cf4d10d45a685fc2c669f03df9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.506237 10247 raft_consensus.cc:359] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.507037 10247 raft_consensus.cc:385] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.507332 10247 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.512959 10245 raft_consensus.cc:359] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.513716 10245 raft_consensus.cc:385] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.514012 10245 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.517851 10247 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.523666 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff855a4bf854fbd9207ae909021d6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.529932 10247 ts_tablet_manager.cc:1434] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:43.531069 10247 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:43.553108 10042 tablet_service.cc:1511] Processing CreateTablet for tablet 56431c97132141908463e11690f7ba09 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:43.555197 10042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56431c97132141908463e11690f7ba09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.555253 10044 tablet_service.cc:1511] Processing CreateTablet for tablet add21891a8334a65adf1e2611b794222 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:43.556056 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 56431c97132141908463e11690f7ba09 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:43.556561 10044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add21891a8334a65adf1e2611b794222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.557240 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56431c97132141908463e11690f7ba09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.557817 10252 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.558270 10252 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.560905 10252 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:43.566586 10244 ts_tablet_manager.cc:1434] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 12:13:43.571306 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:13:43.572141 10094 leader_election.cc:343] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.571977 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 56431c97132141908463e11690f7ba09 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:43.572482 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.572577 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:43.573130 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56431c97132141908463e11690f7ba09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.572821 10120 tablet_service.cc:1511] Processing CreateTablet for tablet f85bc37908cc412eb5ffe5d0318140ee (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:43.587719 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85bc37908cc412eb5ffe5d0318140ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.573575 10247 tablet_bootstrap.cc:654] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.574215 10111 tablet_service.cc:1511] Processing CreateTablet for tablet add21891a8334a65adf1e2611b794222 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:43.588807 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add21891a8334a65adf1e2611b794222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.594798 10253 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.567971 10245 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.596632 10244 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:43.597054 10245 ts_tablet_manager.cc:1434] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 12:13:43.598031 10245 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:43.603343 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 51714cf4d10d45a685fc2c669f03df9c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:43.582944 10037 tablet_service.cc:1511] Processing CreateTablet for tablet 64c7a23860d1449c94c3bf85f8dee617 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:43.612596 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:43.614526 10019 leader_election.cc:343] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.615057 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7a23860d1449c94c3bf85f8dee617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.627354 10194 tablet_service.cc:1511] Processing CreateTablet for tablet add21891a8334a65adf1e2611b794222 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:43.630743 10244 tablet_bootstrap.cc:654] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.642938 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add21891a8334a65adf1e2611b794222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.646749 10253 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.647208 10253 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.650139 10245 tablet_bootstrap.cc:654] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.650032 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:43.650693 10055 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:43.652920 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:43.653719 10254 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.657188 10254 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.657534 10254 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.658700 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51714cf4d10d45a685fc2c669f03df9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.660552 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:43.662101 10020 leader_election.cc:343] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.662559 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:43.663740 10262 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.666913 10253 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:43.667933 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:43.668570 10204 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:43.691672 10254 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.692142 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc6e523dd94755bf6815dd2f89cd0a (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:43.708237 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc6e523dd94755bf6815dd2f89cd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.714665 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc6e523dd94755bf6815dd2f89cd0a (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:43.716035 10247 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:43.716193 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc6e523dd94755bf6815dd2f89cd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.722908 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:43.723644 10055 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.730615 10247 ts_tablet_manager.cc:1403] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.011s
I20260709 12:13:43.745049 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:43.745669 10204 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.753787 10055 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:43.760708 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:43.761543 10253 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.762777 10244 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:43.763336 10244 ts_tablet_manager.cc:1403] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.167s	user 0.040s	sys 0.048s
I20260709 12:13:43.766319 10244 raft_consensus.cc:359] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.768497 10244 raft_consensus.cc:385] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.768847 10244 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.747359 10254 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:43.769606 10244 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.772115 10253 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:43.774348 10253 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:13:43.775143 10244 ts_tablet_manager.cc:1434] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:43.776203 10244 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:43.778942 10262 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.779444 10262 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.781646 10262 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:43.782406 10244 tablet_bootstrap.cc:654] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.781792 10247 raft_consensus.cc:359] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.782878 10247 raft_consensus.cc:385] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.785212 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:43.787091 10245 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:43.787634 10245 ts_tablet_manager.cc:1403] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.190s	user 0.005s	sys 0.011s
I20260709 12:13:43.786904 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:43.760099 10204 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:43.783245 10247 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
W20260709 12:13:43.787925 10019 leader_election.cc:343] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:43.772115  9938 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63148us
W20260709 12:13:43.795418 10020 leader_election.cc:343] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.797866 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:43.798681 10262 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.799125 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:43.801108 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb0ac432438495091e62290dd19b812 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:13:43.802192 10169 leader_election.cc:343] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.802392 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb0ac432438495091e62290dd19b812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.805389 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb0ac432438495091e62290dd19b812 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:43.806644 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb0ac432438495091e62290dd19b812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.811431 10037 tablet_service.cc:1511] Processing CreateTablet for tablet 27f26165888546baaae16d413e9601c5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:43.812206 10120 tablet_service.cc:1511] Processing CreateTablet for tablet 27f26165888546baaae16d413e9601c5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:43.813378 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f26165888546baaae16d413e9601c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.816090 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 12bc6e523dd94755bf6815dd2f89cd0a (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:43.816744 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb0ac432438495091e62290dd19b812 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:43.817237 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc6e523dd94755bf6815dd2f89cd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.812592 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f26165888546baaae16d413e9601c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.817883 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb0ac432438495091e62290dd19b812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.823720 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 03425333a9b0484fbf7c273e6499e2cf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.824077 10186 tablet_service.cc:1511] Processing CreateTablet for tablet 27f26165888546baaae16d413e9601c5 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:43.824934 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03425333a9b0484fbf7c273e6499e2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.824577  9951 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.795420 10245 raft_consensus.cc:359] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.827350 10245 raft_consensus.cc:385] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.827651 10245 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.828522 10245 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.830035 10117 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7d9d50250941bf80c7399e949d802c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.831198 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7d9d50250941bf80c7399e949d802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.834993 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 03425333a9b0484fbf7c273e6499e2cf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.835034 10114 tablet_service.cc:1511] Processing CreateTablet for tablet 03eb59a6c9c6418299ed25e8330b2cef (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.835367 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 03425333a9b0484fbf7c273e6499e2cf (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:43.798485 10247 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.836410 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03425333a9b0484fbf7c273e6499e2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.836342 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eb59a6c9c6418299ed25e8330b2cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.837845 10247 ts_tablet_manager.cc:1434] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.000s
I20260709 12:13:43.838768 10247 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:43.839397 10042 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7d9d50250941bf80c7399e949d802c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.840577 10042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7d9d50250941bf80c7399e949d802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.843441 10044 tablet_service.cc:1511] Processing CreateTablet for tablet 03eb59a6c9c6418299ed25e8330b2cef (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.846283 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f26165888546baaae16d413e9601c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.846923 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03425333a9b0484fbf7c273e6499e2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.846967 10044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eb59a6c9c6418299ed25e8330b2cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.850347 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:43.850960 10130 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:43.851851 10038 tablet_service.cc:1511] Processing CreateTablet for tablet c49badfb58494d79890f98353e487b55 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.852984 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49badfb58494d79890f98353e487b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.855293 10189 tablet_service.cc:1511] Processing CreateTablet for tablet c49badfb58494d79890f98353e487b55 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.856487 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49badfb58494d79890f98353e487b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.827675 10116 tablet_service.cc:1511] Processing CreateTablet for tablet c49badfb58494d79890f98353e487b55 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:43.859406 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49badfb58494d79890f98353e487b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.862084 10043 tablet_service.cc:1511] Processing CreateTablet for tablet efb9d4efacd143a6bbb65eb25d52093d (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.863248 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb9d4efacd143a6bbb65eb25d52093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.864979 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:43.866086 10252 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.866456 10252 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.866777 10252 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.867194 10244 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:43.867642 10244 ts_tablet_manager.cc:1403] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.004s
I20260709 12:13:43.871976 10244 raft_consensus.cc:359] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.872769 10244 raft_consensus.cc:385] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.873126 10244 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.873406 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 370d155a067d4428a676aa10078366b8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.881011 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370d155a067d4428a676aa10078366b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.883631 10041 tablet_service.cc:1511] Processing CreateTablet for tablet e0075e506a7e41288c8c852a9911174c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.884531 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0075e506a7e41288c8c852a9911174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.873672 10252 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.875041 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 370d155a067d4428a676aa10078366b8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.875931 10247 tablet_bootstrap.cc:654] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.892392 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:43.892957 10130 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.892661 10244 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.876431 10120 tablet_service.cc:1511] Processing CreateTablet for tablet efb9d4efacd143a6bbb65eb25d52093d (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.891239 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:43.891829 10252 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:43.891635 10190 tablet_service.cc:1511] Processing CreateTablet for tablet 370d155a067d4428a676aa10078366b8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:43.897784 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370d155a067d4428a676aa10078366b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.904635 10130 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:43.905781 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 03eb59a6c9c6418299ed25e8330b2cef (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:43.907121 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eb59a6c9c6418299ed25e8330b2cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.895545 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb9d4efacd143a6bbb65eb25d52093d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:43.896798 10169 leader_election.cc:343] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.908208 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:43.908990 10252 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.905867 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370d155a067d4428a676aa10078366b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.922911 10244 ts_tablet_manager.cc:1434] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:13:43.896870 10245 ts_tablet_manager.cc:1434] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.109s	user 0.000s	sys 0.006s
I20260709 12:13:43.927652 10194 tablet_service.cc:1511] Processing CreateTablet for tablet efb9d4efacd143a6bbb65eb25d52093d (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:43.935428 10245 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:43.941262 10245 tablet_bootstrap.cc:654] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.944092 10252 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:43.945159 10252 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.948099 10111 tablet_service.cc:1511] Processing CreateTablet for tablet e0075e506a7e41288c8c852a9911174c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.949335 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0075e506a7e41288c8c852a9911174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.964563 10188 tablet_service.cc:1511] Processing CreateTablet for tablet e0075e506a7e41288c8c852a9911174c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:43.966801 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7d9d50250941bf80c7399e949d802c (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:43.967972 10244 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:43.958549 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb9d4efacd143a6bbb65eb25d52093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.983330 10275 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.983861 10275 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.985924 10275 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:43.985641 10192 tablet_service.cc:1511] Processing CreateTablet for tablet acc41bbfb3c94637814837eb2cfad80f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:43.987174 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:43.987825 10130 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:43.989012 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:13:43.990658 10169 leader_election.cc:343] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.990499 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 505b084a723d46f28d06230c6bb0c5bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:43.991364 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:43.991963 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505b084a723d46f28d06230c6bb0c5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:43.992395 10275 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.992731 10275 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.992967 10275 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.999193 10275 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:43.999405 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 505b084a723d46f28d06230c6bb0c5bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:44.001578 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505b084a723d46f28d06230c6bb0c5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.001894 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:43.995359 10117 tablet_service.cc:1511] Processing CreateTablet for tablet acc41bbfb3c94637814837eb2cfad80f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:44.002594 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7d9d50250941bf80c7399e949d802c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:44.003394 10169 leader_election.cc:343] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.006958 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc41bbfb3c94637814837eb2cfad80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.009435 10193 tablet_service.cc:1511] Processing CreateTablet for tablet 505b084a723d46f28d06230c6bb0c5bb (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:44.015447 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc41bbfb3c94637814837eb2cfad80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.026021 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:44.026675 10130 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.027509 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505b084a723d46f28d06230c6bb0c5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.028800 10186 tablet_service.cc:1511] Processing CreateTablet for tablet 47e2925796cf4be4ab9f040c07bf6dd8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:44.031744 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e2925796cf4be4ab9f040c07bf6dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.032820 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0075e506a7e41288c8c852a9911174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.033456 10130 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:44.036329 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:44.037081 10278 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.036826 10038 tablet_service.cc:1511] Processing CreateTablet for tablet 98ca581ce0e64e44a04efbd2710adbf8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:44.040601 10045 tablet_service.cc:1511] Processing CreateTablet for tablet acc41bbfb3c94637814837eb2cfad80f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:44.038092 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ca581ce0e64e44a04efbd2710adbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.038407 10275 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.047490 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 47e2925796cf4be4ab9f040c07bf6dd8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:44.048818 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e2925796cf4be4ab9f040c07bf6dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.049249 10244 tablet_bootstrap.cc:654] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.037999 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 98ca581ce0e64e44a04efbd2710adbf8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:44.051432 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ca581ce0e64e44a04efbd2710adbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.056334 10043 tablet_service.cc:1511] Processing CreateTablet for tablet 9c14882e1876454ba455dbe6212f6ab6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:44.056785 10247 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.057618 10278 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:44.060976 10041 tablet_service.cc:1511] Processing CreateTablet for tablet 47e2925796cf4be4ab9f040c07bf6dd8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:44.064150 10247 ts_tablet_manager.cc:1403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.226s	user 0.019s	sys 0.002s
I20260709 12:13:44.066650 10247 raft_consensus.cc:359] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.067323 10247 raft_consensus.cc:385] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.067588 10247 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.068409 10245 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:44.068343 10247 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.068893 10245 ts_tablet_manager.cc:1403] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.034s
I20260709 12:13:44.070649 10247 ts_tablet_manager.cc:1434] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:44.060868 10278 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.072261 10247 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.077805 10245 raft_consensus.cc:359] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.078545 10245 raft_consensus.cc:385] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.078845 10245 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.079531 10245 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.079600 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 9c14882e1876454ba455dbe6212f6ab6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:44.081708 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c14882e1876454ba455dbe6212f6ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.081738 10245 ts_tablet_manager.cc:1434] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:13:44.082500 10114 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f71cfc2d1484aa7a37c6943e8196f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:44.083727 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f71cfc2d1484aa7a37c6943e8196f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.085115 10042 tablet_service.cc:1511] Processing CreateTablet for tablet a6031fe457e54869a9b512abf1d54183 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:44.089282 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f71cfc2d1484aa7a37c6943e8196f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:44.092345 10245 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.092480 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f71cfc2d1484aa7a37c6943e8196f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.092869 10042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6031fe457e54869a9b512abf1d54183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.102277 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c14882e1876454ba455dbe6212f6ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.086009 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f71cfc2d1484aa7a37c6943e8196f (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:44.104283 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f71cfc2d1484aa7a37c6943e8196f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.105458 10117 tablet_service.cc:1511] Processing CreateTablet for tablet a6031fe457e54869a9b512abf1d54183 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:44.106719 10117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6031fe457e54869a9b512abf1d54183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.107699 10041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e2925796cf4be4ab9f040c07bf6dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.109771 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 9c14882e1876454ba455dbe6212f6ab6 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:44.110952 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c14882e1876454ba455dbe6212f6ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.114840 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc41bbfb3c94637814837eb2cfad80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.097908 10247 tablet_bootstrap.cc:654] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.135161 10190 tablet_service.cc:1511] Processing CreateTablet for tablet 98ca581ce0e64e44a04efbd2710adbf8 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:44.165071 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ca581ce0e64e44a04efbd2710adbf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.166615 10045 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:44.169747 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ec4c2ee75449d8ab4f971e9de7e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.170281 10111 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:44.172039 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ec4c2ee75449d8ab4f971e9de7e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.173161 10188 tablet_service.cc:1511] Processing CreateTablet for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:44.174376 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ec4c2ee75449d8ab4f971e9de7e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.161775 10245 tablet_bootstrap.cc:654] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.184860 10244 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.185382 10244 ts_tablet_manager.cc:1403] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.228s	user 0.032s	sys 0.043s
I20260709 12:13:44.190482 10193 tablet_service.cc:1511] Processing CreateTablet for tablet a6031fe457e54869a9b512abf1d54183 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:44.192270 10193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6031fe457e54869a9b512abf1d54183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.194763 10278 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.195284 10278 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.197419 10278 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.199707 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.200357 10055 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:44.201308 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.203060 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:13:44.203896 10169 leader_election.cc:343] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.206929 10039 tablet_service.cc:1511] Processing CreateTablet for tablet 48f4645742c44585a93863b12f58ba75 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:44.207947 10044 tablet_service.cc:1511] Processing CreateTablet for tablet 2e133f56c04b492fbfac52f65ed6fe2b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:44.194689 10244 raft_consensus.cc:359] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.208982 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f4645742c44585a93863b12f58ba75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.209120 10278 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.209519 10278 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.209838 10278 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.211889 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 48f4645742c44585a93863b12f58ba75 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:44.215595 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f4645742c44585a93863b12f58ba75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.215137 10190 tablet_service.cc:1511] Processing CreateTablet for tablet 2e133f56c04b492fbfac52f65ed6fe2b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:44.218904 10044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e133f56c04b492fbfac52f65ed6fe2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.228456 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e133f56c04b492fbfac52f65ed6fe2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.221289 10116 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6c24fd7e14d1b8d5545bce723ad27 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:44.220222 10194 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6c24fd7e14d1b8d5545bce723ad27 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:44.224023 10045 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6c24fd7e14d1b8d5545bce723ad27 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:44.224980 10037 tablet_service.cc:1511] Processing CreateTablet for tablet 567b4adc73ba4d2ea946e154ebd94129 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:44.230391 10045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6c24fd7e14d1b8d5545bce723ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.226471 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 2e133f56c04b492fbfac52f65ed6fe2b (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:44.226786 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 567b4adc73ba4d2ea946e154ebd94129 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:44.214687 10244 raft_consensus.cc:385] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.238104 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6c24fd7e14d1b8d5545bce723ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.239171 10192 tablet_service.cc:1511] Processing CreateTablet for tablet 567b4adc73ba4d2ea946e154ebd94129 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:44.239802 10245 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:44.240265 10245 ts_tablet_manager.cc:1403] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.154s	user 0.005s	sys 0.010s
I20260709 12:13:44.243184 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567b4adc73ba4d2ea946e154ebd94129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.243405 10194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6c24fd7e14d1b8d5545bce723ad27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.243048 10245 raft_consensus.cc:359] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.243718 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567b4adc73ba4d2ea946e154ebd94129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.234543 10244 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.243742 10245 raft_consensus.cc:385] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.249368 10245 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
W20260709 12:13:44.254701 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:44.255205 10192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567b4adc73ba4d2ea946e154ebd94129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.254837 10245 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.257023 10245 ts_tablet_manager.cc:1434] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:13:44.257951 10245 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.259214 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 48f4645742c44585a93863b12f58ba75 (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:44.260430 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f4645742c44585a93863b12f58ba75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.266978 10247 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.267428 10247 ts_tablet_manager.cc:1403] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.002s
I20260709 12:13:44.277304 10278 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.248853 10244 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.278746 10114 tablet_service.cc:1511] Processing CreateTablet for tablet 63a59e68139a465c858046fab6d14aaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:44.278949 10043 tablet_service.cc:1511] Processing CreateTablet for tablet 63a59e68139a465c858046fab6d14aaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:44.283315 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a59e68139a465c858046fab6d14aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.281034 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a59e68139a465c858046fab6d14aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.283887 10244 ts_tablet_manager.cc:1434] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.004s
I20260709 12:13:44.284871 10244 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.287918 10247 raft_consensus.cc:359] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.288643 10247 raft_consensus.cc:385] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.288914 10247 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.289628 10247 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.291363 10278 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.292470 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:44.294759 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.295356 10055 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.301783 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e133f56c04b492fbfac52f65ed6fe2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:44.305361 10169 leader_election.cc:343] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.306092 10253 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.321734 10055 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:44.326459 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 63a59e68139a465c858046fab6d14aaa (DEFAULT_TABLE table=test-workload [id=369d49ec57244946a73ad2b48cea684c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:44.327569 10247 ts_tablet_manager.cc:1434] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:13:44.327790 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a59e68139a465c858046fab6d14aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.328599 10247 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.327559 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.331390 10278 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.331851 10278 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:44.332664 10278 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.335781 10247 tablet_bootstrap.cc:654] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.346251  9951 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.348323  9951 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:44.357568 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:44.358886 10245 tablet_bootstrap.cc:654] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.365414 10244 tablet_bootstrap.cc:654] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.366855 10247 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.367326 10247 ts_tablet_manager.cc:1403] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.012s
I20260709 12:13:44.370115 10247 raft_consensus.cc:359] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.370829 10247 raft_consensus.cc:385] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.371115 10247 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.371824 10247 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.392484 10244 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.392987 10244 ts_tablet_manager.cc:1403] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.002s
I20260709 12:13:44.395915 10244 raft_consensus.cc:359] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.396668 10244 raft_consensus.cc:385] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.396955 10244 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.397655 10244 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.400223 10247 ts_tablet_manager.cc:1434] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.020s
I20260709 12:13:44.400568 10244 ts_tablet_manager.cc:1434] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:13:44.401225 10247 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.401453 10244 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.407536 10247 tablet_bootstrap.cc:654] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.410111 10292 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.411108 10244 tablet_bootstrap.cc:654] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.411640  9950 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.413736 10245 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:44.414237 10245 ts_tablet_manager.cc:1403] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.156s	user 0.018s	sys 0.011s
I20260709 12:13:44.416970 10245 raft_consensus.cc:359] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.417685 10245 raft_consensus.cc:385] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.418186 10245 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.418980 10245 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.419809 10244 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.420311 10244 ts_tablet_manager.cc:1403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:13:44.421510 10245 ts_tablet_manager.cc:1434] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:44.422520 10245 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.423257 10244 raft_consensus.cc:359] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.424016 10244 raft_consensus.cc:385] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.424314 10244 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.426215 10244 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.427456 10247 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.427906 10247 ts_tablet_manager.cc:1403] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.007s
I20260709 12:13:44.428326 10244 ts_tablet_manager.cc:1434] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:44.429265 10244 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.429352 10245 tablet_bootstrap.cc:654] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.430640 10247 raft_consensus.cc:359] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.431330 10247 raft_consensus.cc:385] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.431612 10247 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.432416 10247 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.434849 10247 ts_tablet_manager.cc:1434] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:13:44.435762 10244 tablet_bootstrap.cc:654] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.435878 10247 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.442307 10247 tablet_bootstrap.cc:654] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.446765 10244 tablet_bootstrap.cc:492] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.447167 10244 ts_tablet_manager.cc:1403] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 12:13:44.449352 10247 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.449770 10247 ts_tablet_manager.cc:1403] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 12:13:44.449527 10244 raft_consensus.cc:359] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.450156 10244 raft_consensus.cc:385] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.450439 10244 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.451059 10244 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.452164 10247 raft_consensus.cc:359] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.452895 10247 raft_consensus.cc:385] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.447180 10245 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:44.453222 10247 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.453619 10245 ts_tablet_manager.cc:1403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.007s
I20260709 12:13:44.452953 10244 ts_tablet_manager.cc:1434] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:44.454556 10244 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.454209 10247 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.456924 10245 raft_consensus.cc:359] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.457643 10245 raft_consensus.cc:385] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.457926 10245 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.459451 10245 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.460119 10244 tablet_bootstrap.cc:654] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.461475 10245 ts_tablet_manager.cc:1434] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:13:44.463702 10247 ts_tablet_manager.cc:1434] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:13:44.465075 10245 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.468240 10247 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.474581 10247 tablet_bootstrap.cc:654] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.475132 10278 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.475754 10278 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.477798 10278 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.478319 10244 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.478930 10244 ts_tablet_manager.cc:1403] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 12:13:44.480068 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.481305 10245 tablet_bootstrap.cc:654] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.481357 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.482065 10130 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:44.481971 10244 raft_consensus.cc:359] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.482851 10244 raft_consensus.cc:385] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.483191 10294 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.483721 10294 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:44.484037 10169 leader_election.cc:343] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.484760 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:44.485970 10294 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.485754 10278 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.487565 10278 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.487890 10278 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.487272 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.483191 10244 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.489639 10244 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:44.492138 10094 leader_election.cc:343] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.493063 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.493640 10055 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.494370 10278 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.494786 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:44.495769 10294 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.496115 10294 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.496243 10278 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.496459 10294 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.496940 10247 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.497371 10247 ts_tablet_manager.cc:1403] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.024s
I20260709 12:13:44.498456 10244 ts_tablet_manager.cc:1434] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:13:44.499305 10244 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.499902 10247 raft_consensus.cc:359] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.500532 10247 raft_consensus.cc:385] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.500782 10247 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.501417 10247 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.503193 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:44.503767 10130 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.505777 10244 tablet_bootstrap.cc:654] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.506276 10247 ts_tablet_manager.cc:1434] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:13:44.507164 10247 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.507117 10292 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.507802 10292 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.487079 10262 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.509446 10262 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.514899 10253 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.515431 10253 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.521456 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:13:44.526054 10169 leader_election.cc:343] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.532128 10306 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.532809 10306 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.545413 10278 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.558113 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.558892 10282 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.559926 10247 tablet_bootstrap.cc:654] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:44.559926 10020 leader_election.cc:343] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.563773 10253 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.560534 10278 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.564682 10130 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:44.565168 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.565812 10204 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.566596 10278 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.567875 10262 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.568634 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.568931 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.569130 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.569537 10262 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.569965 10055 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.570010 10262 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:44.570271 10019 leader_election.cc:343] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.567512 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:13:44.571571 10020 leader_election.cc:343] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.572110 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.572320 10262 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.572824 10262 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.573321 10253 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.574148 10253 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.574541 10253 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.577131 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.578725 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.578904 10292 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.579211 10244 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.579612 10244 ts_tablet_manager.cc:1403] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.016s
I20260709 12:13:44.579793 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.580932 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.582978 10244 raft_consensus.cc:359] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.584030 10244 raft_consensus.cc:385] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.584230 10244 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.584749 10244 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.586100 10244 ts_tablet_manager.cc:1434] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:13:44.586791 10244 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.591320 10055 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:44.591735 10244 tablet_bootstrap.cc:654] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.591567 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:44.592361 10169 leader_election.cc:343] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.593734 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:44.595038 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.596127 10245 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
W20260709 12:13:44.596279 10019 leader_election.cc:343] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.596561 10245 ts_tablet_manager.cc:1403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.043s
I20260709 12:13:44.599095 10247 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.599558 10247 ts_tablet_manager.cc:1403] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.093s	user 0.030s	sys 0.034s
I20260709 12:13:44.596729 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.601294 10262 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.600347 10292 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.602953 10247 raft_consensus.cc:359] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.603685 10247 raft_consensus.cc:385] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.603960 10247 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.604723 10247 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.598706 10253 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.612478 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.613059 10055 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.613469 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.614208 10129 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:44.615489 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.616231 10262 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.616931 10245 raft_consensus.cc:359] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.617632 10245 raft_consensus.cc:385] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.617869 10245 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.618547 10245 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.619957 10245 ts_tablet_manager.cc:1434] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:13:44.621225 10294 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.622648 10262 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.624500 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:44.622571 10055 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:44.623495 10294 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.624094 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.630831 10054 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.633735 10292 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.597668 10306 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.629184 10245 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.597440 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:13:44.626291 10094 leader_election.cc:343] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.635802 10095 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:44.635970 10253 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:44.636098 10169 leader_election.cc:343] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.638604 10278 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.639098 10278 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:44.639209 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:44.639806 10204 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.639945 10278 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.636600 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.644064 10282 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.651278 10247 ts_tablet_manager.cc:1434] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.004s
I20260709 12:13:44.652101 10247 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.652848 10292 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.652747 10282 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:44.654351 10054 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:44.655784 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:44.656710 10204 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:44.656873 10313 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.657657 10313 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:44.657789 10245 tablet_bootstrap.cc:654] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.654513 10292 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:44.662503 10253 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.662988 10253 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.665069 10253 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.667171 10247 tablet_bootstrap.cc:654] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.668221 10282 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.661979 10292 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.670914 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.672465 10244 tablet_bootstrap.cc:492] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.673548 10244 ts_tablet_manager.cc:1403] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.013s
I20260709 12:13:44.658576 10313 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:44.676553 10095 leader_election.cc:343] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.678714 10244 raft_consensus.cc:359] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.679527 10244 raft_consensus.cc:385] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.679917 10244 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.682595 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.683333 10244 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:44.689483 10094 leader_election.cc:343] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.689956 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:44.690608 10247 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.691075 10247 ts_tablet_manager.cc:1403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 12:13:44.693415 10244 ts_tablet_manager.cc:1434] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:13:44.694340 10244 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.700793 10306 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.701264 10306 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.703130 10247 raft_consensus.cc:359] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.703874 10247 raft_consensus.cc:385] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.704133 10247 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.707604 10247 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.698835 10253 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.709254 10294 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.717115 10306 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.721700 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.721923 10294 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.723115 10306 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.723582 10306 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.731765  9950 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.733716 10244 tablet_bootstrap.cc:654] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.777750 10245 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:44.778515 10245 ts_tablet_manager.cc:1403] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.150s	user 0.026s	sys 0.014s
I20260709 12:13:44.780649 10247 ts_tablet_manager.cc:1434] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.009s
I20260709 12:13:44.781559 10247 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.774876 10313 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.781349 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.782025 10313 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.791667 10130 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:44.791226 10245 raft_consensus.cc:359] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.792167 10245 raft_consensus.cc:385] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.792658 10245 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.793439 10245 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.795964 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.828521 10282 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.800532 10055 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.795377 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.811829 10294 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.812927 10306 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.848112 10319 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:44.793361 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:13:44.859440 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66178.1us
W20260709 12:13:44.848874 10094 leader_election.cc:343] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.821977 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:13:44.867643 10095 leader_election.cc:343] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.857838  9950 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.871052 10310 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:13:44.871661 10310 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.796981 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.873243 10054 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.825851 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.874313 10202 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.874625 10244 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.853327 10245 ts_tablet_manager.cc:1434] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.003s
I20260709 12:13:44.850018 10282 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.875077 10244 ts_tablet_manager.cc:1403] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.020s
I20260709 12:13:44.875715 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:44.876688 10282 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.859978 10306 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.877081 10294 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.875072 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:44.795392 10313 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.863413 10247 tablet_bootstrap.cc:654] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.794921 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.877832 10244 raft_consensus.cc:359] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.878526 10244 raft_consensus.cc:385] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.878599 10204 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:44.878832 10244 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.869724  9950 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.879484 10244 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.879124 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.880700 10054 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:44.881420 10244 ts_tablet_manager.cc:1434] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:44.882043 10019 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:44.882601 10244 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.883638 10262 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.884001 10262 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.884315 10262 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.884886 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:44.879930 10310 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.877506 10294 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.886140 10294 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.888490 10282 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.889036 10244 tablet_bootstrap.cc:654] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.890928 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.891422 10306 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.888860 10282 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.892175 10282 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.892388 10313 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.892822 10313 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.893170 10313 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.894392 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.850940 10130 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:44.907615 10294 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.911818 10245 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:44.916129 10294 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.919539 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.920266 10130 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:44.923000 10322 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.924296 10247 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:44.924445 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:44.924886 10247 ts_tablet_manager.cc:1403] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.010s
I20260709 12:13:44.928279 10282 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.925001 10204 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.931114 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.931347 10244 tablet_bootstrap.cc:492] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:44.931860 10244 ts_tablet_manager.cc:1403] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.016s
I20260709 12:13:44.933248 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:44.933797 10129 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.932545 10247 raft_consensus.cc:359] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.934496 10244 raft_consensus.cc:359] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.935177 10244 raft_consensus.cc:385] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.934903 10247 raft_consensus.cc:385] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.935480 10244 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.935693 10247 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.936374 10244 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.937485 10306 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.937923 10306 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.937600 10247 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.939447 10282 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:44.939782 10294 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.939919 10306 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.940310 10294 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.941622 10245 tablet_bootstrap.cc:654] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:44.925436 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 43489.2us
I20260709 12:13:44.941418 10129 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:44.941737 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:44.943337 10244 ts_tablet_manager.cc:1434] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:44.945046 10294 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.945019 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:44.945704 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:44.946584 10244 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:44.946717 10247 ts_tablet_manager.cc:1434] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:13:44.946033 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.947786 10282 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.948316 10053 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.947758 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.948042 10247 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:44.948958 10202 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:44.945739 10128 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:44.950502 10095 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:44.947856 10052 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.952632 10204 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:44.948396 10282 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:44.955514 10020 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:44.956341 10306 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.959259 10306 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.959605 10306 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.961254 10262 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.962742 10054 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:44.963322 10262 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.964138 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:44.964915 10128 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:44.965467 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:44.966032 10202 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:44.958487 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.967442 10282 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.967833 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:44.968892 10292 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.969355 10292 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:44.970616 10247 tablet_bootstrap.cc:654] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.970156 10292 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.954187 10294 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.973181 10294 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.973563 10294 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.974211 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:44.974709 10262 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.982350 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:44.964104 10313 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.982836 10019 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:44.986140 10313 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:44.987121 10244 tablet_bootstrap.cc:654] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.988286 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:44.988850 10054 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.989730 10306 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.987349 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:44.993723 10294 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:44.990635 10262 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:13:44.997812 10094 leader_election.cc:343] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.008524 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.009205 10204 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.010394  9952 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.003116 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.011650 10247 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.012063 10052 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:45.012120 10247 ts_tablet_manager.cc:1403] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.009s
I20260709 12:13:45.003321 10294 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.015017 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.015138 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.015810 10128 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:45.016878 10020 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.017657 10262 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.001425 10054 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:45.017107 10204 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:45.022195 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:45.016907 10306 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.026639 10294 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.027091 10294 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:45.026396  9951 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.027858 10294 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.033193 10244 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.033658 10244 ts_tablet_manager.cc:1403] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.007s
I20260709 12:13:45.033659 10245 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.035145 10245 ts_tablet_manager.cc:1403] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.007s
I20260709 12:13:45.035301 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:45.038995 10294 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.039057 10244 raft_consensus.cc:359] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.039386 10247 raft_consensus.cc:359] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.039665 10294 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:45.039790 10244 raft_consensus.cc:385] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.040037 10247 raft_consensus.cc:385] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.040145 10244 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.040513 10294 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.041055 10244 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.042932 10244 ts_tablet_manager.cc:1434] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:45.040337 10247 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.043730 10244 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.044379 10247 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.047271 10245 raft_consensus.cc:359] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.047921 10245 raft_consensus.cc:385] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.048169 10245 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.049629 10247 ts_tablet_manager.cc:1434] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.001s
I20260709 12:13:45.050542 10247 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.054031 10244 tablet_bootstrap.cc:654] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.054832 10245 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.056344 10247 tablet_bootstrap.cc:654] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.056869 10245 ts_tablet_manager.cc:1434] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:13:45.060420 10245 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.064785 10244 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.065207 10244 ts_tablet_manager.cc:1403] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:13:45.065968 10245 tablet_bootstrap.cc:654] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.067327 10247 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.067745 10247 ts_tablet_manager.cc:1403] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:13:45.067853 10244 raft_consensus.cc:359] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.068526 10244 raft_consensus.cc:385] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.068799 10244 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.069676 10244 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.070389 10247 raft_consensus.cc:359] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.071063 10247 raft_consensus.cc:385] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.071312 10247 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.072045 10247 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.074397 10247 ts_tablet_manager.cc:1434] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:13:45.075738 10247 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.077608 10244 ts_tablet_manager.cc:1434] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:45.078662 10244 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.078575  9951 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.080458  9951 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.081423 10247 tablet_bootstrap.cc:654] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.090407 10294 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.091753 10294 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.093211 10247 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.093647 10247 ts_tablet_manager.cc:1403] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:13:45.093986 10244 tablet_bootstrap.cc:654] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.095535 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.096146 10247 raft_consensus.cc:359] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.096786 10247 raft_consensus.cc:385] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:45.096909 10095 leader_election.cc:343] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.097071 10247 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.097759 10247 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.098556 10245 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.098958 10245 ts_tablet_manager.cc:1403] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.006s
I20260709 12:13:45.099455 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.099999 10247 ts_tablet_manager.cc:1434] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:45.100862 10247 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
W20260709 12:13:45.100764 10094 leader_election.cc:343] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.101263 10094 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:45.102039 10292 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.101927 10245 raft_consensus.cc:359] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.102546 10245 raft_consensus.cc:385] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.102869 10245 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.103505 10245 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.105188 10245 ts_tablet_manager.cc:1434] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:45.106242 10245 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.107014 10247 tablet_bootstrap.cc:654] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.108672 10244 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.109097 10244 ts_tablet_manager.cc:1403] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:13:45.110186 10306 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.110677 10306 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.111565 10244 raft_consensus.cc:359] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.112201 10244 raft_consensus.cc:385] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.112459 10244 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.112715 10306 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.113039 10244 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.114706 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.115408 10244 ts_tablet_manager.cc:1434] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:45.115352 10130 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:45.116242 10244 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.117319 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.118489 10262 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.118865 10262 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.119196 10262 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.122008 10245 tablet_bootstrap.cc:654] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.123689 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.124372 10204 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:45.131783 10244 tablet_bootstrap.cc:654] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.133745 10292 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.137887 10282 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.138195 10245 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.138643 10245 ts_tablet_manager.cc:1403] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.001s
I20260709 12:13:45.138338 10282 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.140290 10282 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.141129 10245 raft_consensus.cc:359] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.141755 10245 raft_consensus.cc:385] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.142218 10245 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.142458 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.142501 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.142962 10245 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.143426 10052 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:45.144901 10245 ts_tablet_manager.cc:1434] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:45.147091 10245 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.149089 10292 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.144912 10169 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.155205 10282 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.158107 10245 tablet_bootstrap.cc:654] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.163848 10282 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.168700 10245 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.169173 10245 ts_tablet_manager.cc:1403] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:13:45.170511 10253 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.176806 10245 raft_consensus.cc:359] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.177536 10245 raft_consensus.cc:385] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.177802 10245 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.180754 10245 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.182760 10245 ts_tablet_manager.cc:1434] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:13:45.183666 10245 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.188643 10245 tablet_bootstrap.cc:654] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.191162 10262 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.194262 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.194875 10130 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.202661 10294 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.206815 10245 tablet_bootstrap.cc:492] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.206943 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.207351 10245 ts_tablet_manager.cc:1403] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 12:13:45.207576 10204 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.210039 10245 raft_consensus.cc:359] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.210789 10245 raft_consensus.cc:385] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.211005 10262 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.211131 10245 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.212571 10245 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.214636 10245 ts_tablet_manager.cc:1434] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:45.224882 10245 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.202418 10130 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:45.232728 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.236186 10294 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.240352 10244 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.240883 10244 ts_tablet_manager.cc:1403] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.049s
I20260709 12:13:45.242272 10204 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:45.243028 10245 tablet_bootstrap.cc:654] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.243777 10244 raft_consensus.cc:359] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.244515 10244 raft_consensus.cc:385] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.244829 10244 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.245498 10244 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.248169 10322 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.249758 10306 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.250528 10306 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:45.250627 10244 ts_tablet_manager.cc:1434] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:45.251372 10306 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.252456 10244 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.255731 10247 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.256210 10247 ts_tablet_manager.cc:1403] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.156s	user 0.076s	sys 0.037s
I20260709 12:13:45.258733 10247 raft_consensus.cc:359] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.259169 10244 tablet_bootstrap.cc:654] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.259372 10247 raft_consensus.cc:385] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.259650 10247 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.271194 10282 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.274691 10247 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.275238 10244 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.275786 10244 ts_tablet_manager.cc:1403] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:13:45.278223 10244 raft_consensus.cc:359] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.279577 10244 raft_consensus.cc:385] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.279927 10244 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.281213 10244 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.282696 10253 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.283391 10244 ts_tablet_manager.cc:1434] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:45.283149 10253 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.284365 10244 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.285135 10253 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.286639 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:13:45.288008 10095 leader_election.cc:343] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.291143 10244 tablet_bootstrap.cc:654] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.294457 10247 ts_tablet_manager.cc:1434] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:13:45.295506 10247 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.298988 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.299721 10204 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:45.300910 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:45.302227 10294 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.302626 10294 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.302963 10294 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:45.307119 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:45.309821 10294 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.310148 10247 tablet_bootstrap.cc:654] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.308209 10244 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.310833 10244 ts_tablet_manager.cc:1403] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.001s
I20260709 12:13:45.313606 10244 raft_consensus.cc:359] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.314309 10244 raft_consensus.cc:385] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.320143 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:13:45.321499 10095 leader_election.cc:343] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.323403 10294 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.314638 10244 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.325028 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.325688 10204 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.327607 10322 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.328133 10322 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.331142 10322 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.333133 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.333247 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.333915 10054 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.333985 10128 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.335664 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.337345 10322 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.337687 10322 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.338006 10322 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.324774 10244 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.344120 10244 ts_tablet_manager.cc:1434] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:13:45.345089 10244 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.344708 10322 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.346068  9950 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.347440 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.348073 10052 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.350756 10204 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:45.354367 10245 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.354821 10245 ts_tablet_manager.cc:1403] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.130s	user 0.046s	sys 0.062s
I20260709 12:13:45.356525 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:45.357921 10245 raft_consensus.cc:359] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.358584 10245 raft_consensus.cc:385] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.358513 10294 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.358907 10244 tablet_bootstrap.cc:654] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.359369 10294 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:45.360201 10294 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.358887 10245 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.362884 10245 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.365000 10245 ts_tablet_manager.cc:1434] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:45.365836 10245 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.366535 10052 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.367739 10322 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.368188 10321 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.370502 10321 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.371152 10245 tablet_bootstrap.cc:654] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.372696 10321 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.374181 10282 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.374636 10282 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.376479 10282 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.377875 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.378046 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.378556 10130 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.380162 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.380787 10053 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.382326 10245 tablet_bootstrap.cc:492] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.382813 10245 ts_tablet_manager.cc:1403] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:13:45.385244 10245 raft_consensus.cc:359] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.385859 10245 raft_consensus.cc:385] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.386121 10245 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.386792 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.387465 10128 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.388898 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.389072 10322 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.382287 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.389544 10054 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:45.390399 10322 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:45.391332 10322 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.392302 10245 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.393818 10245 ts_tablet_manager.cc:1434] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:13:45.394007 10278 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.394454 10278 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.394806 10278 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.397330 10245 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.397842 10319 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.400377 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.401012 10204 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:45.402278 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.403999 10292 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.404356 10292 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.404682 10292 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.405650 10130 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.406774 10245 tablet_bootstrap.cc:654] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.369941 10247 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.407263 10247 ts_tablet_manager.cc:1403] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.005s
I20260709 12:13:45.409787 10247 raft_consensus.cc:359] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.410403 10247 raft_consensus.cc:385] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.410701 10247 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.411357 10247 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.411535 10278 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.413039 10294 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.415423 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.415709 10247 ts_tablet_manager.cc:1434] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 12:13:45.416141 10052 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.416613 10247 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.418031 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.410918  9950 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.415432 10278 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.421185 10128 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.428043 10321 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.419783 10292 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.459273 10247 tablet_bootstrap.cc:654] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.463407 10262 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.463932 10262 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.465487 10253 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.465796 10292 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.466622 10262 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.468570 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.469692 10202 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.469959 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.473392 10244 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.473836 10244 ts_tablet_manager.cc:1403] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.129s	user 0.044s	sys 0.020s
I20260709 12:13:45.474773 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.475020 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.475366 10053 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.475570 10130 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:45.477263 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.478654 10262 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.479014 10262 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.479326 10262 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.482399 10202 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
W20260709 12:13:45.479578 10019 leader_election.cc:343] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.483712 10094 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:45.491957 10052 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.493503 10128 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.494712 10245 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.495064 10245 ts_tablet_manager.cc:1403] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.003s
I20260709 12:13:45.487054 10322 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:45.499577 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.503377 10294 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.503887 10294 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:45.504712 10294 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.505563 10245 raft_consensus.cc:359] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.506173 10245 raft_consensus.cc:385] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.506412 10245 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.503105 10244 raft_consensus.cc:359] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.507022 10244 raft_consensus.cc:385] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.506769 10262 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.507715 10321 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.507323 10244 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.509509 10262 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.516444 10053 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:45.519423 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.523325 10306 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.502466 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.541464 10322 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.544059 10245 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.544199 10244 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:45.546269 10019 leader_election.cc:343] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.548722 10245 ts_tablet_manager.cc:1434] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:13:45.523319 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.549587 10245 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.550237 10324 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.550727 10324 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:45.551559 10324 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.550634 10244 ts_tablet_manager.cc:1434] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.077s	user 0.028s	sys 0.011s
I20260709 12:13:45.553309 10244 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.543954 10306 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.555408 10247 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.555835 10247 ts_tablet_manager.cc:1403] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.002s
I20260709 12:13:45.544028 10322 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.592464 10313 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.599472 10247 raft_consensus.cc:359] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.600281 10247 raft_consensus.cc:385] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.600558 10247 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
W20260709 12:13:45.547710 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47254.6us
I20260709 12:13:45.603454 10306 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.558394 10128 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.623852 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.607172 10322 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.637657 10247 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.639087 10245 tablet_bootstrap.cc:654] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.636375 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.640245 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.643229 10247 ts_tablet_manager.cc:1434] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.003s
I20260709 12:13:45.645155 10247 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.647519 10244 tablet_bootstrap.cc:654] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.644783 10202 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:45.640509 10054 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.649330 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.654716 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.655364 10262 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.655735 10262 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.656057 10262 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:45.664499 10020 leader_election.cc:343] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:45.665710 10169 leader_election.cc:343] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.668561 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.672922 10322 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.673311 10322 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.673628 10322 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.679659  9951 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.682027  9951 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.686990 10322 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.688133 10247 tablet_bootstrap.cc:654] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.689088 10322 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.699354 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:13:45.703490 10169 leader_election.cc:343] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.707680 10294 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.708194 10294 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.711522 10294 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.695529 10128 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:45.712289 10262 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.715560 10262 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.709040 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.716856 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.717406 10050 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:45.717741 10202 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:45.718590 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:45.719877 10094 leader_election.cc:343] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.724397 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.724442  9952 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.725813 10278 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.730013 10262 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.730504 10262 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.733281 10262 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.733474 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:45.734683 10019 leader_election.cc:343] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.735464 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.736027 10054 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:45.742511 10095 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:45.743196 10321 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.743536 10321 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.743850 10321 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.743780 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:45.744468 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.745065 10306 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.745532 10306 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:45.747048 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.746354 10306 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:45.749338 10020 leader_election.cc:343] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.749779 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.750663 10329 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.753530 10244 tablet_bootstrap.cc:492] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.753638 10329 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.754086 10244 ts_tablet_manager.cc:1403] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.201s	user 0.031s	sys 0.021s
I20260709 12:13:45.751111 10321 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.759894 10244 raft_consensus.cc:359] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.762001 10247 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.762486 10247 ts_tablet_manager.cc:1403] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.004s
I20260709 12:13:45.762844  9951 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.764539 10245 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.764997 10245 ts_tablet_manager.cc:1403] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.216s	user 0.027s	sys 0.022s
I20260709 12:13:45.767413 10245 raft_consensus.cc:359] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.768056 10245 raft_consensus.cc:385] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.768342 10245 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.768960 10245 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.771087 10128 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:45.772432 10306 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.773264 10247 raft_consensus.cc:359] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.774722 10020 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.777684 10245 ts_tablet_manager.cc:1434] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:13:45.777822 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.778661 10245 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.775483 10244 raft_consensus.cc:385] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.778991 10244 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.779448 10247 raft_consensus.cc:385] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.779611 10278 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.779776 10247 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.780071 10278 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.778335 10054 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.780602 10244 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.782886 10244 ts_tablet_manager.cc:1434] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:13:45.783756 10244 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.776573 10321 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.787865 10278 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.788882 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.789376 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.789667 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:45.791272 10169 leader_election.cc:343] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.791674 10054 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
W20260709 12:13:45.791986 10169 leader_election.cc:343] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.792205 10306 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.792469 10169 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:45.793637 10278 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.793644 10095 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:45.795018 10247 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.797254 10247 ts_tablet_manager.cc:1434] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.002s
W20260709 12:13:45.798225 10094 leader_election.cc:343] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.794958 10321 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.800632 10247 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.800698 10321 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:45.801643 10321 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.803785 10245 tablet_bootstrap.cc:654] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.809731 10244 tablet_bootstrap.cc:654] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.813318 10247 tablet_bootstrap.cc:654] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.817852 10247 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.818805 10247 ts_tablet_manager.cc:1403] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 12:13:45.821882  9951 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.822297 10247 raft_consensus.cc:359] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.822901 10247 raft_consensus.cc:385] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.823124 10247 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.823668 10247 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.825502 10247 ts_tablet_manager.cc:1434] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:45.826238 10247 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.833649 10306 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.833546 10321 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.834120 10306 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.835008 10247 tablet_bootstrap.cc:654] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.835551 10245 tablet_bootstrap.cc:492] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.835986 10245 ts_tablet_manager.cc:1403] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.009s
I20260709 12:13:45.836119 10306 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.837548 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:45.838373 10245 raft_consensus.cc:359] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.839074 10245 raft_consensus.cc:385] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.839325 10245 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
W20260709 12:13:45.839680 10019 leader_election.cc:343] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:45.839893 10245 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.841886 10245 ts_tablet_manager.cc:1434] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:45.842819 10244 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.843235 10244 ts_tablet_manager.cc:1403] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.005s
I20260709 12:13:45.844221 10245 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.844691 10054 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.848348 10322 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.852825 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.853431 10127 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:45.845621 10244 raft_consensus.cc:359] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.854718 10244 raft_consensus.cc:385] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.854863 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:45.855147 10244 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.855209 10321 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.856302 10306 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.856014 10244 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.856735 10306 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.857187 10306 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.862139 10244 ts_tablet_manager.cc:1434] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:13:45.863324 10244 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.855489 10322 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:45.865236 10306 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.875660 10245 tablet_bootstrap.cc:654] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.881071 10244 tablet_bootstrap.cc:654] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.881212 10306 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:45.882786 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:45.894022 10245 tablet_bootstrap.cc:492] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:45.894605 10203 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.894801 10245 ts_tablet_manager.cc:1403] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 12:13:45.897550 10245 raft_consensus.cc:359] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.898778 10245 raft_consensus.cc:385] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.899386 10245 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.900640 10245 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.901254 10247 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.902352 10247 ts_tablet_manager.cc:1403] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.005s
I20260709 12:13:45.883002 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.905072 10127 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.904939 10247 raft_consensus.cc:359] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.905567 10247 raft_consensus.cc:385] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.905838 10247 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.906486 10247 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.908432 10247 ts_tablet_manager.cc:1434] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:45.909314 10247 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.909543 10203 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:45.910629 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.911424 10306 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.911851 10324 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.912302 10324 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.915465 10247 tablet_bootstrap.cc:654] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.920207 10127 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:45.922466 10324 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.911861 10306 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:45.923902 10306 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.925804 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:45.926484 10054 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.927680 10244 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.927915 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.928177 10244 ts_tablet_manager.cc:1403] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 12:13:45.928440 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:45.929034 10127 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:45.931008 10244 raft_consensus.cc:359] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.931735 10244 raft_consensus.cc:385] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.931993 10244 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.932638 10244 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.932723 10321 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.934734 10324 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.935115 10324 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.935528 10324 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.937575 10245 ts_tablet_manager.cc:1434] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:13:45.938594 10245 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:45.942474 10324 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.935086 10247 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:45.945423 10247 ts_tablet_manager.cc:1403] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.011s
I20260709 12:13:45.946400 10244 ts_tablet_manager.cc:1434] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:13:45.946759 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:45.947389 10244 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:45.947422 10054 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.948305 10247 raft_consensus.cc:359] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.950459 10247 raft_consensus.cc:385] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.950677 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:45.950937 10324 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:45.951184 10245 tablet_bootstrap.cc:654] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.951296 10127 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.955243 10054 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.956494 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:45.950796 10247 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.957499 10244 tablet_bootstrap.cc:654] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.957463 10324 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.958027 10247 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.958753 10324 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:45.959575 10324 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.964404  9950 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.969586 10247 ts_tablet_manager.cc:1434] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:13:45.970677 10247 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:45.980436 10127 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:45.983388 10247 tablet_bootstrap.cc:654] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:45.992693 10244 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:45.993165 10244 ts_tablet_manager.cc:1403] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.023s
I20260709 12:13:45.995795 10244 raft_consensus.cc:359] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:45.995631  9951 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.996500 10244 raft_consensus.cc:385] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:45.996821 10244 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:45.997449 10244 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.000483 10244 ts_tablet_manager.cc:1434] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:46.002576 10247 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.003042 10247 ts_tablet_manager.cc:1403] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:13:46.004622 10244 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.006544 10247 raft_consensus.cc:359] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.007172 10247 raft_consensus.cc:385] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.007463 10247 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.008069 10247 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.008416 10292 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.010074 10247 ts_tablet_manager.cc:1434] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:46.010155 10244 tablet_bootstrap.cc:654] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.011431 10247 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.017992 10247 tablet_bootstrap.cc:654] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.021130 10245 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.023063 10245 ts_tablet_manager.cc:1403] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.010s
I20260709 12:13:46.025556 10245 raft_consensus.cc:359] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.026244 10245 raft_consensus.cc:385] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.026521 10245 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.027253 10245 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.029100 10245 ts_tablet_manager.cc:1434] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:46.029907 10245 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.030874 10244 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.031303 10244 ts_tablet_manager.cc:1403] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 12:13:46.033555 10244 raft_consensus.cc:359] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.034189 10244 raft_consensus.cc:385] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.034411 10324 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.034456 10244 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.034893 10324 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.035303 10245 tablet_bootstrap.cc:654] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.035387 10244 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.036908 10324 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:46.037617 10244 ts_tablet_manager.cc:1434] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:46.038542 10244 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.039310 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.042933 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.043717 10127 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:46.044371 10244 tablet_bootstrap.cc:654] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.044883 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.046875 10324 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.047555 10306 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.048030 10306 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.050169 10306 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.053830 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.054380 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.055013 10127 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
W20260709 12:13:46.055356 10019 leader_election.cc:343] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.056290 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.057296 10306 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.057622 10306 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.057914 10306 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.058827 10324 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.063795 10203 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.066084 10244 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.066565 10244 ts_tablet_manager.cc:1403] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.000s
I20260709 12:13:46.069518 10244 raft_consensus.cc:359] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.070180 10244 raft_consensus.cc:385] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.072021 10244 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.072778 10244 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.078971 10244 ts_tablet_manager.cc:1434] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:13:46.079873 10244 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.085242 10244 tablet_bootstrap.cc:654] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.077260 10306 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.096964 10306 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.097589 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.098199 10247 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.098670 10247 ts_tablet_manager.cc:1403] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.000s
W20260709 12:13:46.098987 10019 leader_election.cc:343] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.100274 10244 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.100224 10324 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.100728 10244 ts_tablet_manager.cc:1403] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 12:13:46.101107 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:46.101203 10247 raft_consensus.cc:359] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.101678 10127 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.101923 10247 raft_consensus.cc:385] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.102192 10247 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.102804 10244 raft_consensus.cc:359] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.102814 10247 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.103549 10244 raft_consensus.cc:385] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.103838 10244 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.104712 10245 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.104527 10244 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.105123 10245 ts_tablet_manager.cc:1403] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.034s
I20260709 12:13:46.105214 10247 ts_tablet_manager.cc:1434] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:46.106276 10247 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.109004 10245 raft_consensus.cc:359] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.109623 10245 raft_consensus.cc:385] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.109863 10245 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.110474 10244 ts_tablet_manager.cc:1434] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:13:46.111312 10244 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.113281 10245 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.110991 10294 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.118038 10294 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.119176 10245 ts_tablet_manager.cc:1434] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:13:46.120028 10245 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.119993 10294 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.121896 10127 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:46.122202 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.122207 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:46.125033 10094 leader_election.cc:343] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.123080 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.129405 10306 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.129876 10306 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:46.129424 10294 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.131194 10095 leader_election.cc:343] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.131706 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.132309 10262 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.132728 10262 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.134764 10262 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.135288 10292 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.135906 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.137066 10324 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:46.139271 10019 leader_election.cc:343] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.130985 10294 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.130678 10306 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.211086 10306 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.212975 10306 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.228659 10202 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.227890  9949 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.230540 10247 tablet_bootstrap.cc:654] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.231180 10306 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.234036 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:46.235550 10019 leader_election.cc:343] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.237977 10244 tablet_bootstrap.cc:654] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.238230 10245 tablet_bootstrap.cc:654] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:46.231766 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 108781us
I20260709 12:13:46.265758 10294 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.383173 10324 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.383682 10324 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.384464 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.385073 10202 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.385713 10324 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:46.389276 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.392437 10244 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.392704 10313 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:46.393254 10244 ts_tablet_manager.cc:1403] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.282s	user 0.012s	sys 0.001s
I20260709 12:13:46.394006 10378 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.394402 10378 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.394758 10378 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.417622 10262 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.418154 10262 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.420219 10262 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.420145 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.421268 10262 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.421693 10262 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.426129 10262 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.425978 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.427856 10051 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:46.426946 10244 raft_consensus.cc:359] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.428828 10244 raft_consensus.cc:385] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.429077 10244 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.430615 10322 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.432714 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.432821 10244 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.433836 10322 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.436918 10244 ts_tablet_manager.cc:1434] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:13:46.434249 10322 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:13:46.438252 10322 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.440939 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.443079 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.443711 10204 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:46.444787 10322 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:46.446939 10019 leader_election.cc:343] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.449404 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.414317 10378 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.450834 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.449689 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:46.452375 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.452566 10414 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.453601 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.454605 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.455008 10204 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.452304 10262 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.455773 10054 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.458024 10262 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.458482 10262 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.461450 10204 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:46.462008 10292 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.449128 10247 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.462750 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.463419 10247 ts_tablet_manager.cc:1403] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.357s	user 0.013s	sys 0.053s
I20260709 12:13:46.464303 10294 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.464787 10294 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:46.465448 10414 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.465885 10414 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.466123 10247 raft_consensus.cc:359] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.466734 10247 raft_consensus.cc:385] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.465579 10294 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.466984 10247 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.468010 10414 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.474228 10378 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:46.476357 10020 leader_election.cc:343] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.476753 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.476893 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:13:46.478541 10020 leader_election.cc:343] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.478972 10020 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.479215 10413 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.479837 10414 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:46.480001 10019 leader_election.cc:343] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.481216 10413 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.482208 10245 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.482702 10245 ts_tablet_manager.cc:1403] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.363s	user 0.016s	sys 0.004s
I20260709 12:13:46.482779 10262 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.483575 10247 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.485792 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.486976 10247 ts_tablet_manager.cc:1434] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:13:46.488058 10247 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.489074 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.490587 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:46.491966 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.492508 10262 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.492810 10324 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.500491 10324 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.502453 10247 tablet_bootstrap.cc:654] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.493371 10322 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:46.437937 10244 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.493593 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.507545 10201 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:46.494381 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.521114 10245 raft_consensus.cc:359] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.521593 10245 raft_consensus.cc:385] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.521795 10245 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.523378 10245 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.525399 10245 ts_tablet_manager.cc:1434] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:46.526291 10245 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.531840 10245 tablet_bootstrap.cc:654] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.538972  9949 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.543707 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.546365 10294 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.546974 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:46.546993 10294 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:46.550205 10020 leader_election.cc:343] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.550559 10294 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.550756 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.550676 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.551661 10202 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:46.551818 10415 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.552489 10415 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.552709 10262 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.558612 10245 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.559125 10245 ts_tablet_manager.cc:1403] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.007s
W20260709 12:13:46.563241 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:13:46.566743 10020 leader_election.cc:343] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.567294 10020 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.568097 10262 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.569900 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.570755 10262 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.571635 10244 tablet_bootstrap.cc:654] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.574474 10262 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.574944 10262 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.575873 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.576627 10054 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:46.577035 10262 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.578658 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:46.580016 10019 leader_election.cc:343] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.581583 10245 raft_consensus.cc:359] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.582229 10245 raft_consensus.cc:385] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.582504 10245 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.583128 10245 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.585106 10245 ts_tablet_manager.cc:1434] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.003s
I20260709 12:13:46.585945 10245 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.591953 10245 tablet_bootstrap.cc:654] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.606633 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.607187 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.607299 10130 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:46.609136 10378 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.609607 10245 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.610116 10245 ts_tablet_manager.cc:1403] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 12:13:46.614895 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.615414 10321 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.615679 10262 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.616087 10262 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.615943 10321 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.616501 10262 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.619491 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:46.621009 10094 leader_election.cc:343] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.621598 10321 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.622974 10245 raft_consensus.cc:359] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.623427 10262 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.625483 10262 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.626609 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.627352 10378 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.630400 10244 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.630864 10244 ts_tablet_manager.cc:1403] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.004s
I20260709 12:13:46.631819 10247 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.632248 10247 ts_tablet_manager.cc:1403] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.144s	user 0.052s	sys 0.051s
I20260709 12:13:46.623865 10245 raft_consensus.cc:385] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.634004 10245 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.634824 10247 raft_consensus.cc:359] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.634838 10245 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.635903 10202 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.635612 10247 raft_consensus.cc:385] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.636461 10247 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.636600 10245 ts_tablet_manager.cc:1434] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 12:13:46.640980 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:46.641510 10245 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.641269 10247 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.639824 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.641531 10130 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.642154 10054 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.633282 10244 raft_consensus.cc:359] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.644181 10244 raft_consensus.cc:385] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.644443 10244 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.644752 10247 ts_tablet_manager.cc:1434] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:13:46.649703 10247 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.649385 10244 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.651603 10244 ts_tablet_manager.cc:1434] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:13:46.652530 10244 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.654069 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:46.656528 10245 tablet_bootstrap.cc:654] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.656823 10202 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:46.658736 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:46.659699 10321 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.659929 10262 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.660056 10321 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.660423 10247 tablet_bootstrap.cc:654] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.660424 10262 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:46.660434 10321 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.661479 10262 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.668069 10415 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.668447 10321 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.668527 10415 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.670074 10321 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.672554 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.672758 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.673534 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.674067 10054 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:46.674013 10094 leader_election.cc:343] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.676143 10415 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:46.673966 10019 leader_election.cc:343] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.650104 10130 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:46.679260 10054 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:46.680068 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.680738 10244 tablet_bootstrap.cc:654] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.681690 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:13:46.682068 10020 leader_election.cc:343] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.682328 10378 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.682534 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.682966 10378 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:46.683830 10415 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.683920 10378 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.689347 10244 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.689803 10244 ts_tablet_manager.cc:1403] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 12:13:46.692354 10244 raft_consensus.cc:359] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.692981 10244 raft_consensus.cc:385] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.693252 10244 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.698750 10247 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.699276 10247 ts_tablet_manager.cc:1403] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.007s
I20260709 12:13:46.701647 10247 raft_consensus.cc:359] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.702288 10247 raft_consensus.cc:385] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.702586 10247 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.702883 10245 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.703347 10245 ts_tablet_manager.cc:1403] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.003s
I20260709 12:13:46.703187 10247 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.703361  9949 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.704085  9952 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.705374 10247 ts_tablet_manager.cc:1434] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:13:46.706210 10247 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.706151 10245 raft_consensus.cc:359] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.706868 10245 raft_consensus.cc:385] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.707084 10245 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.707471 10244 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.708263 10245 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.710156 10245 ts_tablet_manager.cc:1434] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:46.711750 10245 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.713791 10244 ts_tablet_manager.cc:1434] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:13:46.714744 10244 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.716173 10245 tablet_bootstrap.cc:654] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.719563 10247 tablet_bootstrap.cc:654] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.722318 10244 tablet_bootstrap.cc:654] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.729337 10244 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.729717 10244 ts_tablet_manager.cc:1403] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:13:46.732419 10244 raft_consensus.cc:359] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.733081 10244 raft_consensus.cc:385] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.733342 10244 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.733963 10244 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.736109 10244 ts_tablet_manager.cc:1434] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:13:46.737026 10244 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.743075 10244 tablet_bootstrap.cc:654] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.747601 10247 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.748085 10247 ts_tablet_manager.cc:1403] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 12:13:46.748744 10245 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.749218 10245 ts_tablet_manager.cc:1403] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.022s
I20260709 12:13:46.750414 10247 raft_consensus.cc:359] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.751156 10247 raft_consensus.cc:385] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.751454 10247 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.751678 10245 raft_consensus.cc:359] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.752040 10247 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.752315 10245 raft_consensus.cc:385] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.752889 10244 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.753302 10244 ts_tablet_manager.cc:1403] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:13:46.753759 10247 ts_tablet_manager.cc:1434] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:13:46.752679 10245 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.759858 10415 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:46.755689 10244 raft_consensus.cc:359] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.758279 10202 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.758388 10247 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.772997 10244 raft_consensus.cc:385] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.773303 10244 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.773509 10245 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.773897 10244 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.775898 10244 ts_tablet_manager.cc:1434] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.022s	user 0.022s	sys 0.000s
I20260709 12:13:46.777609 10244 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.778240 10245 ts_tablet_manager.cc:1434] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:13:46.779259 10245 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.783078 10244 tablet_bootstrap.cc:654] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.784403 10245 tablet_bootstrap.cc:654] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.793602 10378 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.794075 10378 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.794480 10244 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.794968 10244 ts_tablet_manager.cc:1403] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:13:46.797089 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.797693 10203 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.797480 10244 raft_consensus.cc:359] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.798184 10244 raft_consensus.cc:385] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.798998 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.799748 10321 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.800082 10321 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.800400 10321 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.800804 10245 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.801265 10245 ts_tablet_manager.cc:1403] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 12:13:46.801604 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.802170 10054 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.807380 10247 tablet_bootstrap.cc:654] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.803678 10245 raft_consensus.cc:359] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.799494 10244 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.808038 10245 raft_consensus.cc:385] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.806558 10378 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.808350 10245 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.807166 10321 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.808593 10244 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.809512 10262 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.810927 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.811442 10054 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.815810 10244 ts_tablet_manager.cc:1434] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:46.816663 10244 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.821038 10054 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:46.822021 10244 tablet_bootstrap.cc:654] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.823895 10095 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.824792 10378 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.825232 10378 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:46.825979 10378 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.828631 10321 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.829319 10245 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.831645 10245 ts_tablet_manager.cc:1434] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:13:46.831755 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.832530 10245 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.832499 10202 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.841869 10202 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:46.844223 10247 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.844730 10247 ts_tablet_manager.cc:1403] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.015s
I20260709 12:13:46.853832 10322 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.854350 10322 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.858572 10322 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:46.860474 10245 tablet_bootstrap.cc:654] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.861061 10247 raft_consensus.cc:359] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.861716 10247 raft_consensus.cc:385] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.861985 10247 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.860428 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.867327 10054 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:46.860427 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.868120 10128 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:46.868572 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:46.869278 10322 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.869612 10322 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.869928 10322 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.866303  9951 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.862730 10247 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.876672 10244 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.877103 10244 ts_tablet_manager.cc:1403] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.005s
I20260709 12:13:46.877363 10247 ts_tablet_manager.cc:1434] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 12:13:46.878108 10247 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:46.879779 10322 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.882505 10322 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:46.882856 10244 raft_consensus.cc:359] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.884409 10245 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.884594 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:46.886240 10244 raft_consensus.cc:385] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.885588 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.886375 10247 tablet_bootstrap.cc:654] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.886719 10244 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.886818 10054 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.886468 10128 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.892453 10244 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.893023 10128 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:46.894213 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.895051 10322 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.895489 10322 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:46.896246 10322 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.899006 10244 ts_tablet_manager.cc:1434] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:13:46.899893 10415 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.900627 10245 ts_tablet_manager.cc:1403] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.014s
I20260709 12:13:46.900343 10415 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.903276 10415 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.903079 10245 raft_consensus.cc:359] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.904446 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.904819 10245 raft_consensus.cc:385] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.905128 10245 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.905669 10054 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:46.906913 10244 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.907420 10245 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:46.910214 10019 leader_election.cc:343] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.907461 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.910379 10245 ts_tablet_manager.cc:1434] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 12:13:46.911577 10020 leader_election.cc:343] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.911990 10020 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.912238 10245 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.913130 10415 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.916378 10378 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.916828 10378 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.918119 10415 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.918584 10415 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.918845 10378 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.919184 10413 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.919620 10413 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.920305 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.920878 10202 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:46.921507 10413 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.921584 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:46.921950 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:46.922739 10292 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:46.922773 10415 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.923200 10292 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:46.923635 10019 leader_election.cc:343] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.922245 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:46.925549 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:46.926688 10095 leader_election.cc:343] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.928292 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.930706 10245 tablet_bootstrap.cc:654] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.923779 10292 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:46.931584 10019 leader_election.cc:343] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:46.936718 10020 leader_election.cc:343] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.937103 10020 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.937773 10415 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.937601 10294 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.937784 10245 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.939988 10245 ts_tablet_manager.cc:1403] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 12:13:46.942203 10294 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:46.942317 10245 raft_consensus.cc:359] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.942992 10245 raft_consensus.cc:385] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.943246 10245 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.943856 10245 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.944064 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:46.945779 10245 ts_tablet_manager.cc:1434] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
W20260709 12:13:46.946030 10020 leader_election.cc:343] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.946467 10020 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:46.946755 10245 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.947189 10415 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:46.950817 10292 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.952314 10245 tablet_bootstrap.cc:654] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.953464 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:46.960687  9951 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:46.962241 10095 leader_election.cc:343] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:46.963265 10244 tablet_bootstrap.cc:654] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.966346 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:46.966950 10203 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.970330 10245 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:46.970783 10245 ts_tablet_manager.cc:1403] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.009s
I20260709 12:13:46.968418 10292 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:46.976956 10245 raft_consensus.cc:359] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.977597 10245 raft_consensus.cc:385] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.977829 10245 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.978976 10244 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:46.978590 10245 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.979486 10247 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:46.979403 10244 ts_tablet_manager.cc:1403] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.080s	user 0.003s	sys 0.007s
I20260709 12:13:46.980046 10247 ts_tablet_manager.cc:1403] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.017s
I20260709 12:13:46.981649 10245 ts_tablet_manager.cc:1434] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:46.982509 10245 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:46.982518 10244 raft_consensus.cc:359] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.983232 10244 raft_consensus.cc:385] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.983494 10244 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.984293 10203 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:46.984169 10244 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:46.988219 10244 ts_tablet_manager.cc:1434] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:13:46.988785 10245 tablet_bootstrap.cc:654] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.990844 10244 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:46.997651 10244 tablet_bootstrap.cc:654] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.008513 10244 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.011288 10244 ts_tablet_manager.cc:1403] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 12:13:47.011864 10202 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:47.013098 10324 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.013552 10324 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.013705 10244 raft_consensus.cc:359] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.014508 10244 raft_consensus.cc:385] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.014778 10244 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.015983 10244 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.017027 10324 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.017681 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.018219 10244 ts_tablet_manager.cc:1434] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:47.018603 10050 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:47.018929 10245 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.019126 10244 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.019369 10245 ts_tablet_manager.cc:1403] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 12:13:47.019218 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.021569 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.024467 10324 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.024236 10247 raft_consensus.cc:359] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.024907 10247 raft_consensus.cc:385] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.025163 10247 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.025770 10247 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.027925 10247 ts_tablet_manager.cc:1434] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 12:13:47.028750 10247 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.031186 10324 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.023592 10292 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:47.032894 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:47.033581 10245 raft_consensus.cc:359] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.034015 10245 raft_consensus.cc:385] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.034225 10294 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:47.034598 10294 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.035503 10313 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.035995 10313 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.036165 10294 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.037271 10247 tablet_bootstrap.cc:654] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.037353 10294 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.037405 10313 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.040130 10414 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.040582 10414 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.045013 10414 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.045796 10244 tablet_bootstrap.cc:654] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.034260 10245 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.045774 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.046985 10245 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:47.047828 10020 leader_election.cc:343] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.049651 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.050019 10247 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
W20260709 12:13:47.051172 10019 leader_election.cc:343] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.051548 10247 ts_tablet_manager.cc:1403] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:13:47.051677 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.052510 10414 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.054095 10247 raft_consensus.cc:359] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.054872 10247 raft_consensus.cc:385] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.055127 10247 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.055662 10245 ts_tablet_manager.cc:1434] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:13:47.055734 10247 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.059170 10245 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.060308 10247 ts_tablet_manager.cc:1434] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:47.061239 10247 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.061619 10414 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.062050 10414 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.065860 10245 tablet_bootstrap.cc:654] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.066613 10414 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.067307 10247 tablet_bootstrap.cc:654] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.070232 10244 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.070748 10244 ts_tablet_manager.cc:1403] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.007s
I20260709 12:13:47.071404 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.073352 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.073377 10244 raft_consensus.cc:359] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.075007 10244 raft_consensus.cc:385] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.075274 10244 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.076306 10247 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.075961 10244 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.076685 10245 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.076718 10247 ts_tablet_manager.cc:1403] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 12:13:47.077196 10245 ts_tablet_manager.cc:1403] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.005s
I20260709 12:13:47.074702 10203 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:47.078799 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.079772 10245 raft_consensus.cc:359] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.080396 10245 raft_consensus.cc:385] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.080669 10245 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.079962 10414 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.081326 10244 ts_tablet_manager.cc:1434] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:13:47.081254 10245 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.081750 10247 raft_consensus.cc:359] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.082690 10244 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.082772 10247 raft_consensus.cc:385] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.083137 10247 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.083345 10245 ts_tablet_manager.cc:1434] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:47.084147 10245 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.083845 10247 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.085958 10247 ts_tablet_manager.cc:1434] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:47.086820 10247 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.091877 10244 tablet_bootstrap.cc:654] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.092401 10247 tablet_bootstrap.cc:654] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.094730 10245 tablet_bootstrap.cc:654] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.102365 10324 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.103262 10324 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.105460 10324 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.110813 10414 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.114302 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.119058 10050 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.121198  9951 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.126343 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.127045 10128 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.130062 10245 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.131502 10245 ts_tablet_manager.cc:1403] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.006s
I20260709 12:13:47.139029 10244 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.139497 10244 ts_tablet_manager.cc:1403] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.057s	user 0.032s	sys 0.020s
I20260709 12:13:47.134104 10245 raft_consensus.cc:359] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.140205 10245 raft_consensus.cc:385] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.140468 10245 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.141001 10247 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.141471 10247 ts_tablet_manager.cc:1403] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.055s	user 0.032s	sys 0.014s
I20260709 12:13:47.141920 10244 raft_consensus.cc:359] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.142587 10244 raft_consensus.cc:385] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.142843 10244 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.143458 10244 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.143920 10247 raft_consensus.cc:359] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.144562 10247 raft_consensus.cc:385] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.144819 10247 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.141043 10245 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.146121 10313 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.146601 10313 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.146505 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:47.147547 10322 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.147836 10245 ts_tablet_manager.cc:1434] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:13:47.147882 10322 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.148304 10322 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.148634 10313 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.148811 10245 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.149804 10244 ts_tablet_manager.cc:1434] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:47.150717 10244 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.154510 10245 tablet_bootstrap.cc:654] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.145404 10247 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.156054 10244 tablet_bootstrap.cc:654] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.156809 10247 ts_tablet_manager.cc:1434] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:13:47.157825 10247 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.158670 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.159278 10050 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.163462 10414 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.163975 10414 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.164249 10095 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.165158 10294 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.165052 10322 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.166009 10414 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.169377 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:47.169449 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.170095 10127 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:47.170775 10020 leader_election.cc:343] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.171423 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.171970 10054 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.176952 10127 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.178292 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.178809 10414 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.179136 10324 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.179273 10414 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.179647 10324 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.181334 10414 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.181692 10324 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.182268 10324 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.182806 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.182940 10324 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:47.165597 10294 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.183591 10294 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:47.184171 10019 leader_election.cc:343] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.183852 10324 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.184918 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:47.186142 10020 leader_election.cc:343] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.186687 10020 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.188246 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.188764 10414 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.188911 10055 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.189922 10378 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.192323 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.192581 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:47.192981 10128 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.193305 10321 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.193746 10321 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.194268 10467 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.194644 10467 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.194967 10467 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.195081 10322 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.196117 10321 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.197945 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.198168 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.198621 10204 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.199419 10247 tablet_bootstrap.cc:654] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:47.200251 10019 leader_election.cc:343] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.200500 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.200687 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.201084 10050 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.202318 10262 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.202970 10262 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.214591 10247 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.215024 10247 ts_tablet_manager.cc:1403] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:13:47.216014 10467 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.221194 10313 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.202418 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.221963 10324 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.222462 10324 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.221760 10313 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.224865 10321 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.225234 10321 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.225543 10321 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.225759 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.226295 10204 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.226814 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.228497 10051 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.229509 10292 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.229797 10094 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.230472 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.230808 10292 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.231251 10127 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:47.232458 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.233271 10322 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.233426 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.233892 10292 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.233628 10321 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.234304 10292 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.222716 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.234484 10467 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.233794 10247 raft_consensus.cc:359] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.252249 10247 raft_consensus.cc:385] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.233635 10322 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.255311 10322 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.258522 10245 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.259018 10245 ts_tablet_manager.cc:1403] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.040s
I20260709 12:13:47.257817 10467 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.253286 10247 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.263366 10247 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.229234 10313 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.255422 10050 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.260022 10467 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.255553 10053 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.264417 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:47.219642 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.275393 10247 ts_tablet_manager.cc:1434] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.015s
I20260709 12:13:47.276072 10247 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.234817 10324 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.280766 10244 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.282177 10244 ts_tablet_manager.cc:1403] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.029s
I20260709 12:13:47.271139 10414 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.287922 10321 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.289901 10414 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.291970 10245 raft_consensus.cc:359] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.292582 10245 raft_consensus.cc:385] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.292850 10245 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.293202 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:47.293452 10245 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.281387 10127 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.295288 10467 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.293805 10200 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.290863 10322 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.301221 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.312381 10128 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.311444 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.313711 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:13:47.314937 10019 leader_election.cc:343] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.315192 10467 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:47.293835 10414 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.315570 10467 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.326520 10467 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.330750 10245 ts_tablet_manager.cc:1434] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 12:13:47.332604 10245 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.284864 10203 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.348222 10244 raft_consensus.cc:359] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.350943 10244 raft_consensus.cc:385] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.351256 10244 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.351788 10244 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.354068 10244 ts_tablet_manager.cc:1434] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.072s	user 0.015s	sys 0.027s
I20260709 12:13:47.354993 10244 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.346235 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.359160 10055 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.361850 10324 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:47.360204 10050 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.370021 10294 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.370324 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:47.371599 10324 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.372255 10324 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:47.372406 10294 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.369079 10054 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.384894 10464 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:47.386520 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.393770 10472 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:13:47.388434  9952 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.398588 10262 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.400731 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.401274 10053 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:47.402683 10020 leader_election.cc:343] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.403165 10020 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.404421 10200 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.404565 10414 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.405397 10324 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.410298 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.411013 10049 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.406025 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.416247 10245 tablet_bootstrap.cc:654] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.417747 10052 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.423905 10322 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.434386 10247 tablet_bootstrap.cc:654] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.431339 10053 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.430929 10052 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.438167 10313 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.435349 10292 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.447093 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:47.448021 10126 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:47.467320 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.467852 10127 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.437252 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.471140 10471 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.480788 10472 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.481297 10472 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.483489 10244 tablet_bootstrap.cc:654] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:47.484078 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48122.4us
I20260709 12:13:47.482997 10472 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.479954 10471 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:47.493016 10471 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.497080 10321 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.492223 10467 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.511502 10049 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.519203 10321 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.535734 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:47.536341 10203 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.536510 10095 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.537806 10378 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.539016 10378 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.539815 10378 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.541052 10247 tablet_bootstrap.cc:492] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.541584 10247 ts_tablet_manager.cc:1403] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.266s	user 0.029s	sys 0.023s
I20260709 12:13:47.559614 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.560390 10052 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:47.547406 10292 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.575453 10321 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.576049 10245 tablet_bootstrap.cc:492] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.576553 10245 ts_tablet_manager.cc:1403] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.244s	user 0.020s	sys 0.000s
I20260709 12:13:47.560534 10467 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.588894 10245 raft_consensus.cc:359] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.590206 10245 raft_consensus.cc:385] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.590515 10245 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.591149 10245 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.593214 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.593807 10049 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.600566 10483 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.601086 10483 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.597764 10245 ts_tablet_manager.cc:1434] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:47.603241 10483 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:13:47.607784 10482 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:13:47.614773 10247 raft_consensus.cc:359] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.615310 10247 raft_consensus.cc:385] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.615561 10247 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.616292 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:47.616196 10247 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.617818 10247 ts_tablet_manager.cc:1434] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.002s
I20260709 12:13:47.618747 10247 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.619518 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:47.605286 10414 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.620103 10128 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.623692 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.624356 10204 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.620427 10414 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.628888 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.629535 10049 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:13:47.632647 10245 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.635329 10414 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.635663 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.636055 10321 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.639658  9949 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.636535 10321 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:47.646884 10169 leader_election.cc:343] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.647468 10321 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.647946 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:47.629573 10048 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
W20260709 12:13:47.643852 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:47.650785 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.640974 10203 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.649111 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.650868 10477 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:47.657704 10244 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.658092 10244 ts_tablet_manager.cc:1403] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.303s	user 0.014s	sys 0.015s
I20260709 12:13:47.658321 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.659657 10322 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.660794 10322 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:47.661545 10019 leader_election.cc:343] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.661134 10322 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.662456 10477 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:47.653654 10472 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.666054 10472 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.666417 10472 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.666579 10244 raft_consensus.cc:359] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.667256 10244 raft_consensus.cc:385] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.667512 10244 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.668020 10244 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.669440 10244 ts_tablet_manager.cc:1434] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 12:13:47.670090 10244 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.669921 10322 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.643573 10095 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:47.677107 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.677721 10199 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.680051 10473 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.656081 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.682029 10049 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.683457 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.663262 10477 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.687335 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:47.691501 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:47.691944 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.692081 10053 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:47.684299 10321 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.686733 10128 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:13:47.683593 10322 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:47.693085 10473 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:47.693938 10169 leader_election.cc:343] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.693434  9951 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.693846 10472 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.693516 10489 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:47.698146 10485 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:13:47.698391 10020 leader_election.cc:343] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.698663 10489 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.699333 10489 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.698905 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.699805 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.700505 10262 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.701292 10247 tablet_bootstrap.cc:654] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.699051  9951 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.701807 10049 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.709080 10244 tablet_bootstrap.cc:654] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.718873 10324 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:47.742242  9949 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 2, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.735769 10489 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.745143  9949 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.753178 10245 tablet_bootstrap.cc:654] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.767364 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:47.765781 10472 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.766584 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.766317 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:47.770651 10048 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.770896 10052 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.772059 10200 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.775836 10247 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.776684 10247 ts_tablet_manager.cc:1403] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.010s
I20260709 12:13:47.776940 10489 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.769047 10049 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:47.781400 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.783411 10322 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.783921 10322 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:47.784762 10322 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.787565 10052 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.788794 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.789608 10489 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.790244 10489 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.791033 10489 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.796444 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:47.798190 10199 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:47.801520 10244 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.802033 10244 ts_tablet_manager.cc:1403] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.132s	user 0.005s	sys 0.005s
I20260709 12:13:47.806753 10200 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.806067 10244 raft_consensus.cc:359] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.808560 10244 raft_consensus.cc:385] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.808880 10244 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.810245 10244 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.820125 10244 ts_tablet_manager.cc:1434] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:13:47.824803 10244 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.823415 10199 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.832091 10247 raft_consensus.cc:359] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.832924 10247 raft_consensus.cc:385] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.833232 10247 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.836290 10247 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.831017 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:47.838286 10247 ts_tablet_manager.cc:1434] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.001s
I20260709 12:13:47.839200 10247 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.842578 10244 tablet_bootstrap.cc:654] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.843232 10313 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:47.843817 10313 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:47.847509 10313 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.848435 10245 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.848884 10245 ts_tablet_manager.cc:1403] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.216s	user 0.023s	sys 0.006s
I20260709 12:13:47.857345 10245 raft_consensus.cc:359] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.858858 10245 raft_consensus.cc:385] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.859131 10245 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.859786 10245 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.856529  9951 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.863560 10048 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:47.864884  9949 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.866097 10245 ts_tablet_manager.cc:1434] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:13:47.867079 10245 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:47.869077 10262 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.869544 10262 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.871919 10262 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.873520 10247 tablet_bootstrap.cc:654] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.873905 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:47.880012 10019 leader_election.cc:343] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.884091 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.884219 10322 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:47.885345 10020 leader_election.cc:343] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.885782 10020 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.888129 10414 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.888828 10245 tablet_bootstrap.cc:654] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.888885 10322 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.897717 10244 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.898273 10244 ts_tablet_manager.cc:1403] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.005s
I20260709 12:13:47.901191 10244 raft_consensus.cc:359] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.901840 10244 raft_consensus.cc:385] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.902102 10244 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.902722 10244 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.904836 10244 ts_tablet_manager.cc:1434] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:47.905776 10244 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.911643  9951 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.937600 10244 tablet_bootstrap.cc:654] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.950553 10247 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:47.951001 10247 ts_tablet_manager.cc:1403] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.015s
I20260709 12:13:47.952411 10244 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.952889 10244 ts_tablet_manager.cc:1403] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 12:13:47.953044 10247 raft_consensus.cc:359] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.953579 10247 raft_consensus.cc:385] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.953774 10247 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.954761 10247 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.955130 10244 raft_consensus.cc:359] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.956104 10244 raft_consensus.cc:385] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.956379 10244 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.956732 10247 ts_tablet_manager.cc:1434] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:47.957069 10244 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.958603 10245 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:47.958956 10262 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.959061 10244 ts_tablet_manager.cc:1434] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:47.959758 10247 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:47.959527 10262 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.960006 10244 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.962311 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:47.959048 10245 ts_tablet_manager.cc:1403] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.005s
W20260709 12:13:47.963696 10020 leader_election.cc:343] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.966138 10245 raft_consensus.cc:359] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.966831 10245 raft_consensus.cc:385] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.967083 10245 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.968920 10245 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.968580 10244 tablet_bootstrap.cc:654] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.971618 10245 ts_tablet_manager.cc:1434] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:47.971515 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:47.972539 10245 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
W20260709 12:13:47.973016 10019 leader_election.cc:343] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:47.973510 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:47.974301 10413 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:47.977013 10247 tablet_bootstrap.cc:654] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.978731 10262 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:47.982474 10244 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:47.982944 10245 tablet_bootstrap.cc:654] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.982916 10244 ts_tablet_manager.cc:1403] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 12:13:47.985695 10244 raft_consensus.cc:359] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.986299 10244 raft_consensus.cc:385] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.986600 10244 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.987355 10244 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:47.989560 10244 ts_tablet_manager.cc:1434] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:47.990023 10313 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:47.990535 10244 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:47.997174 10244 tablet_bootstrap.cc:654] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.010237 10244 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:48.010694 10244 ts_tablet_manager.cc:1403] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 12:13:48.012784 10247 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:48.013296 10247 ts_tablet_manager.cc:1403] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.013s
I20260709 12:13:48.016681 10244 raft_consensus.cc:359] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.017767 10244 raft_consensus.cc:385] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.018025 10244 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.018767 10322 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.018724 10244 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.019097 10313 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.019232 10322 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.020959 10322 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.020984 10244 ts_tablet_manager.cc:1434] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:48.023002 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.023686 10128 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.025058 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:48.026889 10485 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.027228 10485 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.027554 10485 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.027886 10244 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:48.027987 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.028661 10048 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.032450 10262 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.032918 10262 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.035205 10262 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.036862 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.037840 10324 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:48.038152 10019 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.039325 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:48.040608 10020 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.041019 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:48.041970 10262 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.044449 10471 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.050211 10244 tablet_bootstrap.cc:654] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.052712 10313 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.058735 10245 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:48.059161 10245 ts_tablet_manager.cc:1403] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.087s	user 0.036s	sys 0.034s
I20260709 12:13:48.061506 10245 raft_consensus.cc:359] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.062117 10245 raft_consensus.cc:385] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.062366 10245 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.064471 10322 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.064935 10322 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.063102 10245 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.068936 10245 ts_tablet_manager.cc:1434] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:48.069993 10245 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:48.071484 10322 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.075460 10245 tablet_bootstrap.cc:654] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.078365 10473 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.084939 10245 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:48.085457 10245 ts_tablet_manager.cc:1403] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:13:48.085448 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.086117 10049 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.087687 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.088409 10245 raft_consensus.cc:359] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.088817 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.089046 10245 raft_consensus.cc:385] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.089299 10245 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.089594 10244 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:48.090004 10322 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.089879 10245 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.090332 10322 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.090646 10322 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.090013 10244 ts_tablet_manager.cc:1403] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.011s
I20260709 12:13:48.091801 10245 ts_tablet_manager.cc:1434] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:48.092602 10245 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:48.093233 10244 raft_consensus.cc:359] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.093837 10244 raft_consensus.cc:385] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.094082 10244 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
W20260709 12:13:48.094991 10169 leader_election.cc:343] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.097390 10322 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.098224 10245 tablet_bootstrap.cc:654] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.098685 10244 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.099995 10322 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.101627 10485 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.177979 10130 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:48.115221 10245 tablet_bootstrap.cc:492] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:48.103057 10244 ts_tablet_manager.cc:1434] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:48.179134 10245 ts_tablet_manager.cc:1403] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.087s	user 0.041s	sys 0.032s
I20260709 12:13:48.155125 10262 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.179665 10244 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:48.180263 10485 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.112922 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:48.103400 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:48.181876 10049 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.181730 10245 raft_consensus.cc:359] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.182402 10245 raft_consensus.cc:385] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.182708 10245 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.183323 10245 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.185290 10245 ts_tablet_manager.cc:1434] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:13:48.186162 10245 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:48.179978 10262 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.188946 10262 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.190099 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.186245 10244 tablet_bootstrap.cc:654] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.102820 10322 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.190740 10200 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:48.191195 10322 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.191969 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.194052 10245 tablet_bootstrap.cc:654] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.195065 10262 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.195402 10262 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.195680 10262 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.199337 10244 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:48.199779 10244 ts_tablet_manager.cc:1403] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:13:48.201786 10473 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.202283 10473 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.206552 10322 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.213229 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.213995 10052 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.215444 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.216696 10052 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:13:48.219385 10169 leader_election.cc:343] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.218787 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:48.220654 10322 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.246064 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:48.246690 10130 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.219024 10324 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.219527 10247 raft_consensus.cc:359] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.249009 10247 raft_consensus.cc:385] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.249238 10247 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.252009 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.248656 10313 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:48.256536 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.250348 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.258636 10247 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.258944 10262 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.319229 10245 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:48.330870 10245 ts_tablet_manager.cc:1403] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.029s
I20260709 12:13:48.332043 10130 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:48.332931 10049 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:48.334152 10322 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.333561 10245 raft_consensus.cc:359] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.334610 10322 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.335105 10322 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.334956 10245 raft_consensus.cc:385] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.246739 10053 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.336490 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 80039.6us
I20260709 12:13:48.335682 10245 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.338198 10262 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:48.340571 10169 leader_election.cc:343] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.341435 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:48.341925 10245 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.343094 10247 ts_tablet_manager.cc:1434] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.329s	user 0.007s	sys 0.007s
I20260709 12:13:48.344276 10247 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:48.333722 10473 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.345497 10244 raft_consensus.cc:359] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.346827 10244 raft_consensus.cc:385] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.347102 10244 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.338876 10414 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.351210 10245 ts_tablet_manager.cc:1434] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:48.259265 10324 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.353420 10244 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.347479 10471 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.365959 10244 ts_tablet_manager.cc:1434] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.166s	user 0.012s	sys 0.006s
I20260709 12:13:48.367941 10244 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:48.364566 10471 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:13:48.369673 10020 leader_election.cc:343] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.369345 10471 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.352924 10414 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.376099 10322 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.380290 10262 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.380815 10262 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.416476 10245 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:48.380225 10413 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.423982 10262 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.434778 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.423522 10413 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.458902 10262 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:13:48.459486 10262 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.484072 10413 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.500710 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.506052 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:13:48.564945 10521 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:13:48.566673 10052 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:48.554359 10125 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.594245 10527 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.594800 10527 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.609406 10322 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.626391 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.626731 10321 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.627322 10321 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.616712 10378 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 12:13:48.627779 10525 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 12:13:48.620921 10527 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.614356 10053 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
W20260709 12:13:48.636920 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260709 12:13:48.622748 10262 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.635720 10414 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.641831 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:48.654786 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:48.672781 10053 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.641713 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:48.668999 10321 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:48.696899 10199 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.719228 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 77472.4us
I20260709 12:13:48.725761 10528 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.727970 10094 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:48.726389 10528 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:48.730870 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:13:48.717276 10020 leader_election.cc:343] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.716369 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.731038 10528 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.733345 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.733889 10533 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.729717 10321 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.745419 10247 tablet_bootstrap.cc:654] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.738179 10052 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.749276 10477 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.750942 10053 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:48.753720 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:48.731483 10049 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:48.734555 10324 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:48.740670 10533 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.762979 10322 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.761826 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.769439 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.772498 10485 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.773555 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.778712 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:48.773882 10485 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.777060 10467 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:48.781852 10467 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:48.782485 10485 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.786695 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.817116 10531 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.786501 10471 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.822142 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.822549 10467 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.825824 10471 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.843454 10471 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.827329 10049 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:48.858349 10244 tablet_bootstrap.cc:654] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.858393 10245 tablet_bootstrap.cc:654] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:48.846179 10020 leader_election.cc:343] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:48.861778 10020 leader_election.cc:343] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.842882 10531 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.872713 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.879403 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.880023 10129 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.890662 10378 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:48.892562 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:48.899290 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.897017 10489 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.901301 10489 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.901625 10489 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:48.893599 10020 leader_election.cc:343] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.908641 10485 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:48.916389 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:48.924698 10529 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:13:48.916054 10020 leader_election.cc:343] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:48.932406 10169 leader_election.cc:343] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.936367 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:48.945176 10247 tablet_bootstrap.cc:492] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:48.945699 10247 ts_tablet_manager.cc:1403] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.602s	user 0.018s	sys 0.014s
I20260709 12:13:48.947556 10245 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:48.948053 10245 ts_tablet_manager.cc:1403] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.532s	user 0.035s	sys 0.001s
W20260709 12:13:48.949076 10019 leader_election.cc:343] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.949584 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:48.930974 10126 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:13:48.954630 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:48.957231 10414 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:48.959494 10019 leader_election.cc:343] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.995677 10198 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:48.954715 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.020406 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:48.944679 10489 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.045332 10247 raft_consensus.cc:359] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.047992 10247 raft_consensus.cc:385] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.048207 10247 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.050129 10247 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.037352 10019 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.051608 10247 ts_tablet_manager.cc:1434] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
W20260709 12:13:49.051440 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 100706us
I20260709 12:13:49.041267 10485 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.051397 10414 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:49.066601 10543 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:13:49.060931 10196 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:49.073493 10533 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.075184 10471 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.077258 10471 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.078806 10195 raft_consensus.cc:2368] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:13:49.073513 10244 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.080084 10244 ts_tablet_manager.cc:1403] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.713s	user 0.024s	sys 0.006s
I20260709 12:13:49.088065 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.088377 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.088953 10051 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:13:49.090106 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 94736.6us
I20260709 12:13:49.092273 10169 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:13:49.099189 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 183746us
I20260709 12:13:49.089330 10489 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.092383 10055 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.108804 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.095391 10477 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.097540 10245 raft_consensus.cc:359] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.115728 10245 raft_consensus.cc:385] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.115967 10245 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.115924 10199 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:49.116171 10477 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.120474 10477 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.122097 10414 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:49.122090 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:49.123226 10414 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.123385 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:49.123661 10414 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.124239 10199 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:49.125419 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.121685 10245 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.093334 10472 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:13:49.127426 10413 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.127545 10533 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.129813 10413 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:49.130054 10244 raft_consensus.cc:359] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.130770 10244 raft_consensus.cc:385] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.131014 10244 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.140296 10244 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.150115 10244 ts_tablet_manager.cc:1434] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:13:49.152136 10244 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.145728 10413 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.162456 10245 ts_tablet_manager.cc:1434] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.214s	user 0.017s	sys 0.001s
I20260709 12:13:49.163631 10245 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.164381 10019 leader_election.cc:400] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:13:49.164714 10019 leader_election.cc:403] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:49.167409 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.171041 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.172230 10247 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.182641 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:49.191831 10531 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.191931 10051 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:13:49.177250 10127 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:13:49.196228 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.204985 10414 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.187763 10489 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.224400 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:49.225767 10245 tablet_bootstrap.cc:654] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.216737 10527 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.228583 10527 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:49.229393 10527 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.194057 10530 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:13:49.258646 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.262517 10247 tablet_bootstrap.cc:654] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:49.265368 10019 leader_election.cc:343] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.265841 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.269232 10244 tablet_bootstrap.cc:654] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.271466 10531 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.271327 10477 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.271986 10531 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.273500 10477 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.273896 10531 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.276973 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.279906 10055 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:49.295342 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.296787 10477 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.297315 10477 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:13:49.283728 10020 leader_election.cc:343] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.298182 10477 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.305429 10563 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:49.308522 10020 leader_election.cc:343] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.320528 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:49.321280 10196 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:49.322158 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.323485 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:49.324286 10125 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:13:49.324728 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.318048 10414 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.325825 10563 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:13:49.329559 10019 leader_election.cc:343] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.331120 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.330206 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:49.332005 10128 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.332196 10530 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.351661 10244 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.352249 10244 ts_tablet_manager.cc:1403] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.005s
I20260709 12:13:49.360430 10533 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.347242 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:13:49.367566 10169 consensus_peers.cc:597] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:49.376068 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.366384 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.379603 10049 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:49.385233 10244 raft_consensus.cc:359] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.385928 10244 raft_consensus.cc:385] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.386201 10244 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.386827 10244 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.394912  9952 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.396968  9952 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:49.399931 10169 leader_election.cc:343] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.402129  9952 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.406566 10169 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.410393 10467 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.419831 10128 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:13:49.472909 10244 ts_tablet_manager.cc:1434] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.120s	user 0.005s	sys 0.003s
W20260709 12:13:49.473937 10169 leader_election.cc:343] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.478966 10489 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.479530 10489 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.480857 10247 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.481320 10247 ts_tablet_manager.cc:1403] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.309s	user 0.027s	sys 0.001s
I20260709 12:13:49.481779 10489 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.484838 10533 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.485340 10533 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.485791 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.486696 10204 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:49.487535 10533 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.490049 10245 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.490521 10245 ts_tablet_manager.cc:1403] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.327s	user 0.021s	sys 0.035s
I20260709 12:13:49.492235 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:49.492835 10052 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:49.493033 10245 raft_consensus.cc:359] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.493669 10245 raft_consensus.cc:385] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.493918 10245 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.496573 10245 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.499051 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:49.499329 10244 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.500622 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:49.499153 10245 ts_tablet_manager.cc:1434] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:49.505366 10244 tablet_bootstrap.cc:654] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.507121 10247 raft_consensus.cc:359] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.508142 10489 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.508437 10247 raft_consensus.cc:385] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.508765 10247 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.509373 10247 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.508517 10245 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.515841 10245 tablet_bootstrap.cc:654] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.506969 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.516852 10489 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.519729 10247 ts_tablet_manager.cc:1434] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:13:49.520684 10247 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.521250 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.523041 10528 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.523406 10528 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.523733 10528 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.528302 10527 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.526317 10247 tablet_bootstrap.cc:654] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.530407 10528 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.530988 10245 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.531446 10245 ts_tablet_manager.cc:1403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:13:49.532333 10528 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:13:49.537139 10169 leader_election.cc:343] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.537358 10245 raft_consensus.cc:359] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.537614 10528 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.538725 10245 raft_consensus.cc:385] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.539004 10245 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.538393 10244 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.539736 10244 ts_tablet_manager.cc:1403] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.010s
I20260709 12:13:49.539613 10245 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.540064 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.540665 10054 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.541576 10245 ts_tablet_manager.cc:1434] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:49.542390 10245 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.542128 10244 raft_consensus.cc:359] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.542763 10244 raft_consensus.cc:385] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.543011 10244 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.543617 10244 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.546037 10244 ts_tablet_manager.cc:1434] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:49.546940 10244 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.549574 10054 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:49.552269 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:49.552487 10247 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.553898 10247 ts_tablet_manager.cc:1403] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:13:49.554980 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.556373 10247 raft_consensus.cc:359] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.557231 10247 raft_consensus.cc:385] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.557474 10247 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.557780 10528 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.558673 10245 tablet_bootstrap.cc:654] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.558398 10247 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.559000 10528 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:49.559739 10528 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.560472 10247 ts_tablet_manager.cc:1434] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:13:49.561339 10247 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
W20260709 12:13:49.563553 10169 leader_election.cc:343] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.585628 10244 tablet_bootstrap.cc:654] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.580111 10414 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.587795 10414 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.589758 10414 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.592262 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:49.593924 10019 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.596937 10247 tablet_bootstrap.cc:654] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:49.596995 10169 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:49.604287 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.605805 10414 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:13:49.612782 10020 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.614696 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.616253 10414 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.623973 10245 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.624449 10245 ts_tablet_manager.cc:1403] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.022s
I20260709 12:13:49.629549  9950 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.631408 10244 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.631839 10244 ts_tablet_manager.cc:1403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.005s
I20260709 12:13:49.632059 10530 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.632490 10530 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.634295 10244 raft_consensus.cc:359] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.634931 10244 raft_consensus.cc:385] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.635186 10244 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.635726 10244 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.629942 10245 raft_consensus.cc:359] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.637219 10245 raft_consensus.cc:385] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.637472 10245 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.638055 10245 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.639395 10247 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.639871 10247 ts_tablet_manager.cc:1403] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.005s
I20260709 12:13:49.640425 10245 ts_tablet_manager.cc:1434] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:13:49.641286 10245 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.643041 10247 raft_consensus.cc:359] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.643718 10247 raft_consensus.cc:385] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.644013 10247 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.645040 10244 ts_tablet_manager.cc:1434] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:49.644763 10247 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.645943 10244 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.646411 10530 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.648648 10247 ts_tablet_manager.cc:1434] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:49.650326 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.651774 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.651865 10413 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:49.652869 10019 leader_election.cc:343] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.654561 10247 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.659827 10245 tablet_bootstrap.cc:654] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:49.660468 10020 leader_election.cc:343] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.660892 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.661525 10530 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.664945 10244 tablet_bootstrap.cc:654] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.668195 10247 tablet_bootstrap.cc:654] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.696273 10129 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.715809  9949 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.717746  9949 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.719587  9949 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.724931 10245 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.726150 10244 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.726189 10245 ts_tablet_manager.cc:1403] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.019s
I20260709 12:13:49.726749 10244 ts_tablet_manager.cc:1403] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.015s
I20260709 12:13:49.732463 10244 raft_consensus.cc:359] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.733146 10244 raft_consensus.cc:385] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.733654 10244 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.734203 10247 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.734349 10244 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.735306 10247 ts_tablet_manager.cc:1403] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.081s	user 0.026s	sys 0.039s
I20260709 12:13:49.736738 10244 ts_tablet_manager.cc:1434] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:49.736960 10245 raft_consensus.cc:359] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.737599 10245 raft_consensus.cc:385] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.737679 10244 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.737886 10245 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.738046 10247 raft_consensus.cc:359] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.738885 10247 raft_consensus.cc:385] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.738718 10245 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.739236 10247 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.740113 10247 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.741948 10245 ts_tablet_manager.cc:1434] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:13:49.742499 10247 ts_tablet_manager.cc:1434] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:49.742916 10245 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.743511 10247 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.746774 10244 tablet_bootstrap.cc:654] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.749918 10247 tablet_bootstrap.cc:654] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.750888 10245 tablet_bootstrap.cc:654] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.760567 10245 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.761291 10245 ts_tablet_manager.cc:1403] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:13:49.763532 10245 raft_consensus.cc:359] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.764137 10245 raft_consensus.cc:385] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.764252 10244 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.764420 10245 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.764626 10247 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.764669 10244 ts_tablet_manager.cc:1403] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 12:13:49.765112 10245 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.767318 10245 ts_tablet_manager.cc:1434] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:49.767474 10244 raft_consensus.cc:359] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.768057 10244 raft_consensus.cc:385] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.768198 10245 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.769047 10247 ts_tablet_manager.cc:1403] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 12:13:49.770116 10530 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.770577 10530 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.771596 10247 raft_consensus.cc:359] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.772352 10247 raft_consensus.cc:385] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.772505 10530 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.772675 10247 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.773392 10247 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.774727 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.775290 10204 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:49.775403 10247 ts_tablet_manager.cc:1434] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:13:49.776321 10247 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.776448 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.777981 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.778584 10129 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:49.781929 10530 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.782305 10530 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.782681 10530 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.783802 10247 tablet_bootstrap.cc:654] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.790380 10530 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.793020 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:49.793574 10129 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.798470 10247 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.768311 10244 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.799297 10244 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.802731 10244 ts_tablet_manager.cc:1434] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:13:49.804687 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:49.807039 10204 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.798976 10247 ts_tablet_manager.cc:1403] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:13:49.806185 10245 tablet_bootstrap.cc:654] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.812546 10054 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:49.812575 10204 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:49.812500 10247 raft_consensus.cc:359] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.813769 10247 raft_consensus.cc:385] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.814044 10247 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.814169 10533 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:49.814518 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:49.814754 10247 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.815502 10413 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.815959 10413 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:49.816828 10247 ts_tablet_manager.cc:1434] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:13:49.816758 10413 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.817776 10247 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.818910 10125 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:49.820308 10528 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:49.813169 10530 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.824275 10247 tablet_bootstrap.cc:654] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.825086 10528 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.827817 10244 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.827843 10528 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.806409 10129 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:49.829859 10528 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.831928 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:49.831676  9951 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:49.833177 10169 leader_election.cc:343] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.834098 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.835237 10244 tablet_bootstrap.cc:654] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:49.835281 10169 leader_election.cc:343] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.835739 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.836668 10528 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.844822 10245 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:49.845337 10245 ts_tablet_manager.cc:1403] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.077s	user 0.003s	sys 0.012s
I20260709 12:13:49.846796 10244 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:49.847295 10244 ts_tablet_manager.cc:1403] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.002s
I20260709 12:13:49.850855 10244 raft_consensus.cc:359] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.851516 10244 raft_consensus.cc:385] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.851780 10244 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.852422 10245 raft_consensus.cc:359] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.852595 10244 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.853144 10245 raft_consensus.cc:385] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.853433 10245 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.854060 10245 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.854888 10244 ts_tablet_manager.cc:1434] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:49.855753 10244 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:49.856115 10245 ts_tablet_manager.cc:1434] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:49.857316 10245 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:49.860767 10528 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.861135 10244 tablet_bootstrap.cc:654] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.861209 10528 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.862003 10247 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.862452 10247 ts_tablet_manager.cc:1403] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:13:49.863718 10528 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:49.864879 10247 raft_consensus.cc:359] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.865562 10247 raft_consensus.cc:385] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.865368 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:49.865836 10247 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.866309 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.866966 10551 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.867450 10551 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:49.868021 10169 leader_election.cc:343] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.870456 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:49.871114 10047 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:49.872628 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:49.873409 10247 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.874336 10473 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.874388 10046 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:49.874853 10473 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.875653 10247 ts_tablet_manager.cc:1434] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:49.875869 10473 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.876664 10247 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.877887 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.879391 10551 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.879653 10534 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.880074 10534 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.880391 10534 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.883096 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.883661 10204 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:49.884450 10247 tablet_bootstrap.cc:654] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.899906 10245 tablet_bootstrap.cc:654] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.904706 10247 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:49.905238 10247 ts_tablet_manager.cc:1403] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 12:13:49.899520 10473 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.905655 10530 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.906160 10530 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.907790 10247 raft_consensus.cc:359] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.908216 10530 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.908494 10247 raft_consensus.cc:385] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.908776 10247 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.909106 10413 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.909194 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:49.909397 10247 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.909590 10413 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.909900 10046 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.912660 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.913082 10413 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:49.914883 10019 leader_election.cc:343] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.916109 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:49.916874 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:49.917702 10020 leader_election.cc:343] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:49.918874 10020 leader_election.cc:343] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.919313 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.919512 10527 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:49.920581 10530 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:49.921602 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:49.922178 10204 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:49.923251 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:49.924160 10473 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.924283 10262 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.947916 10262 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.948299 10262 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.929785 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:49.949141 10200 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.931143 10247 ts_tablet_manager.cc:1434] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:13:49.955335 10247 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:49.941813 10528 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.960558 10200 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:49.933903 10534 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.968544 10262 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.969137 10526 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.969597 10526 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:49.971899 10262 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.979782 10526 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:49.980428 10124 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.987246 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:49.987903 10200 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.972909 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:49.994822 10321 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.999593 10046 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:50.002534 10533 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:50.001259 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.005811 10048 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:50.006487 10321 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:50.007319 10321 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.008637 10262 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.009076 10262 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.012598 10262 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.013607 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:50.013697 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.014990 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.015067 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:13:50.016345 10094 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.016546 10526 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.016974 10526 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.017311 10526 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:50.021622 10020 leader_election.cc:343] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.024751 10534 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:13:50.025851 10019 leader_election.cc:343] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.026288 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.027269 10262 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.003822 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.029445 10245 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
W20260709 12:13:50.029752 10020 leader_election.cc:343] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.029919 10245 ts_tablet_manager.cc:1403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.014s
I20260709 12:13:50.032812 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.035105 10247 tablet_bootstrap.cc:654] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:50.036801 10169 leader_election.cc:343] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.041267 10244 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:50.041675 10244 ts_tablet_manager.cc:1403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.186s	user 0.063s	sys 0.067s
I20260709 12:13:50.038923 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.047252 10200 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.053212 10244 raft_consensus.cc:359] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.048187 10526 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.054234 10244 raft_consensus.cc:385] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.054996 10244 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.051141 10047 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.048300 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.061314 10262 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.061789 10262 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:50.062479 10526 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.063614 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.070583 10049 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.063964 10245 raft_consensus.cc:359] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.071025 10245 raft_consensus.cc:385] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.071300 10245 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.071943 10245 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.068068 10244 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.073436 10245 ts_tablet_manager.cc:1434] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.003s
I20260709 12:13:50.073627 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.074157 10244 ts_tablet_manager.cc:1434] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
W20260709 12:13:50.074810 10094 leader_election.cc:343] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.076323 10244 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:50.079938 10245 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.085309 10047 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:50.063831 10262 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.089895 10049 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:50.091079 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:50.092442 10526 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.092892 10526 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:50.093751 10526 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.096410 10244 tablet_bootstrap.cc:654] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.097163  9952 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.107710 10244 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:50.108191 10244 ts_tablet_manager.cc:1403] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.002s
I20260709 12:13:50.110797 10244 raft_consensus.cc:359] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.111455 10244 raft_consensus.cc:385] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.111720 10244 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.112296 10244 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.113826 10244 ts_tablet_manager.cc:1434] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:50.114830 10244 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:50.120654 10244 tablet_bootstrap.cc:654] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.122946 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.130235 10534 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.138219 10247 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.138801 10247 ts_tablet_manager.cc:1403] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.184s	user 0.032s	sys 0.011s
I20260709 12:13:50.144838  9951 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.139997 10534 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:50.151947 10321 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.160549 10321 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.159979 10129 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.164414 10321 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.172434 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.173218 10048 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:50.165460 10245 tablet_bootstrap.cc:654] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.167656 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.175602 10200 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:13:50.176326 10527 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.176751 10527 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.178323 10533 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.179941 10533 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.180531 10527 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:50.181761 10533 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:50.183192 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:50.184720 10473 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.189699 10534 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.193065 10247 raft_consensus.cc:359] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.193799 10247 raft_consensus.cc:385] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.194098 10247 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.195501 10247 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.198839 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.199456 10047 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:50.201323 10473 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.201799 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.202857 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.202768 10533 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.203476 10128 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:50.205523 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.206233 10528 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.206611 10528 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.206924 10528 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.207010 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.207417 10247 ts_tablet_manager.cc:1434] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 12:13:50.207675 10047 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:50.208250 10247 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.213307 10528 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.215183 10528 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:50.206259  9952 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.218873 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.219413 10048 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:50.221434 10169 leader_election.cc:343] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.223814 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:13:50.226863 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:50.235077 10244 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:50.235038 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.235671 10244 ts_tablet_manager.cc:1403] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.121s	user 0.036s	sys 0.014s
I20260709 12:13:50.227721 10533 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.236984 10533 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.237910 10533 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.239496 10244 raft_consensus.cc:359] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.240134 10244 raft_consensus.cc:385] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:50.240193 10169 leader_election.cc:343] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.240440 10244 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.242846 10244 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.248757 10244 ts_tablet_manager.cc:1434] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:50.249650 10244 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:50.253185 10048 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:50.254294 10533 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.258306 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.260826 10477 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.269366 10262 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.269833 10262 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.266614 10477 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:50.273139 10262 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.276677 10245 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.276655 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.277305 10245 ts_tablet_manager.cc:1403] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.198s	user 0.006s	sys 0.023s
I20260709 12:13:50.277477 10477 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:50.283385 10019 leader_election.cc:343] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.286224  9949 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.288749 10245 raft_consensus.cc:359] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.289281 10245 raft_consensus.cc:385] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.289479 10245 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.274642 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.290778 10321 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:13:50.291266 10321 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.290488 10047 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.295889 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.297863 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.299325 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:50.299873 10245 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.301651 10245 ts_tablet_manager.cc:1434] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 12:13:50.302608 10245 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.302536 10619 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.304224 10321 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.286981 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.305091 10533 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:50.308744 10247 tablet_bootstrap.cc:654] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:50.310786 10020 leader_election.cc:343] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.311139 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.311677 10262 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.321923 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.322538 10125 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.324196 10047 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:50.326798 10262 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.327173 10262 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.328614 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.331629 10262 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.332232 10528 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.340715 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:50.343959 10020 leader_election.cc:343] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.346794 10528 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:50.348248 10125 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:50.349599 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.349898 10244 tablet_bootstrap.cc:654] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:50.350970 10019 leader_election.cc:343] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.351490 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.348419 10528 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.355795 10413 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.352340 10531 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:50.359962 10262 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.371387 10245 tablet_bootstrap.cc:654] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.374257  9952 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.392174 10247 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.392714 10247 ts_tablet_manager.cc:1403] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.002s
I20260709 12:13:50.411728 10244 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:50.412145 10244 ts_tablet_manager.cc:1403] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.163s	user 0.008s	sys 0.006s
I20260709 12:13:50.413497  9952 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.416266 10247 raft_consensus.cc:359] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.416837 10247 raft_consensus.cc:385] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.417138 10247 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.419123 10247 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.416967 10245 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.420411 10245 ts_tablet_manager.cc:1403] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.012s
I20260709 12:13:50.420889 10244 raft_consensus.cc:359] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.421449 10244 raft_consensus.cc:385] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.421619 10244 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.422325 10247 ts_tablet_manager.cc:1434] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 12:13:50.422540 10262 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.422473 10244 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.423207 10247 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.422976 10262 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.424741 10262 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.425616 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:13:50.426839 10020 leader_election.cc:343] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.430951 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.431540 10204 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:50.432763 10245 raft_consensus.cc:359] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.432873 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.433444 10245 raft_consensus.cc:385] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.433720 10245 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.434595 10413 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.434993 10413 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.435328 10413 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.438045 10247 tablet_bootstrap.cc:654] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.434329 10245 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.441869 10245 ts_tablet_manager.cc:1434] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:13:50.443234 10245 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.448757 10245 tablet_bootstrap.cc:654] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.451548 10413 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.457947 10472 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.461021 10262 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.464519 10247 tablet_bootstrap.cc:492] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.468714 10247 ts_tablet_manager.cc:1403] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 12:13:50.468581 10262 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.470325 10262 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.471156 10247 raft_consensus.cc:359] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.471789 10247 raft_consensus.cc:385] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.472031 10247 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.472069 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.472689 10247 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:13:50.474159 10019 leader_election.cc:343] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.474686 10247 ts_tablet_manager.cc:1434] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:50.475541 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.474709 10244 ts_tablet_manager.cc:1434] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:13:50.475525 10247 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.473397 10413 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:13:50.476850 10020 leader_election.cc:343] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.476321 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.477934 10204 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.482344 10247 tablet_bootstrap.cc:654] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.485594 10244 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Bootstrap starting.
I20260709 12:13:50.487648 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.491667 10244 tablet_bootstrap.cc:654] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.491923 10204 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.493046 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.494156 10413 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.494671 10413 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:50.495425 10413 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.499527 10244 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: No bootstrap required, opened a new log
I20260709 12:13:50.499940 10244 ts_tablet_manager.cc:1403] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:13:50.505074 10247 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.505560 10247 ts_tablet_manager.cc:1403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 12:13:50.507926 10321 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.508220 10247 raft_consensus.cc:359] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.508913 10247 raft_consensus.cc:385] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.509200 10247 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
W20260709 12:13:50.509771 10020 leader_election.cc:343] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.509898 10247 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.510257 10020 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.510921 10413 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.511392 10619 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.511997 10247 ts_tablet_manager.cc:1434] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:50.512858 10247 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.508347 10321 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.515978 10321 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.517170 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.517897 10199 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:50.518256 10247 tablet_bootstrap.cc:654] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.520061 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.518626 10413 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.519672 10244 raft_consensus.cc:359] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.520648 10472 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.521013 10244 raft_consensus.cc:385] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.521317 10244 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.521910 10244 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.523993 10244 ts_tablet_manager.cc:1434] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:13:50.535526 10247 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.535972 10247 ts_tablet_manager.cc:1403] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 12:13:50.538371 10247 raft_consensus.cc:359] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.539040 10247 raft_consensus.cc:385] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.539294 10247 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.539871 10247 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.541288 10247 ts_tablet_manager.cc:1434] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:50.541951 10245 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.542135 10247 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.542435 10245 ts_tablet_manager.cc:1403] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.012s
I20260709 12:13:50.544842 10245 raft_consensus.cc:359] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.545464 10245 raft_consensus.cc:385] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.545732 10245 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.547556 10245 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.548411 10247 tablet_bootstrap.cc:654] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.554316 10245 ts_tablet_manager.cc:1434] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:13:50.555384 10245 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.558981 10262 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.559273 10247 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.559674 10247 ts_tablet_manager.cc:1403] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:13:50.559401 10262 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.561120 10262 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.562243 10247 raft_consensus.cc:359] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.562975 10247 raft_consensus.cc:385] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.563235 10247 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.563921 10247 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.564497 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.565078 10195 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:50.565346 10247 ts_tablet_manager.cc:1434] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:50.566375 10247 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.567096 10129 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.572458 10245 tablet_bootstrap.cc:654] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.566953 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.573485 10530 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.573829 10530 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.574139 10530 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.574476 10247 tablet_bootstrap.cc:654] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.580317 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.580967 10128 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:50.581852 10095 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:13:50.586525 10321 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.595575 10526 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.596154 10526 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.599630 10526 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.599852 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.585150 10530 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.600713 10195 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 1: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:13:50.601672 10531 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.604905 10530 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.606603 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.607887 10245 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.609594 10125 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.611989 10247 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.614295 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.628137 10195 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.629249 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.629830 10129 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.616732  9949 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.632375 10245 ts_tablet_manager.cc:1403] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 12:13:50.628125 10247 ts_tablet_manager.cc:1403] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.014s
I20260709 12:13:50.637449 10247 raft_consensus.cc:359] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.638023 10247 raft_consensus.cc:385] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.638278 10247 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.638494 10534 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.634799 10195 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.639791 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.634860 10245 raft_consensus.cc:359] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.640662 10245 raft_consensus.cc:385] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.640934 10245 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.641844 10531 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.642158 10262 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.642401 10531 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:50.643821 10129 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.643877 10531 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.642589 10262 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.647554 10262 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.650183 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.647405 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:13:50.651562 10019 leader_election.cc:343] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.654554 10526 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.654923 10195 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.641968 10245 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.658197 10245 ts_tablet_manager.cc:1434] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:13:50.661470 10526 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.663228 10321 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.665906 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.647353 10247 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.668603 10247 ts_tablet_manager.cc:1434] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.000s
W20260709 12:13:50.669867 10020 leader_election.cc:343] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.670729 10020 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:13:50.671520 10262 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.674607 10623 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.678028 10247 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.681998 10245 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.686084 10247 tablet_bootstrap.cc:654] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.696581 10245 tablet_bootstrap.cc:654] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.697580 10247 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.698017 10247 ts_tablet_manager.cc:1403] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:13:50.700896 10247 raft_consensus.cc:359] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.701536 10247 raft_consensus.cc:385] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.701794 10247 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.702538 10247 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.706198 10247 ts_tablet_manager.cc:1434] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:50.706967 10247 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.708242  9949 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.711001 10526 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.714532 10526 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.725021 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.725672 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:50.726702 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:50.727421 10619 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.727794 10619 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.728112 10619 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.728452 10247 tablet_bootstrap.cc:654] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.730223 10526 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.732107 10245 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.732581 10245 ts_tablet_manager.cc:1403] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.007s
I20260709 12:13:50.733873 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.736383 10199 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:50.740799 10245 raft_consensus.cc:359] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.741509 10245 raft_consensus.cc:385] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.741822 10245 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.742481 10245 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.750092 10619 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.750885 10245 ts_tablet_manager.cc:1434] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:50.752133 10619 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.753232 10245 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.752934 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.754298 10047 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.754361 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.754988 10195 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.755429 10247 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.755927 10247 ts_tablet_manager.cc:1403] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.010s
I20260709 12:13:50.758623 10247 raft_consensus.cc:359] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.759361 10247 raft_consensus.cc:385] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.759668 10247 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.760479 10245 tablet_bootstrap.cc:654] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.760320 10247 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.761549 10195 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:50.763031 10247 ts_tablet_manager.cc:1434] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:50.763306 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:50.763680 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:50.764062 10526 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.764178 10247 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.764176 10623 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.764602 10526 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:50.766203 10526 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.781689 10619 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.782243 10619 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.784369 10619 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.786989 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.787752 10195 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:50.789264 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:50.790496 10619 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.790951 10619 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.791517 10619 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.797009 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.803609 10619 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.804605 10247 tablet_bootstrap.cc:654] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.805887 10619 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.806741 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:50.806862 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.807425 10195 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.808058 10048 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:50.809454 10247 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.809900 10247 ts_tablet_manager.cc:1403] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:13:50.812388 10247 raft_consensus.cc:359] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.813028 10247 raft_consensus.cc:385] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.813285 10247 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.814045 10195 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:50.813867 10247 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.815318 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:13:50.816075 10551 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.816308 10247 ts_tablet_manager.cc:1434] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:50.816519 10551 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:50.817230 10247 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.817341 10551 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.817360 10528 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:50.824400 10528 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.827863 10247 tablet_bootstrap.cc:654] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.833956 10245 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.834415 10245 ts_tablet_manager.cc:1403] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.011s
I20260709 12:13:50.836850 10245 raft_consensus.cc:359] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.837479 10245 raft_consensus.cc:385] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.837719 10245 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.838404 10245 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.841300 10245 ts_tablet_manager.cc:1434] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:50.842031 10245 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.843891  9951 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.846104 10245 tablet_bootstrap.cc:654] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.855827 10247 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.856323 10247 ts_tablet_manager.cc:1403] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.003s
I20260709 12:13:50.859162 10247 raft_consensus.cc:359] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.860152 10247 raft_consensus.cc:385] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.860458 10247 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.861136 10247 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.861943 10130 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.863152 10247 ts_tablet_manager.cc:1434] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:50.864364 10247 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Bootstrap starting.
I20260709 12:13:50.869671 10247 tablet_bootstrap.cc:654] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.869740 10245 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.870154 10245 ts_tablet_manager.cc:1403] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 12:13:50.872550 10245 raft_consensus.cc:359] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.873205 10245 raft_consensus.cc:385] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.873476 10245 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.874051 10245 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.875828 10528 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.878647 10245 ts_tablet_manager.cc:1434] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:50.879488 10245 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.882741 10531 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.883227 10531 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.884812 10245 tablet_bootstrap.cc:654] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.885174 10531 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.891651 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.892333 10129 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:50.894898 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:50.896787 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:50.897486 10245 tablet_bootstrap.cc:492] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
I20260709 12:13:50.897782 10531 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.897941 10245 ts_tablet_manager.cc:1403] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 12:13:50.898142 10531 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.897394 10195 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 0.
I20260709 12:13:50.900128 10531 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.927273 10247 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: No bootstrap required, opened a new log
I20260709 12:13:50.927740 10247 ts_tablet_manager.cc:1403] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.008s
I20260709 12:13:50.926167  9951 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.932664 10245 raft_consensus.cc:359] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.933435 10245 raft_consensus.cc:385] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.933764 10245 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.934567 10245 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.934902 10531 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.937012 10245 ts_tablet_manager.cc:1434] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:13:50.938102 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:50.938562 10245 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Bootstrap starting.
I20260709 12:13:50.939615 10195 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.942523 10247 raft_consensus.cc:359] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.943182 10247 raft_consensus.cc:385] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.943444 10247 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.944042 10247 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.945993 10247 ts_tablet_manager.cc:1434] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:50.948027 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:50.948576 10129 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.948091 10531 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:50.954627 10129 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.957581 10195 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:50.958943 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.960094 10531 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.961198 10245 tablet_bootstrap.cc:654] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.964180 10531 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:50.961614 10262 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.965277 10531 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.970221 10623 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.970752 10623 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:50.972826 10623 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:50.974189 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:50.974840 10048 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:50.977589 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:50.978403 10630 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.978832 10630 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.979152 10630 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.982182 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:50.982939 10128 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:50.988080 10413 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.997459 10619 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.997952 10619 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.000133 10619 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:51.002327 10630 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.004419 10630 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:51.003890  9952 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.005570 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:51.005570 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:51.007031 10130 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.008924 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:51.009665 10048 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 0.
I20260709 12:13:51.011598 10095 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:51.007167 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:51.014874 10551 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.015246 10551 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.015419 10245 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: No bootstrap required, opened a new log
W20260709 12:13:51.015978 10094 leader_election.cc:343] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.006280 10049 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.015591 10551 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.015996 10245 ts_tablet_manager.cc:1403] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.024s
I20260709 12:13:51.020442 10245 raft_consensus.cc:359] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.021102 10245 raft_consensus.cc:385] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.021364 10245 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.022375 10049 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.022218 10245 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.023901 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:51.024592 10245 ts_tablet_manager.cc:1434] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:13:51.024653 10630 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.026405 10630 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:51.027220 10630 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.030943 10551 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.031569 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.033489 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:51.033927 10048 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.035910 10551 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:51.036461 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:51.038406 10199 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.042971  9949 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.044246 10199 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:51.045469 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:51.046685 10551 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.065747 10551 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:13:51.084743 10551 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.092048 10048 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:13:51.109962 10630 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.110486 10630 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.112459 10630 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:51.113099 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:51.113483 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:51.113739 10049 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:51.114056 10130 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:51.114899 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:51.115417 10630 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.115742 10630 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.116070 10630 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.122501 10630 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.124400 10630 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:51.126250 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:51.127189 10130 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.127171 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:51.127835 10049 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.129281  9952 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 0 to 1, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.131744 10530 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.133193 10130 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.135629 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:51.134136 10049 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.136327 10630 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.136765 10630 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:51.137517 10630 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.147953 10530 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.151115  9949 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.215750 10049 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.221385 10551 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.231359 10526 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.232856 10630 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.233340 10630 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.234687 10530 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.235157 10530 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.236043 10630 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:51.236986 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:13:51.237605 10049 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 0.
I20260709 12:13:51.237668 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:51.238267 10128 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:51.238860 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:51.239569 10477 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.239913 10477 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.240216 10477 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.243151 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:51.243896 10262 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:51.244211 10262 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.244501 10262 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.244841 10530 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:51.246758 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:13:51.247371 10195 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:13:51.250818 10477 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.252733 10477 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:51.255120 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:51.255760 10128 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.255198 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:13:51.256727 10049 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.253895 10262 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.266181 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:13:51.266727 10129 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.268520 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:13:51.276005 10049 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.282071 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:13:51.282894 10528 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:51.283334 10001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:51.283380 10528 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:13:51.284061 10129 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:13:51.284516 10528 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.285113 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:13:51.285887 10530 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:51.286376 10530 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:13:51.286010 10262 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:51.261513 10128 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:13:51.287868 10530 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:13:51.291599 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:13:51.292362 10195 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.299063 10195 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:13:51.303514 10472 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.307602  9949 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 0 to 2, leader changed from <none> to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.309650  9952 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.321276 10472 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.375695 10530 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.385135 10262 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.474781 10528 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.484071 10623 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.517969 10623 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.528841 10528 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.533134 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.552964 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.676259 10128 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:51.677382 10262 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.685634 10199 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:51.687247 10262 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.775228 10630 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.790447 10630 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.946810  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:52.980054 10691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:52.980118 10692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:52.980281 10694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:52.981437  8907 server_base.cc:1061] running on GCE node
I20260709 12:13:52.982343  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:52.982575  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:52.982751  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599232982729 us; error 0 us; skew 500 ppm
I20260709 12:13:52.983242  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:52.985642  8907 webserver.cc:533] Webserver started at http://127.8.178.196:43443/ using document root <none> and password file <none>
I20260709 12:13:52.986115  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:52.986304  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:52.986609  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:52.987699  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-3-root/instance:
uuid: "4b3390fbbe574de7bf154b5a6cc35677"
format_stamp: "Formatted at 2026-07-09 12:13:52 on dist-test-slave-jlx4"
I20260709 12:13:52.992782  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:52.996078 10699 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:52.996826  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:52.997092  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
uuid: "4b3390fbbe574de7bf154b5a6cc35677"
format_stamp: "Formatted at 2026-07-09 12:13:52 on dist-test-slave-jlx4"
I20260709 12:13:52.997371  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:53.018846  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:53.020649  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:53.023350  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:53.026824  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:53.027021  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.027271  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:53.027468  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.085601  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.196:38867
I20260709 12:13:53.085681 10761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.196:38867 every 8 connection(s)
I20260709 12:13:53.089234  8907 auto_leader_rebalancer-test.cc:439] add a tserver: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:53.100380 10762 heartbeater.cc:344] Connected to a master server at 127.8.178.254:37497
I20260709 12:13:53.100737 10762 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:53.101430 10762 heartbeater.cc:507] Master 127.8.178.254:37497 requested a full tablet report, sending...
I20260709 12:13:53.103139  9952 ts_manager.cc:194] Registered new tserver with Master: 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:13:53.104557  9952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44990
I20260709 12:13:53.435694 10130 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:53.442586 10049 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:53.444290 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:53.446866 10204 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:53.449787 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:53.459372 10767 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.460536 10049 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:13:53.463508 10094 consensus_peers.cc:597] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63a59e68139a465c858046fab6d14aaa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.465068 10204 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.477689  9951 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.483793 10130 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:53.492836 10204 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:53.494155 10049 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:53.495292 10619 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:53.496996 10619 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:53.497735 10094 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6031fe457e54869a9b512abf1d54183. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.525568 10526 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.540228 10049 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.567361 10204 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.585248  9952 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.595999 10204 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:53.608577 10130 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:53.610519 10528 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:53.611856 10049 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:53.613037 10623 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:53.619858 10168 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3496631dbf3b49519fbc5604f6834f3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.621212 10528 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.623083 10049 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.623580 10130 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.637027  9952 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 3, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.639391 10204 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:53.658648 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:53.658917 10168 consensus_peers.cc:597] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12bc6e523dd94755bf6815dd2f89cd0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.659209 10047 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:53.659884 10789 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:53.660681 10528 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:53.671458 10528 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.673110 10049 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.677811 10129 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:53.688687  9951 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.957805 10793 ts_tablet_manager.cc:933] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:53.960057 10793 tablet_copy_client.cc:323] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:13:53.982010 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 63a59e68139a465c858046fab6d14aaa from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:13:53.982546 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 63a59e68139a465c858046fab6d14aaa from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-63a59e68139a465c858046fab6d14aaa
I20260709 12:13:53.995940 10140 tablet_copy_source_session.cc:215] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:53.999914 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a59e68139a465c858046fab6d14aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.016311 10793 tablet_copy_client.cc:806] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:54.017027 10793 tablet_copy_client.cc:670] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:54.022033 10793 tablet_copy_client.cc:538] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:54.031324 10793 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:54.043632 10798 ts_tablet_manager.cc:933] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:13:54.046162 10798 tablet_copy_client.cc:323] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:13:54.048916 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet a6031fe457e54869a9b512abf1d54183 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:13:54.049414 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet a6031fe457e54869a9b512abf1d54183 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-a6031fe457e54869a9b512abf1d54183
I20260709 12:13:54.055557 10140 tablet_copy_source_session.cc:215] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:54.058348 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6031fe457e54869a9b512abf1d54183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.061223 10793 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:54.062027 10793 tablet_bootstrap.cc:492] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:54.062647 10793 ts_tablet_manager.cc:1403] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.014s
I20260709 12:13:54.065178 10793 raft_consensus.cc:359] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.065794 10793 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:54.066406 10793 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.068840 10762 heartbeater.cc:499] Master 127.8.178.254:37497 was elected leader, sending a full tablet report...
I20260709 12:13:54.069013 10793 ts_tablet_manager.cc:1434] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:13:54.071489 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-63a59e68139a465c858046fab6d14aaa received from {username='slave'} at 127.0.0.1:54462
I20260709 12:13:54.072006 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-63a59e68139a465c858046fab6d14aaa on tablet 63a59e68139a465c858046fab6d14aaa with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:54.081662 10798 tablet_copy_client.cc:806] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:54.082141 10802 ts_tablet_manager.cc:933] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:54.082377 10798 tablet_copy_client.cc:670] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:54.084935 10802 tablet_copy_client.cc:323] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:13:54.086079 10798 tablet_copy_client.cc:538] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:54.099254 10798 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:54.109951 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 12bc6e523dd94755bf6815dd2f89cd0a from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:13:54.110492 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 12bc6e523dd94755bf6815dd2f89cd0a from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-12bc6e523dd94755bf6815dd2f89cd0a
I20260709 12:13:54.112974 10793 ts_tablet_manager.cc:933] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:54.118582 10214 tablet_copy_source_session.cc:215] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:54.121668 10802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bc6e523dd94755bf6815dd2f89cd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.128603 10798 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:54.129573 10798 tablet_bootstrap.cc:492] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:54.130244 10798 ts_tablet_manager.cc:1403] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 12:13:54.133071 10798 raft_consensus.cc:359] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.133863 10798 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:54.134542 10798 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.138675 10802 tablet_copy_client.cc:806] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:54.139240 10802 tablet_copy_client.cc:670] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:54.139810 10798 ts_tablet_manager.cc:1434] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:54.141552 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-a6031fe457e54869a9b512abf1d54183 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:13:54.141965 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-a6031fe457e54869a9b512abf1d54183 on tablet a6031fe457e54869a9b512abf1d54183 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:54.147276 10802 tablet_copy_client.cc:538] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:54.148554 10793 tablet_copy_client.cc:323] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:13:54.150035 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 3496631dbf3b49519fbc5604f6834f3e from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:13:54.150564 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 3496631dbf3b49519fbc5604f6834f3e from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-3496631dbf3b49519fbc5604f6834f3e
I20260709 12:13:54.156162 10802 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:54.161006 10214 tablet_copy_source_session.cc:215] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:54.166806 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3496631dbf3b49519fbc5604f6834f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.176703 10802 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:54.177537 10802 tablet_bootstrap.cc:492] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:54.178118 10802 ts_tablet_manager.cc:1403] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 12:13:54.180976 10802 raft_consensus.cc:359] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.181739 10802 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:54.182340 10802 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.182878 10793 tablet_copy_client.cc:806] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:54.183429 10793 tablet_copy_client.cc:670] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:54.186199 10802 ts_tablet_manager.cc:1434] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:54.187937 10213 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-12bc6e523dd94755bf6815dd2f89cd0a received from {username='slave'} at 127.0.0.1:49780
I20260709 12:13:54.188356 10213 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-12bc6e523dd94755bf6815dd2f89cd0a on tablet 12bc6e523dd94755bf6815dd2f89cd0a with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:54.192107 10793 tablet_copy_client.cc:538] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:54.211817 10793 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:54.237424 10793 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:54.238291 10793 tablet_bootstrap.cc:492] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:54.240427 10793 ts_tablet_manager.cc:1403] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.004s
I20260709 12:13:54.242997 10793 raft_consensus.cc:359] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.243755 10793 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:54.244320 10793 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:54.246641 10793 ts_tablet_manager.cc:1434] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:54.248138 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-3496631dbf3b49519fbc5604f6834f3e received from {username='slave'} at 127.0.0.1:49780
I20260709 12:13:54.248471 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-3496631dbf3b49519fbc5604f6834f3e on tablet 3496631dbf3b49519fbc5604f6834f3e with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:54.491946 10737 raft_consensus.cc:1217] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:54.553781 10737 raft_consensus.cc:1217] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:54.658684 10737 raft_consensus.cc:1217] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:13:54.689311 10737 raft_consensus.cc:1217] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:55.037773 10623 raft_consensus.cc:1064] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:55.039697 10623 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.045153 10737 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.046612 10528 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.047909 10130 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.048986 10047 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.050293 10528 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.051265 10810 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.060830 10810 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.063403 10130 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.065852 10048 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.080766 10737 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.083182 10526 raft_consensus.cc:1064] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:55.085268 10526 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.100298  9952 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.102902 10781 raft_consensus.cc:1064] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:55.104727 10781 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.125169 10737 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.125169 10204 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.132064 10782 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.135051 10782 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.137207 10810 raft_consensus.cc:1064] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:55.139726 10810 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.151250 10048 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.152964 10737 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.153568 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.154361 10528 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.154639 10817 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:55.155644 10789 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.159050 10047 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.163870 10047 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.165081 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.165472 10623 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.172992 10735 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.176026 10195 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:55.175797 10810 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.177525 10735 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.186673 10817 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.191447 10130 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.266588 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:55.286542 10817 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.287529 10735 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.300241  9949 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.303260 10526 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.311473 10049 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.325176 10047 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.327487 10195 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.336928 10735 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:55.339442 10623 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:55.343698  9953 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.344705 10049 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:55.349472 10735 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.352288 10827 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.355154 10832 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:55.355008  9951 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.361528 10049 raft_consensus.cc:2955] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.368211 10195 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.377635  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3496631dbf3b49519fbc5604f6834f3e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:55.379820 10736 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.379469 10735 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.381085 10623 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.381817 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.386061 10623 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.386816 10047 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.390177 10204 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.384402  9950 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 4 to 5, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.401496 10195 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.404125 10833 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.405613 10736 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.409893 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 3496631dbf3b49519fbc5604f6834f3e with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55214
I20260709 12:13:55.417205  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12bc6e523dd94755bf6815dd2f89cd0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:55.434836 10130 raft_consensus.cc:2955] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.435298  9951 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.451030 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 12bc6e523dd94755bf6815dd2f89cd0a with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:13:55.451771 10835 tablet_replica.cc:333] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:13:55.454465 10835 raft_consensus.cc:2243] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.455276 10835 raft_consensus.cc:2272] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.462742 10835 ts_tablet_manager.cc:1916] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:55.471513 10130 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.478049 10835 ts_tablet_manager.cc:1929] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:13:55.478672 10835 log.cc:1199] T 3496631dbf3b49519fbc5604f6834f3e P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/3496631dbf3b49519fbc5604f6834f3e
I20260709 12:13:55.480716 10129 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:55.483511  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 3496631dbf3b49519fbc5604f6834f3e (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:55.492897 10736 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.495432 10736 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.496371 10817 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.499927 10837 tablet_replica.cc:333] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:13:55.501156 10837 raft_consensus.cc:2243] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.501585 10817 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.501847 10837 raft_consensus.cc:2272] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.503275 10049 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.504555 10526 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.508527 10195 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:55.520838 10818 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.533918 10837 ts_tablet_manager.cc:1916] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:55.539465 10049 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.542806  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6031fe457e54869a9b512abf1d54183 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:55.543113 10526 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:55.554337  9953 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.565444 10837 ts_tablet_manager.cc:1929] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:55.565897 10837 log.cc:1199] T 12bc6e523dd94755bf6815dd2f89cd0a P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/12bc6e523dd94755bf6815dd2f89cd0a
I20260709 12:13:55.567924  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 12bc6e523dd94755bf6815dd2f89cd0a (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:55.570924 10736 raft_consensus.cc:2955] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.576617 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet a6031fe457e54869a9b512abf1d54183 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:13:55.576882 10781 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.588132  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63a59e68139a465c858046fab6d14aaa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:55.589075 10735 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.590981 10195 raft_consensus.cc:2955] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:55.613453  9951 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.629298 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 63a59e68139a465c858046fab6d14aaa with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:13:55.630252 10837 tablet_replica.cc:333] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:13:55.634380 10839 tablet_replica.cc:333] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:13:55.634873 10837 raft_consensus.cc:2243] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.635440 10837 raft_consensus.cc:2272] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.635483 10839 raft_consensus.cc:2243] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.636232 10839 raft_consensus.cc:2272] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.638983 10837 ts_tablet_manager.cc:1916] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:55.639688 10839 ts_tablet_manager.cc:1916] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:55.651070 10837 ts_tablet_manager.cc:1929] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:55.651530 10837 log.cc:1199] T 63a59e68139a465c858046fab6d14aaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/63a59e68139a465c858046fab6d14aaa
I20260709 12:13:55.653283  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 63a59e68139a465c858046fab6d14aaa (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:55.653405 10839 ts_tablet_manager.cc:1929] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:55.653787 10839 log.cc:1199] T a6031fe457e54869a9b512abf1d54183 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/a6031fe457e54869a9b512abf1d54183
I20260709 12:13:55.655021  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet a6031fe457e54869a9b512abf1d54183 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:56.703904 10047 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:56.709900 10195 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.712365 10262 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:56.733982 10019 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c49badfb58494d79890f98353e487b55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.735018 10129 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:56.736366 10262 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.737722 10841 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.742018 10195 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.751819 10129 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.754246  9952 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.756981 10047 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:56.770341 10129 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:56.770740 10019 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c14882e1876454ba455dbe6212f6ab6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.771507 10195 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:56.771822 10262 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.772653 10846 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.784596 10841 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.787997 10129 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.791272 10200 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.809656  9952 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.816636 10047 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:56.830591 10200 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:56.831182 10129 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:56.832480 10846 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:56.833405 10019 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4aaadb6c64c344b186ed9c3e3630b660. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.833415 10858 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:56.841454 10262 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.843230 10200 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.843475 10129 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.858222  9950 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.866549 10200 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:56.873600 10129 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:56.875540 10840 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:56.876382 10168 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03eb59a6c9c6418299ed25e8330b2cef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.878985 10049 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:56.880582 10840 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:56.892719 10528 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.899060 10129 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.899363 10049 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:56.909909  9951 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.211311 10866 ts_tablet_manager.cc:933] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:13:57.216912 10866 tablet_copy_client.cc:323] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:13:57.235278 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet c49badfb58494d79890f98353e487b55 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:13:57.235731 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet c49badfb58494d79890f98353e487b55 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-c49badfb58494d79890f98353e487b55
I20260709 12:13:57.243455 10065 tablet_copy_source_session.cc:215] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:57.246234 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49badfb58494d79890f98353e487b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:57.261276 10866 tablet_copy_client.cc:806] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:57.261823 10866 tablet_copy_client.cc:670] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:57.264361 10870 ts_tablet_manager.cc:933] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:13:57.268599 10866 tablet_copy_client.cc:538] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:57.268651 10870 tablet_copy_client.cc:323] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:13:57.270946 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 4aaadb6c64c344b186ed9c3e3630b660 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:13:57.271445 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 4aaadb6c64c344b186ed9c3e3630b660 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-4aaadb6c64c344b186ed9c3e3630b660
I20260709 12:13:57.277006 10866 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:57.278086 10065 tablet_copy_source_session.cc:215] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:57.281462 10870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aaadb6c64c344b186ed9c3e3630b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:57.296000 10870 tablet_copy_client.cc:806] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:57.296499 10870 tablet_copy_client.cc:670] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:57.297936 10866 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.298887 10866 tablet_bootstrap.cc:492] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:57.299533 10866 ts_tablet_manager.cc:1403] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.012s
I20260709 12:13:57.300175 10870 tablet_copy_client.cc:538] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:57.302621 10866 raft_consensus.cc:359] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.303432 10866 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:57.304267 10866 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.307137 10870 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:57.310026 10866 ts_tablet_manager.cc:1434] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:57.311857 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-c49badfb58494d79890f98353e487b55 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:13:57.312250 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-c49badfb58494d79890f98353e487b55 on tablet c49badfb58494d79890f98353e487b55 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:57.328425 10866 ts_tablet_manager.cc:933] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:13:57.333487 10866 tablet_copy_client.cc:323] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:13:57.335508 10876 ts_tablet_manager.cc:933] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:13:57.338637 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 03eb59a6c9c6418299ed25e8330b2cef from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:13:57.339087 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 03eb59a6c9c6418299ed25e8330b2cef from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-03eb59a6c9c6418299ed25e8330b2cef
I20260709 12:13:57.342240 10870 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.343123 10870 tablet_bootstrap.cc:492] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:57.343743 10870 ts_tablet_manager.cc:1403] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.015s
I20260709 12:13:57.346606 10870 raft_consensus.cc:359] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.347415 10870 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:57.348017 10870 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.352210 10870 ts_tablet_manager.cc:1434] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:57.355317 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-4aaadb6c64c344b186ed9c3e3630b660 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:13:57.355784 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-4aaadb6c64c344b186ed9c3e3630b660 on tablet 4aaadb6c64c344b186ed9c3e3630b660 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:57.360713 10214 tablet_copy_source_session.cc:215] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:57.365711 10866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03eb59a6c9c6418299ed25e8330b2cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:57.365895 10876 tablet_copy_client.cc:323] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:13:57.367542 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 9c14882e1876454ba455dbe6212f6ab6 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:13:57.368024 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 9c14882e1876454ba455dbe6212f6ab6 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-9c14882e1876454ba455dbe6212f6ab6
I20260709 12:13:57.374743 10065 tablet_copy_source_session.cc:215] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:57.377604 10876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c14882e1876454ba455dbe6212f6ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:57.381028 10866 tablet_copy_client.cc:806] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:57.381608 10866 tablet_copy_client.cc:670] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:57.384900 10866 tablet_copy_client.cc:538] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:57.392464 10876 tablet_copy_client.cc:806] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:57.393054 10876 tablet_copy_client.cc:670] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:57.395200 10866 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:57.396884 10876 tablet_copy_client.cc:538] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:57.405655 10876 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:13:57.426873 10876 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.427675 10876 tablet_bootstrap.cc:492] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:57.428280 10876 ts_tablet_manager.cc:1403] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 12:13:57.432439 10876 raft_consensus.cc:359] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.433228 10876 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:57.433843 10876 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.436905 10866 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:57.437711 10866 tablet_bootstrap.cc:492] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:13:57.438160 10876 ts_tablet_manager.cc:1434] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:57.438294 10866 ts_tablet_manager.cc:1403] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.008s
I20260709 12:13:57.439689 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-9c14882e1876454ba455dbe6212f6ab6 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:13:57.440066 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-9c14882e1876454ba455dbe6212f6ab6 on tablet 9c14882e1876454ba455dbe6212f6ab6 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:57.441495 10866 raft_consensus.cc:359] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.442251 10866 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:13:57.442865 10866 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:57.445205 10866 ts_tablet_manager.cc:1434] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:57.446884 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-03eb59a6c9c6418299ed25e8330b2cef received from {username='slave'} at 127.0.0.1:49780
I20260709 12:13:57.447268 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-03eb59a6c9c6418299ed25e8330b2cef on tablet 03eb59a6c9c6418299ed25e8330b2cef with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:13:57.693193 10735 raft_consensus.cc:1217] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:57.701818 10735 raft_consensus.cc:1217] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:57.739964 10735 raft_consensus.cc:1217] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:57.743924 10735 raft_consensus.cc:1217] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:13:57.966694 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55086.1us
I20260709 12:13:58.107764 10842 raft_consensus.cc:1064] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:58.110162 10842 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.116366 10735 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.116649 10129 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.123988 10840 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.125950 10842 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.135597 10047 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.136713 10846 raft_consensus.cc:1064] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:58.139251 10846 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.143725 10842 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.162892 10736 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.163837 10200 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.165390 10262 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.165789 10129 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.166965 10262 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.169623 10840 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.168499 10262 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:58.186185 10262 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.190511 10200 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.195099 10048 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.197263 10129 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.209401 10736 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.227941  9950 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.256436 10736 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.286901 10129 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.296057  9951 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.303321 10200 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.307361 10893 raft_consensus.cc:1064] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:58.309823 10893 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.311733 10047 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.325979 10736 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.335361 10128 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:58.336846 10894 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.340623 10130 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.342272 10736 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:58.344254 10195 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:58.344583 10894 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.345718 10846 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:58.348268 10736 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.347692 10893 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:13:58.358794 10894 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.359781 10885 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.360719 10894 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.362704 10127 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.367695 10047 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.371404 10884 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.374703 10736 raft_consensus.cc:2955] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.379590 10846 raft_consensus.cc:1064] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:13:58.382362 10846 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.391669 10840 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.393599  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03eb59a6c9c6418299ed25e8330b2cef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:58.382304 10737 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.404332  9951 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.405565 10048 raft_consensus.cc:2955] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.429582 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 4aaadb6c64c344b186ed9c3e3630b660 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:13:58.431979  9952 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.441413 10904 tablet_replica.cc:333] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:13:58.443576 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 03eb59a6c9c6418299ed25e8330b2cef with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:13:58.442396 10858 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.450460 10204 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.456845 10262 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.460538 10904 raft_consensus.cc:2243] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.461205 10904 raft_consensus.cc:2272] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.481729 10905 tablet_replica.cc:333] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:13:58.484355 10904 ts_tablet_manager.cc:1916] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:13:58.496032 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44409.2us
I20260709 12:13:58.498031 10736 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.506665 10736 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.528211  9951 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.482865 10905 raft_consensus.cc:2243] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.530616 10907 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.535032  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4aaadb6c64c344b186ed9c3e3630b660 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:58.542685 10127 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:58.534085 10128 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.547075 10858 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:58.554167 10195 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.568698 10905 raft_consensus.cc:2272] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.579144 10048 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.625257 10735 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:58.627204 10858 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.634250 10128 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:58.638553 10858 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:58.640556 10905 ts_tablet_manager.cc:1916] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:58.651650 10130 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.648386 10846 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.675828  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c49badfb58494d79890f98353e487b55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:58.679920 10735 raft_consensus.cc:2955] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.663935 10904 ts_tablet_manager.cc:1929] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:58.684512 10904 log.cc:1199] T 4aaadb6c64c344b186ed9c3e3630b660 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/4aaadb6c64c344b186ed9c3e3630b660
I20260709 12:13:58.691689  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 4aaadb6c64c344b186ed9c3e3630b660 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:58.695307  9950 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.700672 10846 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.703024 10736 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.708530 10905 ts_tablet_manager.cc:1929] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:58.708997 10905 log.cc:1199] T 03eb59a6c9c6418299ed25e8330b2cef P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/03eb59a6c9c6418299ed25e8330b2cef
I20260709 12:13:58.710487  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 03eb59a6c9c6418299ed25e8330b2cef (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:58.711381 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet c49badfb58494d79890f98353e487b55 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:13:58.712136 10195 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.713760 10904 tablet_replica.cc:333] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:13:58.719353 10904 raft_consensus.cc:2243] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.720062 10904 raft_consensus.cc:2272] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.723204 10904 ts_tablet_manager.cc:1916] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:58.728391  9951 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.740121 10130 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.743511 10904 ts_tablet_manager.cc:1929] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:13:58.743916 10904 log.cc:1199] T c49badfb58494d79890f98353e487b55 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/c49badfb58494d79890f98353e487b55
I20260709 12:13:58.746069  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet c49badfb58494d79890f98353e487b55 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:58.759253 10048 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:13:58.763549 10735 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.765100 10195 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:58.764981 10846 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.767387 10846 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.772940 10858 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.785231  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c14882e1876454ba455dbe6212f6ab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:58.793566  9951 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.797560 10735 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.805497 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c14882e1876454ba455dbe6212f6ab6 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:13:58.806324 10905 tablet_replica.cc:333] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:13:58.807281 10905 raft_consensus.cc:2243] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.807899 10905 raft_consensus.cc:2272] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.803582 10195 raft_consensus.cc:2955] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:13:58.811210 10905 ts_tablet_manager.cc:1916] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:58.829746 10905 ts_tablet_manager.cc:1929] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:58.830060 10905 log.cc:1199] T 9c14882e1876454ba455dbe6212f6ab6 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/9c14882e1876454ba455dbe6212f6ab6
I20260709 12:13:58.832655  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 9c14882e1876454ba455dbe6212f6ab6 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:13:59.868947 10130 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:59.874753 10204 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:59.875664 10094 consensus_peers.cc:597] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01ee41f44fe24909bc0f087cbbc6213e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.876845 10818 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.877204 10048 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.878438 10908 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.892158 10908 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.896803 10204 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.897418 10047 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.916330  9952 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.923089 10204 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:13:59.946527 10168 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51714cf4d10d45a685fc2c669f03df9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.949244 10130 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.949407 10047 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:59.950851 10842 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.952440 10842 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:59.965054 10884 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.966667 10129 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.994084 10047 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:13:59.994602 10130 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:13:59.993969  9951 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.020257 10204 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:00.020484 10094 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0eadcb623c84a7daa48999c60decbe2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.020840 10047 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:00.021503 10918 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:00.022265 10917 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:00.030877 10918 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.033617 10204 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.035615 10047 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.044569 10130 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.051038  9951 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.057508 10047 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:00.059782 10908 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:00.060714 10094 consensus_peers.cc:597] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f08623f87ec8442c961120bdd44e9b08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.061642 10204 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:00.063810 10908 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:00.069051 10918 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.070968 10047 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.077097 10204 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:00.094283  9951 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.445364 10933 ts_tablet_manager.cc:933] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:00.447244 10933 tablet_copy_client.cc:323] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:00.448606 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 51714cf4d10d45a685fc2c669f03df9c from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:00.449059 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 51714cf4d10d45a685fc2c669f03df9c from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-51714cf4d10d45a685fc2c669f03df9c
I20260709 12:14:00.455557 10214 tablet_copy_source_session.cc:215] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:00.457935 10933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51714cf4d10d45a685fc2c669f03df9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.466948 10935 ts_tablet_manager.cc:933] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:00.475271 10935 tablet_copy_client.cc:323] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:00.477252 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 01ee41f44fe24909bc0f087cbbc6213e from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:00.477850 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 01ee41f44fe24909bc0f087cbbc6213e from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-01ee41f44fe24909bc0f087cbbc6213e
I20260709 12:14:00.480901 10933 tablet_copy_client.cc:806] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:00.481570 10933 tablet_copy_client.cc:670] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:00.485785 10140 tablet_copy_source_session.cc:215] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:00.486819 10933 tablet_copy_client.cc:538] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:00.489264 10935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee41f44fe24909bc0f087cbbc6213e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.506821 10935 tablet_copy_client.cc:806] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:00.507445 10935 tablet_copy_client.cc:670] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:00.508689 10937 ts_tablet_manager.cc:933] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:00.514005 10933 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:00.516651 10935 tablet_copy_client.cc:538] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:00.524468 10935 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:00.535025 10937 tablet_copy_client.cc:323] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:00.536892 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet f08623f87ec8442c961120bdd44e9b08 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:00.537456 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet f08623f87ec8442c961120bdd44e9b08 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-f08623f87ec8442c961120bdd44e9b08
I20260709 12:14:00.556654 10933 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.557816 10933 tablet_bootstrap.cc:492] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:00.559376 10933 ts_tablet_manager.cc:1403] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.004s
I20260709 12:14:00.562407 10933 raft_consensus.cc:359] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.565133 10933 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:00.567314 10941 ts_tablet_manager.cc:933] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:00.565882 10933 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.570761 10140 tablet_copy_source_session.cc:215] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:00.571426 10935 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.573463 10935 tablet_bootstrap.cc:492] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:00.574299 10935 ts_tablet_manager.cc:1403] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.024s
I20260709 12:14:00.578022 10937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08623f87ec8442c961120bdd44e9b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.578629 10935 raft_consensus.cc:359] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.579504 10935 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:00.580127 10935 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.595952 10941 tablet_copy_client.cc:323] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:00.599452 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet f0eadcb623c84a7daa48999c60decbe2 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:00.599829 10935 ts_tablet_manager.cc:1434] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:14:00.602210 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet f0eadcb623c84a7daa48999c60decbe2 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-f0eadcb623c84a7daa48999c60decbe2
I20260709 12:14:00.604425 10139 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-01ee41f44fe24909bc0f087cbbc6213e received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:00.604856 10139 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-01ee41f44fe24909bc0f087cbbc6213e on tablet 01ee41f44fe24909bc0f087cbbc6213e with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:00.609853 10937 tablet_copy_client.cc:806] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:00.610378 10937 tablet_copy_client.cc:670] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:00.611555 10933 ts_tablet_manager.cc:1434] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.008s
I20260709 12:14:00.613124 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-51714cf4d10d45a685fc2c669f03df9c received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:00.613500 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-51714cf4d10d45a685fc2c669f03df9c on tablet 51714cf4d10d45a685fc2c669f03df9c with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:00.614892 10937 tablet_copy_client.cc:538] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:00.615545 10140 tablet_copy_source_session.cc:215] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:00.621238 10941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eadcb623c84a7daa48999c60decbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.623890 10937 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:00.638522 10941 tablet_copy_client.cc:806] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:00.639091 10941 tablet_copy_client.cc:670] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:00.642361 10941 tablet_copy_client.cc:538] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:00.648952 10937 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.649796 10937 tablet_bootstrap.cc:492] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:00.650418 10937 ts_tablet_manager.cc:1403] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.014s
I20260709 12:14:00.651188 10941 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:00.653887 10937 raft_consensus.cc:359] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.654843 10937 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:00.655483 10937 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.658078 10937 ts_tablet_manager.cc:1434] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:00.659742 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f08623f87ec8442c961120bdd44e9b08 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:00.660121 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f08623f87ec8442c961120bdd44e9b08 on tablet f08623f87ec8442c961120bdd44e9b08 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:00.681296 10941 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.682183 10941 tablet_bootstrap.cc:492] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:00.682857 10941 ts_tablet_manager.cc:1403] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.006s
I20260709 12:14:00.685640 10941 raft_consensus.cc:359] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.686416 10941 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:00.687043 10941 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:00.689618 10941 ts_tablet_manager.cc:1434] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:00.691185 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f0eadcb623c84a7daa48999c60decbe2 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:00.691668 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f0eadcb623c84a7daa48999c60decbe2 on tablet f0eadcb623c84a7daa48999c60decbe2 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:00.977339 10735 raft_consensus.cc:1217] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:00.999611 10736 raft_consensus.cc:1217] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:01.003939 10735 raft_consensus.cc:1217] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:01.031214 10735 raft_consensus.cc:1217] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:01.365741 10950 raft_consensus.cc:1064] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:01.367578 10950 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.373373 10735 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.373433 10195 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.374176 10048 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.374851 10950 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.375705 10918 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.376341 10949 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.400606 10950 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.402168 10048 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.408555 10735 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.420305  9952 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.428757 10195 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.450024 10918 raft_consensus.cc:1064] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:01.452569 10918 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.457080 10130 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.465459 10735 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.466730 10951 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.472750 10195 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.475519 10950 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.476516 10951 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:01.481192 10735 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.492274 10048 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.495189  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f08623f87ec8442c961120bdd44e9b08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:01.496184 10953 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.502951 10736 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.501617  9951 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.486936 10195 raft_consensus.cc:2955] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.510615 10204 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.515000 10953 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.515910 10949 raft_consensus.cc:1064] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:01.519745 10951 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.526602 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet f08623f87ec8442c961120bdd44e9b08 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:01.535975 10949 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.604889 10967 tablet_replica.cc:333] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:01.605957 10967 raft_consensus.cc:2243] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.606774 10967 raft_consensus.cc:2272] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.609890 10966 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:14:01.619021 10842 raft_consensus.cc:1064] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:01.626472 10200 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.633490 10736 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.624377 10918 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.627924 10842 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.641427 10967 ts_tablet_manager.cc:1916] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:01.661338  9951 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.680265 10735 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.680377 10736 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.681557 10195 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.681713 10884 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.681874 10954 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.685757 10954 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.688841 10048 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.690323 10954 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.695825 10049 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:01.702253 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 90523.2us
I20260709 12:14:01.720333 10128 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.721046 10967 ts_tablet_manager.cc:1929] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:01.720163 10952 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.721469 10967 log.cc:1199] T f08623f87ec8442c961120bdd44e9b08 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/f08623f87ec8442c961120bdd44e9b08
I20260709 12:14:01.723557  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet f08623f87ec8442c961120bdd44e9b08 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:01.725234 10842 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.726054 10736 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.735761 10048 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:01.745170 10129 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.746670 10971 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.753027  9953 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.758970 10884 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.761368 10200 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.770949 10049 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.772151 10054 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.779105 10735 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.779016 10736 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.800326 10908 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.804459 10952 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.815373 10129 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.817451  9951 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.820037 10735 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.823366 10954 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.830308 10949 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.830936 10953 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.831511 10735 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.838057 10048 raft_consensus.cc:2955] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:01.844249 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44567us
W20260709 12:14:01.844156 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46178.6us
I20260709 12:14:01.848050 10199 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.854265 10128 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.855978 10954 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.858171  9950 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.860417 10049 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.868191 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet f0eadcb623c84a7daa48999c60decbe2 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:01.881843 10736 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.882666  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01ee41f44fe24909bc0f087cbbc6213e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:01.883567  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f0eadcb623c84a7daa48999c60decbe2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:01.884029  9951 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.886632 10983 tablet_replica.cc:333] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:01.887645 10983 raft_consensus.cc:2243] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.889410 10199 raft_consensus.cc:2955] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.888356 10983 raft_consensus.cc:2272] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.897362 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 01ee41f44fe24909bc0f087cbbc6213e with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:01.898329 10967 tablet_replica.cc:333] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:01.898917 10983 ts_tablet_manager.cc:1916] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:01.899438 10967 raft_consensus.cc:2243] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.900197 10967 raft_consensus.cc:2272] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.914286 10967 ts_tablet_manager.cc:1916] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:01.925912 10983 ts_tablet_manager.cc:1929] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:01.926367 10983 log.cc:1199] T f0eadcb623c84a7daa48999c60decbe2 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/f0eadcb623c84a7daa48999c60decbe2
I20260709 12:14:01.929733  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet f0eadcb623c84a7daa48999c60decbe2 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:01.937284 10967 ts_tablet_manager.cc:1929] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:01.937753 10967 log.cc:1199] T 01ee41f44fe24909bc0f087cbbc6213e P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/01ee41f44fe24909bc0f087cbbc6213e
I20260709 12:14:01.939327  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 01ee41f44fe24909bc0f087cbbc6213e (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:01.944407 10199 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:01.948486 10736 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.949142 10049 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:01.949837 10981 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:01.950838 10971 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:01.956266 10884 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.957839 10049 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.958153 10736 raft_consensus.cc:2955] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.970615  9951 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:01.972867  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51714cf4d10d45a685fc2c669f03df9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:01.983592 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 51714cf4d10d45a685fc2c669f03df9c with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:01.988817 10984 tablet_replica.cc:333] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:01.989758 10984 raft_consensus.cc:2243] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.990386 10984 raft_consensus.cc:2272] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.993458 10984 ts_tablet_manager.cc:1916] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:02.004033 10984 ts_tablet_manager.cc:1929] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:02.004361 10984 log.cc:1199] T 51714cf4d10d45a685fc2c669f03df9c P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/51714cf4d10d45a685fc2c669f03df9c
I20260709 12:14:02.005807  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 51714cf4d10d45a685fc2c669f03df9c (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:03.049873 10125 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:03.057482 10094 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b4f71cfc2d1484aa7a37c6943e8196f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.058073 10048 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.059068 10195 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.059324 10951 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.060906 10988 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.068773 10953 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.082286 10199 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.089046 10049 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.097493  9952 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.107736 10125 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:03.125680 10094 consensus_peers.cc:597] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ff855a4bf854fbd9207ae909021d6bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.126477 10195 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.126567 10054 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.128439 10951 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.130214 10951 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.157938 10953 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.159252 10048 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.170106 10195 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.172436 10199 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.189692  9951 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.190595 10125 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.191839 10054 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.194296 10971 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:03.196712 10168 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acc41bbfb3c94637814837eb2cfad80f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.205142 10981 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:03.207840 10986 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.218379 10054 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.229707 10199 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.260052  9952 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.229779 10128 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.285172 10125 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:03.286715 10168 consensus_peers.cc:597] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5cb0ac432438495091e62290dd19b812. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.288105 10048 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:03.307499 10986 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:03.313228 10981 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:03.369988 10981 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.372814 10048 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.376508 10125 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.395816  9952 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:03.437165 11009 ts_tablet_manager.cc:933] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:03.474325 11009 tablet_copy_client.cc:323] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:03.476212 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 1b4f71cfc2d1484aa7a37c6943e8196f from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:03.476658 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 1b4f71cfc2d1484aa7a37c6943e8196f from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-1b4f71cfc2d1484aa7a37c6943e8196f
I20260709 12:14:03.482203 10140 tablet_copy_source_session.cc:215] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:03.485351 11009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f71cfc2d1484aa7a37c6943e8196f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:03.500386 11009 tablet_copy_client.cc:806] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:03.500998 11009 tablet_copy_client.cc:670] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:03.505020 11009 tablet_copy_client.cc:538] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:03.515424 11009 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:03.527493 11011 ts_tablet_manager.cc:933] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:03.530000 11011 tablet_copy_client.cc:323] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:03.531718 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 4ff855a4bf854fbd9207ae909021d6bf from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:03.532256 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 4ff855a4bf854fbd9207ae909021d6bf from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-4ff855a4bf854fbd9207ae909021d6bf
I20260709 12:14:03.537087 11009 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.538045 11009 tablet_bootstrap.cc:492] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:03.538760 11009 ts_tablet_manager.cc:1403] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 12:14:03.539772 10140 tablet_copy_source_session.cc:215] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:03.542001 11009 raft_consensus.cc:359] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.542695 11009 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:03.543246 11011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff855a4bf854fbd9207ae909021d6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:03.543263 11009 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.551736 11009 ts_tablet_manager.cc:1434] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 12:14:03.557987 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-1b4f71cfc2d1484aa7a37c6943e8196f received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:03.558490 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-1b4f71cfc2d1484aa7a37c6943e8196f on tablet 1b4f71cfc2d1484aa7a37c6943e8196f with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:03.571681 11011 tablet_copy_client.cc:806] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:03.572463 11011 tablet_copy_client.cc:670] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:03.577009 11011 tablet_copy_client.cc:538] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:03.585784 11011 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:03.605021 11011 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.605787 11011 tablet_bootstrap.cc:492] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:03.606353 11011 ts_tablet_manager.cc:1403] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 12:14:03.609213 11011 raft_consensus.cc:359] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.609865 11011 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:03.610473 11011 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.615048 11011 ts_tablet_manager.cc:1434] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:03.616863 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-4ff855a4bf854fbd9207ae909021d6bf received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:03.617254 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-4ff855a4bf854fbd9207ae909021d6bf on tablet 4ff855a4bf854fbd9207ae909021d6bf with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:03.674964 11011 ts_tablet_manager.cc:933] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:03.676856 11011 tablet_copy_client.cc:323] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:03.679081 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 5cb0ac432438495091e62290dd19b812 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:03.679606 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 5cb0ac432438495091e62290dd19b812 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-5cb0ac432438495091e62290dd19b812
I20260709 12:14:03.687525 10214 tablet_copy_source_session.cc:215] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:03.690762 11011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb0ac432438495091e62290dd19b812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:03.703584 11011 tablet_copy_client.cc:806] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:03.704082 11011 tablet_copy_client.cc:670] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:03.707453 11011 tablet_copy_client.cc:538] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:03.716107 11011 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:03.735466 11011 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.736251 11011 tablet_bootstrap.cc:492] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:03.736809 11011 ts_tablet_manager.cc:1403] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:14:03.739490 11011 raft_consensus.cc:359] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.740254 11011 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:03.740726 11011 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.742584 11011 ts_tablet_manager.cc:1434] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:03.744081 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-5cb0ac432438495091e62290dd19b812 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:03.744496 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-5cb0ac432438495091e62290dd19b812 on tablet 5cb0ac432438495091e62290dd19b812 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:03.759186 11011 ts_tablet_manager.cc:933] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:03.760658 11011 tablet_copy_client.cc:323] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:03.764954 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet acc41bbfb3c94637814837eb2cfad80f from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:03.765470 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet acc41bbfb3c94637814837eb2cfad80f from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-acc41bbfb3c94637814837eb2cfad80f
I20260709 12:14:03.770998 10214 tablet_copy_source_session.cc:215] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:03.773665 11011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc41bbfb3c94637814837eb2cfad80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:03.789636 11011 tablet_copy_client.cc:806] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:03.790241 11011 tablet_copy_client.cc:670] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:03.794436 11011 tablet_copy_client.cc:538] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:03.799897 11011 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:03.815158 11011 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.815726 11011 tablet_bootstrap.cc:492] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:03.816226 11011 ts_tablet_manager.cc:1403] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:14:03.818354 11011 raft_consensus.cc:359] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.818974 11011 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:03.819602 11011 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:03.821910 11011 ts_tablet_manager.cc:1434] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:03.828477 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-acc41bbfb3c94637814837eb2cfad80f received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:03.828903 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-acc41bbfb3c94637814837eb2cfad80f on tablet acc41bbfb3c94637814837eb2cfad80f with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:04.034691 10735 raft_consensus.cc:1217] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:04.122200 10735 raft_consensus.cc:1217] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:04.258236 10735 raft_consensus.cc:1217] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:04.283416 10736 raft_consensus.cc:1217] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:04.536226 10953 raft_consensus.cc:1064] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:04.538141 10953 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.544806 10736 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.546243 10054 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.547580 10989 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:04.551889 10989 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.554765 10199 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.556285 10953 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.582746 10953 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.597115 10054 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.600440 10199 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.606015  9950 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.607805 10736 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.630158 10953 raft_consensus.cc:1064] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
W20260709 12:14:04.632110 11025 consensus_queue.cc:1175] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260709 12:14:04.635058 10953 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.650581 10054 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.651058 10735 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.652302 10951 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:04.653416 10199 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.654613 10951 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.656962 10953 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.683606 10951 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.686757 10048 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.694463 10734 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.695400 10128 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.704423 10195 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.705338  9953 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.716487 10054 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.717859 11025 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.718477 10735 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.721259 11025 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.725339 11006 raft_consensus.cc:1064] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:04.726351 10129 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.727876 11006 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.731428 11025 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.740725 10199 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.742137 10048 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.743938 10736 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:04.744100 10951 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.745780 10953 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.756886 10953 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.768750 10734 raft_consensus.cc:2955] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.772408  9952 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.779798 10735 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.788200 10199 raft_consensus.cc:2955] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.801234 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4f71cfc2d1484aa7a37c6943e8196f with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:04.818095  9952 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.822691  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ff855a4bf854fbd9207ae909021d6bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:04.823537  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b4f71cfc2d1484aa7a37c6943e8196f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:04.833443 10986 raft_consensus.cc:1064] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:04.840353 10986 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:04.853763 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ff855a4bf854fbd9207ae909021d6bf with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:04.856154 11040 tablet_replica.cc:333] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:04.859679 10735 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.859310 11040 raft_consensus.cc:2243] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.860704 11040 raft_consensus.cc:2272] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.861742 11020 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:04.875073 11040 ts_tablet_manager.cc:1916] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:04.879385 11037 tablet_replica.cc:333] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:04.881402 11037 raft_consensus.cc:2243] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.896925 11037 raft_consensus.cc:2272] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.904851 11037 ts_tablet_manager.cc:1916] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:14:04.931860 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 106674us
I20260709 12:14:04.934201 10054 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.934546 10128 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.939813 11037 ts_tablet_manager.cc:1929] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:04.940552 11037 log.cc:1199] T 1b4f71cfc2d1484aa7a37c6943e8196f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/1b4f71cfc2d1484aa7a37c6943e8196f
I20260709 12:14:04.942615  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 1b4f71cfc2d1484aa7a37c6943e8196f (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:04.957916 11020 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.964699 11038 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:04.965473 10735 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.966539 11040 ts_tablet_manager.cc:1929] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:04.966995 11040 log.cc:1199] T 4ff855a4bf854fbd9207ae909021d6bf P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/4ff855a4bf854fbd9207ae909021d6bf
I20260709 12:14:04.967039 11020 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:04.968940  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 4ff855a4bf854fbd9207ae909021d6bf (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:04.974479 10128 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.976727 10054 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:04.982283 10986 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.990417 10986 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:04.998521 11020 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:05.005286 10735 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.005486 10054 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.011786  9952 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.020800 10125 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.036127 11020 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.041024 10128 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.053468 10195 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:05.056798 10735 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.061463 10130 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:05.063023 11038 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.063807 10736 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:05.065289 11038 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.069166 10054 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.082202 10736 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.083979 11036 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.081223  9952 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.098299 10125 raft_consensus.cc:2955] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.117834 10195 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:05.121196  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5cb0ac432438495091e62290dd19b812 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:05.133419 10054 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:05.132906  9952 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.137553 10735 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:05.139027 11020 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.144512 11006 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.149698 11006 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.160750 10735 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.171155 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb0ac432438495091e62290dd19b812 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:05.172184 11040 tablet_replica.cc:333] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:05.173190 11040 raft_consensus.cc:2243] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.173918 11040 raft_consensus.cc:2272] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.177485 11040 ts_tablet_manager.cc:1916] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:05.178864  9953 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:05.188649  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acc41bbfb3c94637814837eb2cfad80f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:05.224550 10046 raft_consensus.cc:2955] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:05.229842 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77636.8us
I20260709 12:14:05.241375 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet acc41bbfb3c94637814837eb2cfad80f with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:05.248292 11040 ts_tablet_manager.cc:1929] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:05.248860 11040 log.cc:1199] T 5cb0ac432438495091e62290dd19b812 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/5cb0ac432438495091e62290dd19b812
I20260709 12:14:05.250525  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 5cb0ac432438495091e62290dd19b812 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:05.250418 11048 tablet_replica.cc:333] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:05.252118 11048 raft_consensus.cc:2243] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.252763 11048 raft_consensus.cc:2272] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.255816 11048 ts_tablet_manager.cc:1916] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:05.268375 11048 ts_tablet_manager.cc:1929] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:05.268849 11048 log.cc:1199] T acc41bbfb3c94637814837eb2cfad80f P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/acc41bbfb3c94637814837eb2cfad80f
I20260709 12:14:05.270691  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet acc41bbfb3c94637814837eb2cfad80f (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:06.295480 10046 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.301008 10195 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:06.302358 10972 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.303169 10125 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:06.303344 10019 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 567b4adc73ba4d2ea946e154ebd94129. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.304200 10972 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.309824 11004 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.311079 10195 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.313318 10125 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.329605 10199 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.329725  9953 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.351401 10130 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:06.352907 10168 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89ebc329a9274f3595e703104efa64c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.354837 11006 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.358304 10046 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:06.359925 11006 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.368517 11055 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.370571 10130 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.394484 10048 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.397192 10199 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.412210  9952 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.413404 10130 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:06.414283 10168 consensus_peers.cc:597] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60ade9b09dbd4c1e8ef7fb9e1f22c472. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.415325 11055 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.418143 10048 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:06.422202 11056 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.426731 11055 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.428323 10130 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.433292 10048 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.440935  9953 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.444015 10199 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:06.454764 10168 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f85bc37908cc412eb5ffe5d0318140ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.455524 10048 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:06.457755 10981 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.463980 10130 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:06.465406 11056 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.473322 11055 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.475529 10130 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.483202 10046 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.489982  9953 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:06.766992 11068 ts_tablet_manager.cc:933] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:06.768591 11068 tablet_copy_client.cc:323] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:06.770395 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 89ebc329a9274f3595e703104efa64c0 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:06.770934 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 89ebc329a9274f3595e703104efa64c0 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-89ebc329a9274f3595e703104efa64c0
I20260709 12:14:06.778084 10214 tablet_copy_source_session.cc:215] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:06.780839 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebc329a9274f3595e703104efa64c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.799309 11068 tablet_copy_client.cc:806] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:06.799952 11068 tablet_copy_client.cc:670] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:06.805223 11068 tablet_copy_client.cc:538] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:06.814347 11068 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:06.835775 11068 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.836797 11068 tablet_bootstrap.cc:492] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:06.837550 11068 ts_tablet_manager.cc:1403] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:14:06.840440 11068 raft_consensus.cc:359] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.842381 11068 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:06.843153 11068 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.846978 11068 ts_tablet_manager.cc:1434] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:14:06.848596 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-89ebc329a9274f3595e703104efa64c0 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:06.849042 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-89ebc329a9274f3595e703104efa64c0 on tablet 89ebc329a9274f3595e703104efa64c0 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:06.918278 11068 ts_tablet_manager.cc:933] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:14:06.925784 11068 tablet_copy_client.cc:323] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:14:06.927393 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 567b4adc73ba4d2ea946e154ebd94129 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:14:06.927938 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 567b4adc73ba4d2ea946e154ebd94129 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-567b4adc73ba4d2ea946e154ebd94129
I20260709 12:14:06.933959 10065 tablet_copy_source_session.cc:215] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:06.937263 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567b4adc73ba4d2ea946e154ebd94129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.949812 11068 tablet_copy_client.cc:806] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:06.950385 11068 tablet_copy_client.cc:670] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:06.954020 11068 tablet_copy_client.cc:538] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:06.963014 11068 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:06.994489 11068 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.995417 11068 tablet_bootstrap.cc:492] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:06.996085 11068 ts_tablet_manager.cc:1403] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.033s	user 0.028s	sys 0.005s
I20260709 12:14:06.998840 11068 raft_consensus.cc:359] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:06.999837 11068 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:07.000507 11068 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:07.003464 11068 ts_tablet_manager.cc:1434] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:07.005317 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-567b4adc73ba4d2ea946e154ebd94129 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:14:07.005712 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-567b4adc73ba4d2ea946e154ebd94129 on tablet 567b4adc73ba4d2ea946e154ebd94129 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:07.007108 11076 ts_tablet_manager.cc:933] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:07.019896 11076 tablet_copy_client.cc:323] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:07.021323 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:07.021759 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-60ade9b09dbd4c1e8ef7fb9e1f22c472
I20260709 12:14:07.023772 11068 ts_tablet_manager.cc:933] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:07.030820 10214 tablet_copy_source_session.cc:215] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:07.031180 11068 tablet_copy_client.cc:323] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:07.033071 10213 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet f85bc37908cc412eb5ffe5d0318140ee from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:07.033597 10213 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet f85bc37908cc412eb5ffe5d0318140ee from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-f85bc37908cc412eb5ffe5d0318140ee
I20260709 12:14:07.038208 11076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.041095 10213 tablet_copy_source_session.cc:215] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:07.044232 11068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85bc37908cc412eb5ffe5d0318140ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.050496 11076 tablet_copy_client.cc:806] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:07.051131 11076 tablet_copy_client.cc:670] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:07.054774 11076 tablet_copy_client.cc:538] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:07.060173 11068 tablet_copy_client.cc:806] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:07.060791 11068 tablet_copy_client.cc:670] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:07.061535 11076 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:07.066538 11068 tablet_copy_client.cc:538] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:07.076829 11068 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:07.212450 11068 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:07.213389 11068 tablet_bootstrap.cc:492] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:07.215225 11068 ts_tablet_manager.cc:1403] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.139s	user 0.046s	sys 0.051s
I20260709 12:14:07.215262 11076 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:07.216831 11076 tablet_bootstrap.cc:492] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:07.217564 11076 ts_tablet_manager.cc:1403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.156s	user 0.081s	sys 0.057s
I20260709 12:14:07.219241 11068 raft_consensus.cc:359] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:07.220067 11068 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:07.220675 11068 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:07.220520 11076 raft_consensus.cc:359] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:07.221489 11076 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:07.222199 11076 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:07.222675 11068 ts_tablet_manager.cc:1434] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:07.225073 10213 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f85bc37908cc412eb5ffe5d0318140ee received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:07.225307 11076 ts_tablet_manager.cc:1434] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:07.225473 10213 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-f85bc37908cc412eb5ffe5d0318140ee on tablet f85bc37908cc412eb5ffe5d0318140ee with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:07.228948 10213 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-60ade9b09dbd4c1e8ef7fb9e1f22c472 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:07.229358 10213 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-60ade9b09dbd4c1e8ef7fb9e1f22c472 on tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:07.233916 10736 raft_consensus.cc:1217] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:07.379432 10736 raft_consensus.cc:1217] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:07.416028 10736 raft_consensus.cc:1217] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:07.545970 10736 raft_consensus.cc:1217] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:07.759780 10981 raft_consensus.cc:1064] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:07.762087 10981 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:07.768123 10736 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.769543 11055 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.773429 10125 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.775058 10048 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.775142 10981 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.777463 10981 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.786954 10125 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.785315 11055 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.805296 10736 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.805287 10048 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.811357  9950 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.844785 10981 raft_consensus.cc:1064] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:07.846961 10981 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:07.860179 10195 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:07.863288 10125 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.864703 11006 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.867085 10054 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.867702 10736 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.869401 11006 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.870196 11056 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:07.878870 10054 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:07.881636 10735 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:07.888830 11056 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:07.891896 11006 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:07.894635 11006 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.901466 10735 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.902685 11055 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.903029 10048 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.914693  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89ebc329a9274f3595e703104efa64c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:07.909924 10736 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.920491  9952 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.924749 10054 raft_consensus.cc:2955] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.943375 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 89ebc329a9274f3595e703104efa64c0 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:07.954221 11096 tablet_replica.cc:333] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:07.957093  9952 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.970300 10972 raft_consensus.cc:1064] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:07.972544 10972 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:07.981606 11096 raft_consensus.cc:2243] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:07.982595 11096 raft_consensus.cc:2272] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:07.981566 10128 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:07.990530 10199 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:07.992506 10195 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:07.995216 11052 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.003083 10734 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.004750 11094 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.007731 10128 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:08.011515 10972 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.014053 11096 ts_tablet_manager.cc:1916] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:08.018404 10735 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:08.027519 11095 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.039160 11052 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.040555  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:08.041811 10734 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.047705 10130 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.068862  9953 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.071512 10972 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.083024 10125 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.086763 11006 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.093086 11094 raft_consensus.cc:1064] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:08.093421 10199 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.096707 11094 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:08.099968 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:08.109241 11101 tablet_replica.cc:333] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:08.108127  9952 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.117758 10734 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.132212 11101 raft_consensus.cc:2243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:08.133292 11101 raft_consensus.cc:2272] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:08.141466 11101 ts_tablet_manager.cc:1916] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:08.142158 10125 raft_consensus.cc:2955] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.145602 10054 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:08.148311 11096 ts_tablet_manager.cc:1929] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:08.148828 11096 log.cc:1199] T 89ebc329a9274f3595e703104efa64c0 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/89ebc329a9274f3595e703104efa64c0
I20260709 12:14:08.150398  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 89ebc329a9274f3595e703104efa64c0 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:08.150792 10734 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.153098 11072 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.156669 10130 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.159549 10972 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.178555 11101 ts_tablet_manager.cc:1929] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:08.180419 11072 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.189118 10128 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.184026 10736 raft_consensus.cc:2955] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.188135 10048 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:08.190039 11101 log.cc:1199] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/60ade9b09dbd4c1e8ef7fb9e1f22c472
I20260709 12:14:08.192147  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 60ade9b09dbd4c1e8ef7fb9e1f22c472 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:08.188448 10734 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:08.198056 11055 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.198583  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 567b4adc73ba4d2ea946e154ebd94129 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:08.199985 11055 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.189571 10125 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:08.207245  9951 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.221354 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 567b4adc73ba4d2ea946e154ebd94129 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:08.228767 11006 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.247377 11104 tablet_replica.cc:333] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:08.248761 11104 raft_consensus.cc:2243] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:08.249516 11104 raft_consensus.cc:2272] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:08.256168 11094 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.257697 11104 ts_tablet_manager.cc:1916] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:08.259697 10125 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.276867 10736 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.283303 10048 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.286805  9953 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.321452 10199 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:08.336788 10736 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.338126 10048 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:08.338415 11095 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.339545 11094 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.346342 11094 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.345228 11104 ts_tablet_manager.cc:1929] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:08.348896 11104 log.cc:1199] T 567b4adc73ba4d2ea946e154ebd94129 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/567b4adc73ba4d2ea946e154ebd94129
I20260709 12:14:08.348647 10048 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.352612  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 567b4adc73ba4d2ea946e154ebd94129 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:08.359936  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f85bc37908cc412eb5ffe5d0318140ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:08.361171 10736 raft_consensus.cc:2955] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:08.378680  9951 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.400951 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet f85bc37908cc412eb5ffe5d0318140ee with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:08.409173 11096 tablet_replica.cc:333] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:08.409934 11096 raft_consensus.cc:2243] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:08.410616 11096 raft_consensus.cc:2272] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:08.414633 11096 ts_tablet_manager.cc:1916] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:08.432394 11096 ts_tablet_manager.cc:1929] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:08.432957 11096 log.cc:1199] T f85bc37908cc412eb5ffe5d0318140ee P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/f85bc37908cc412eb5ffe5d0318140ee
I20260709 12:14:08.434638  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet f85bc37908cc412eb5ffe5d0318140ee (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:09.471375 10128 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:09.477437 10195 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.477437 10054 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:09.477579 10094 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aedf82824d3c4883ad33ed154a6a08a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.478930 10989 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.479682 11081 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.486969 10989 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.488773 10195 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.490808 10054 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.501214 10130 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:09.505018  9952 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:09.511049 10094 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efb9d4efacd143a6bbb65eb25d52093d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.513206 10195 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.514796 10989 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.525720 10054 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.527236 11110 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.524140 11114 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.526301 10195 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.549263 10195 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:09.555341  9951 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.566875 10128 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.567342 10048 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.568343 11094 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.569360 11056 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:09.571157 10168 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03649ca7b822435188aa9ef044bc52b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.574808 10054 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.598675 11095 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.601230 10054 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.606822 10128 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.618120  9953 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.630971 10195 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:09.637430 10128 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:09.637697 10168 consensus_peers.cc:597] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e133f56c04b492fbfac52f65ed6fe2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.639149 10054 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:09.639639 11095 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.643293 11126 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.650759 11095 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.653652 10128 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.679674  9953 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.680248 10048 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:09.958045 11130 ts_tablet_manager.cc:933] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:09.959903 11130 tablet_copy_client.cc:323] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:09.961632 10213 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 03649ca7b822435188aa9ef044bc52b0 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:09.962185 10213 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 03649ca7b822435188aa9ef044bc52b0 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-03649ca7b822435188aa9ef044bc52b0
I20260709 12:14:09.970013 10213 tablet_copy_source_session.cc:215] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:09.973501 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03649ca7b822435188aa9ef044bc52b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:09.992811 11130 tablet_copy_client.cc:806] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:09.993379 11130 tablet_copy_client.cc:670] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:09.996780 11130 tablet_copy_client.cc:538] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.006263 11130 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:10.029696 11130 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.030599 11130 tablet_bootstrap.cc:492] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:10.031210 11130 ts_tablet_manager.cc:1403] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.008s
I20260709 12:14:10.033321 11130 raft_consensus.cc:359] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.033890 11130 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:10.034395 11130 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.037354 11130 ts_tablet_manager.cc:1434] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:10.039819 10213 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-03649ca7b822435188aa9ef044bc52b0 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:10.040256 10213 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-03649ca7b822435188aa9ef044bc52b0 on tablet 03649ca7b822435188aa9ef044bc52b0 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:10.047260 11130 ts_tablet_manager.cc:933] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:10.048931 11130 tablet_copy_client.cc:323] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:10.050655 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet efb9d4efacd143a6bbb65eb25d52093d from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:10.051169 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet efb9d4efacd143a6bbb65eb25d52093d from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-efb9d4efacd143a6bbb65eb25d52093d
I20260709 12:14:10.058725 10140 tablet_copy_source_session.cc:215] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:10.061932 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb9d4efacd143a6bbb65eb25d52093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.078672 11130 tablet_copy_client.cc:806] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:10.079286 11130 tablet_copy_client.cc:670] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:10.084969 11130 tablet_copy_client.cc:538] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.099337 11135 ts_tablet_manager.cc:933] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:10.106412 11130 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:10.111168 11135 tablet_copy_client.cc:323] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:10.115176 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet aedf82824d3c4883ad33ed154a6a08a1 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:10.115746 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet aedf82824d3c4883ad33ed154a6a08a1 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-aedf82824d3c4883ad33ed154a6a08a1
I20260709 12:14:10.123587 10140 tablet_copy_source_session.cc:215] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:10.133059 11135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedf82824d3c4883ad33ed154a6a08a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.150444 11135 tablet_copy_client.cc:806] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:10.151087 11135 tablet_copy_client.cc:670] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:10.151401 11130 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.152240 11130 tablet_bootstrap.cc:492] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:10.153263 11130 ts_tablet_manager.cc:1403] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.010s
I20260709 12:14:10.156381 11130 raft_consensus.cc:359] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.157226 11130 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:10.157876 11130 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.160356 11135 tablet_copy_client.cc:538] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.161550 11130 ts_tablet_manager.cc:1434] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:14:10.167286 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-efb9d4efacd143a6bbb65eb25d52093d received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:10.169054 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-efb9d4efacd143a6bbb65eb25d52093d on tablet efb9d4efacd143a6bbb65eb25d52093d with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:10.173380 11135 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:10.173960 11138 ts_tablet_manager.cc:933] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:10.187186 11138 tablet_copy_client.cc:323] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:10.188993 10213 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 2e133f56c04b492fbfac52f65ed6fe2b from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:10.189543 10213 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 2e133f56c04b492fbfac52f65ed6fe2b from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-2e133f56c04b492fbfac52f65ed6fe2b
I20260709 12:14:10.196746 10213 tablet_copy_source_session.cc:215] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:10.200258 11138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e133f56c04b492fbfac52f65ed6fe2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.201325 11135 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.202280 11135 tablet_bootstrap.cc:492] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:10.202947 11135 ts_tablet_manager.cc:1403] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 12:14:10.206283 11135 raft_consensus.cc:359] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.207125 11135 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:10.207738 11135 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.212988 11135 ts_tablet_manager.cc:1434] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:10.214884 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-aedf82824d3c4883ad33ed154a6a08a1 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:10.215296 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-aedf82824d3c4883ad33ed154a6a08a1 on tablet aedf82824d3c4883ad33ed154a6a08a1 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:10.226297 11138 tablet_copy_client.cc:806] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:10.226857 11138 tablet_copy_client.cc:670] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:10.230315 11138 tablet_copy_client.cc:538] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:10.236636 11138 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:10.270787 11138 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.271886 11138 tablet_bootstrap.cc:492] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:10.272554 11138 ts_tablet_manager.cc:1403] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.022s
I20260709 12:14:10.275547 11138 raft_consensus.cc:359] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.276386 11138 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:10.277041 11138 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:10.279520 11138 ts_tablet_manager.cc:1434] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:10.281438 10213 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-2e133f56c04b492fbfac52f65ed6fe2b received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:10.281860 10213 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-2e133f56c04b492fbfac52f65ed6fe2b on tablet 2e133f56c04b492fbfac52f65ed6fe2b with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:10.336360 10735 raft_consensus.cc:1217] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:10.495146 10736 raft_consensus.cc:1217] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:10.571266 10736 raft_consensus.cc:1217] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:10.767470 10736 raft_consensus.cc:1217] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:10.865753 11095 raft_consensus.cc:1064] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:10.868294 11095 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:10.874274 10736 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.875806 11094 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.881804 10048 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.883941 10130 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.890663 11095 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.894039 11094 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.906037 11094 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:10.911500 10735 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:10.929431  9951 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.930598 10130 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:10.935642 10046 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:10.972038 11114 raft_consensus.cc:1064] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:10.977279 11114 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:10.986162 10735 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.986268 10199 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:10.988195 10046 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.988633 11110 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.988835 10195 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:10.990664 10989 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.997375 10735 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.001668 11110 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:11.003079 10048 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.003633 11143 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.009773 11094 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.013191 11126 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.020937 10735 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.029451  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03649ca7b822435188aa9ef044bc52b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:11.040897  9953 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.044039 10048 raft_consensus.cc:2955] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:11.078624 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 88600.2us
I20260709 12:14:11.099937 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 03649ca7b822435188aa9ef044bc52b0 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:11.127133 11157 tablet_replica.cc:333] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:11.128466 11157 raft_consensus.cc:2243] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:11.129455 11157 raft_consensus.cc:2272] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:11.132055 11153 raft_consensus.cc:1064] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:11.134969 11157 ts_tablet_manager.cc:1916] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:11.134268 11153 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:11.137188 11158 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.141644 10199 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.151013 10046 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.153733 10735 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.153909 11159 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.155866 10199 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.157024 11157 ts_tablet_manager.cc:1929] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:11.157527 11157 log.cc:1199] T 03649ca7b822435188aa9ef044bc52b0 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/03649ca7b822435188aa9ef044bc52b0
I20260709 12:14:11.158891 11110 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.159684 11161 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.161710  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 03649ca7b822435188aa9ef044bc52b0 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:11.161218 10735 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.162478 10046 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.187913 11161 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.193965 10048 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.166955  9953 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.212781 10734 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.234196 10195 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.233353  9950 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.246168 10128 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:11.252331 10048 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.253371 10734 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.253890 11110 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.257553 11155 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:11.263123 11114 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.267099 10735 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.268275 10048 raft_consensus.cc:2955] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.286019  9951 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.289033  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aedf82824d3c4883ad33ed154a6a08a1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:11.289582 10128 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:11.299710 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet aedf82824d3c4883ad33ed154a6a08a1 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:11.303642 10735 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.304288 10054 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.306010 11114 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.307858 11155 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.309273 11143 raft_consensus.cc:1064] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:11.311918 11143 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:11.315281 10989 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.319010 10048 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.320184 11166 tablet_replica.cc:333] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:11.321264 11166 raft_consensus.cc:2243] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:11.322067 11166 raft_consensus.cc:2272] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:11.328169 11166 ts_tablet_manager.cc:1916] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:11.331918 10735 raft_consensus.cc:2955] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.333921  9952 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.336971  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efb9d4efacd143a6bbb65eb25d52093d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:11.344199 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet efb9d4efacd143a6bbb65eb25d52093d with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:11.373713 11166 ts_tablet_manager.cc:1929] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:11.374199 11166 log.cc:1199] T aedf82824d3c4883ad33ed154a6a08a1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/aedf82824d3c4883ad33ed154a6a08a1
I20260709 12:14:11.376046 11166 tablet_replica.cc:333] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:11.376004  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet aedf82824d3c4883ad33ed154a6a08a1 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:11.377138 11166 raft_consensus.cc:2243] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:11.377883 11166 raft_consensus.cc:2272] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:11.380934 11166 ts_tablet_manager.cc:1916] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:11.387727 10128 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.389262 10048 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.387703 10735 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:11.391243 11126 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.392527 11095 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.397200 11144 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:11.411952 11166 ts_tablet_manager.cc:1929] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:11.412422 11166 log.cc:1199] T efb9d4efacd143a6bbb65eb25d52093d P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/efb9d4efacd143a6bbb65eb25d52093d
I20260709 12:14:11.413842  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet efb9d4efacd143a6bbb65eb25d52093d (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:11.419199 11094 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.421384 10735 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.421384 10048 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.435334 10128 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.437974  9951 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.454901 10195 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:11.464483 10735 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.465790 11095 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.468039 10128 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:11.469389 11095 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.472843 11144 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.477335 10734 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.482236 10129 raft_consensus.cc:2955] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.504421  9953 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:11.552399  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e133f56c04b492fbfac52f65ed6fe2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:11.552866 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e133f56c04b492fbfac52f65ed6fe2b with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:11.563427 11172 tablet_replica.cc:333] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:11.570655 11172 raft_consensus.cc:2243] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:11.571527 11172 raft_consensus.cc:2272] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:11.574954 11172 ts_tablet_manager.cc:1916] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:11.586724 11172 ts_tablet_manager.cc:1929] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:11.587033 11172 log.cc:1199] T 2e133f56c04b492fbfac52f65ed6fe2b P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/2e133f56c04b492fbfac52f65ed6fe2b
I20260709 12:14:11.588265  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 2e133f56c04b492fbfac52f65ed6fe2b (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:12.607653 10128 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:12.612686 10048 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:12.612699 10195 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:12.612854 10094 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29ce21faad84430d93ec2445ba64030b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.613919 10989 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.614562 11114 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.622916 11114 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.629865 10199 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.640822 10195 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:12.643082  9953 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.647081 10054 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.658448 10128 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:12.659296 10048 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:12.660246 10168 consensus_peers.cc:597] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 370d155a067d4428a676aa10078366b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.663264 11094 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.664839 11143 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.671711 11094 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.680413 10128 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.687849 10054 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.706590 10048 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:12.722131 10195 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:12.723662 10019 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b7d9d50250941bf80c7399e949d802c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.723744 11122 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.725143 10128 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:12.722884  9951 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.726611 11122 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.735872 11072 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.741259 10129 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.747648 10199 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.768720  9950 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.769627 10199 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:12.777153 10168 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7109c20f60c433bbfea17052252d2e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:12.778414 10129 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:12.780731 11177 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.781749 10048 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:12.783478 11143 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.794137 11094 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.796070 10128 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.797833 10048 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:12.822299  9953 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:13.077943 11193 ts_tablet_manager.cc:933] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:13.079733 11193 tablet_copy_client.cc:323] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:13.081261 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 29ce21faad84430d93ec2445ba64030b from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:13.081704 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 29ce21faad84430d93ec2445ba64030b from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-29ce21faad84430d93ec2445ba64030b
I20260709 12:14:13.088971 10140 tablet_copy_source_session.cc:215] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:13.090617  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.092455 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ce21faad84430d93ec2445ba64030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:13.109797 11193 tablet_copy_client.cc:806] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:13.110508 11193 tablet_copy_client.cc:670] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:13.114980 11193 tablet_copy_client.cc:538] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:13.124351 11193 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:13.155203 11193 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:13.155910 11193 tablet_bootstrap.cc:492] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:13.156505 11193 ts_tablet_manager.cc:1403] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.005s
I20260709 12:14:13.158716 11193 raft_consensus.cc:359] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.159433 11193 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:13.159955 11193 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.162539 11193 ts_tablet_manager.cc:1434] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:13.164340 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-29ce21faad84430d93ec2445ba64030b received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:13.164677 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-29ce21faad84430d93ec2445ba64030b on tablet 29ce21faad84430d93ec2445ba64030b with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.181010 11193 ts_tablet_manager.cc:933] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.187230 11193 tablet_copy_client.cc:323] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:13.190021 10213 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 370d155a067d4428a676aa10078366b8 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:13.190747 10213 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 370d155a067d4428a676aa10078366b8 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-370d155a067d4428a676aa10078366b8
I20260709 12:14:13.203516 10213 tablet_copy_source_session.cc:215] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:13.208729 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370d155a067d4428a676aa10078366b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:13.212862 10199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:13.213590 10199 raft_consensus.cc:606] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.219880 10199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:13.220569 10199 raft_consensus.cc:606] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:13.229125 11193 tablet_copy_client.cc:806] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:13.230939 11193 tablet_copy_client.cc:670] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:13.231303 11200 ts_tablet_manager.cc:933] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.232945 10199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:13.233398 10199 raft_consensus.cc:606] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.240669 11200 tablet_copy_client.cc:323] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:13.242995 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet a7109c20f60c433bbfea17052252d2e4 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:13.243498 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet a7109c20f60c433bbfea17052252d2e4 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-a7109c20f60c433bbfea17052252d2e4
I20260709 12:14:13.243978 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:13.244552 10198 raft_consensus.cc:606] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.261363 11177 raft_consensus.cc:993] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.263163 10214 tablet_copy_source_session.cc:215] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:13.264560 11193 tablet_copy_client.cc:538] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:13.264910 11177 raft_consensus.cc:1081] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.266697 10734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:14:13.267867 10734 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.268280 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7109c20f60c433bbfea17052252d2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:13.268363 10734 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.288795 11193 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:13.277320 10129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:13.291066 10129 raft_consensus.cc:606] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:13.296554 10734 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.301913 11200 tablet_copy_client.cc:806] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:13.302944 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:13.307156 10198 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:13.308382 11200 tablet_copy_client.cc:670] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:13.309465  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:13.311131  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.312139  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.314682 11200 tablet_copy_client.cc:538] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:13.324340 11143 raft_consensus.cc:993] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.326606 11200 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:13.327205 11094 raft_consensus.cc:1081] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.328951 10054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:13.329526 10054 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.329877 10054 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.339648 10054 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.347919 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:13.352754 10128 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.369119 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:13.369325 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.369784 10129 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.369855 10054 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.370018 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.370750 10195 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.371035 10195 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:13.371752 10195 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.372799 10195 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.369933 10198 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.375079 10198 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:13.375612 10128 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:13.375953 10198 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.376734 10129 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.324435 11193 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:13.376997 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:13.378042 11122 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.378584 11122 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:13.379369 11207 ts_tablet_manager.cc:933] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:14:13.370102 10734 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.379657 11122 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.383404 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:13.384471 11196 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.385623 10198 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.388495 11176 raft_consensus.cc:993] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.381350 11193 tablet_bootstrap.cc:492] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:13.397231 11176 raft_consensus.cc:1081] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.389523 10195 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:13.400729 11193 ts_tablet_manager.cc:1403] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.006s
I20260709 12:14:13.405071 10054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:14:13.405671 10054 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.406019 10054 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.407861 10198 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.417495 11196 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:13.418768 11196 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.423600 11193 raft_consensus.cc:359] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.430796 11193 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:13.439903 11193 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.446764 11193 ts_tablet_manager.cc:1434] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:14:13.427174 11207 tablet_copy_client.cc:323] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:14:13.441303 10054 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.449451 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 6b7d9d50250941bf80c7399e949d802c from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:14:13.449777 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-370d155a067d4428a676aa10078366b8 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:13.450022 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 6b7d9d50250941bf80c7399e949d802c from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-6b7d9d50250941bf80c7399e949d802c
I20260709 12:14:13.450270 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-370d155a067d4428a676aa10078366b8 on tablet 370d155a067d4428a676aa10078366b8 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.454300  9950 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:13.450906  9953 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:13.458153 11200 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:13.459350 11200 tablet_bootstrap.cc:492] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:13.459996 11200 ts_tablet_manager.cc:1403] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.134s	user 0.037s	sys 0.033s
I20260709 12:14:13.463135 11200 raft_consensus.cc:359] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.463922 11200 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:13.464975 10054 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.464550 11200 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:13.466732 11200 ts_tablet_manager.cc:1434] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:14:13.468575 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-a7109c20f60c433bbfea17052252d2e4 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:13.469036 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-a7109c20f60c433bbfea17052252d2e4 on tablet a7109c20f60c433bbfea17052252d2e4 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:13.511656 10065 tablet_copy_source_session.cc:215] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:13.521103 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.522652 10198 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.535995 11143 raft_consensus.cc:993] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.536991 11205 raft_consensus.cc:1081] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:13.540019 11143 raft_consensus.cc:993] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.540668 11143 raft_consensus.cc:1081] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.559981 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7d9d50250941bf80c7399e949d802c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:13.569042 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:13.569883 10048 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.570415 10048 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.552987 10734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:14:13.572608 10734 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.574481 10734 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.592729 10734 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.608541 10734 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.611307 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:13.612156 10054 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.622248 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.623221 10195 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.623560 10195 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:13.624533 10195 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.626351 10195 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.617821 10198 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:13.636489 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 82297.5us
W20260709 12:14:13.603171 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48177.8us
I20260709 12:14:13.648764 10198 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:13.650313 10195 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.675598 10735 raft_consensus.cc:1217] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:13.682264 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:13.683161 10129 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.683709 10129 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:13.685309 10129 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.688966 10129 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.692620 10054 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.707008 10048 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.729259 10129 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:13.751976 10048 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.757055 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:13.758901 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59498.1us
I20260709 12:14:13.759999 11196 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.760569 11196 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:13.761870 11196 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:13.764252 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98640.9us
I20260709 12:14:13.775620 10734 raft_consensus.cc:1217] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:13.781985 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.782758 10195 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.783144 10195 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:13.791558 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:13.796797 11223 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.797636 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:13.798345 10130 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.818344 11094 raft_consensus.cc:993] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.819103 11094 raft_consensus.cc:1081] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:13.822171 10735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:14:13.822944 10735 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:13.823434 10735 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.830991 11207 tablet_copy_client.cc:806] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:13.831733 11207 tablet_copy_client.cc:670] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:13.831768 10735 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.835935 11223 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:13.837218 11223 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:13.841197 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 96639.5us
I20260709 12:14:13.858196 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:13.823542 10195 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.859416 10195 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.858909 10048 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.860788 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:13.861368 10198 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:13.861675 10198 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:13.862493 10198 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.863739 10198 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:13.866532 10735 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:13.866330 10048 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.868324 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:13.869257 11210 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.871745 10130 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:13.872555 10128 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:13.876266 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:13.878084 11189 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:13.878605 11189 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:13.878834 10195 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:13.879590 10198 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:13.880440 11189 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:13.886277 11207 tablet_copy_client.cc:538] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:13.886340 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 149949us
I20260709 12:14:13.892443 11210 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:13.893832 10735 raft_consensus.cc:1217] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:13.898723 11210 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:13.918666  9953 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:13.924914 10130 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.926491 11122 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:13.949034 10128 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:13.951067 11235 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:13.955515  9950 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:13.961270 10198 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.993208 11122 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.962986 11207 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:14.006587  9950 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:14.010634  9951 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.022825 10195 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:14.028595 11210 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:14.102538 11207 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:14.103508 11207 tablet_bootstrap.cc:492] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:14.104192 11207 ts_tablet_manager.cc:1403] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.008s
I20260709 12:14:14.107273 11207 raft_consensus.cc:359] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:14.108103 11207 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:14.108733 11207 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:14.111363 11207 ts_tablet_manager.cc:1434] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:14.113626 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6b7d9d50250941bf80c7399e949d802c received from {username='slave'} at 127.0.0.1:53880
I20260709 12:14:14.113996 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6b7d9d50250941bf80c7399e949d802c on tablet 6b7d9d50250941bf80c7399e949d802c with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:14.135792 11230 raft_consensus.cc:1064] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:14.137825 11230 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.144126 10125 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.144447 10733 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.145363 10054 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.145763 11222 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:14.146988 11225 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.149274 11230 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.168743 11225 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.171794 10054 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.181617 10733 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.187449 10128 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.193140  9953 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.199927 10735 raft_consensus.cc:1217] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:14.224671 10198 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.230345 10733 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.230333 10128 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.232352 11225 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.234323 11230 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.249112 10733 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.246747 11230 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.252321 10128 raft_consensus.cc:2955] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.265535  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 370d155a067d4428a676aa10078366b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:14.266791  9950 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.278506 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 370d155a067d4428a676aa10078366b8 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:14.282315 10048 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:14.287102 11210 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.303663 11230 raft_consensus.cc:1064] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:14.306383 11230 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.311259 11251 tablet_replica.cc:333] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:14:14.320236 11251 raft_consensus.cc:2243] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.322739 11251 raft_consensus.cc:2272] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.327958 11251 ts_tablet_manager.cc:1916] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:14.329638 10198 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:14.331260 11210 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.336709 11202 raft_consensus.cc:1064] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:14.340104 11202 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.348289 10733 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.352197 11222 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.365213 10200 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:14.368602 10054 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.369243 10125 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.377373 11177 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:14.380193 10200 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:14.382838 10199 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:14.386574 11210 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.395365 10128 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:14.397435 11218 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:14.398365 11251 ts_tablet_manager.cc:1929] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:14.398727 11229 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:14.398947 11251 log.cc:1199] T 370d155a067d4428a676aa10078366b8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/370d155a067d4428a676aa10078366b8
I20260709 12:14:14.406502 11218 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:14.406116 10128 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:14.411945 11122 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:14.451743 10054 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:14.509035 11196 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.456326  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 370d155a067d4428a676aa10078366b8 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:14.520767 11225 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.524072 11094 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:14.519007  9939 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62819.8us
I20260709 12:14:14.537658 10737 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.539418 10204 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.539371 11220 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:14.541029 11219 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:14.544555 10049 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.546136 11202 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:14.548168 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51200.8us
I20260709 12:14:14.566470 10733 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.586941 10198 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.588155 11220 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.611737 10049 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.655990 10737 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.644485 10048 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.701997  9950 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.704274  9950 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.711990 10125 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.734207 10125 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.739137 10737 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.739595 10048 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.741878 11202 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.743753 11202 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.745452 10198 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.751482 11228 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.753630 10735 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.757205 10046 raft_consensus.cc:2955] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.766871 10048 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.767539 11229 raft_consensus.cc:1064] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:14.770166 11229 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:14.772418 10737 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:14.774047 11094 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.774830  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29ce21faad84430d93ec2445ba64030b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:14.785562 11261 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.793337 10737 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.802194 11225 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.812400  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7109c20f60c433bbfea17052252d2e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:14.812942 10048 raft_consensus.cc:2955] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.827703 10198 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.829407 11122 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.831089 10735 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.836937  9951 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.840608 11189 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:14.852067 10125 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:14.851263  9952 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:14.853734 11218 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:14.857664 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 29ce21faad84430d93ec2445ba64030b with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:14.860548 11273 tablet_replica.cc:333] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:14.861689 11273 raft_consensus.cc:2243] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.868240 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet a7109c20f60c433bbfea17052252d2e4 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:14.881731 11276 tablet_replica.cc:333] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:14.882903 11276 raft_consensus.cc:2243] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.893226 11273 raft_consensus.cc:2272] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.892259 11218 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.895785 10124 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.900828 11276 raft_consensus.cc:2272] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.904642 11273 ts_tablet_manager.cc:1916] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:14.919090 10737 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.923287  9952 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.929760 11276 ts_tablet_manager.cc:1916] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:14.929349 10200 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:14.975497 11273 ts_tablet_manager.cc:1929] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:14.976150 11273 log.cc:1199] T 29ce21faad84430d93ec2445ba64030b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/29ce21faad84430d93ec2445ba64030b
I20260709 12:14:14.977418  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:14.982704  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 29ce21faad84430d93ec2445ba64030b (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:14.984198 11276 ts_tablet_manager.cc:1929] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:14.984702 11276 log.cc:1199] T a7109c20f60c433bbfea17052252d2e4 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/a7109c20f60c433bbfea17052252d2e4
I20260709 12:14:14.992960  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet a7109c20f60c433bbfea17052252d2e4 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:15.023787 10046 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.035040 10737 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:15.039412 11189 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:15.041534 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:15.042233 10198 raft_consensus.cc:606] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:15.047075 10200 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:15.047019 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:15.053982 11189 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:15.054759 10198 raft_consensus.cc:606] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:15.057430 11122 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:15.062034 10737 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:15.079483  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b7d9d50250941bf80c7399e949d802c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:15.079836  9952 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:15.080725 10130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:15.081316 10130 raft_consensus.cc:606] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:15.090276 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:15.093304 10200 raft_consensus.cc:2955] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:15.095367 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b7d9d50250941bf80c7399e949d802c with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55214
I20260709 12:14:15.096393 11276 tablet_replica.cc:333] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:14:15.099157 10198 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:15.109401 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:15.110145 10198 raft_consensus.cc:606] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:15.115072 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:15.116523 11276 raft_consensus.cc:2243] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:15.129742 10198 raft_consensus.cc:606] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:15.130122 11276 raft_consensus.cc:2272] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:15.133090 11261 raft_consensus.cc:993] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.133584 11261 raft_consensus.cc:1081] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.133919 11276 ts_tablet_manager.cc:1916] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:15.135386 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:14:15.136013 10737 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.136364 10737 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.139868  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:14:15.141530  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:15.142388  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.149829 11276 ts_tablet_manager.cc:1929] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:15.150388 11276 log.cc:1199] T 6b7d9d50250941bf80c7399e949d802c P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/6b7d9d50250941bf80c7399e949d802c
I20260709 12:14:15.150847 10737 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.152117  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 6b7d9d50250941bf80c7399e949d802c (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:15.153007 10737 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.153592 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:15.154219 10046 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.154470 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.155094 10198 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.155431 10198 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:15.156225 10198 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.157361 10198 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.165385 10046 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:15.166782 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:15.167516 11210 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.168000 11210 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:15.168361 10198 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:15.168875 11210 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.180229  9953 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.354350 11228 raft_consensus.cc:993] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.354967 11227 raft_consensus.cc:1081] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.356894 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:14:15.357446 10737 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.357801 10737 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.362250 10737 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.364022 11094 raft_consensus.cc:993] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.364269 10737 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.364630 11225 raft_consensus.cc:1081] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.364493 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:15.364880 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.365762 10198 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.366845 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:15.367344 10046 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.367663 10046 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.370980 10198 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:15.373013 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:15.374146 11210 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.374017 10046 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.374683 11210 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:15.375574 11210 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.365272 10124 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.376502 10124 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:15.376649 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:15.377199 10130 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.377468 10124 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.381708 10124 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.387653 10046 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.388708 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.391093 10200 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:15.391413 10200 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:15.392169 10200 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.393194 10200 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.397953  9953 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.404004 10200 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:15.405223 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:15.406013 10124 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:15.407940 10130 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:15.409883 11223 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.410318 11223 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:15.411070 11223 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.420953  9953 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.472954 11094 raft_consensus.cc:993] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.473361 11225 raft_consensus.cc:1081] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.474695 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:15.475126 10046 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.475379 10046 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.481173 10046 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.482621 10046 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.483300 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:15.483476 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.483892 10130 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.484122 10200 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.484493 10200 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:15.485276 10200 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.486182 10200 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.489126 10130 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:15.490267 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:15.490998 11122 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.491423 11122 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:15.491546 10200 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:15.492143 11122 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.564805  9953 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.591457 10054 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:15.598474 11210 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:15.600003 11225 raft_consensus.cc:993] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.600486 11094 raft_consensus.cc:1081] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:15.601290 11094 raft_consensus.cc:993] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.601665 11094 raft_consensus.cc:1081] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:15.603472 10733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:14:15.603633 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:15.604061 10733 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.604182 10048 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.604489 10733 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.604652 10048 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.605369 10198 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:15.606881 11210 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:15.613495 10048 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.620144 10733 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.621326 10048 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.622128 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:15.622705 10130 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.625198 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.625792 10198 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.626071 10198 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:15.626832 10198 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.627997 10198 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.635003 10130 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:15.637375 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:15.639197 11218 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.639761 11218 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:15.641433 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:15.642124 10046 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.642705 11218 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:15.637462 10198 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:15.649451 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:15.651410 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:15.652881 11210 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:15.653388 11210 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:15.654259 11210 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.656446 10733 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:15.659346 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:15.659973 10198 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:15.660271 10198 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:15.661039 10198 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:15.662251 10198 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:15.673774 10198 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:15.711118  9953 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.712724  9950 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.815907 10124 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:15.817236 11210 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:15.825969 10195 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:15.827782 11210 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:15.848997 10195 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:15.850313 11223 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:15.857785 10125 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:15.859292 11292 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.041697 10204 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.042881 11223 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.051062 10125 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.053009 11223 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.079314 10195 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.080619 11218 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.086519 10125 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.087859 11122 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.099417 10195 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:16.101207 11196 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:16.113889 10046 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:16.116349 11235 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:16.181908 10195 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:16.188704 10168 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d0b2763b8154a7392dcbe6c6acfec0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.189631 10125 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.189808 10046 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.190296  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.191280 11094 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.192340 11261 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.202874 11261 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.206094 10054 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.226524 10124 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.226836  9950 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.252293 10054 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.266013 10195 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.266549 10124 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:14:16.268904 10019 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6596abeb975142149ebfb7b9d1b7d100. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.270604 11218 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.275822 11223 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.290630 11218 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.294112 10124 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.295603 10204 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.310829 10195 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:16.318553 10168 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 505b084a723d46f28d06230c6bb0c5bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.320379 10054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:16.321023 10054 raft_consensus.cc:606] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:16.324095 10054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:16.324867 10054 raft_consensus.cc:606] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:16.324720 10124 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.325704  9952 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.332628 11261 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.336124 10046 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.338603 11314 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.339298 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:16.339898 10195 raft_consensus.cc:606] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:16.345753 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:16.346589 10046 raft_consensus.cc:606] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:16.346024 11261 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.350903 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:16.351719 10124 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:16.351013 10125 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.353353  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:16.355058  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:16.355830  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.360296 10046 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.369174 10124 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:16.388252 10094 consensus_peers.cc:597] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52fc66fb7de4405ba4a4ef0ea5ca5ba1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.388338 10195 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.388720 10046 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:14:16.390534 11281 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.391409 11312 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.392063  9952 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.439618 10054 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.439533 11281 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.473948  9952 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 1 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.490665 10200 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:16.499457 11218 raft_consensus.cc:993] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.500046 11218 raft_consensus.cc:1081] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.502799 11292 raft_consensus.cc:993] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.503258 11292 raft_consensus.cc:1081] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.514401 10733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37554
I20260709 12:14:16.515061 10733 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.515442 10733 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.527020 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37554
I20260709 12:14:16.527647 10737 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.527989 10737 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.531369 10733 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.533608 10733 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:16.535228 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:16.535910 10124 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.536628 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:16.539522 10048 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.539841 10048 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:16.540578 10048 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.541827 10048 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.544147 10124 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.545424 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:16.546093 10737 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.546536 11196 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.549171 10048 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.549346 11196 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:16.550261 11196 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.552326 10737 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:16.553169 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:16.553565 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:16.553732 10200 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.558096 10048 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.559036 10048 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:16.560125 10048 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.561275  9952 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.562484 10048 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.567206 10048 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.569649 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:16.570361 11196 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.571106 11196 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:16.571983 11196 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.574468 10200 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.583690  9952 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.671773 11261 raft_consensus.cc:993] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:16.672304 11314 raft_consensus.cc:1081] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:16.673862 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:16.674456 10048 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.674815 10048 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.681587 10048 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.683753 10048 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:16.684612 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:16.685210 10200 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.685509 10200 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:16.686266 10200 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.687744 10200 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.690690 11218 raft_consensus.cc:993] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.691275 11292 raft_consensus.cc:1081] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:16.692967 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37554
I20260709 12:14:16.693522 10737 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.693881 10737 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.694518 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:16.695132 10124 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.695602 10200 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:16.696827 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:16.697968 11223 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.698475 11223 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:16.699393 11223 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.711928 10737 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.715670 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:16.716261 10054 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.716431 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:16.716749 10054 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:16.717109 10204 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.717651 10054 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.718748 10054 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.719213 11324 ts_tablet_manager.cc:933] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:14:16.725625 11324 tablet_copy_client.cc:323] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:14:16.727604 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 6596abeb975142149ebfb7b9d1b7d100 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:14:16.728158 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 6596abeb975142149ebfb7b9d1b7d100 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-6596abeb975142149ebfb7b9d1b7d100
I20260709 12:14:16.730211 10124 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:16.732206 10204 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.732796  9952 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.734033 10054 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:16.738677 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:16.739502 11196 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.739954 11196 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:16.740751 11196 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.736074 10065 tablet_copy_source_session.cc:215] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:16.736745 10737 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:16.747206 11324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6596abeb975142149ebfb7b9d1b7d100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:16.756439 10054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:16.757134 10054 raft_consensus.cc:606] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Received request to transfer leadership
I20260709 12:14:16.762964 11281 raft_consensus.cc:993] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:16.763471 11228 raft_consensus.cc:1081] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:16.765265 10054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:14:16.765838 10054 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.767298 10054 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.763484  9952 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.771584 11324 tablet_copy_client.cc:806] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:16.772223 11324 tablet_copy_client.cc:670] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:16.772821 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:16.773380 10048 raft_consensus.cc:606] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Received request to transfer leadership
W20260709 12:14:16.774401  9939 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 6d0b2763b8154a7392dcbe6c6acfec0c already in progress [suppressed 3 similar messages]
I20260709 12:14:16.775974 11324 tablet_copy_client.cc:538] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:16.850564 10054 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.851531 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53716
I20260709 12:14:16.859531 10048 raft_consensus.cc:606] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Received request to transfer leadership
I20260709 12:14:16.861001 11324 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:16.862865 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:16.863433 10737 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:16.868597 10001 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:14:16.869084 10001 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6d0b2763b8154a7392dcbe6c6acfec0c already in progress
W20260709 12:14:16.869377 10001 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6d0b2763b8154a7392dcbe6c6acfec0c already in progress
I20260709 12:14:16.870659 10737 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:16.872496 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:16.873070 10124 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.873409 10124 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:16.874228 10124 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.875286 10124 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.872521 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:16.881328 11218 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.881848 11218 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:16.882751 11218 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:16.895895 11324 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:16.897049 11324 tablet_bootstrap.cc:492] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:16.897794 11324 ts_tablet_manager.cc:1403] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.008s
I20260709 12:14:16.873040 10054 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:16.903270 10124 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:16.905019  9952 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.901757 11330 ts_tablet_manager.cc:933] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:16.901531 11324 raft_consensus.cc:359] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.906461 11324 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:16.907227 11324 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:16.909719 11324 ts_tablet_manager.cc:1434] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:14:16.912354 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6596abeb975142149ebfb7b9d1b7d100 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:14:16.912783 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6596abeb975142149ebfb7b9d1b7d100 on tablet 6596abeb975142149ebfb7b9d1b7d100 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:16.916190 11330 tablet_copy_client.cc:323] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:14:16.918135 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 505b084a723d46f28d06230c6bb0c5bb from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:14:16.918692 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 505b084a723d46f28d06230c6bb0c5bb from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-505b084a723d46f28d06230c6bb0c5bb
I20260709 12:14:16.925282 10214 tablet_copy_source_session.cc:215] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:16.929021 11330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505b084a723d46f28d06230c6bb0c5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:16.941141 11330 tablet_copy_client.cc:806] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:16.941792 11330 tablet_copy_client.cc:670] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:16.945740 11330 tablet_copy_client.cc:538] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:16.953887 11330 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:16.968945 11324 ts_tablet_manager.cc:933] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:16.973680 10054 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:16.975368 11235 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:16.985646 11324 tablet_copy_client.cc:323] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:16.990586 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:16.990868 10046 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:16.991498 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-52fc66fb7de4405ba4a4ef0ea5ca5ba1
I20260709 12:14:16.992538 11235 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:17.002416 10140 tablet_copy_source_session.cc:215] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:17.016204 11324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.042894 11330 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:17.043205 11324 tablet_copy_client.cc:806] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:17.043887 11324 tablet_copy_client.cc:670] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:17.043988 11330 tablet_bootstrap.cc:492] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:17.044893 11330 ts_tablet_manager.cc:1403] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.053s
I20260709 12:14:17.055456 11330 raft_consensus.cc:359] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.056401 11330 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:17.057160 11330 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.059046 10200 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.062036 11330 ts_tablet_manager.cc:1434] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:17.062580 11210 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.066584 10124 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.067866 11210 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.061987 11324 tablet_copy_client.cc:538] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:17.093024 11324 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:17.094743 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-505b084a723d46f28d06230c6bb0c5bb received from {username='slave'} at 127.0.0.1:49780
I20260709 12:14:17.095263 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-505b084a723d46f28d06230c6bb0c5bb on tablet 505b084a723d46f28d06230c6bb0c5bb with peer 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:17.107002 11334 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:17.175642 11324 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:17.175783 10019 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d0b2763b8154a7392dcbe6c6acfec0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.176693 11324 tablet_bootstrap.cc:492] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:14:17.177477 11324 ts_tablet_manager.cc:1403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.085s	user 0.034s	sys 0.009s
I20260709 12:14:17.180812 11324 raft_consensus.cc:359] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.181773 11324 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:17.182520 11324 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.188266 11324 ts_tablet_manager.cc:1434] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:14:17.190557 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-52fc66fb7de4405ba4a4ef0ea5ca5ba1 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:17.191011 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-52fc66fb7de4405ba4a4ef0ea5ca5ba1 on tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:17.247893 10130 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:17.248389 10737 raft_consensus.cc:1217] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:17.251652 11122 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.266215 11223 raft_consensus.cc:993] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:17.266719 11223 raft_consensus.cc:1081] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:17.270056 10125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:14:17.270627 10125 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.270999 10125 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.273247 10200 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:17.281963 10125 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.283627 11223 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.291117 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:17.291741 10195 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.293073 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:17.293634 10054 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.293908 10054 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:17.295244 10124 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.297920 10737 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.298516 10195 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:17.299607 10200 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:14:17.299995 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:17.300856 11281 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:17.291324 10125 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:17.301321 11281 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:17.302254 11281 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.303932 10054 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:17.297816 11218 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.305835 10054 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.309134 11218 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.310313 10048 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.314134 11210 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:17.314091 10195 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:17.320130 11337 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:17.345777 10054 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:17.348562  9950 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 3 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.405694 10737 raft_consensus.cc:1217] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:17.473642  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.518338 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:17.518877 10125 raft_consensus.cc:606] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:17.521299 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:17.521745 10125 raft_consensus.cc:606] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:17.523933 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:17.524348 10125 raft_consensus.cc:606] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:17.526706 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:17.527254 10048 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:17.529873 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:14:17.531476 10125 raft_consensus.cc:606] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:17.532500  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:17.533782  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.534353  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.579612 10737 raft_consensus.cc:1217] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:14:17.584550 11223 raft_consensus.cc:993] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:14:17.585130 11223 raft_consensus.cc:1081] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:14:17.587824 10204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:14:17.588354 10204 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.588722 10204 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.594686 10204 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:17.596141 10204 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:17.596886 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:17.597074 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:17.598117 10048 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.598135 10125 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.598661 10048 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:17.599421 10048 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:17.600411 10048 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.610061 10048 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:17.610822 10125 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:17.611802 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:17.612500 11349 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:17.612980 11349 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:17.613705 11349 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:17.626192  9950 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 2 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:17.654847 11320 raft_consensus.cc:993] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:17.655361 11320 raft_consensus.cc:1081] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:14:17.656762 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:14:17.657202 10737 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.657454 10737 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.662074 10737 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.663611 10737 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:17.664417 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:17.664611 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:17.665192 10130 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.665230 10204 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.665535 10130 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:17.666105 10130 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.667290 10130 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.675233 10204 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:17.676633 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:17.677560 11210 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:17.678052 11210 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:17.678939 11210 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.679893 10130 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:17.697032  9950 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:17.706068 10048 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:17.708292 11281 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:17.723747 10195 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:17.729148 11281 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:17.733270 10094 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d0b2763b8154a7392dcbe6c6acfec0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.797286 11218 raft_consensus.cc:1064] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:17.799101 11218 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.805785 10737 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:17.805800 10124 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:17.806473 10195 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:17.807386 11218 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.808228 11292 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.808940 11223 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.823421 11292 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.828269 10124 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.835853 10195 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.846001  9951 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.854671 10737 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.878322 10054 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.883929 10737 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:17.883919 10124 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:14:17.885689 11223 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:17.886476 11218 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:17.892383 11228 raft_consensus.cc:993] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:17.892848 11353 raft_consensus.cc:1081] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:17.894480 11292 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.896005 10054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:14:17.896533 10054 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.896842 10054 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.899554 10124 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.905478 10054 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.908099 10054 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:17.909294 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:17.909821 10735 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.910813 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:17.911340 10130 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.911607 10130 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:17.912285 10130 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.913298 10130 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.916043 10735 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:17.917249 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:17.918093 11218 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:17.918514 11218 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:17.919309 11218 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:17.918998  9950 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 1 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.931396 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 6596abeb975142149ebfb7b9d1b7d100 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38756
I20260709 12:14:17.933908 10130 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:17.935619  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6596abeb975142149ebfb7b9d1b7d100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:17.903712 10737 raft_consensus.cc:2955] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:17.941071  9950 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.951046 11360 tablet_replica.cc:333] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:14:17.952041 11360 raft_consensus.cc:2243] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:17.952742 11360 raft_consensus.cc:2272] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:17.957187 11360 ts_tablet_manager.cc:1916] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:17.978612 11360 ts_tablet_manager.cc:1929] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:14:17.979130 11360 log.cc:1199] T 6596abeb975142149ebfb7b9d1b7d100 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/6596abeb975142149ebfb7b9d1b7d100
I20260709 12:14:17.980741  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 6596abeb975142149ebfb7b9d1b7d100 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:14:17.983779 11281 raft_consensus.cc:993] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:17.984292 11281 raft_consensus.cc:1081] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:17.986977 11281 raft_consensus.cc:993] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:14:17.987391 11281 raft_consensus.cc:1081] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:14:17.989006 10195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38758
I20260709 12:14:17.989517 10195 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.989854 10195 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.991088 10054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:14:17.991653 10054 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.991981 10054 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.000095 10054 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:18.002861 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:18.003435 10124 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.003724 10124 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:18.003830 11094 raft_consensus.cc:1064] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:18.004436 10124 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:18.005455 10124 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.006070 11094 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:18.009989 10130 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.011767 11349 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.017027 10054 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:18.017556 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:18.018164 10200 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.020576 10195 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:18.025267 10200 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:18.026631 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:18.027576 11218 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.027998 11218 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:18.028755 11218 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:18.041218 10195 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:18.042320 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:18.043000 10735 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.026181 10124 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:18.069612 10737 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:14:18.082860 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69420.1us
I20260709 12:14:18.101742  9950 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.106129 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:18.106825 10124 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.107124 10124 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:18.107204 11370 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:18.107854 10124 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:18.109143 10124 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.135684 10124 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:18.138797 10735 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:18.140414 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:18.195426 11367 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:18.218998 11364 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:14:18.224309 10054 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.232931 11367 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:18.234067 11367 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:18.243489 10195 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:18.247954 11387 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:18.250595 11363 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.202s	user 0.007s	sys 0.004s
W20260709 12:14:18.250846 11362 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.188s	user 0.011s	sys 0.004s
W20260709 12:14:18.250661 11182 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.142s	user 0.013s	sys 0.001s
I20260709 12:14:18.262588 11228 raft_consensus.cc:1064] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:18.269759 11228 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:18.270622 10048 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:18.292469 11393 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:18.300403  9953 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.303253 10125 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:18.304253 10129 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:18.311954 11094 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.321583 11380 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:14:18.335911 10124 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:18.341862 11371 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:18.493053 11392 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 12:14:18.580097 10735 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:18.624804 10200 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.651129 11383 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:14:18.664923 11405 ts_tablet_manager.cc:933] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:18.671003 10737 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:18.675771 11377 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:14:18.647271 11371 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 12:14:19.141407 11415 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:14:20.168998  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080003c720 after lost signal to thread 8910
I20260709 12:14:19.078802 11405 tablet_copy_client.cc:323] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:14:23.549456 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 204) took 4886 ms. Trace:
I20260709 12:14:23.550163 10735 rpcz_store.cc:276] 0709 12:14:18.663165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.663646 (+   481us) service_pool.cc:224] Handling call
0709 12:14:18.664003 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.664350 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.664378 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.664812 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.747646 (+ 82834us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:18.747745 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.747881 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.549029 (+4801148us) raft_consensus.cc:1685] finished
0709 12:14:23.549053 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.549351 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1384,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12938,"thread_start_us":81998,"threads_started":1,"wal-append.queue_time_us":118072,"wal-append.run_cpu_time_us":3241,"wal-append.run_wall_time_us":1375892}
I20260709 12:14:23.562007 11383 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.584162 11373 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.613314 11419 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:23.653761 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.006s	user 0.048s	sys 0.047s
I20260709 12:14:23.656643 11420 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:23.714533 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.066s	user 0.050s	sys 0.047s
W20260709 12:14:23.716024 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 5.06775e+06us
I20260709 12:14:23.717443 11419 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.715255 11383 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.716734 11365 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.726235 11419 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.726864 11419 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.727310 11419 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:23.717864 11373 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.729153 11419 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.729629 11419 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.730057 11373 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.724226 11420 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.732800 11223 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.733331 11223 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.730082 11419 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:23.730299 11365 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:23.735682 11419 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.737383 11365 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.737797 11365 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.739687 11223 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.738250 11365 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.741955 11365 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.742412 11365 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:23.742894 11365 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.744911 11365 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.745354 11365 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.745795 11365 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.733398 11420 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.745958 11388 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:23.748123 11383 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.753010 11394 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.751257 11425 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.754227 11394 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.759711 11425 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.769901 11427 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:23.770139 11425 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.770103 11429 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.770395 11427 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.770871 11425 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.770941 11429 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.771416 11425 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.772451 11427 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.772877 11427 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:23.773200 11429 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.773226 11427 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.773792 11429 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.817574 11373 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.768412 11394 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.819758 11394 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.819285 11373 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.820842 11394 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.773270 11425 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:23.802942 10048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 5.472s	user 0.077s	sys 0.195s
W20260709 12:14:23.827131 10048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 5.496s	user 0.078s	sys 0.196s
I20260709 12:14:23.827227 11420 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.827733 11419 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.828647 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1573) took 5500 ms. Trace:
I20260709 12:14:23.828261 11420 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.829576 10048 rpcz_store.cc:276] 0709 12:14:18.328663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.328789 (+   126us) service_pool.cc:224] Handling call
0709 12:14:18.329230 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.329576 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.329603 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.330465 (+   862us) log.cc:844] Serialized 564 byte log entry
0709 12:14:23.828031 (+5497566us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:23.828127 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.828274 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.828344 (+    70us) raft_consensus.cc:1685] finished
0709 12:14:23.828354 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.828553 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":5496896,"threads_started":1,"wal-append.queue_time_us":445961,"wal-append.run_cpu_time_us":49265,"wal-append.run_wall_time_us":4966515}
I20260709 12:14:23.829248 11426 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.867672 11425 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:23.823068 11383 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.877698 11223 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.879225 11426 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.877784 11427 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.881951 11223 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.882825 11427 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.883692 11427 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.884949 11223 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.885845 11373 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.866851 11368 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.816445 11365 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.886246 11427 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.838183 11423 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.848618 11424 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.830255 11419 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.892838 11424 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.894371 11419 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.887444 11368 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:23.896315 11365 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.897172 11365 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.903271 11394 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.857583 11428 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.904516 11428 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.904531 11420 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.910473 11368 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.910869 11365 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.905484 11427 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.911621 11383 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.867467 11429 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.914885 11427 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.917320 11427 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.919466 11429 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.830042 11422 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.921898 11365 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.922847 11365 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.925633 11365 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.904812 11425 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.943744 11427 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:23.944653 11427 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.920555 11422 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.926216 11365 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:23.967024 11365 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.978854 11424 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:23.980232 11420 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.981045 11420 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.970813 11425 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:23.984164 11394 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.996940 11394 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:23.982146 11422 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:23.991031 11420 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.002929 11430 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:23.985267 11424 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.007722 11424 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.008569 11394 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.005084 11427 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.011637 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.012812 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.013370 11433 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.015486 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.016402 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.001893 11431 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.026898 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 372) took 5343 ms. Trace:
I20260709 12:14:24.028797 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.029732 10047 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:24.030262 11365 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.026882 11394 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.032027 11394 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.027385 10737 rpcz_store.cc:276] 0709 12:14:18.679797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.679966 (+   169us) service_pool.cc:224] Handling call
0709 12:14:18.680562 (+   596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.680949 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.680978 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.682087 (+  1109us) log.cc:844] Serialized 564 byte log entry
0709 12:14:18.777212 (+ 95125us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:18.777253 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.777323 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.014569 (+5237246us) raft_consensus.cc:1685] finished
0709 12:14:24.014629 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.022822 (+  8193us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":94640,"threads_started":1,"wal-append.queue_time_us":461386,"wal-append.run_cpu_time_us":1870,"wal-append.run_wall_time_us":1015465}
I20260709 12:14:24.039310 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.040014 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.040139 10736 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.041805 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.042086 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.043322 10734 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.043480 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.044202 10732 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.039275 11434 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.046663 11434 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:23.998772 11423 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.003760 11430 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.034286 11394 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.030371 10733 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.035038 11431 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.064309 10049 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:24.036744 11427 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.109689 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.114460 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.116693 11427 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.119935 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.118508 11440 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.118011 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.139552 11094 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.140368 11094 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.139457 11447 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.149914 11431 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.153839 11353 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.154856 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.134725 11423 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.134212 11434 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.157141 11094 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.136303 10052 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:24.108714 11433 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.129941 11440 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:24.185686 11440 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.186580 10047 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:24.189910 11436 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.190305 11094 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.178519 11446 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.186894 11424 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.206686 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.207541 11337 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:24.207650 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 88362.2us
I20260709 12:14:24.208942 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.187305 11434 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.189733 11353 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.214037 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.215054 11423 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.193605 11442 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.216117 11394 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.217530 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.226271 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.215364 11433 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.229632 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.203821 11440 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.219064 11424 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.233188 11094 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.232684 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.218575 11430 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.227896 11423 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.208495 11337 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.234817 11373 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.235311 11427 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.233516 11424 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.251554 11424 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.252620 11394 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.255252 11394 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.255566 11094 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.249326 10047 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:24.250994 10054 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:24.234087 11365 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.245518 11423 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.246806 11430 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.190496 11447 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.244822 11433 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.226841 11446 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:24.292642 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 46706.8us
I20260709 12:14:24.249145 11373 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.242228 11434 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.308036 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.308944 10735 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.309295 11388 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.265331 11440 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.309098 11438 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.311256 11388 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.324048 11094 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.250208 11436 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.330101 11436 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.330907 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.331611 11353 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.331730 10733 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.332232 11353 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.332855 11353 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.301658 11430 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.332723 11378 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.293345 11442 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.322304 11373 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.333986 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.337782 11378 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:24.340561 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61933.6us
I20260709 12:14:24.327284 11365 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:24.341845 11385 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.342561 11450 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:24.344888 11449 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:24.344750 11122 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.345942 11122 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.345989 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.346313 11122 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.342339 11094 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.348316 11445 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.349040 11419 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.339119 11430 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.349018 11445 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.349576 11419 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.353842 11419 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.325042 11433 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.342478 11448 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.342347 11435 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.364578 11445 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.365442 11445 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.366179 11445 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.375144 11458 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.375782 11458 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.378129 11458 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.367882 11378 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.379362 11378 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.380173 11378 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.382356 11378 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.378798 11458 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.384305 11458 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.386513 11458 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.342406 11444 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.345160 11450 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.345497 11438 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.340727 11451 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:23.935942  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:24.431478 11452 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.575256 11424 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.480192 11122 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.525024 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.553869 11353 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.513877 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.602648 11460 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.602913 11353 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.603416 11460 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.603624 11353 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:24.473970 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 117731us
I20260709 12:14:24.496011 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.527066  9953 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 269) took 6115 ms. Trace:
I20260709 12:14:24.607663 11353 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.607877 11419 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.608305 11353 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.608904 11353 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.525450 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.424378 10199 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:24.577478 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.612552 11122 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.368431 11445 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.610196 11419 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.605476 10728 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:24.389032 11446 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.514604 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.465250 11434 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:24.550590  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080014d7e0 after lost signal to thread 9987
I20260709 12:14:24.595772 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.498687 11440 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.459796 11388 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.411635 11458 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.464066 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.548138 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.448669 11442 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.501097 11337 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.574491 11390 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:24.623284 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46027.7us
I20260709 12:14:24.550196 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.607762  9953 rpcz_store.cc:276] 0709 12:14:18.411171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.411333 (+   162us) service_pool.cc:224] Handling call
0709 12:14:24.526787 (+6115454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20215,"reported_tablets":1}
I20260709 12:14:24.552029 11447 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.549425 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.462001 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.541301 11459 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.626080 11365 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.616042 11423 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.410854 11386 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.526849 11454 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.578042 11373 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.591070 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.622301 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.634752 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.642952 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.605146 11444 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.618287 11430 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.631435 11446 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.483963 11448 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.631142 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.643654 10200 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:24.488215 11435 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.462036 10736 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:24.500665 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.641606 11434 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.656091 11448 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.654676 11463 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.669085 11448 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.669728 11448 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.669109 11463 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.650571 11446 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.641839 11388 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.638360 11459 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.645254 11353 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.526603 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.424611 11385 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.650337 11365 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.658030 11430 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.675608 11446 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.653568 11458 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.683986 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.670538 11386 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.704579 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.652205 11460 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.623782 11451 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.677984 11424 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.596802 11452 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.710107 11385 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.696110 11353 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.678081 10731 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:24.718120 11349 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:24.718668 11349 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.719115 11349 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.718935 11365 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.685500 11434 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.652607 11390 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.725432 11390 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.726197 11383 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.728451 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.710740 11452 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.658571 11454 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.722034 11438 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.734509 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.735906 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:24.726722 11428 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.738708 11457 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.739143 11457 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.739490 11457 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.721062 11385 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:24.745416 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.746753 11448 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.739817 11380 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:24.722782 11388 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.742865 11385 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:24.766156 11365 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.767715 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.775280 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.775540 11388 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.776655 10054 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:24.777108 11385 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.730134 11353 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.769586 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.755059 11423 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.763994 11456 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:24.771337 11459 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.781530 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.789160 11353 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.791971 11460 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.791718 11349 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.792555 11438 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.797250 11448 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.799661 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.794492 11456 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:24.806031 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.836953 11438 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.839394 11438 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.806582 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.807752 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:24.808082 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.842592 10737 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.808758 11281 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.812381 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.813177 11460 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.809176 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.815546 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.821612 11353 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.823448 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.824862 11435 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.825320 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.860298 11373 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.826645 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.861182 10200 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.862102 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.812265 11454 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.833338 11459 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.865796 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.865705 11459 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.867029 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.839414 11456 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:24.847517 11281 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.850708 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.854003 10051 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:24.824903 11434 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.854790 11353 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.837193 11448 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.842141 11450 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.883473 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 6d0b2763b8154a7392dcbe6c6acfec0c from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:14:24.878872 11434 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:24.884222 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 6d0b2763b8154a7392dcbe6c6acfec0c from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-6d0b2763b8154a7392dcbe6c6acfec0c
I20260709 12:14:24.884330 11434 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:24.887341 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.888135 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:24.888494 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 59747.4us
I20260709 12:14:24.888787 10124 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:24.889806 11435 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:24.890368 11435 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:24.892431 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.893042 10204 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.878455 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.893898 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.895190 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.896338 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:24.927861 11453 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.588s	user 0.002s	sys 0.000s
I20260709 12:14:24.930022 11450 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:24.930559 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:24.934130 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 60231us
I20260709 12:14:24.862044 11438 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:24.867372 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.849608 11451 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:24.870134 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.870316 11459 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.870623 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.870030 10052 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:24.861912 11460 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:24.875501 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:24.860390 10731 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.971285 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.971877 10124 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:24.972532 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.972812 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.973881 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.876799 11458 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:24.896996 10200 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.935278 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:24.936586  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080014dcc0 after lost signal to thread 10048
W20260709 12:14:24.938930 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 63810us
I20260709 12:14:24.932116 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.863405 10737 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:24.951156 11398 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 6.517s	user 0.019s	sys 0.034s
I20260709 12:14:24.951988 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.952400 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.953382 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.954006 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.952415 10129 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:24.981319 10125 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
W20260709 12:14:24.963209 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70484.8us
I20260709 12:14:24.969473 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.969628 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.969851 11438 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:24.988008 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:24.963738 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.993096 11218 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:24.993610 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.993980 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1500) took 6358 ms. Trace:
I20260709 12:14:24.968194 10053 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:24.991292 10126 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.992487 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.996122 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:24.967530 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.986466 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:24.983032 10728 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.998616 10048 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.003405 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.993608 11218 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:25.004698 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:24.982393 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.987485 11438 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:24.988242 11434 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.007907 11376 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.994336 10121 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:25.009938 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:24.979604 10201 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:24.995116 10123 rpcz_store.cc:276] 0709 12:14:18.635623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.650989 (+ 15366us) service_pool.cc:224] Handling call
0709 12:14:24.982309 (+6331320us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:24.989113 (+  6804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.989348 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.989373 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.993691 (+  4318us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:24.993733 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.993797 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.993907 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32268032}
I20260709 12:14:25.011951 10122 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.009569 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.012923 11349 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.013332 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.016819 11426 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.018800 10055 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.059031 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.059710 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 78) took 1045 ms. Trace:
I20260709 12:14:25.019681 11373 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:25.020112 11428 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.021433 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.062297 11438 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.021884 11094 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:25.022464 11292 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.022225 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.023725 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:25.001489  9984 debug-util.cc:398] Leaking SignalData structure 0x7b0800374380 after lost signal to thread 10079
I20260709 12:14:25.027519 11376 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.029744 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.083097 11376 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.008899 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.032438 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.082393 10199 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:25.032620 11218 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.011204 11451 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.081602 11438 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.038170 11122 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.033797 10129 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:25.039631 11463 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.045388 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:25.046856 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.050331 10054 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.064414 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.069728 11466 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:25.061851 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.070952 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.061805 11444 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.064193 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.063604 11433 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:25.065796 10049 rpcz_store.cc:276] 0709 12:14:24.014214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.015080 (+   866us) service_pool.cc:224] Handling call
0709 12:14:25.049861 (+1034781us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54003fa2d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:25.059110 (+  9249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89382656}
I20260709 12:14:25.080734 10126 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.082270 10127 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.082684 11292 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.031883 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.031710 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:25.037360 11446 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.115510 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.084129 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.080659 11428 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.118634 11459 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:25.119557 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.097370 11451 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.060534 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.140081 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.571707 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.283092 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:25.513826  9950 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 283) took 6584 ms. Trace:
I20260709 12:14:25.138677 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.077804 11435 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.139107 11122 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:25.584717 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 544332us
I20260709 12:14:25.579280 10129 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
W20260709 12:14:25.575688 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 186231us
W20260709 12:14:25.505944 11456 consensus_meta.cc:287] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.634s	user 0.004s	sys 0.004s
W20260709 12:14:25.504851 10731 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.000s
W20260709 12:14:25.543265 10019 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.530s (SENT)
W20260709 12:14:25.372164 11385 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.004s
I20260709 12:14:25.586913 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.611754 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.196218 11353 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.148398 11373 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.577173  9950 rpcz_store.cc:276] 0709 12:14:18.620703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.620857 (+   154us) service_pool.cc:224] Handling call
0709 12:14:25.171896 (+6551039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5839967,"reported_tablets":2,"spinlock_wait_cycles":1214720}
I20260709 12:14:25.122378 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:25.197654 11434 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:25.585361 11094 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.386991 11423 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.577911 11451 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.613684 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.646812 10049 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:25.121279 11281 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.279273 10728 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:25.264345 11448 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.617766 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.618626 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.619050 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.619783 11094 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:25.620270 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.673985 11094 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.621927 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.674783 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.675249 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.659348 11426 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.675920 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.676263 11426 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.676944 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.623051 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.615861 11433 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.623819 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:25.624629 11470 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:14:25.625765 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.629765 10140 tablet_copy_source_session.cc:215] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:25.630718 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:25.631275 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.631309 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.632476 11428 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.632740 11461 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.701076 11094 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.702118 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 791) took 1041 ms. Trace:
I20260709 12:14:25.703392 11094 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.703971 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.702569 10202 rpcz_store.cc:276] 0709 12:14:24.660590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.662258 (+  1668us) service_pool.cc:224] Handling call
0709 12:14:24.852204 (+189946us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:24.852426 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.852801 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.852833 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.853407 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.996913 (+143506us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:24.999908 (+  2995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.007695 (+  7787us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.701755 (+694060us) raft_consensus.cc:1685] finished
0709 12:14:25.701793 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.702051 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1733,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":3637504,"thread_start_us":135192,"threads_started":1,"wal-append.queue_time_us":188555}
I20260709 12:14:25.705052 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.705219 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.679904 11433 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.705600 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.705905 11433 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.706265 10051 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.706200 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.707403 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.707818 10202 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:25.708617 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.633428 10733 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:25.634558 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.634793 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.636641 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.638496 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:25.639299 11376 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.002s
I20260709 12:14:25.719322 11376 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.721410 11376 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.723709 11292 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.642973 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.724529 10126 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.725569 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.584915 10055 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.724435 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.728782 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.728871 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.729966 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.643919 11122 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.234174 11457 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.658787 10198 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:25.677407 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.609505 10731 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:25.605923 11459 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.679929 10737 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.681813 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.619485 10053 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.682690 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.610155 11456 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:25.662072  9984 debug-util.cc:398] Leaking SignalData structure 0x7b0800374bc0 after lost signal to thread 10154
I20260709 12:14:25.688239 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.689127 10127 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.690079 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.690846 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.751717 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.711009 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.618580 11385 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:25.702837 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.759883 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.730312 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.718642 10122 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.715965 10051 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.585225 10121 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.718215 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.769901 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.656982 11423 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.733083 10734 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.774415 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1310) took 1025 ms. Trace:
I20260709 12:14:25.777781 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.788594 11385 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:25.789613 11386 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.781896 10047 rpcz_store.cc:276] 0709 12:14:24.748663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.750082 (+  1419us) service_pool.cc:224] Handling call
0709 12:14:25.065651 (+315569us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:25.070770 (+  5119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.613264 (+542494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.613292 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.613331 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:25.613357 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.774211 (+160854us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54003e6a54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:25.774253 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.774363 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223642112}
W20260709 12:14:25.732465 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 358436us
W20260709 12:14:25.716871 11438 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:14:25.673483 11466 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.701109 11461 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.797178 10130 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:25.799924 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1592) took 1027 ms. Trace:
I20260709 12:14:25.800165 11466 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.798599 11461 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.804514 11373 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.805958 11446 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.735387 10125 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:25.807056 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.808497 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.809674 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:25.703117 10052 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:25.810746 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 85) took 1015 ms. Trace:
I20260709 12:14:25.756551 10735 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.726228 10126 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.715617 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.814011 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.693143 11434 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.764127 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:25.828379 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.828861 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1603) took 1001 ms. Trace:
I20260709 12:14:25.829099 11434 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.765054 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.737418 11456 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:25.738888 11457 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.735900 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.771430 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:25.829262 10048 rpcz_store.cc:276] 0709 12:14:24.827103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.828135 (+1001032us) service_pool.cc:224] Handling call
0709 12:14:25.828411 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.828587 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.828611 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.828647 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:25.828673 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.828720 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.828815 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.830657 10046 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.831532 11423 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.833724 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.752665 10050 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.834862 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.758131 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.835458 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.835884 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.836580 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.837770 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.772835 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.839236 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:25.840205 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.788611 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.840749 10124 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:25.841130 10123 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.842032 11429 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:25.843042 11429 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:25.843487 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.844667 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.843564 11429 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:25.774384 11420 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.846590 11420 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.848115 11433 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.848668 11420 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.774859 11122 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.849812 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.850227 11122 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.850999 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.852037 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.852136 11122 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.852547 10130 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.775810 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.736460 11459 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:25.795526 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 183851us
I20260709 12:14:25.855005 10736 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.853365 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.773314 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.855024 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.857550 10122 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:25.859407 11456 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.758191 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.772140 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.718413 11426 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:25.870594 10202 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:25.815820 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.871816 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:25.872051 10128 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:25.859838 11456 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.874236 11456 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.820240 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.874822 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 221) took 1068 ms. Trace:
I20260709 12:14:25.875368 10730 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.822144 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.800890 10129 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.876801 10053 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.877590 10121 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:25.878774 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:25.875181 10733 rpcz_store.cc:276] 0709 12:14:24.805897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.808270 (+  2373us) service_pool.cc:224] Handling call
0709 12:14:25.874606 (+1066336us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54003cd054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:25.874735 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754313472}
I20260709 12:14:25.880776 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.811729 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1594) took 1031 ms. Trace:
I20260709 12:14:25.820495 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.826604 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 88) took 1016 ms. Trace:
I20260709 12:14:25.885432 10047 rpcz_store.cc:276] 0709 12:14:24.780050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.810806 (+1030756us) service_pool.cc:224] Handling call
0709 12:14:25.811175 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.811385 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.811411 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.811471 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:25.811518 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.811570 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.811670 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.826707 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.859230 11429 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:25.886838 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60243.1us
I20260709 12:14:25.887177 11429 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:25.833490 10048 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:25.840476 11457 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:25.811103 10052 rpcz_store.cc:276] 0709 12:14:24.795798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.011403 (+215605us) service_pool.cc:224] Handling call
0709 12:14:25.631164 (+619761us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:25.810682 (+179518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6108544}
I20260709 12:14:25.888093 11390 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.888478 11390 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.888692 11457 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:25.888847 11390 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.889101 11457 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:25.857592 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.886060 10054 rpcz_store.cc:276] 0709 12:14:24.810366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.822741 (+1012375us) service_pool.cc:224] Handling call
0709 12:14:25.823045 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.823228 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.823253 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.826320 (+  3067us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:25.826361 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.826445 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.826551 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.800400 10049 rpcz_store.cc:276] 0709 12:14:24.772415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.799058 (+1026643us) service_pool.cc:224] Handling call
0709 12:14:25.799432 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.799607 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.799633 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.799682 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:25.799712 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.799764 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.799866 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.879583 10196 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:25.827412 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:25.890195 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:14:25.859721  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08000dfae0 after lost signal to thread 10228
I20260709 12:14:25.865094 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1602) took 1038 ms. Trace:
I20260709 12:14:25.868532 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.868835 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:25.871174 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.816812 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1597) took 1028 ms. Trace:
I20260709 12:14:25.898638 11474 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.829599 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:25.890233 11457 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:25.884768 11451 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:25.887864 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:25.901343 10198 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:25.899449 11446 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:25.901722 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 291124us
I20260709 12:14:25.896481 10050 rpcz_store.cc:276] 0709 12:14:24.826844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.673157 (+846313us) service_pool.cc:224] Handling call
0709 12:14:25.865026 (+191869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.918210 11433 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:25.901095  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc700 after lost signal to thread 10229
W20260709 12:14:25.920135  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3a40 after lost signal to thread 10761
I20260709 12:14:25.922241 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.900367 11474 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.923030 11474 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.914575 11442 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:25.916112 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47834.5us
I20260709 12:14:25.898938 10055 rpcz_store.cc:276] 0709 12:14:24.788601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.815879 (+1027278us) service_pool.cc:224] Handling call
0709 12:14:25.816223 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.816438 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.816467 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.816526 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:25.816564 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.816625 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.816746 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:25.925191 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.926023 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:25.923513 11442 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:25.931874 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:25.933099 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45310.9us
I20260709 12:14:25.933842 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:25.934904 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:25.908308 10051 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:25.930703 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.943691 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.944300 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:25.939911 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.945437 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:25.960605 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.961506 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:25.942510 11196 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.936859 11385 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.962885 11385 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:25.963305 11451 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:25.966369 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.932679 11433 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.931514 11442 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.975436 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.983026 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.937240 11457 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.980171 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:25.979106 11379 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.987749 11379 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.979359 11395 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.988255 11379 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.963263 11385 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.994093 11122 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:25.963842 11420 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.981599 11349 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:25.972177 11465 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:25.981873 11433 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.964190 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:25.981148 11426 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:25.965502 11475 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.988420 11361 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:14:25.997941 11386 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.009451 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:25.985208 11464 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.042948 10046 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:14:26.044153 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.011121 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.999409 11446 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.989269 11395 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:26.056664 11395 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:25.994100 11196 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:25.965193 11376 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:25.997583 11420 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:25.960397 11434 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:14:26.015753 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:25.996443 11423 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.001667 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.019810 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.022614 11393 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:26.028375 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.015831 11475 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.031231 11461 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:26.036228 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.037994 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:26.038396 10129 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:26.038579 11476 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:26.014534 11433 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.038810 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.039937 11361 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.040251 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.040934 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.042114 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.051692 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.055153 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.084375 11475 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.057791 11122 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:26.057701 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48329.2us
I20260709 12:14:25.984773 11451 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:26.059624 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.066730 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.004154 11456 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.110287 10203 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:26.081291 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 134502us
I20260709 12:14:26.082376 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.025930 11349 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:26.161749 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.162065 11349 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.162695 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:26.163658 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:26.165046 11094 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.042178 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.165426 11094 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:26.166181 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.166406 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:26.167771 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.168576 11456 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.168882 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:26.089123 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1608) took 1142 ms. Trace:
I20260709 12:14:26.077503 11420 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.170491 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:26.078341 11423 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:26.115054 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.117007 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.178602 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:26.086041 11483 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.056049 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:26.121817 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.146232 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:26.106586 11361 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:26.080320 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78736.1us
I20260709 12:14:26.183112 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:26.150804 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 90380.6us
I20260709 12:14:26.184283 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.105171 11476 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.158336 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.159088 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.160537 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.160769 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.161183 11426 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.180373 10127 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:26.193924 11426 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.194355 11426 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.080857 11393 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:26.151445 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:26.148450 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:26.170171 10048 rpcz_store.cc:276] 0709 12:14:24.942730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.832887 (+890157us) service_pool.cc:224] Handling call
0709 12:14:25.833130 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.833335 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:25.909350 (+ 76015us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.085066 (+175716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.085113 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:26.085152 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.085220 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.085336 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3133,"raft.queue_time_us":7251,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":18362,"thread_start_us":135266,"threads_started":1,"wal-append.queue_time_us":176519}
I20260709 12:14:26.111073 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.166193 11094 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.154013 11122 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:26.198674 11122 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.083410 11196 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.170157 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:26.155464 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.186547 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:26.218931 10046 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.187714 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.192420 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.220162 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.194553 11429 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.226209 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.120133 11386 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:14:26.180121 11423 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.217456 11094 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.217456 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.182952 10050 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.181108 11483 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.227416 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.225063 11382 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.232961 11480 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.008s
I20260709 12:14:26.194571 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:26.235695 10702 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.236864 11466 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.195348 11292 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:26.240206 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:26.254120 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.222849 11461 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.230062 11452 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.231627 11429 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.270412 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.249655 11483 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.275898 11292 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.278115 11292 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.253854 10729 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:26.286372 11292 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.240375 11464 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:14:26.262914 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:26.296303 11464 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.241465 11390 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.278710 11485 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.303619 11485 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.304047 11485 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.274946 11429 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.309530 11390 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.313130 11476 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.290704 11465 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.313807 11465 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.314248 11465 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.259298 11474 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.282680 11393 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.287995 11459 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.225790 11428 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:14:26.274232 11373 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.346743 11474 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.346858 11361 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.348129 11361 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.296703 11464 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:26.300861 11446 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:26.352524 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 125175us
I20260709 12:14:26.344374 11393 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.363438 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:26.364713 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 165748us
W20260709 12:14:26.365159 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 286853us
I20260709 12:14:26.365171 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.366647 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:26.367558 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.368263 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.368995 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.369892 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.338973 11349 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.376119 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 149981us
I20260709 12:14:26.376381 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.377154 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.379849 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:26.381295 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.357295 11446 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.385557 10046 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:26.386798 10046 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.387986 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.388847 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.390110 11094 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:26.390610 11094 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.391033 11094 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.392812 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.369230 11474 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:26.395062 11349 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.378822 11459 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.394682 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.379293 11425 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:26.396175 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 125857us
I20260709 12:14:26.397233 11493 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.369431 11476 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.409787 11428 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.394910 11455 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:26.383495 11452 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.382790 11373 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.375049 11488 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.398660 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.412932 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:26.399148 11489 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:14:26.429055 11434 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.429394 11434 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:26.430209 11434 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.430756 11437 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.431136 11437 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:26.431428 11434 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.420202 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.407143 11122 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:26.433115 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.383652 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.438905 10049 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:26.405434 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 251589us
I20260709 12:14:26.400228 10051 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.398547 11494 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.438412 11459 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.399004 11461 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.408457 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:26.413555 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.430584 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:26.452795 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.413069 11094 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.437884 11490 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.413793 11425 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.421247 11349 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:26.442031 11122 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.402160 11474 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:26.443719 11405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d0b2763b8154a7392dcbe6c6acfec0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:26.403118 11196 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.447930 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:26.445199 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.449107 11489 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:26.476370 11489 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.449760 11459 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.450127 11476 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.483121 11379 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.485448 11379 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.476980 11428 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.487669 11466 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.487979 11428 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:26.488051 11466 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:26.488420 11428 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.422931 11464 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.423281 11455 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.427656 11373 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.404911 11385 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.478544 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.457011 10199 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.460155 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.460865 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.442457 11382 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.464980 11094 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.427802 11442 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.476733 11489 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:26.461557 11425 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.459085 11490 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.502311 11442 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.488978 11466 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.418269 11485 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.469889 11474 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.462512 11349 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.470140 11292 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.500021 11382 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.501758 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.501892 11475 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.536984 11475 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.503069 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:26.503090 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.504791 11385 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:26.505890 11395 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.506570 11386 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.541316 11292 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.541356 11405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52022 (request call id 368) took 8202 ms. Trace:
I20260709 12:14:26.507573 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.509006 11423 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.544211 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:26.544413 11395 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:26.545284 11423 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.545171 11426 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.509671 11464 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.494237 11451 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.548332 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.496932 11373 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.497570 11455 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.514675 11490 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.515832 11489 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.431928 11437 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.530795 11429 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.527686 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.514353 11420 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.537995 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:26.522029 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.520452 11482 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.540076 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:26.542347 10198 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.498736 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.551940 10736 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.547585 11451 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:26.555114 11466 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.533777 11349 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.558912 10728 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.559206 10733 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:26.559501 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:26.623457 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:26.624493 10729 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.580065 10737 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:26.570973 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.568673 10201 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.567926 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:26.631868 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 64013.8us
I20260709 12:14:26.552574 11487 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.615046 10735 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:26.615087 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 116424us
I20260709 12:14:26.549881 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:26.553452 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 107195us
I20260709 12:14:26.556471 10055 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.571383 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.569038 11395 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.626230 10124 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.641160 10737 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.643491 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.517853 11465 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.563617 11437 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.569108 10730 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.635444 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:26.616407 11489 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:26.645754 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 95955.2us
I20260709 12:14:26.646370 11368 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.646733 10203 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.618098 11386 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.648547 11459 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.649772 11420 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.644124 11379 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.653612 11442 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:26.658792 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.659008 10198 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:26.618886 11451 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.664739 10204 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.670341 10197 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.670769 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.655628 11429 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.668031 11461 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.680189 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:26.685153  9950 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 2 to 3, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:14:26.683622 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66185.7us
I20260709 12:14:26.614324 11433 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:26.703353 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.702309 10124 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
W20260709 12:14:26.691499 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.706962 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:14:26.723740 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.726840 11094 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:26.679430 11452 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:14:26.729595 11446 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.732106 11446 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.710310 11456 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.694591 11395 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:14:26.721952 11385 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.667958 11483 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.719480 11379 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.749065 10199 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:14:26.753019 11452 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:26.753453 11452 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:26.720077 11426 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.720408 11461 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:26.547502 11405 rpcz_store.cc:276] 0709 12:14:18.338644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.338796 (+   152us) service_pool.cc:224] Handling call
0709 12:14:18.670512 (+331716us) ts_tablet_manager.cc:934] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
0709 12:14:26.256058 (+7585546us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:26.514557 (+258499us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:26.514693 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:26.530954 (+ 16261us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:26.540740 (+  9786us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:26.541121 (+   381us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:26.541225 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":260676,"tablet-copy.queue_time_us":280144,"thread_start_us":347167,"threads_started":2}
I20260709 12:14:26.770684 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:26.760160 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 361572us
I20260709 12:14:26.774245 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.775908 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.776742 11459 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.778445 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.779665 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.713649 11376 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:14:26.719277 11466 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:14:26.782496 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:26.726263 11393 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:14:26.735824 10050 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:26.788897 10047 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.759390 11385 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:26.776669 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 79688.3us
I20260709 12:14:26.748703 10731 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.795120 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.800256 10130 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.802057 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.736757 11425 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.798036 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:26.804618 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:26.804484 11461 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.805065 10732 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:26.778048 11494 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.747948 11386 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:26.777212 11459 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:26.809294 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:26.792145 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.821382 11122 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.804877 11488 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:26.788017 11456 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:26.801121 11423 raft_consensus.cc:2764] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:14:26.799782 11385 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.787099 11405 tablet_copy_client.cc:806] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:26.799345 11485 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.834648 11122 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:26.808097 11292 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.830763 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48365.5us
W20260709 12:14:26.434703 11493 consensus_queue.cc:1175] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:26.824759 11459 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:26.852691 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.869230 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.814993 11495 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:26.861080 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.871109 11122 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.820164 11489 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:14:26.823266 11465 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.832420 11475 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:26.919340 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50207us
I20260709 12:14:26.822675 11501 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.905483 11428 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.922803 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:26.924237 11428 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:26.924768 11386 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:26.868362 11433 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:26.927836 10130 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:26.927531 11456 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:26.836158 11434 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:26.835824 11466 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:26.919536 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 58553.3us
I20260709 12:14:26.870072 11405 tablet_copy_client.cc:670] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:26.870483 11483 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:26.939263 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 117157us
W20260709 12:14:27.027781 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.028301 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.030611 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.031251 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.032595 10054 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:27.033331 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 307008us
I20260709 12:14:26.876556 11385 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:26.929867 11426 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.036556 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.040941 10054 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:27.042340 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.043512 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.044750 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.946592 11475 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:27.047013 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.056499 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.056798 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.059072 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:26.933116 11501 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:27.048210 10736 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:27.066413 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.066778 10049 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:27.048834 11094 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:26.829114 11452 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:26.860296 11494 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 12:14:27.035614 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:26.933854 11434 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:27.062657 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:27.028720 11428 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.073971 10199 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:27.084646 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.051151 11379 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:27.086381 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:27.023614 11373 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:27.071368 11474 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.544s	user 0.000s	sys 0.009s
I20260709 12:14:27.063563 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.096910 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.098268 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:27.127476 10199 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:27.091511 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.062018 11490 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.142819 10730 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:27.143958 10731 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.144136 11490 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:27.129279 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 93729.3us
I20260709 12:14:27.098065 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.137454 11395 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:27.096511 11425 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.138684 11475 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:27.140713 11464 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.595s	user 0.003s	sys 0.005s
I20260709 12:14:27.141700 11511 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.130721 11433 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:27.149145 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:27.092321 11379 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:27.150197 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.157582 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.157857 11361 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:27.167874 10197 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:27.168265 11501 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.129858 11483 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:27.171628 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.070787 11450 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:14:27.130511 11452 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:27.201610 11455 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.004s
I20260709 12:14:27.222025 11455 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.224138 11455 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.224354 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:27.224957 11437 consensus_meta.cc:287] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 12:14:27.225893 11498 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.226313 11498 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.184665 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.226946 11510 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.227375 11510 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:27.227247 11498 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.227771 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:27.228684 11498 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.228238 11510 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.192950 10196 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:27.104364 11474 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.182947 11433 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:27.206493 11473 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:27.207201 11349 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 12:14:27.207350 11379 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.177407 11511 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:27.208928 11507 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.125s	user 0.001s	sys 0.002s
I20260709 12:14:27.209549 11482 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.138092 11434 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:27.149359 11476 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:14:27.231031 11425 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.218986 11450 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.285933 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.288769 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:27.289300 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.283903 11433 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:27.293715 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 254216us
I20260709 12:14:27.298642 10054 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.179261 11428 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:14:27.329989 10195 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:27.332931 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.218030 10203 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.284502 11473 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:27.290555 10046 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:27.349357 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.336678 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.229943 10202 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
W20260709 12:14:27.351751 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.353360 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.341974 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.339258 11450 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:27.335749 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 111474us
I20260709 12:14:27.354974 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.356148 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.358156 11373 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:27.358376 10122 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:14:27.359802 10735 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.330158 11437 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:27.360472 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.331921 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.333333 11504 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.329985 11482 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.337185 11510 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.359097 11512 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.365469 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.367184 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.347890 11457 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:27.358389 10197 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.339365 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.345028 11379 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.351533 11473 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.371596 11461 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:27.299394 11459 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.328311 11349 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.433424 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:27.449116 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.364756 11466 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.359546 11494 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:27.434185 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67090.8us
I20260709 12:14:27.358902 11511 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.516175 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.517416 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.363938 11385 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:27.467175 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.519192 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.519563 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.445866 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:27.370417 11464 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.509371 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.434080 10051 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.435237 11434 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.520576 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:27.368566 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.435987 11493 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.445837 11457 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:27.542220 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.452929 11465 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:27.542614 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 174112us
I20260709 12:14:27.552395 10126 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.553889 11452 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.556635 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.582149 10046 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.557775 10130 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:27.470408 10050 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:27.530023 11488 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.564353 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.584697 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.557178 10124 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.542896 11512 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.557416 11461 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.589540 10049 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.592681 10049 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:27.594631 10049 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.595675 10197 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.596396 10049 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.596035 11457 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.597586 11474 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:27.561146 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:27.606691 11517 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:27.611810 11459 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:27.613178 11349 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.615953 11437 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:27.618077 10702 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.648157 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.649816 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.581287 11465 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.658835 11465 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.659530 11465 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:27.660002 11465 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:27.660902 11465 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.600474 11522 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.620365 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:27.662918 11522 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.663893 11522 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.625874 11385 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:27.627349 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:27.632910 11514 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.435s	user 0.015s	sys 0.013s
I20260709 12:14:27.627401 10129 raft_consensus.cc:2410] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:14:27.634224 11433 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.671613 11433 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:27.672339 10203 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:27.589740 11482 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.673422 11482 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:27.603271 11451 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.891s	user 0.007s	sys 0.003s
I20260709 12:14:27.640651 10127 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.651305 11437 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.651782 11475 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.653489 11405 tablet_copy_client.cc:538] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:27.666105 11455 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.667721 11474 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:27.679231 11451 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.668339 11425 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.690526 11425 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.690934 11425 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.691416 11451 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.692111 10199 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.691753 11425 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.685447 11442 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.668908 11376 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:27.693276 11376 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.694101 11376 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.695241 11376 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:27.666927 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:27.702625 11455 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:27.668838 11461 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.703042 11455 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:27.703464 11455 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.704761 11461 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.705144 11461 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.706249 11461 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.707814 11461 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.709945 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.692939 11425 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.711516 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.714066 11474 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:27.719866 10198 raft_consensus.cc:606] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:27.721653 11386 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.722078 11386 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:27.722975 11386 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.723987 11386 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.682076 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.668157 11456 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.706664 11475 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.729246 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47268.6us
W20260709 12:14:27.729838 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 209345us
I20260709 12:14:27.676154 10124 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:27.730798 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.732216 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:27.732618 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.733681 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.741802 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.743566 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.744261 10046 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:27.746605 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:27.748977 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:27.734856 11442 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.736630 11446 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:27.748409 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:27.747337 11510 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:27.745551 11459 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.749248 11452 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:27.541920 11450 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.750511 11466 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.753743 11494 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:27.738382 11475 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.756013 10051 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.776525 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:27.777138 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 217988us
I20260709 12:14:27.765588 11512 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.764269 11456 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.778630 11494 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:27.766175 11510 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:27.763371 11446 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.783718 11494 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.803762 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76e7629206124e6390a9baab062635eb"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:27.804414 10046 raft_consensus.cc:606] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.787073 11510 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.786806 10197 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:27.812243 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.813663 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.814818 11496 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.815243 11496 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:27.815963 11496 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.816854 11496 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.817238 11437 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.790015 11456 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:27.825680 11504 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:27.823370 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.828099 10204 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:27.832007 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.784973 11434 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:14:27.841943 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.843374 11490 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.845927 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.847939 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.849294 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:27.849438 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.850046 11122 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.783466 11512 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.860977 11457 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:27.861917 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.846467 11487 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:27.863164 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.848129 11504 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.851173 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:27.865355 11498 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.636s	user 0.000s	sys 0.012s
I20260709 12:14:27.866768 10047 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:27.868347 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:27.848744 11292 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:27.852802 11529 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.866472 10051 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:27.831085 11473 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.875742 11438 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.877739 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.879983 11475 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.850975 11490 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:14:27.880483 11529 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.883916 11456 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:27.883767 11386 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.888193 11386 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.882351 11438 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:27.889714 11438 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.883558 10122 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:27.895556 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.896425 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.900789 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.901397 10054 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.894614 11451 raft_consensus.cc:993] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:27.903306 11450 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.905838 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:27.865558 11455 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:27.916688 10737 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:27.890219 11386 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:27.894042 11438 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.892028 11512 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:27.926321 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.929626 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.912824 11473 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.919221 11376 raft_consensus.cc:1081] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:14:27.926498 11529 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.939231 10197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:27.941848 10197 raft_consensus.cc:606] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:27.942786 11446 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.943397  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:27.945161  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:27.946162  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:27.946779 10127 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
W20260709 12:14:27.947489 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.948305 11516 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:27.949558 11503 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:27.932132 10732 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:27.922569 11522 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:14:27.956534 11429 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:27.949597 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.958551 11429 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:27.964421 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:27.957666 11405 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:14:27.962416 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:27.970526 11490 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.964480 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:27.949113 11510 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:27.974713 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 157) took 1621 ms (client timeout 1837 ms). Trace:
I20260709 12:14:27.981040 10054 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:27.971194 11455 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:27.982791 10051 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:27.986203 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 78759.3us
I20260709 12:14:27.989115 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.990700 11292 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.001417 11292 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:27.990912 11385 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:27.993019 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:28.006337 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.006968 10130 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.008760 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:27.982867 10202 rpcz_store.cc:269] 0709 12:14:26.353185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.362061 (+  8876us) service_pool.cc:224] Handling call
0709 12:14:27.974502 (+1612441us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54000627d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:27.974625 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729732864}
I20260709 12:14:27.996665 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:27.997149 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:27.998625 10051 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:28.022596 10198 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:28.018848 11465 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.018975 11524 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.020154 10201 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:28.022710 10200 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:28.020599 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:28.020776 10197 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:28.026503 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:27.999089 10729 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:28.031749 10732 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.029079 10204 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.032179 10198 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.033272 11423 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:28.033471 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.034117 11292 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.034677 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.035061 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.035487 11292 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.035640 10052 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.035893 10054 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:27.986927 11494 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.030226 10200 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:28.030936 11524 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:28.033444 11474 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:14:27.963109 11503 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:28.102841 11503 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:28.068471 11532 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:14:28.105527 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.106302 10200 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:28.106583 10129 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:28.106487 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.107568 10051 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:28.109103 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.110292 11446 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.068832 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.034273 11423 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:28.069941 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.070746 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.117668 10048 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:28.119663 10048 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.119371 11423 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.120795 10048 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.072417 10198 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.070037 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.122912 10055 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:28.072857 10736 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:28.122972 11521 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.773s	user 0.005s	sys 0.006s
I20260709 12:14:28.075416 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:28.076781 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:28.125320 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48612.1us
I20260709 12:14:28.077229 10734 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:28.035494 11504 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:14:28.086799 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45701.3us
I20260709 12:14:28.127978 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.020762 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:28.087455 10054 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.129029 10054 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.000368 11429 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:28.090474 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 240041us
I20260709 12:14:28.130699 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.133522 10055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:14:28.095340 11524 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.134826 11524 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.096871 11437 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:28.100054 11494 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.120716 10050 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:28.059720 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.074249 11510 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:28.128239 10129 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.122154 11423 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.130062 10054 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.131927 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.136662 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.089434 11475 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:14:28.135452 11516 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.111279 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.149302 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.150820 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.151034 10733 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.127471 11504 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.141647 11429 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.145365 11428 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.158190 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.142052 10055 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.168125 10054 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:28.169185 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.169723 11379 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.141417 11502 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:28.152129 11292 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:28.141536 11452 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:14:28.162832 11423 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.176685 10053 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.181499 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:28.177984 10055 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.183143 11368 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:28.184872 11511 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.163511 11516 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:28.174254 11446 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:28.170536 11504 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.200111 11504 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:28.180903 11529 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:14:28.199350 10734 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:28.182322 11379 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:28.201700 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.177636 11429 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.186652 11428 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:14:28.190335 10127 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.203831 11437 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:14:28.205498 11452 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.202390 11494 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:14:28.222134 11506 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.224071 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.211995 11537 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.226006 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 163) took 1567 ms. Trace:
I20260709 12:14:28.179852 11502 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.226974 10195 rpcz_store.cc:276] 0709 12:14:26.658070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.658478 (+   408us) service_pool.cc:224] Handling call
0709 12:14:26.672129 (+ 13651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.345182 (+673053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.224944 (+879762us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54000e97d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:28.225124 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512493312}
I20260709 12:14:28.229720 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 237) took 1175 ms. Trace:
I20260709 12:14:28.230142 10735 rpcz_store.cc:276] 0709 12:14:27.052990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.053133 (+   143us) service_pool.cc:224] Handling call
0709 12:14:27.081437 (+ 28304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.360175 (+278738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.228074 (+867899us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:28.228246 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639776640}
I20260709 12:14:28.200554 11516 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.236554 11529 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:28.237625 11529 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:28.237964 11529 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:28.222723 11506 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.217078 11437 consensus_queue.cc:1243] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:28.238755 11529 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.257179 11529 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.243160 11368 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.262872 11506 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.267871 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:28.268591 10735 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:28.274310 11502 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.275017 11122 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.275424 11122 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.277072 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.283782 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.284715 10198 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.283910 11122 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.286270 11491 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:28.241338 11379 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.286736 11122 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.285960 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.286836 11491 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.298036 11386 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:28.298707 11386 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.300894 11386 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.303618 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.304528 10198 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:28.308363 10122 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.310020 10052 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:28.310688 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1628) took 1025 ms. Trace:
I20260709 12:14:28.311018 10052 rpcz_store.cc:276] 0709 12:14:27.284970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.298290 (+ 13320us) service_pool.cc:224] Handling call
0709 12:14:28.034919 (+736629us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:28.310614 (+275695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16446720}
I20260709 12:14:28.322721 11475 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.332137 10196 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.345075 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1641) took 1040 ms. Trace:
I20260709 12:14:28.345497 10047 rpcz_store.cc:276] 0709 12:14:27.304816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.471445 (+166629us) service_pool.cc:224] Handling call
0709 12:14:28.344918 (+873473us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002a2454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:28.345014 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665518464}
I20260709 12:14:28.346817 11475 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.347929 11491 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:28.349547 11475 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:28.353783 11429 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:28.330544 11349 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.356168 11349 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.357158 11349 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.358728 11501 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:28.359349 11501 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.365948 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:28.374450 11433 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.374759 11504 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.375087 10128 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.376132 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:28.380821 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.386209 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.393754 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.375685 11491 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.396145 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.400242 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:28.402529 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1554) took 1106 ms. Trace:
I20260709 12:14:28.403148 10732 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:28.399461 11426 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.374706 10055 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.397321 11498 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.375313 11504 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.407488 11473 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:28.425777 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.401784 11491 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.415256 10054 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.420264 11094 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:28.428880 11094 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.424686 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.429559 10125 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.430090 10055 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.430514 11503 raft_consensus.cc:993] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:28.431041 11503 raft_consensus.cc:1081] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:28.403301 11456 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.401870 11361 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:14:28.432240 11094 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.433465 11094 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.433640 11349 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.390111 11433 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.422966 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.435659 10198 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.438079 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:28.429018 10129 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.444355 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.444751 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.445319 10128 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.446116 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.446946 10128 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.447084 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.402930 10126 rpcz_store.cc:276] 0709 12:14:27.294967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.298692 (+  3725us) service_pool.cc:224] Handling call
0709 12:14:27.344584 (+ 45892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.585408 (+240824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.396686 (+811278us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400243e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:28.401664 (+  4978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477326592}
I20260709 12:14:28.447757 11529 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.448110 11529 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.406889 11426 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.448428 11529 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.448868 10122 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:28.449118 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.449234 11433 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.450361 11473 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.450750 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.450920 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.451261 11473 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.454093 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.454713 10130 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.456190 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.436213 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.456403 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.446368 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:28.457854 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.458907 10128 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:28.460817 10128 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.461858 11122 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.462276 11122 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.462612 11122 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.465397 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:28.466063 10198 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.402020 11437 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:28.408891 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.466382 10198 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.469842 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.471493 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:28.479789 10736 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.471587 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.414870 11501 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.479897 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.480345 10204 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.427256 11494 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:28.437022 11502 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.488433 10047 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.454016 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.435534 11524 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.483222 11497 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:28.486011 11437 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.486524 11510 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:28.447521 11456 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.442497 11386 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:28.486580 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:28.489955 10736 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.494704 11122 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.495517 10198 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.474737 11361 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.492434 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.479260 11465 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.498535 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.521973 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.499435 11524 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.502668 10055 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.435083 11506 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:14:28.480671 10130 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:28.499435 11511 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:28.529222 11122 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.531530 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:28.539134 11122 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.539649 11122 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.509522 11510 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:28.493458 11494 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.503649 11437 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.496544 11502 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.504558 11504 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.537273 11506 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:28.532025 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:28.537170 11426 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:28.543679 11376 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:28.545986 10129 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.520112 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:28.550364 10736 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.539145 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.528654 11465 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:28.534674 11361 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.555507 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.548485 11511 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.564664 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.550169 11506 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.557190 11451 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.566787 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.519251 11386 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.541531 11438 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:14:28.568287 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.555434 10127 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:28.539489 11475 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.573050 11502 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.573522 11437 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.574127 11522 raft_consensus.cc:993] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:28.519426 11491 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.558987 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:28.580543 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:28.566787 11498 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.575877 11496 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.565434 11433 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.590350 10202 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:28.537176 11456 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.597397 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.564126 11465 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.585260 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:28.585716 11376 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:28.572500 10736 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:28.579703 11122 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.584592 11361 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.587718 11475 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.589818 11461 raft_consensus.cc:1081] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:14:28.600350 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:28.648522 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48284.7us
I20260709 12:14:28.595610 11429 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.623277 11548 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:28.666740 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.666962 11548 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.666493 11530 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.669144 11530 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.670110 11530 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.670884 11494 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.671494 11506 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.635509 11437 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.659864 11516 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.637567 11376 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:28.593997 10196 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.660001 11438 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:28.686184 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88863.5us
I20260709 12:14:28.687252 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:28.683010 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 455724us
I20260709 12:14:28.691243 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:28.692616 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.695093 11361 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:28.690089 11455 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.698598 11461 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:28.665879 11511 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.633124 11496 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:28.680799 11516 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:28.705209 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.684950 11376 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.707872 10048 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:28.709252 10047 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.706986 10126 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:28.689823 11524 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.625351 11420 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:14:28.720403 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.721191 10046 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:28.723712 10124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55236
I20260709 12:14:28.724295 10124 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.724673 10124 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.726864 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.712231 11516 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.710753 11455 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:28.750638 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 292830us
I20260709 12:14:28.718676 11551 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.753031 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:28.720620 11548 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.702793 11438 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:28.841005 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 114225us
I20260709 12:14:28.841820 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:28.716681 11498 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:14:28.723483 11490 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:14:28.838516 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:28.794822 11542 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:28.742000 11473 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.788533 11452 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.845602 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 92642.5us
I20260709 12:14:28.854669 11122 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.855170 11122 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.846307 10124 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:28.848366 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 120734us
I20260709 12:14:28.754871 11368 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:14:28.860977 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.847427 11455 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:28.876518 10128 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:28.879175 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.879812 10128 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:28.880726 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.881313 10128 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:28.882654 10128 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:28.869411 11551 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.853837 11451 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.895761 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:28.884716 11122 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:28.901670 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44358.2us
I20260709 12:14:28.900964 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:28.903947 10046 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:28.862586 11530 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.870262 11386 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:28.871945 11446 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.906029 11550 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.884640 11560 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:28.915385 11455 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:28.908648 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:28.917235 11571 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.918229 11554 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:28.967730 10046 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:28.912969 11368 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:14:28.921147 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67686.8us
I20260709 12:14:28.868451 11504 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:14:28.860255 11452 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.885381 11553 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:28.859531 11473 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.958753 11457 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:28.910072 11451 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:28.918913 11552 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:14:28.960107 11475 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:28.994714 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:28.996129 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:28.997843 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:29.027719 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:28.899004 11529 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.958513 11550 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.957036 11379 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:28.995462 11368 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:28.924548 11386 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:28.943341 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.959894 11487 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:14:28.925074 11446 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:28.927668 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:28.995278 11496 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:28.920185 11530 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.034210 11386 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.041209 11451 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.041764 11386 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.042503 11438 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.043642 11368 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.044853 11368 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.047331 11452 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.047114 11510 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.048316 11510 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.049402 11376 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.036288 11437 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.959760 11560 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.050293 11437 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.052430 11437 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.052794 11560 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.052958 11496 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.053494 11496 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.055007 11376 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.055572 11496 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.056098 11496 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:29.056512 11496 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:29.057344 11496 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:29.060289 11557 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:14:29.061138 11558 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:14:29.062016 11549 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:14:29.037523 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 109898us
I20260709 12:14:29.038340 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 469) took 1026 ms. Trace:
I20260709 12:14:29.022691 11457 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:29.002128 11571 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.066835 10125 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:29.064978 10737 rpcz_store.cc:276] 0709 12:14:28.011788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.012461 (+   673us) service_pool.cc:224] Handling call
0709 12:14:28.012775 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.013089 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.013118 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.019024 (+  5906us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.326478 (+307454us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18003a4fe0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:14:28.635717 (+309239us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:28.635754 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.635822 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.035039 (+399217us) raft_consensus.cc:1685] finished
0709 12:14:29.035059 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.038274 (+  3215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":510,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6924,"spinlock_wait_cycles":5865728,"thread_start_us":309060,"threads_started":1,"wal-append.queue_time_us":711788}
I20260709 12:14:29.032821 11475 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.069180 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:29.069517  9950 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 263) took 2417 ms. Trace:
I20260709 12:14:29.063268 11569 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.078495 11569 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.030303 11379 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:29.081715 11379 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.082849 11569 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.072214 11426 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.072485 11457 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.075439 11571 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.071560 11529 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.053418 11560 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.090276 11457 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.054240 10123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76e7629206124e6390a9baab062635eb"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:14:29.038908 11494 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.085664 11426 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.046293 11465 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.089071 11487 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.058595 11530 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.028326 11559 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:14:29.024230 11551 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.132462 11529 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.132918 11529 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:29.133728 11529 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.134967 11529 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.135535 11465 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.137190 10735 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.076349 11548 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.109158 11577 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:14:29.110617 11487 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.111261 11426 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.111714 10196 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:29.110553 11573 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:29.059059 11550 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.077908  9950 rpcz_store.cc:276] 0709 12:14:26.647581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.647739 (+   158us) service_pool.cc:224] Handling call
0709 12:14:29.065212 (+2417473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:26.912040 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:26.912726 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:26.912772 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:26.912807 (+    35us) tablet.cc:662] Decoding operations
0709 12:14:26.913256 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:26.913361 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:26.913389 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:26.913650 (+   261us) tablet.cc:701] Row locks acquired
0709 12:14:26.913708 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:14:26.913873 (+   165us) write_op.cc:270] Start()
0709 12:14:26.914026 (+   153us) write_op.cc:276] Timestamp: P: 1783599266913809 usec, L: 0
0709 12:14:26.914070 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:14:27.031561 (+117491us) log.cc:844] Serialized 599 byte log entry
0709 12:14:27.825950 (+794389us) op_driver.cc:464] REPLICATION: finished
0709 12:14:27.931876 (+105926us) write_op.cc:301] APPLY: starting
0709 12:14:27.931973 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:27.932082 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:27.957204 (+ 25122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:27.964780 (+  7576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:27.965001 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:27.965050 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:27.965274 (+   224us) log.cc:844] Serialized 23 byte log entry
0709 12:14:27.965487 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:27.965569 (+    82us) write_op.cc:454] Released schema lock
0709 12:14:27.965620 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:27.965976 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:27.966004 (+    28us) write_op.cc:454] Released schema lock
0709 12:14:28.267004 (+301000us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78d32a 00007fc17e712f14 00007fc17e712ec3 00007fc17e712e38 00007fc17e712df3 00007fc17e7120dc 00007fc17e73be16 00007fc17e723cbb 00007fc17e70e39d 00007fc17e711d75
Metrics: {"mutex_wait_us":3019,"reported_tablets":4,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":105632,"apply.run_cpu_time_us":2180,"apply.run_wall_time_us":34097,"num_ops":1,"prepare.queue_time_us":84225,"prepare.run_cpu_time_us":11697,"prepare.run_wall_time_us":282086,"raft.queue_time_us":163617,"raft.run_cpu_time_us":47786,"raft.run_wall_time_us":457612,"replication_time_us":911730,"spinlock_wait_cycles":30756608,"thread_start_us":503516,"threads_started":4,"wal-append.queue_time_us":404104,"wal-append.run_cpu_time_us":26143,"wal-append.run_wall_time_us":1535774}]]}
I20260709 12:14:29.125764 11571 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.121156 11516 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.123776 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:29.086915 11504 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:29.132990 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.097575 11420 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.064935 11490 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 12:14:29.123050 10123 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:29.139674 11548 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.150655 11573 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:29.120594 11494 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:29.154479 11568 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:14:29.165041 11420 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.170279 11429 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:29.177852 11429 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.178901 11446 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.179037 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.177493 11420 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.179797 10203 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:29.181123 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.170814 10123 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.183533 10196 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.184499 11516 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.185596 11501 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.139564 11530 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.087267 11475 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.148221 11487 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.164217 11426 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.205312 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.205957 10195 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:29.206102 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.162985 11423 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:29.189131 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.207500 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.208189 10195 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:29.209059 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.189535 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:29.191737 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.209702 10197 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.195298 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.196017 11494 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.196734 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.210400 10201 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.211293 11559 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:29.211683 11559 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.212008 11559 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.172091 11573 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.199883 11530 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.200285 11487 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.222875 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.163254 11571 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.170555 11548 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.201920 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.202010 11475 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.197379 11501 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.201273 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:29.223598 10199 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.226861 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.232935 10200 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.233243 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:14:29.161993 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65445.4us
I20260709 12:14:29.222258 11494 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.245229 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.246192 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.249393 11452 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:29.249800 11452 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.250152 11452 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.251719 11530 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.255707 11461 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.256215 11461 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.262467 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.263154 10130 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:29.264055 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.264645 10130 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:29.265451 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:29.269073 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.242278 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.279006 10195 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.280409 11516 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:29.280882 11516 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.281244 11516 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:29.258879 11501 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.283202 11501 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.283910 11576 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:29.284389 11576 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.284834 11576 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.260820 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:29.286993 10049 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.286075 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.288182 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:29.288573 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.289705 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:29.291308 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.292012 10199 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:29.293335 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.293987 10048 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:29.294261 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:29.297273 11094 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:29.298501 11094 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:29.299580 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.301067 10053 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:29.305357 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.242300 10196 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.239832 10203 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:29.299861 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.308861 11094 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.309265 11094 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.309599 11094 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.312585 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.315245 11405 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.258369 11461 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.250087 11429 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.293223 11503 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:29.296864 11376 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:29.307945 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:29.260485 11494 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.323074 11457 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.342619 11570 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:29.260010 11379 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.349527 10736 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.315910 11420 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.338598 11503 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:29.326864 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 298301us
I20260709 12:14:29.351434 10122 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:14:29.353412 11405 tablet_bootstrap.cc:492] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
W20260709 12:14:29.353272 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 357152us
W20260709 12:14:29.365507 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.372215 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:29.368275 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 373616us
I20260709 12:14:29.375787 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.376411 10048 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:29.349196 11474 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.370585 10734 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.377003 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.378013 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:29.378185 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.379675 10047 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:29.381877 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:29.383574 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.384007 10048 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:29.384286 10049 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.354050 11571 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.387385 10049 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.389496 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.338845 11376 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.361546 10122 pending_rounds.cc:85] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 2
I20260709 12:14:29.393164 10048 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:29.393522 10046 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:29.355356 11570 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.394783 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:29.400535 11094 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.349787 11457 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.385972 11474 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.396232 11529 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.400689 11570 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.401378 11571 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:29.417117 11405 ts_tablet_manager.cc:1403] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 1.486s	user 0.038s	sys 0.013s
I20260709 12:14:29.397351 11465 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:29.408840 10122 pending_rounds.cc:107] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:14:29.399827 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.409372 11572 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.427029 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:29.418838 11094 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.422096 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:29.425102 11529 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.416585 11474 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.441506 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:29.427660 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:29.443678 10123 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.449910 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.429627 10126 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.427510 11571 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.464823 11580 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:29.466109 11580 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.466571 11580 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.436033 10122 raft_consensus.cc:2917] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:14:29.473244 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:29.474269 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.437508 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:29.474957 10129 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:29.487404 10199 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:29.488356 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.476636 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:29.489348 10048 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:29.451741 11529 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.490531 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:29.491271 10124 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.491652 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 252) took 1019 ms. Trace:
I20260709 12:14:29.492338 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.492980 10124 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:29.493808 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:29.454663 11561 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.494599 11561 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:29.495009 11561 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.492033 10735 rpcz_store.cc:276] 0709 12:14:28.472357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.472674 (+   317us) service_pool.cc:224] Handling call
0709 12:14:28.472960 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.137593 (+664633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.491433 (+353840us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54006efd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:29.491591 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527148928}
I20260709 12:14:29.485148 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:29.492539 11496 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.457940 10732 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:29.483059 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 101256us
I20260709 12:14:29.457050 11524 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.502207 10204 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.497871 11094 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:29.462633 10053 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:29.464357 11571 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.499485 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:29.426102 11579 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:29.498558 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:29.436347 11465 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.501616 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:29.448024 10051 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:29.488422 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:29.503227 11094 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.509225 10125 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:29.504431 10197 raft_consensus.cc:2410] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:29.510334 11094 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.511812 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:29.502496 11496 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.673518 11496 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.499449 11451 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:14:29.674512 11583 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.487497 10728 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:29.495697 11437 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:14:29.437538 11503 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:29.574810 11553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.027s
I20260709 12:14:29.504117 11429 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.504281 11530 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.149s
I20260709 12:14:29.504648 11551 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
W20260709 12:14:29.678205 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 166466us
I20260709 12:14:29.572784 10203 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.573453 11491 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:29.504474 11452 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.504788 11550 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 12:14:29.573410 11494 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.684948 11122 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:29.714833 11122 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.506234 11524 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:29.683531 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:29.716840 10125 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:29.669801 11510 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.011s
I20260709 12:14:29.697147 11553 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.699821 11580 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.721336 10127 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:29.674489 11565 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.708827 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.697458 11376 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.722338 11122 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.699743 11579 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:29.757498 11122 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.718263 11584 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.312s
I20260709 12:14:29.759310 11429 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.759727 11429 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:29.760078 11565 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.760622 11429 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.762079 11429 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.762393 11565 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:29.770665 11465 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:29.775589 11564 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:29.718518 11501 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.771535 10123 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.704329 11571 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.754711 11580 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.758193 11455 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:29.779330 11487 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.003s
I20260709 12:14:29.800181 11094 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.804044 11094 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.806991 10124 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:29.808430 11585 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:29.806092 11494 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:29.809944 11494 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.812001 11494 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.779032 11579 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.790145 11455 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.704984 11583 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:29.822333 11590 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:14:29.782274 11501 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.816140 11504 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:29.799458 11451 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:14:29.820884 11455 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.789377 11580 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.759788 11553 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.855690 11475 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:29.823998 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:29.860173 11593 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
I20260709 12:14:29.856400 11475 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.862730 11475 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.831990 11504 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:29.865566 11579 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:29.869401 11586 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:14:29.880432 11582 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:14:29.880941 11559 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.004s
W20260709 12:14:29.865504 11587 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 12:14:29.878712 11501 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:29.865549 11588 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 12:14:29.881400 11559 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.890349 10125 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:29.894677 10125 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:29.896907 11573 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.002s
W20260709 12:14:29.897524 11548 consensus_meta.cc:287] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.002s
I20260709 12:14:29.870173 11475 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.889881 11473 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:29.907467 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.881518 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:29.910125 10125 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:29.918074 10737 raft_consensus.cc:2368] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4.
I20260709 12:14:29.934394 10123 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
W20260709 12:14:29.939329 11595 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:29.910375 11548 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:29.941403 11548 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.910450 11452 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:29.945492 10052 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:29.949451 10125 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:29.947921 10129 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:29.908612 11524 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.931298 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:29.950403 10124 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:29.952641 10129 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:29.911098 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1668) took 1202 ms. Trace:
I20260709 12:14:29.909473 11573 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:29.994730 11516 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 12:14:30.006704 11516 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:30.007213 11559 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.917392 11475 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.943229 11529 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:29.920626 11504 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.015170 10736 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:30.003764 10196 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.001s
I20260709 12:14:29.956436 11583 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:29.947671 11405 raft_consensus.cc:359] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:30.179113 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.031s	sys 0.041s
I20260709 12:14:30.017587 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:30.172631 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.035s	sys 0.052s
W20260709 12:14:29.999476 11474 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 12:14:30.125974 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1350) took 1567 ms. Trace:
W20260709 12:14:30.125978 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.048s	sys 0.095s
I20260709 12:14:30.282944 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:30.278252 10734 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.123059 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:30.262372 10121 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 12:14:29.996774 11580 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:30.179448 11559 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:30.172745 11570 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.742s	user 0.000s	sys 0.010s
I20260709 12:14:30.131933 11516 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:30.104231 11572 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.002s
I20260709 12:14:30.108354 11475 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:30.298751 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.038s	sys 0.056s
I20260709 12:14:30.311841 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.312914 11426 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.313422 11426 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.292364 11573 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:30.284124 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.106931 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:30.121423 11420 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:30.091908 11581 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.735s	user 0.000s	sys 0.006s
I20260709 12:14:30.269222 11455 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.095367 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.277380 11571 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:30.077785 11529 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.297381 10204 rpcz_store.cc:276] 0709 12:14:28.558785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.558961 (+   176us) service_pool.cc:224] Handling call
0709 12:14:28.559331 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.502789 (+943458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.125684 (+622895us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54003133d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:30.125907 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161644800}
I20260709 12:14:30.272879 11465 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.296648 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.052s	sys 0.110s
W20260709 12:14:30.360255 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 847898us
I20260709 12:14:30.097743 11579 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.374708 11579 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.081807 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.305677 11457 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:30.295679 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.032s	sys 0.046s
I20260709 12:14:30.277058 11405 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:14:30.378787 10731 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:30.379256 11405 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:30.380249 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:30.011301 11496 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.305958 10121 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:30.208726 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.024s
W20260709 12:14:30.383868 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.024s
W20260709 12:14:30.384198 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 683565us
I20260709 12:14:30.382239 11405 ts_tablet_manager.cc:1434] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.947s	user 0.016s	sys 0.008s
I20260709 12:14:30.384914 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 926) took 1518 ms. Trace:
I20260709 12:14:30.385861 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:30.083173 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:30.387256 11579 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.385313 10128 rpcz_store.cc:276] 0709 12:14:28.866794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.883424 (+ 16630us) service_pool.cc:224] Handling call
0709 12:14:28.883812 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.886789 (+  2977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.886875 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.905498 (+ 18623us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.328125 (+422627us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:29.328165 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.328236 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:30.082132 (+753896us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:30.384583 (+302451us) raft_consensus.cc:1685] finished
0709 12:14:30.384604 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.384858 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2053,"raft.queue_time_us":33184,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":2913664,"thread_start_us":341375,"threads_started":1,"wal-append.queue_time_us":406874}
I20260709 12:14:30.340623 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:30.278712 10196 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:30.390620 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:30.391400 10047 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:30.307303 11446 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:30.106873 11576 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.822s	user 0.006s	sys 0.005s
I20260709 12:14:30.299755 11474 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.340183 11572 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:30.342618 11561 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.006s
I20260709 12:14:30.339797 11583 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:30.358640 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1578) took 1095 ms. Trace:
I20260709 12:14:30.363242 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 256) took 1074 ms. Trace:
I20260709 12:14:30.419344 10737 rpcz_store.cc:276] 0709 12:14:29.289314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.289472 (+   158us) service_pool.cc:224] Handling call
0709 12:14:30.363012 (+1073540us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54007102d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:30.363175 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443521920}
I20260709 12:14:29.956051 10055 rpcz_store.cc:276] 0709 12:14:28.704262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.707549 (+  3287us) service_pool.cc:224] Handling call
0709 12:14:28.789041 (+ 81492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.858008 (+ 68967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.860509 (+  2501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.918950 (+ 58441us) log.cc:844] Serialized 26 byte log entry
0709 12:14:29.393078 (+474128us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:29.399388 (+  6310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.412320 (+ 12932us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.882104 (+469784us) raft_consensus.cc:1685] finished
0709 12:14:29.889586 (+  7482us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.904215 (+ 14629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43232,"raft.queue_time_us":15245,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":11077,"thread_start_us":456368,"threads_started":1,"wal-append.queue_time_us":562644}
I20260709 12:14:30.373764 11465 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:30.376298 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.314985 11559 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:30.397747 10093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.013s
W20260709 12:14:30.421239 10093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.007s	sys 0.013s
I20260709 12:14:30.397806 11498 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:30.421696 11433 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.384953 11405 ts_tablet_manager.cc:1467] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Tablet startup took 956ms
I20260709 12:14:30.424650 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.425027 10046 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.397385 10125 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:30.399655 10735 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:30.399871 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.021s	sys 0.017s
W20260709 12:14:30.401147 10167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.016s
I20260709 12:14:30.315212 11570 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.408047 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:30.413918 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:30.389511 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1576) took 1124 ms. Trace:
I20260709 12:14:30.416538 10054 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:30.397396 11473 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:14:30.437654 10128 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:30.398869 11530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.010s	sys 0.027s
I20260709 12:14:30.418664 10127 rpcz_store.cc:276] 0709 12:14:29.260802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.266507 (+  5705us) service_pool.cc:224] Handling call
0709 12:14:30.355592 (+1089085us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540009a6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:30.355717 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954990464}
I20260709 12:14:30.386971 11497 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:30.399935 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 184) took 1213 ms. Trace:
I20260709 12:14:30.426141 10733 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
W20260709 12:14:30.426901 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.021s	sys 0.017s
I20260709 12:14:30.421244 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:30.427327 10167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.016s
I20260709 12:14:30.437369 11579 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.422734 11605 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:30.403522 11446 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:30.437141 10094 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.015s	sys 0.067s
I20260709 12:14:30.425227 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:30.438285 10049 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:30.443038 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.449435 10733 pending_rounds.cc:85] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 2
I20260709 12:14:30.422168 11433 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.414837 11576 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.430483 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.463815 10735 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:30.438390 11426 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:30.456794 10094 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.016s	sys 0.067s
I20260709 12:14:30.457408 10733 pending_rounds.cc:107] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
W20260709 12:14:30.428519 10170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.005s	sys 0.017s
I20260709 12:14:30.464358 10733 raft_consensus.cc:2917] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:14:30.448385 10050 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:30.464704 10170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.005s	sys 0.017s
I20260709 12:14:30.459666 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:30.465365 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 709435us
I20260709 12:14:30.469728 10048 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:30.470055 10048 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:30.425576 11583 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.503281 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:30.503528 11496 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.422844 11561 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.504220 10048 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.505143 10048 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:30.505815 11561 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:30.464922 10733 raft_consensus.cc:2889] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:30.507346 10737 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:30.504025 10125 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:30.508127 11349 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.508862 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:30.503540 10019 leader_election.cc:400] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4.
I20260709 12:14:30.510885 10019 leader_election.cc:403] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:30.447201 11606 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.473332 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:30.508668 11349 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:30.452852 11530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.010s	sys 0.028s
I20260709 12:14:30.456498 11605 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.504015 11583 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.522372 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:30.521586 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54261.3us
W20260709 12:14:30.439836 11503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.031s
I20260709 12:14:30.514283 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:30.529027 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:30.531586 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:30.514235 11461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.016s	sys 0.015s
W20260709 12:14:30.521682 11437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.013s	sys 0.022s
I20260709 12:14:30.548095 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1589) took 1130 ms. Trace:
I20260709 12:14:30.467494 11523 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:14:30.535126 10125 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:30.509852 11516 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.509804 11438 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:30.537230 11583 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:30.534119 10735 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:30.449178 10196 rpcz_store.cc:276] 0709 12:14:29.186617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.197133 (+ 10516us) service_pool.cc:224] Handling call
0709 12:14:30.398064 (+1200931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:30.531018 11455 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:30.520874 11502 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.514274 11604 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:30.537528 11490 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.554764 11551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.004s	sys 0.027s
I20260709 12:14:30.540031 11465 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.540583 11349 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:30.524335 11606 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.541076 11607 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.541178 11473 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:30.456281 11579 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.545923 10048 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:30.503356 11433 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:30.438862 10126 rpcz_store.cc:276] 0709 12:14:29.260287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.286083 (+ 25796us) service_pool.cc:224] Handling call
0709 12:14:29.321348 (+ 35265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.461213 (+139865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.366965 (+905752us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54001b0654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:30.384428 (+ 17463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228431744}
I20260709 12:14:30.613906 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:30.614570 10126 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:30.614714 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1675) took 1334 ms. Trace:
I20260709 12:14:30.579444 11502 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.526726 11605 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.617094 11502 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.617580 11502 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:30.548564 10124 rpcz_store.cc:276] 0709 12:14:29.418207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.493558 (+ 75351us) service_pool.cc:224] Handling call
0709 12:14:30.547903 (+1054345us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b5400173c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:30.548033 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718986624}
W20260709 12:14:30.584601 11551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.005s	sys 0.027s
W20260709 12:14:30.543151 11461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.016s	sys 0.015s
I20260709 12:14:30.536187 11446 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.533080 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:30.517889 11603 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:14:30.548369 11437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.014s	sys 0.023s
I20260709 12:14:30.576761 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:30.538980 11570 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:30.571305 11368 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:30.599745 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:30.628252 10125 raft_consensus.cc:2368] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:30.599807 10049 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:30.599399 11497 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:30.609298 11473 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.611847 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:30.666651 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:30.667313 10048 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:30.668079 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:30.688880 10048 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
W20260709 12:14:30.530025 11503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.000s	sys 0.031s
I20260709 12:14:30.609025 11423 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.543624 11428 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:30.558576 11516 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.625118 10735 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:30.626667 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 93656.4us
I20260709 12:14:30.584548 11608 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:30.629482 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:30.586635 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 303739us
I20260709 12:14:30.607308 11474 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:30.618000 11502 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.571879 11438 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.599156 11583 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:31.335270 10731 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.954s	user 0.005s	sys 0.014s
I20260709 12:14:30.578526 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:31.342514 11446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.002s	sys 0.007s
I20260709 12:14:30.615201 10052 rpcz_store.cc:276] 0709 12:14:29.280830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.280998 (+   168us) service_pool.cc:224] Handling call
0709 12:14:29.281404 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.951102 (+669698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.614367 (+663265us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003e6554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:30.614643 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519928064}
I20260709 12:14:30.693511 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:30.727880 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 477) took 1309 ms. Trace:
I20260709 12:14:30.627911 11368 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:30.581650 11604 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.623411 11601 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:30.585090 11490 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.611186 11607 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:30.727651 10019 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.832s (SENT) [suppressed 6 similar messages]
I20260709 12:14:31.300930 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:31.056248 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 261906us
W20260709 12:14:30.981433 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.399209 11583 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:30.843739 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:31.000540 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.005s
I20260709 12:14:31.327808 10049 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:31.432080 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.014s	sys 0.009s
W20260709 12:14:31.432442 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 1.01118e+06us
I20260709 12:14:30.762616 10199 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:31.319413 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:31.289781 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:31.433598 10199 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:31.289354 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:30.787233 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:30.665163 11570 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:31.288574 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 553887us
I20260709 12:14:31.334486 11622 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:31.334764 11630 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.676194 11473 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.333727 11621 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.609498 10734 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
W20260709 12:14:31.458822 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 486) took 1539 ms (client timeout 1502 ms). Trace:
I20260709 12:14:31.395177 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:30.710772 11433 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.731940 11349 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.740132 11614 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:14:31.285570 11428 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.000s
I20260709 12:14:30.614778 11579 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.295377 11629 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:31.300086 10732 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:31.231386 10201 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.217130 11566 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.757699 11576 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:30.758855 11559 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.303772 11461 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.732836 11455 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.815853 11537 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:31.315325 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:30.754680 11606 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:30.947063 11465 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:30.815641 11597 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:30.961969 11503 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:30.810655 11618 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:31.402799 10048 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:31.332661 11516 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.299366 11634 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.777796 11617 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.946382 11610 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:31.410379 10130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1580) took 2130 ms (client timeout 2024 ms). Trace:
W20260709 12:14:31.288727 10735 consensus_meta.cc:287] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.555s	user 0.030s	sys 0.035s
I20260709 12:14:31.389674 11529 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.402976 11446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.018s
I20260709 12:14:30.675909 11497 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:30.731099 11423 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.397254 11474 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:30.771708 11605 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.399384 10731 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:31.401837 10050 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:31.388751 11608 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:31.288520 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.422117 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:31.422749 11624 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.423316 11490 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.453892 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:31.453341 10047 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:31.430577 11368 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.511231 10203 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:31.454592 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:31.456184 11641 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.542806 10130 rpcz_store.cc:269] 0709 12:14:29.261346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.266200 (+  4854us) service_pool.cc:224] Handling call
0709 12:14:31.391571 (+2125371us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001d6d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:31.391737 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868402944}
W20260709 12:14:31.562249 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 107742us
I20260709 12:14:31.434842 10199 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.566020 10199 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:31.459251 10734 rpcz_store.cc:269] 0709 12:14:29.919467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.017302 (+ 97835us) service_pool.cc:224] Handling call
0709 12:14:31.458721 (+1441419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.467339 10049 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:31.412273 11601 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:31.479389 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 751721us
W20260709 12:14:31.479861 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 692694us
I20260709 12:14:31.573338 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:31.460537 11635 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:30.424271 11405 ts_tablet_manager.cc:1469] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Trace:
0709 12:14:18.338644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.338796 (+   152us) service_pool.cc:224] Handling call
0709 12:14:18.670512 (+331716us) ts_tablet_manager.cc:934] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
0709 12:14:26.256058 (+7585546us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:26.514557 (+258499us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:26.514693 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:26.530954 (+ 16261us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:26.540740 (+  9786us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:26.541121 (+   381us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:26.541225 (+   104us) inbound_call.cc:177] Queueing success response
0709 12:14:27.930331 (+1389106us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:14:29.437172 (+1506841us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:14:29.772788 (+335616us) tablet_replica.cc:261] Starting instrumentation
0709 12:14:29.857030 (+ 84242us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":260676,"raft.queue_time_us":2160,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":615,"tablet-copy.queue_time_us":280144,"tablet-download-pool.queue_time_us":276,"tablet-download-pool.run_cpu_time_us":1311,"tablet-download-pool.run_wall_time_us":628370,"thread_start_us":347167,"threads_started":2}
W20260709 12:14:31.509428 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 220173us
I20260709 12:14:31.471928 11433 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.514279 11579 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:31.583876 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.542013 10735 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
W20260709 12:14:31.584518 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 483) took 1677 ms (client timeout 2071 ms). Trace:
W20260709 12:14:31.584869 10735 rpcz_store.cc:269] 0709 12:14:29.906760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.576441 (+669681us) service_pool.cc:224] Handling call
0709 12:14:31.584463 (+1008022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.535153 10198 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.527321 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 476) took 2117 ms. Trace:
I20260709 12:14:31.546675 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1372) took 1088 ms. Trace:
I20260709 12:14:31.434861 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:31.407717 10729 rpcz_store.cc:276] 0709 12:14:29.414630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.417908 (+  3278us) service_pool.cc:224] Handling call
0709 12:14:30.574955 (+1157047us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66be9c 00007fc17b66ba5b 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:30.584955 (+ 10000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.612394 (+ 27439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:30.621858 (+  9464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:30.623817 (+  1959us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:30.626085 (+  2268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.673699 (+ 47614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.724163 (+ 50464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5755136}
I20260709 12:14:31.567674 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1377) took 1108 ms. Trace:
I20260709 12:14:31.587703 10049 rpcz_store.cc:276] 0709 12:14:30.459270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.629247 (+169977us) service_pool.cc:224] Handling call
0709 12:14:31.567607 (+938360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.561385 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:31.569365 11617 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.576496 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:31.508258 11639 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.579973 11642 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:31.531152 11631 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:31.578305 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:31.596088 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1375) took 1137 ms. Trace:
I20260709 12:14:31.596444 10049 rpcz_store.cc:276] 0709 12:14:30.458778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.595334 (+1136556us) service_pool.cc:224] Handling call
0709 12:14:31.595629 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.595785 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.595809 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:31.595849 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:31.595875 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.595923 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:31.596037 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.596994 11497 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.597918 10049 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.580996 11648 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:31.598987 11648 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.590850 11368 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.599539 11576 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:31.600133 11576 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.536813 11438 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.475934 11428 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4.
W20260709 12:14:31.582501 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.522706 10204 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:31.517521 11386 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:31.514473 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:31.533449 11551 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:31.469245 11630 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.473217 11636 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.543673 10200 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:31.585716 10733 rpcz_store.cc:276] 0709 12:14:29.410321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.410456 (+   135us) service_pool.cc:224] Handling call
0709 12:14:30.114969 (+704513us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:30.115220 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.506905 (+391685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.527027 (+1020122us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400731ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:31.527223 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710086272}
I20260709 12:14:31.586316 10046 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:31.568986 11465 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.582571 11516 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:31.474247 11349 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.524185 11379 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:31.469581 11622 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.586861 10048 rpcz_store.cc:276] 0709 12:14:30.458025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.693246 (+235221us) service_pool.cc:224] Handling call
0709 12:14:31.546603 (+853357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:31.528162 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 480) took 1634 ms (client timeout 1878 ms). Trace:
I20260709 12:14:31.570677 11491 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.570611 11559 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:31.539366 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 481) took 1640 ms. Trace:
I20260709 12:14:31.461822 11570 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.517096 11638 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:31.632200 11516 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:31.593499 10734 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:31.663522 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 482) took 1759 ms (client timeout 2128 ms). Trace:
W20260709 12:14:31.663910 10734 rpcz_store.cc:269] 0709 12:14:29.903747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.576236 (+1672489us) service_pool.cc:224] Handling call
0709 12:14:31.663463 (+ 87227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.664786 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:31.665498 10734 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:31.595227 11639 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:31.530330 11632 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:30.323854  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.535532 10122 raft_consensus.cc:2889] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:31.600955 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:31.601827 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1379) took 1082 ms. Trace:
I20260709 12:14:31.576423 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1376) took 1110 ms. Trace:
I20260709 12:14:31.577695 11571 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:31.603456 10199 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:31.576896 11627 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:31.471630 11621 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.581837 11373 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.576285 10731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 399) took 1507 ms (client timeout 1781 ms). Trace:
W20260709 12:14:31.610549 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 215416us
I20260709 12:14:31.600478 11576 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.576714 11610 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.576468 11634 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.573812 11624 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.577116 11637 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:31.523314 11461 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:31.619208 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 404) took 1539 ms (client timeout 1775 ms). Trace:
W20260709 12:14:31.699658 10737 rpcz_store.cc:269] 0709 12:14:30.079321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.424438 (+345117us) service_pool.cc:224] Handling call
0709 12:14:31.618961 (+1194523us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54005505d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:31.619141 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188220288}
I20260709 12:14:31.700839 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:31.701617 10737 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:31.701988 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 413) took 1230 ms. Trace:
I20260709 12:14:31.579658 11292 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:31.577564 11606 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:14:31.588016 11537 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.708240  9951 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.570767 11455 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.578678 10052 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:31.728260 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1373) took 1270 ms. Trace:
I20260709 12:14:31.516724 11566 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.580217 11641 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.576565 11474 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.599602 11423 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.606657 11629 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.607508 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1587) took 2212 ms. Trace:
I20260709 12:14:31.614692 11646 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.623155 11428 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.641650 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:31.618506 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:31.580058 11503 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.616655 11551 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:31.593618 11579 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.625175 11607 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.623812 11386 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:31.594383 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:31.570457 11597 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.667253  9953 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 171) took 4488 ms. Trace:
I20260709 12:14:31.667853 11648 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.668103 11622 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.668334 11502 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.671136 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 403) took 1592 ms. Trace:
I20260709 12:14:31.711051 11637 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.671175 10130 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:31.677374 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71380.5us
W20260709 12:14:31.648111 10728 rpcz_store.cc:269] 0709 12:14:29.893555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.898629 (+  5074us) service_pool.cc:224] Handling call
0709 12:14:31.527943 (+1629314us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54005efbd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:31.528090 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280048384}
W20260709 12:14:31.685938 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120566us
W20260709 12:14:31.683233 11094 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:14:31.686796 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1363) took 2187 ms (client timeout 2243 ms). Trace:
I20260709 12:14:31.629719 11636 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.648885 11491 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.662832 11559 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:31.675318 10050 rpcz_store.cc:276] 0709 12:14:30.459000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.545249 (+ 86249us) service_pool.cc:224] Handling call
0709 12:14:31.569180 (+1023931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.685173 11548 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:14:31.692134 11349 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:31.694937 11594 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.580890 11635 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.670761 11516 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:31.577350 11618 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.577167 11529 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.601361 11497 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.729930 11455 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:31.688278 11426 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:31.714962  9951 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.682926 11571 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:31.683221 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:31.727628 11630 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:31.737072 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.794968 11643 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:31.737294 10198 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:31.727272 10201 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.702288 10737 rpcz_store.cc:276] 0709 12:14:30.471091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.700554 (+1229463us) service_pool.cc:224] Handling call
0709 12:14:31.701936 (+  1382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.710196 11617 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:31.746157 11605 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:31.702978 11583 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.670012 11638 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.697850 11373 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.671305 10049 rpcz_store.cc:276] 0709 12:14:30.519475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.597360 (+1077885us) service_pool.cc:224] Handling call
0709 12:14:31.597621 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.598229 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.601770 (+  3541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.688283 11627 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.651142 10732 rpcz_store.cc:276] 0709 12:14:29.899058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.903893 (+  4835us) service_pool.cc:224] Handling call
0709 12:14:31.299516 (+1395623us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:31.299705 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.506223 (+206518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.539303 (+ 33080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14923136}
I20260709 12:14:31.972561 10734 rpcz_store.cc:276] 0709 12:14:30.078981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.664542 (+1585561us) service_pool.cc:224] Handling call
0709 12:14:31.671071 (+  6529us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:31.974458 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.040890 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:31.953584 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:31.688493 10731 rpcz_store.cc:269] 0709 12:14:30.061791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.379928 (+318137us) service_pool.cc:224] Handling call
0709 12:14:31.569127 (+1189199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:32.043399 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89911.4us
I20260709 12:14:32.003202 11624 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.980513  9953 rpcz_store.cc:276] 0709 12:14:27.178940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.179120 (+   180us) service_pool.cc:224] Handling call
0709 12:14:31.667192 (+4488072us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":570754,"reported_tablets":8}
I20260709 12:14:31.981935 10733 raft_consensus.cc:2410] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:14:31.972720 10199 rpcz_store.cc:269] 0709 12:14:29.495223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.497118 (+  1895us) service_pool.cc:224] Handling call
0709 12:14:30.425063 (+927945us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:30.762456 (+337393us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b54002c5720. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e793e18 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:31.683049 (+920593us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165957632}
I20260709 12:14:31.984486 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:31.984558 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:31.987331 10130 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.997591  9951 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.000532 10047 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
W20260709 12:14:32.047883 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63399.2us
I20260709 12:14:32.049794 10130 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.742911 10052 rpcz_store.cc:276] 0709 12:14:30.458281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.412885 (+954604us) service_pool.cc:224] Handling call
0709 12:14:31.728185 (+315300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:31.735046 11292 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.996374 11497 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.006484 11634 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:32.007360 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.006758 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 860) took 3540 ms (client timeout 1832 ms). Trace:
I20260709 12:14:32.007920 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:31.976177 11641 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:31.986862 10729 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:31.762992 11621 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:31.986961 11594 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.066124 11573 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:32.005738 11530 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.042181 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.038s
I20260709 12:14:32.044140 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:31.980027 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 400) took 1918 ms (client timeout 2031 ms). Trace:
I20260709 12:14:32.002576 11426 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:31.993791 11428 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.045531 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.045624 11570 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.011639 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.037348 11496 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:32.059598 10737 raft_consensus.cc:2368] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
W20260709 12:14:32.194875 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 415) took 1681 ms (client timeout 2002 ms). Trace:
I20260709 12:14:32.045310 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1575) took 2785 ms. Trace:
W20260709 12:14:32.058284 10733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 262) took 1674 ms (client timeout 1824 ms). Trace:
I20260709 12:14:31.992962 11646 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:31.987927 11629 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.064110 11638 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:32.065512 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81098us
I20260709 12:14:32.065634 11433 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.099810 11655 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:32.058650 10198 rpcz_store.cc:269] 0709 12:14:28.465004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.465122 (+   118us) service_pool.cc:224] Handling call
0709 12:14:30.083397 (+1618275us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b58000116d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e79427c 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c
0709 12:14:31.534725 (+1451328us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540032cba0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e705a1d 00007fc17e6ec1a4 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e79427c 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591
0709 12:14:32.005750 (+471025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155936384}
I20260709 12:14:32.001406 11571 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.052922 11577 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:32.186177 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.014s	sys 0.058s
W20260709 12:14:32.186398 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 405) took 2106 ms (client timeout 2587 ms). Trace:
W20260709 12:14:32.186100 10735 rpcz_store.cc:269] 0709 12:14:30.062020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.594122 (+1532102us) service_pool.cc:224] Handling call
0709 12:14:31.979954 (+385832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.087467 11573 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.188208 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:32.189637 11426 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.241767 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.051364 11379 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:32.050622 11386 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:32.068136 10729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 401) took 2005 ms (client timeout 2032 ms). Trace:
W20260709 12:14:32.320976 10729 rpcz_store.cc:269] 0709 12:14:30.062235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.618163 (+1555928us) service_pool.cc:224] Handling call
0709 12:14:32.068074 (+449911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.077149 11610 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:32.236565 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 479) took 2767 ms (client timeout 1740 ms). Trace:
I20260709 12:14:32.075851 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.237581 11428 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.070055 11608 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:32.220394 10733 rpcz_store.cc:269] 0709 12:14:30.383579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.622181 (+1238602us) service_pool.cc:224] Handling call
0709 12:14:32.058233 (+436052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.307837 11573 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.280517 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.041509 11474 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.012144 11551 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.073156 11491 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.069880 11566 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.290485 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.391144 10198 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.392153 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.392814 10198 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.057763 11651 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:32.240413 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.416997 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:32.417977 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.418748 10199 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:32.074692 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.073829 11461 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.068528 11465 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:32.195534 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 258434us
I20260709 12:14:32.072289 11292 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.188697 11530 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:32.305665 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 872524us
I20260709 12:14:32.441258 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.348804 10126 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:32.445045 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.445864 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.386457 10731 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:32.353587 11579 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.308493 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:32.450038 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 218805us
W20260709 12:14:32.450819 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 412) took 2369 ms (client timeout 3087 ms). Trace:
I20260709 12:14:32.277892 11639 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.239812 11373 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.241622 11497 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.012205 11643 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.066354 10051 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.447438 11618 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.242182 10728 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:32.462702 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 261) took 2079 ms (client timeout 1999 ms). Trace:
W20260709 12:14:32.463071 10728 rpcz_store.cc:269] 0709 12:14:30.383304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.993340 (+1610036us) service_pool.cc:224] Handling call
0709 12:14:32.462630 (+469290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:32.464126 11473 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.992s	user 0.004s	sys 0.005s
I20260709 12:14:32.464543 11473 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:32.465377 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 397) took 3622 ms (client timeout 2123 ms). Trace:
I20260709 12:14:32.081365 11634 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:32.070870 11597 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.055310 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.297255 11577 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:32.465790 10730 rpcz_store.cc:269] 0709 12:14:28.844217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.079973 (+1235756us) service_pool.cc:224] Handling call
0709 12:14:32.465164 (+2385191us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400600254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.465311 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739023104}
I20260709 12:14:32.470310 11577 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.470948 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.471297 11506 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:32.195288 10737 rpcz_store.cc:269] 0709 12:14:30.513523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.007630 (+1494107us) service_pool.cc:224] Handling call
0709 12:14:32.194821 (+187191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:32.350883 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 70416.7us
I20260709 12:14:32.296336 11655 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:32.356755 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 312670us
W20260709 12:14:32.379066 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.336287 10052 raft_consensus.cc:606] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:32.336416 11638 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.383571 11428 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.349014 11379 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.435310 11651 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:32.437250 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.438005 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.438652 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.481938 10199 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:32.304844 10734 rpcz_store.cc:269] 0709 12:14:30.079567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.045263 (+1965696us) service_pool.cc:224] Handling call
0709 12:14:32.186336 (+141073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.194239 11569 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.452183 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:32.451176 10735 rpcz_store.cc:269] 0709 12:14:30.081861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.308205 (+2226344us) service_pool.cc:224] Handling call
0709 12:14:32.450762 (+142557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.453552 11621 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:32.453743 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1569) took 3998 ms (client timeout 2056 ms). Trace:
W20260709 12:14:32.453375 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.454062 11451 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:32.490325 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6d0b2763b8154a7392dcbe6c6acfec0c received from {username='slave'} at 127.0.0.1:54462
I20260709 12:14:32.490873 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-6d0b2763b8154a7392dcbe6c6acfec0c on tablet 6d0b2763b8154a7392dcbe6c6acfec0c with peer 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:32.454321 11576 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.000s
I20260709 12:14:32.491365 11600 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:32.447359 11635 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.443342 11551 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.454752 11654 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:14:32.454087 11605 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:32.508466 10199 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:32.455955 11503 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.220568 10122 rpcz_store.cc:276] 0709 12:14:29.259981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.293199 (+ 33218us) service_pool.cc:224] Handling call
0709 12:14:29.323613 (+ 30414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.535427 (+2211814us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4c0046d900. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17ca5ca20 00007fc17ca6da29 00007fc17ca33644 00007fc17ca5af2d 00007fc17ca5ab93 00007fc17e78b18b 00007fc17e78bcb5 00007fc17e79afde 00007fc17e79a7bf 00007fc17e7ac81f 00007fc17e7ac7b8
0709 12:14:32.011829 (+476402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.045204 (+ 33375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8326912}
I20260709 12:14:32.456255 11461 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.092509 11559 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.446564 10203 raft_consensus.cc:2368] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.459172 10202 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:32.461095 11627 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.499269 11600 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:32.464012 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.069036 11529 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:32.486172 10121 rpcz_store.cc:269] 0709 12:14:28.454917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.467612 (+ 12695us) service_pool.cc:224] Handling call
0709 12:14:28.581077 (+113465us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:32.453555 (+3872478us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.453679 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504469504}
I20260709 12:14:32.447359 11566 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.450336 11438 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.444880 11537 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.468011 11634 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:32.337075 10736 rpcz_store.cc:269] 0709 12:14:29.426361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.499204 (+ 72843us) service_pool.cc:224] Handling call
0709 12:14:32.193306 (+2694102us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b540015a754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.193469 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171930496}
I20260709 12:14:32.528185 11634 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.525782 11566 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.528774 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.529362 10736 raft_consensus.cc:2376] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3. Re-sending same reply.
I20260709 12:14:32.529863 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.475183 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.530519 10121 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.530738 10737 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:32.531677 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.532334 10737 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:31.982293 10123 rpcz_store.cc:276] 0709 12:14:29.392901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.941255 (+548354us) service_pool.cc:224] Handling call
0709 12:14:29.941583 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:29.941950 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:29.941984 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:29.944013 (+  2029us) log.cc:844] Serialized 26 byte log entry
0709 12:14:30.415578 (+471565us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:30.421288 (+  5710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.426876 (+  5588us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:31.583820 (+1156944us) raft_consensus.cc:1685] finished
0709 12:14:31.583841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:31.604919 (+ 21078us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":827,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6330,"thread_start_us":456783,"threads_started":1,"wal-append.queue_time_us":606004}
I20260709 12:14:32.479192 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.482753 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.456998 11491 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:14:32.484715 10733 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:32.535465 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:32.486931 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.471550 11473 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.489918 11433 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:32.486390 11569 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.491983 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.481097 11638 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.474484 10052 raft_consensus.cc:614] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:32.492650 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.542359 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.526024 11438 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.545542 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.546223 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.547154 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.547608 11601 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.547885 10052 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 2: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:32.526055 10728 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.475895 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.543279 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.475849 11379 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:32.473224 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 408) took 2393 ms (client timeout 2717 ms). Trace:
I20260709 12:14:32.476686 11597 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.455405 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.481563 11465 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:32.507314 10730 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:32.461185 11594 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.503108 11655 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.518965 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.506793 11455 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.521526 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.510389 11605 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:32.515319 11461 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.530011 11566 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.586856 10128 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:32.587311 11455 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.588040 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.530192 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.588698 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.485327 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.533507 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:32.536643 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.490082 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:32.589756 11461 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.589911 10050 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.590464 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:32.527128 11516 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:14:32.512535 11639 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:14:32.491681 11576 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:32.594863 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:32.543020 10735 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:32.543990 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:32.544376 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.544893 11600 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:32.601496 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57575.3us
I20260709 12:14:32.545274 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.545766 11438 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.548321 10734 raft_consensus.cc:2376] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3. Re-sending same reply.
I20260709 12:14:32.466260 11571 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.551122 10729 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:32.475936 11428 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.522127 11621 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:14:32.554778 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.557389 11629 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.553036 10122 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.540251 11617 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:32.683549 11617 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:32.683976 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.684653 10122 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:32.684407 11617 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.685210 11571 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.685599 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.686928 11634 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.687315 11654 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:32.554965 11379 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.681636 11428 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.558920 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.560886 11638 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.561630 11604 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.553790 11646 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.562680 11651 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.564546 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.557010 11597 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.565513 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.688983 11634 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.574131 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:32.690394 10054 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:32.694887 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120805us
I20260709 12:14:32.694970 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.695650 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.558290 10731 raft_consensus.cc:2368] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.696458 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 414) took 2224 ms. Trace:
I20260709 12:14:32.696803 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:32.697368 10054 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.551343 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.698280 10052 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:32.554939 11433 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:32.699343 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.699548 11433 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.700554 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.576499 11473 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:14:32.701835 11473 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:32.586052 11569 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.589543 10198 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:32.537326 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.589516 10130 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:32.702910 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.703794 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.704167 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.704419 11530 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.661010 11576 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.704838 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.665231 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.705363 10130 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:32.663940 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69118.2us
I20260709 12:14:32.702240 11473 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:32.707063 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:32.707222 11473 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.708420 11473 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.708922 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:32.661450 11657 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:14:32.710270 11646 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.710811 11646 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:32.711014 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1382) took 1940 ms. Trace:
I20260709 12:14:32.586900 11605 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.662040 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.697851 11573 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.656944 10048 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:32.670733 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 69631.6us
I20260709 12:14:32.555524 10129 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:32.663328 11504 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.717407 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:32.664441 11635 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.690826 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 190) took 1115 ms. Trace:
I20260709 12:14:32.568150 10051 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:32.689514 10203 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:32.674949 10050 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.615298 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 487) took 1207 ms. Trace:
I20260709 12:14:32.682772 10197 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.693953 11597 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.729909 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:32.730365 10167 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38760 dropped due to backpressure: service queue is full with 50 items
I20260709 12:14:32.722180 11635 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.731058 11635 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.731175 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.730332 10728 rpcz_store.cc:276] 0709 12:14:31.394908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.463733 (+1068825us) service_pool.cc:224] Handling call
0709 12:14:32.602142 (+138409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.696812 10731 rpcz_store.cc:276] 0709 12:14:30.472031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.455185 (+1983154us) service_pool.cc:224] Handling call
0709 12:14:32.696394 (+241209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.732792 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.733589 10731 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:14:32.733788 10051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1380) took 2209 ms (client timeout 2235 ms). Trace:
I20260709 12:14:32.722707 11634 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.695838 10733 raft_consensus.cc:2410] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:32.698670 11570 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:32.701745 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.585120 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.732849 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.472290 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:32.730587 10125 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.588794 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.734404 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.702919 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 194) took 1126 ms. Trace:
I20260709 12:14:32.738864 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.711421 10047 rpcz_store.cc:276] 0709 12:14:30.770155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.561080 (+790925us) service_pool.cc:224] Handling call
0709 12:14:32.710826 (+1149746us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003f1454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.710937 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942423808}
I20260709 12:14:32.712750 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 949) took 1109 ms. Trace:
I20260709 12:14:32.687367 11498 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:14:32.740018 10736 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:32.740399 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.740872 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.741503 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.742035 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.687628 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 417) took 1108 ms. Trace:
I20260709 12:14:32.711206 11646 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.607070 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.713604 11600 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.660586 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.698357 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 871) took 1855 ms. Trace:
I20260709 12:14:32.756688 10049 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:32.756596 10128 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.756943 10204 rpcz_store.cc:276] 0709 12:14:30.842992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.843138 (+   146us) service_pool.cc:224] Handling call
0709 12:14:30.843482 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.608910 (+765428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.698132 (+1089222us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:32.698300 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561623296}
I20260709 12:14:32.727186 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:32.728488 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.760177 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.761085 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:32.728703 10054 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:14:32.556089 10732 rpcz_store.cc:269] 0709 12:14:30.080262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.059660 (+1979398us) service_pool.cc:224] Handling call
0709 12:14:32.469981 (+410321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.738714 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.762118 10125 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.740986 11629 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.734606 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 196) took 1156 ms. Trace:
I20260709 12:14:32.601496 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.768224 10735 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:32.742501 11599 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.764186 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:32.615566 11516 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.743019 11570 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:32.743345 11639 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:32.704761 10730 raft_consensus.cc:2376] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3. Re-sending same reply.
I20260709 12:14:32.722396 10196 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.722754 10200 rpcz_store.cc:276] 0709 12:14:31.575145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.565253 (+990108us) service_pool.cc:224] Handling call
0709 12:14:32.690768 (+125515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.686230 10122 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:32.615829 11566 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:32.737576 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 197) took 1149 ms. Trace:
I20260709 12:14:32.811105 10199 rpcz_store.cc:276] 0709 12:14:31.588661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.576958 (+988297us) service_pool.cc:224] Handling call
0709 12:14:32.737523 (+160565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.742573 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.739212 10198 rpcz_store.cc:276] 0709 12:14:31.576158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.485076 (+908918us) service_pool.cc:224] Handling call
0709 12:14:32.702861 (+217785us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:32.738160 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 265956us
I20260709 12:14:32.744971 10048 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.738514 10197 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.737896 10121 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.737824 10728 raft_consensus.cc:2410] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:32.739491 11597 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.737105 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.747655 10736 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:32.739663 10124 rpcz_store.cc:276] 0709 12:14:31.602871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.603088 (+   217us) service_pool.cc:224] Handling call
0709 12:14:32.712137 (+1109049us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:32.712330 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.712477 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.712498 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.712534 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:32.712559 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.712607 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.712701 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3708800}
I20260709 12:14:32.589525 11455 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.719933 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.739437 10731 raft_consensus.cc:2368] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.752751 10130 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.762800 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:32.763165 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:32.774803 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:32.827628 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.828166 10054 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.769177 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.829751 10735 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:32.830278 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 265) took 1249 ms. Trace:
I20260709 12:14:32.830619 10735 rpcz_store.cc:276] 0709 12:14:31.581100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.768916 (+1187816us) service_pool.cc:224] Handling call
0709 12:14:32.830214 (+ 61298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.772610 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 946) took 1173 ms. Trace:
I20260709 12:14:32.770026 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.736608 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.828357 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.817785 10020 leader_election.cc:400] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:32.832437 10020 leader_election.cc:403] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:32.832772 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.760449 11506 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.820004 10737 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:32.833491 10130 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
W20260709 12:14:32.834281 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 64326.4us
I20260709 12:14:32.767880 11576 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:32.760460 11530 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:32.822311 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 102448us
I20260709 12:14:32.806949 11496 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:32.847857 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.848083 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.579218 11643 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.767724 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.831605 10127 rpcz_store.cc:276] 0709 12:14:31.598769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.601490 (+  2721us) service_pool.cc:224] Handling call
0709 12:14:32.771868 (+1170378us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:32.772119 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.772289 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.772315 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:32.772356 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:32.772385 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.772440 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.772551 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727680}
I20260709 12:14:32.806720 11638 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:32.842374 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.777124 11474 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:14:32.735106 11634 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:32.848763 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74028.5us
I20260709 12:14:32.777451 11589 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.850823 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.749607 10729 rpcz_store.cc:276] 0709 12:14:31.578885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.444391 (+865506us) service_pool.cc:224] Handling call
0709 12:14:32.687563 (+243172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.836449 11651 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:32.900615 11570 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.851842 11559 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:32.851615 11386 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:32.853551 10128 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
W20260709 12:14:32.734203 10051 rpcz_store.cc:269] 0709 12:14:30.524103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.460881 (+936778us) service_pool.cc:224] Handling call
0709 12:14:32.733607 (+1272726us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400087354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.733728 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015588224}
I20260709 12:14:32.815780 11606 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:32.815596 11597 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.871625 11455 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.862217 10054 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
W20260709 12:14:32.862579 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 99867.5us
I20260709 12:14:32.852741 11553 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:32.870702 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.843384 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.867478 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.743966 10167 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38760 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 896)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
I20260709 12:14:32.870949 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.822788 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1365) took 1217 ms. Trace:
I20260709 12:14:32.874681 10123 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:32.913417 11553 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:32.917831 11553 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.913666 11597 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.889060 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.891852 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:32.919355 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76084us
I20260709 12:14:32.915509 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.920585 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 1.
I20260709 12:14:32.921052 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.921327 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.921815 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
I20260709 12:14:32.837358 11566 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.837823 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.894722 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.926276 10733 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
W20260709 12:14:32.898278 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47545us
I20260709 12:14:32.898689 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.871881 11594 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:32.900833 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 880) took 1973 ms. Trace:
I20260709 12:14:32.847163 11604 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.774830 11629 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.897149 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.911412 11651 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:32.904052 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1593) took 2496 ms. Trace:
I20260709 12:14:32.903970 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:32.893832 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:32.867360 11420 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:14:32.907516 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.913661 11455 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:32.935750 10198 raft_consensus.cc:2368] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.936173 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1382) took 1184 ms. Trace:
I20260709 12:14:32.935148 10129 rpcz_store.cc:276] 0709 12:14:30.407625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.407767 (+   142us) service_pool.cc:224] Handling call
0709 12:14:32.454246 (+2046479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.717194 (+262948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.874640 (+157446us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:32.903877 (+ 29237us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400243450. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.904000 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4897518592}
I20260709 12:14:32.936534 10198 rpcz_store.cc:276] 0709 12:14:31.778568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.907277 (+1128709us) service_pool.cc:224] Handling call
0709 12:14:32.936117 (+ 28840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.937242 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.937441 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.855115 11496 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:32.938329 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.938620 11496 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:32.938954 10129 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:32.935761 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 53570.1us
I20260709 12:14:32.868786 11529 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.777777 11599 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.909375 10125 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:32.867146 11576 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:32.869882 11638 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.931555 11604 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.773758 10203 rpcz_store.cc:276] 0709 12:14:31.577959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.553415 (+975456us) service_pool.cc:224] Handling call
0709 12:14:32.734541 (+181126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.867928 10130 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.868237 11637 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:32.914546 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 868) took 3424 ms. Trace:
I20260709 12:14:32.964952 10202 rpcz_store.cc:276] 0709 12:14:29.486470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.486906 (+   436us) service_pool.cc:224] Handling call
0709 12:14:32.006044 (+2519138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.516387 (+510343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.878288 (+361901us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000ea1d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:32.910752 (+ 32464us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54000ea1d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:32.910865 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6834071168}
I20260709 12:14:32.912268 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.915341 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.915390 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.916170 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.916450 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 950) took 1313 ms. Trace:
I20260709 12:14:32.917109 11634 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:32.855334 11506 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.855491 11577 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.973794 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.922521 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:32.922926 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.974592 10128 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.956832 11523 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.939991 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.975651 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.965507 11604 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.906309 11569 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.919422 10127 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.924245 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.901167 11516 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:32.980266 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56095.8us
I20260709 12:14:32.980381 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.906555 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:32.927250 10049 raft_consensus.cc:2368] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:32.981204 10127 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:32.898938 11490 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:32.913563 11598 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.983371 11598 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.927893 11428 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.970320 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:32.928658 11643 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.911307 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.902827 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:32.982190 11665 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:14:32.877976 10170 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 896)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
I20260709 12:14:32.925452 11628 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:32.941582 10094 leader_election.cc:400] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.995643 10094 leader_election.cc:403] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:32.942317 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.996279 10198 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:32.996625 11628 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:32.997063 11628 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:32.997352 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 55899us
I20260709 12:14:32.997539 11635 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:32.970368 10126 rpcz_store.cc:276] 0709 12:14:31.603308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.603755 (+   447us) service_pool.cc:224] Handling call
0709 12:14:31.632138 (+ 28383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.447137 (+814999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.913098 (+465961us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54001e3f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:32.916387 (+  3289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521308928}
I20260709 12:14:32.997102 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.931767 10201 rpcz_store.cc:276] 0709 12:14:30.927039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.538724 (+611685us) service_pool.cc:224] Handling call
0709 12:14:31.539004 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:32.010304 (+471300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.900576 (+890272us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000eb5d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:32.900777 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368631040}
I20260709 12:14:32.897817 11589 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:33.000291 10126 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:33.000615 11589 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.000893 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:33.001343 11451 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:33.001698 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1376) took 1316 ms. Trace:
I20260709 12:14:33.001878 10728 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:33.002108 10201 rpcz_store.cc:276] 0709 12:14:31.689784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.000631 (+1310847us) service_pool.cc:224] Handling call
0709 12:14:33.001638 (+  1007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.909832 11559 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.992377 11643 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.987391 10122 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.003599 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:33.004290 11559 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.911911 11461 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.929339 10050 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.963326 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.943485 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.958830 11638 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:32.968832 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.943473 11386 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:32.919028 10197 rpcz_store.cc:276] 0709 12:14:31.605329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.544994 (+939665us) service_pool.cc:224] Handling call
0709 12:14:32.820357 (+275363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.941936 11529 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:32.970775 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58581.5us
I20260709 12:14:33.025007 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.957057 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.941421 11629 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.955855 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.893134 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:32.923862 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:32.976235 10128 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.957440 11573 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:32.977316 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:33.027881 10202 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.931025 11379 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.978534 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.981024 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:33.029613 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48662.7us
I20260709 12:14:33.030370 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.031406 10095 leader_election.cc:400] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:33.031670 10095 leader_election.cc:403] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:32.928287 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:33.032382 10733 raft_consensus.cc:2368] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:32.972432 11637 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:32.984498 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.985005 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:32.941941 11651 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:32.957645 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:32.977700 11523 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:32.972855 10731 raft_consensus.cc:2376] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3. Re-sending same reply.
I20260709 12:14:33.036484 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1371) took 1384 ms. Trace:
I20260709 12:14:32.993395 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:32.975764 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:32.979571 11569 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.999467 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:32.923703 11566 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:33.037747 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.002951 11643 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.004781 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:32.985431 11634 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:33.018227 10124 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:33.033867 11655 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:33.034312 11571 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:32.994138 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:33.033601 10049 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:32.986810 10127 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:32.940349 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:33.034235 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.038861 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.063611 11094 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:33.063750 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.064042 11094 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.064421 11094 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.064785 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.067512 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:33.036899 10204 rpcz_store.cc:276] 0709 12:14:31.652468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.892860 (+1240392us) service_pool.cc:224] Handling call
0709 12:14:33.036424 (+143564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:32.942715 11455 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.040700 10048 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:33.001724 11451 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:33.044916 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.035943 11637 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.041894 11566 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.048347 10202 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:32.986709 10732 raft_consensus.cc:2376] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3. Re-sending same reply.
I20260709 12:14:33.069897 11573 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:33.077726 11573 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:33.078081 11573 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.054061 10734 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:33.033056 11529 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:33.054553 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 114253us
I20260709 12:14:33.054015 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.038084 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:33.045476 10195 raft_consensus.cc:2410] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:33.041507 11569 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.042963 11433 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:33.040419 11523 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.089285 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.090636 10049 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:33.091344 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.091811 10049 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:33.075327 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 191) took 1499 ms. Trace:
I20260709 12:14:33.061959 11666 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:33.043282 10051 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
W20260709 12:14:33.080456 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.084319 11580 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.085235 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 485) took 3166 ms. Trace:
I20260709 12:14:33.088407 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 398) took 3027 ms. Trace:
I20260709 12:14:33.089346 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:33.151605 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 120336us
I20260709 12:14:33.151350 10735 rpcz_store.cc:276] 0709 12:14:30.061495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.087712 (+3026217us) service_pool.cc:224] Handling call
0709 12:14:33.087969 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.088116 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.088137 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:33.088175 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:33.088203 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.088252 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.088354 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.152328 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63088.1us
I20260709 12:14:33.154004 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:33.075621 11672 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:14:33.093411 10202 rpcz_store.cc:276] 0709 12:14:31.575432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.971111 (+1395679us) service_pool.cc:224] Handling call
0709 12:14:33.075266 (+104155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.052320 11667 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 12:14:33.095368 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.069747 11491 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.072108 11498 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:33.070276 11629 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:33.062022 11473 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:33.100035 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.213225 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.214511 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.086781 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.106401 11496 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.107517 11461 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.074848 11637 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:33.229465 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.072196 11530 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:33.070403 11634 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:33.070096 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.072953 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.074337 11621 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:33.005473 11576 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:33.052903 11571 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:33.096812 10170 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
W20260709 12:14:33.159780 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 160385us
I20260709 12:14:33.239781 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:33.159973 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.240585 10202 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:33.207230 11629 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:33.190165 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.163033 10735 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:33.206043 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.245467 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.246068 10054 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:33.094050 11636 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.160169 10731 rpcz_store.cc:276] 0709 12:14:29.919162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.084394 (+3165232us) service_pool.cc:224] Handling call
0709 12:14:33.084704 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.084896 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.084929 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:33.084973 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:33.085009 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.085067 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.085178 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.202394 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 107109us
I20260709 12:14:33.151088 11433 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:33.150007 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.203052 11639 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:33.208024 11559 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:33.241967 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:33.150624 10203 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:33.241470 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.301970 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.302788 10202 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:33.303035 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.303190 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385) took 1114 ms. Trace:
I20260709 12:14:33.303593 10202 rpcz_store.cc:276] 0709 12:14:32.189035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.301680 (+1112645us) service_pool.cc:224] Handling call
0709 12:14:33.303135 (+  1455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.304557 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.203128 11594 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:14:33.246996 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 260) took 2864 ms. Trace:
I20260709 12:14:33.307017 10735 rpcz_store.cc:276] 0709 12:14:30.383001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.162504 (+2779503us) service_pool.cc:224] Handling call
0709 12:14:33.162858 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.246765 (+ 83907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.246947 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.307722 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.247289 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.308614 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:33.248831 11504 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:33.227718 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:33.242074 11571 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:33.293603 11605 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.003s
I20260709 12:14:33.250406 10170 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
I20260709 12:14:33.255060 11676 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:33.255329 11651 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.237993 11677 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:33.255852 10126 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:33.215175 11664 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:14:33.335378 11677 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:33.335769 11677 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:33.259593 10053 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:33.335879 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.337003 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.337229 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.337870 10053 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:33.337631 11638 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:33.259632 11438 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.002s
I20260709 12:14:33.338210 11643 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.338471 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.338658 11438 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.339706 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.340342 10126 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:33.340612 11438 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.341393 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.260419 10196 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:33.300174 11553 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.342005 10126 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:33.151243 11666 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.342919 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.262907 11629 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.343742 10126 raft_consensus.cc:2368] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:33.343863 11666 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:33.263566 11604 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.344570 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.345701 11604 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.345661 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.264922 10122 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:33.346997 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.348143 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.348449 10129 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:33.349175 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.349684 11566 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.266814 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.267724 11634 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.269357 11681 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:33.209192 11580 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.209357 11491 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.224669 11646 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.224469 11473 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.223996 11498 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:33.223925 11655 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:33.278108 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:33.278834 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:33.276249 10167 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38760 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
I20260709 12:14:33.284849 11094 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.290035 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:33.297776 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 113150us
I20260709 12:14:33.238637 11577 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.236588 11506 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.086884 11451 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.308856 10054 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:33.279973 11628 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.270401 11573 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.307883 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:33.277639 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:33.334196 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:33.350291 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:34.443619 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:34.444340 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 972) took 1142 ms. Trace:
I20260709 12:14:34.444689 10122 rpcz_store.cc:276] 0709 12:14:33.302265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.350041 (+ 47776us) service_pool.cc:224] Handling call
0709 12:14:34.444222 (+1094181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.309633 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:34.449271 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 1.13954e+06us
W20260709 12:14:34.104920 10167 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38760 dropped due to backpressure: service queue is full with 50 items [suppressed 4 similar messages]
I20260709 12:14:34.454710 11634 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:34.455255 11634 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:34.455653 11634 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:34.459396 10055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1387) took 2453 ms (client timeout 1694 ms). Trace:
W20260709 12:14:34.459905 10055 rpcz_store.cc:269] 0709 12:14:32.005362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.006862 (+  1500us) service_pool.cc:224] Handling call
0709 12:14:34.459008 (+2452146us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003fa7d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.459215 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136478464}
W20260709 12:14:33.905480 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1381) took 2156 ms (client timeout 1933 ms). Trace:
W20260709 12:14:34.464413 10199 rpcz_store.cc:269] 0709 12:14:31.749519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.278550 (+1529031us) service_pool.cc:224] Handling call
0709 12:14:33.905387 (+626837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:33.311367 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1388) took 1121 ms. Trace:
I20260709 12:14:34.468218 10202 rpcz_store.cc:276] 0709 12:14:32.189858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.304302 (+1114444us) service_pool.cc:224] Handling call
0709 12:14:33.311304 (+  7002us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.326133 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 86427us
I20260709 12:14:34.472376 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:33.521761 10198 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:33.468366 10737 raft_consensus.cc:2368] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:34.475528 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 429) took 1902 ms. Trace:
I20260709 12:14:34.475914 10737 rpcz_store.cc:276] 0709 12:14:32.572595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.939699 (+367104us) service_pool.cc:224] Handling call
0709 12:14:33.277975 (+338276us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:34.475317 (+1197342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494848}
I20260709 12:14:33.308149 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:34.479321 10735 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:34.479843 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 506) took 1190 ms. Trace:
I20260709 12:14:34.480159 10735 rpcz_store.cc:276] 0709 12:14:33.289735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.307928 (+ 18193us) service_pool.cc:224] Handling call
0709 12:14:34.479760 (+1171832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.481747 10735 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:34.089550 11455 consensus_meta.cc:287] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.002s
I20260709 12:14:34.483258 11455 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.733729 11473 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:33.327884 11433 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.066466 11491 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.735841 11498 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.326561 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:34.495159 10731 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:33.312546 11504 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:34.062664 10733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.004s	sys 0.009s
I20260709 12:14:33.326854 11523 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:33.285851 11530 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:34.502583 10733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.004s	sys 0.009s
I20260709 12:14:34.503983 11683 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:34.503633 11530 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.504678 11504 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.352813 11420 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.730s
I20260709 12:14:33.735126 11566 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:34.077184 11569 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.969s	user 0.006s	sys 0.002s
I20260709 12:14:34.508607 11569 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.510179 10730 raft_consensus.cc:2368] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
W20260709 12:14:34.257004 10701 leader_election.cc:336] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.813s (SENT)
I20260709 12:14:34.569958 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:34.571053 11695 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:33.323997 11682 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:33.935672 11680 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:14:34.572386 11682 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.572865 11682 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.123515 11691 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:34.169770 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.181376 10124 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:34.294665 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 123) took 1574 ms. Trace:
I20260709 12:14:34.577636 10054 rpcz_store.cc:276] 0709 12:14:32.719981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.247056 (+527075us) service_pool.cc:224] Handling call
0709 12:14:34.294351 (+1047295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.307799 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:34.382723 10050 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
W20260709 12:14:33.455320 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 870) took 2590 ms (client timeout 1824 ms). Trace:
W20260709 12:14:34.406140 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 878) took 3554 ms (client timeout 1923 ms). Trace:
I20260709 12:14:34.407948 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:34.416301 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 120) took 1935 ms. Trace:
I20260709 12:14:34.430186 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1714) took 1716 ms. Trace:
I20260709 12:14:34.432168 10053 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:34.434281 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:33.748131 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:34.512009 10046 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:34.122642 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 832620us
I20260709 12:14:34.308655 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:34.407651 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:34.792393 10732 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.276454 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:34.795408 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 501) took 1948 ms (client timeout 1672 ms). Trace:
W20260709 12:14:34.795742 10736 rpcz_store.cc:269] 0709 12:14:32.847046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.852939 (+  5893us) service_pool.cc:224] Handling call
0709 12:14:34.275937 (+1422998us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:34.795340 (+519403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19776256}
I20260709 12:14:34.797273 10736 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:34.797847 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 266) took 3216 ms. Trace:
I20260709 12:14:34.798136 10736 rpcz_store.cc:276] 0709 12:14:31.581401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.796545 (+3215144us) service_pool.cc:224] Handling call
0709 12:14:34.796993 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.797625 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.797800 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.800365 10732 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:34.800990 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 279) took 1443 ms (client timeout 1861 ms). Trace:
I20260709 12:14:33.758936 11094 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:33.273860 11379 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.280340 11386 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:33.281493 11428 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.049993 11451 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.283388 11496 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.352421 11516 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
W20260709 12:14:34.521488 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387) took 2331 ms (client timeout 2043 ms). Trace:
W20260709 12:14:34.814116 10202 rpcz_store.cc:269] 0709 12:14:32.189579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.521199 (+2331620us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.521394 (+   195us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.815135 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894) took 2731 ms (client timeout 2181 ms). Trace:
W20260709 12:14:34.815479 10202 rpcz_store.cc:269] 0709 12:14:32.083260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.814918 (+2731658us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.815058 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.816231 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201) took 2374 ms (client timeout 1930 ms). Trace:
W20260709 12:14:34.816541 10202 rpcz_store.cc:269] 0709 12:14:32.442297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.816075 (+2373778us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.816188 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.817247 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389) took 2375 ms (client timeout 1960 ms). Trace:
W20260709 12:14:34.817579 10202 rpcz_store.cc:269] 0709 12:14:32.441523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.817092 (+2375569us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.817203 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.450968 10167 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38760 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
W20260709 12:14:34.521965 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.478320 10737 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:34.824784 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 263) took 4093 ms. Trace:
I20260709 12:14:34.825139 10737 rpcz_store.cc:276] 0709 12:14:30.731242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.477259 (+3746017us) service_pool.cc:224] Handling call
0709 12:14:34.477751 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.824481 (+346730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.824707 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.522938 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50862.1us
W20260709 12:14:34.523444 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 73111.1us
I20260709 12:14:34.827092 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:34.829352 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:34.510246 11523 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.499967 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1700) took 1972 ms. Trace:
I20260709 12:14:34.831230 10055 rpcz_store.cc:276] 0709 12:14:32.492235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.461260 (+1969025us) service_pool.cc:224] Handling call
0709 12:14:34.461697 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.462025 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.462053 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.462116 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:34.462146 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.462225 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.462358 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.833240 10055 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:34.833913 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1713) took 2120 ms. Trace:
I20260709 12:14:33.345949 11529 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.837771 11529 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.304499 11559 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:34.839861 11559 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.343752 11553 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.512601 11569 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.368674 11570 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.844446 11570 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:34.845019 11570 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:33.270970 11597 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.250989 11635 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:34.850234 10049 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:34.852044 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1408) took 1562 ms. Trace:
I20260709 12:14:34.852368 10049 rpcz_store.cc:276] 0709 12:14:33.289839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.407406 (+1117567us) service_pool.cc:224] Handling call
0709 12:14:34.851788 (+444382us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54001310d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.851947 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568682752}
I20260709 12:14:33.739745 11573 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.329150 11589 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.359634 11599 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:34.087662 11600 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.314s	user 0.006s	sys 0.007s
I20260709 12:14:33.369951 11605 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.864854 11605 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:34.865821 10047 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:33.544119 11628 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.870704 11701 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.871249 11701 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.102830 11638 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.312585 11639 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:33.340294 11643 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:33.413228 11654 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:34.056330 11655 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:33.335973 11664 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:34.884995 11664 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:33.358248 11676 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.336146 11677 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:34.117350 11571 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.001s
I20260709 12:14:34.891010 11571 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:34.892910 10047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1397) took 2167 ms (client timeout 1960 ms). Trace:
I20260709 12:14:34.249209 11598 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:34.119203 11629 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.000s
I20260709 12:14:34.895463 11629 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.897710 11629 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:33.334002 11637 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.900702 11637 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:33.750216 11646 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.886305 11664 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:33.766148 11660 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.903378 11660 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.223189 11663 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:34.904796 11663 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:34.858246 11589 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.905879 11663 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.906975 11663 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.029332 11681 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:34.877758 11639 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.908960 11681 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.542975 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:34.910637 10122 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 2: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:34.911108 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 961) took 1619 ms. Trace:
I20260709 12:14:34.911440 10122 rpcz_store.cc:276] 0709 12:14:33.291610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.446126 (+1154516us) service_pool.cc:224] Handling call
0709 12:14:34.911027 (+464901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.834239 10055 rpcz_store.cc:276] 0709 12:14:32.713292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.832634 (+2119342us) service_pool.cc:224] Handling call
0709 12:14:34.833045 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.833647 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.833854 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.912554 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:33.735517 10201 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 1.
W20260709 12:14:33.322718 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 192) took 1737 ms (client timeout 2241 ms). Trace:
I20260709 12:14:34.913360 10055 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:14:34.558611 10127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.294s	user 0.030s	sys 0.031s
W20260709 12:14:34.913972 10127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.650s	user 0.030s	sys 0.031s
I20260709 12:14:34.913406 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 962) took 1621 ms. Trace:
I20260709 12:14:34.914876 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1616) took 2186 ms. Trace:
I20260709 12:14:34.915249 10127 rpcz_store.cc:276] 0709 12:14:32.728102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.054814 (+326712us) service_pool.cc:224] Handling call
0709 12:14:33.081574 (+ 26760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.238385 (+156811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.238412 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.243895 (+  5483us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.914457 (+1670562us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:34.914509 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.914595 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.914660 (+    65us) raft_consensus.cc:1685] finished
0709 12:14:34.914673 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.914826 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173014,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":1806242,"threads_started":2,"wal-append.queue_time_us":832424}
I20260709 12:14:34.566051 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:34.917722 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 351958us
I20260709 12:14:34.919714 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:34.566339 11420 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.921954 11420 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.914853 10122 rpcz_store.cc:276] 0709 12:14:33.291859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.912220 (+1620361us) service_pool.cc:224] Handling call
0709 12:14:34.913335 (+  1115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.571216 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 314749us
W20260709 12:14:34.583992 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 896) took 2393 ms (client timeout 1934 ms). Trace:
W20260709 12:14:34.924530 10204 rpcz_store.cc:269] 0709 12:14:32.190227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.068622 (+878395us) service_pool.cc:224] Handling call
0709 12:14:34.307317 (+1238695us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:34.583889 (+276572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12246400}
W20260709 12:14:34.925606 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899) took 2458 ms (client timeout 2022 ms). Trace:
W20260709 12:14:34.925961 10204 rpcz_store.cc:269] 0709 12:14:32.467641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.925421 (+2457780us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.925551 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.926815 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898) took 2469 ms (client timeout 2073 ms). Trace:
W20260709 12:14:34.927134 10204 rpcz_store.cc:269] 0709 12:14:32.457410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.926637 (+2469227us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.926759 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.927899 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386) took 2738 ms (client timeout 2374 ms). Trace:
W20260709 12:14:34.928210 10204 rpcz_store.cc:269] 0709 12:14:32.189324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.927732 (+2738408us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.927851 (+   119us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.928969 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199) took 2487 ms (client timeout 2153 ms). Trace:
W20260709 12:14:34.929268 10204 rpcz_store.cc:269] 0709 12:14:32.441833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.928794 (+2486961us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.928926 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.929999 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901) took 2211 ms (client timeout 1898 ms). Trace:
I20260709 12:14:34.584884 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 138) took 1487 ms. Trace:
I20260709 12:14:34.930584 10050 rpcz_store.cc:276] 0709 12:14:33.097035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.209740 (+112705us) service_pool.cc:224] Handling call
0709 12:14:34.584787 (+1375047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.931989 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:34.932291 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1716) took 2197 ms. Trace:
I20260709 12:14:34.585355 10051 rpcz_store.cc:276] 0709 12:14:32.713452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.229964 (+516512us) service_pool.cc:224] Handling call
0709 12:14:34.429994 (+1200030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.586114 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1698) took 2096 ms. Trace:
I20260709 12:14:34.933277 10053 rpcz_store.cc:276] 0709 12:14:32.489961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.430984 (+1941023us) service_pool.cc:224] Handling call
0709 12:14:34.431538 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.585769 (+154231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.586032 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.586090 10196 rpcz_store.cc:269] 0709 12:14:30.842583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.946660 (+104077us) service_pool.cc:224] Handling call
0709 12:14:32.616009 (+1669349us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:33.433273 (+817264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139450624}
W20260709 12:14:34.936511 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394) took 1882 ms (client timeout 1562 ms). Trace:
W20260709 12:14:34.936895 10196 rpcz_store.cc:269] 0709 12:14:33.054219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.936322 (+1882103us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.936453 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.937690 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396) took 1864 ms (client timeout 1573 ms). Trace:
I20260709 12:14:34.589474 10052 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:34.591285 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:34.938733 10052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1404) took 1649 ms (client timeout 1886 ms). Trace:
I20260709 12:14:34.938938 10129 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:34.939396 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 973) took 1637 ms. Trace:
I20260709 12:14:34.939664 10129 rpcz_store.cc:276] 0709 12:14:33.302405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.350416 (+ 48011us) service_pool.cc:224] Handling call
0709 12:14:34.939346 (+1588930us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.582804 10195 rpcz_store.cc:269] 0709 12:14:30.914222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.194498 (+280276us) service_pool.cc:224] Handling call
0709 12:14:32.606877 (+1412379us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:34.405585 (+1798708us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001d1d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.405887 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680879616}
W20260709 12:14:34.942716 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883) took 3357 ms (client timeout 3085 ms). Trace:
I20260709 12:14:34.583250 10130 rpcz_store.cc:276] 0709 12:14:32.480354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.968625 (+488271us) service_pool.cc:224] Handling call
0709 12:14:34.415723 (+1447098us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540009abd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.415988 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511342336}
I20260709 12:14:34.611737 11580 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:34.943269 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1384) took 2835 ms (client timeout 1837 ms). Trace:
W20260709 12:14:34.943691 10201 rpcz_store.cc:269] 0709 12:14:32.107510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.035721 (+928211us) service_pool.cc:224] Handling call
0709 12:14:34.942986 (+1907265us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54002634d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.943125 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655205760}
W20260709 12:14:34.944739 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369) took 3306 ms (client timeout 3047 ms). Trace:
I20260709 12:14:34.944851 10130 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 3. Ops: []
W20260709 12:14:34.945093 10201 rpcz_store.cc:269] 0709 12:14:31.638199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.944541 (+3306342us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.944677 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.945529 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1621) took 1878 ms. Trace:
W20260709 12:14:34.624670 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 202) took 2178 ms (client timeout 1813 ms). Trace:
W20260709 12:14:34.946152 10199 rpcz_store.cc:269] 0709 12:14:32.445834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.624413 (+2178579us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.624593 (+   180us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.629781 11682 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.628518 10170 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 894)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1406)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895)
I20260709 12:14:34.947074 10094 leader_election.cc:400] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:34.947500 10094 leader_election.cc:403] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:34.639307 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1392) took 1939 ms. Trace:
I20260709 12:14:34.951537 11682 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.950598 10054 rpcz_store.cc:276] 0709 12:14:32.699827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.578441 (+1878614us) service_pool.cc:224] Handling call
0709 12:14:34.578909 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.579258 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:34.601168 (+ 21910us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.638875 (+ 37707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.638926 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:34.638977 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.639051 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.639213 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32317,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":134375,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"thread_start_us":42056,"threads_started":3,"wal-append.queue_time_us":27270}
I20260709 12:14:34.952301 10121 raft_consensus.cc:2368] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
I20260709 12:14:34.953099 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 135) took 2189 ms. Trace:
I20260709 12:14:34.639315 11703 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.953313 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1615) took 2225 ms (client timeout 2056 ms). Trace:
I20260709 12:14:34.953819 11703 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.954876 10200 raft_consensus.cc:2368] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:34.643373 11551 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.955874 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1368) took 3324 ms (client timeout 2213 ms). Trace:
I20260709 12:14:34.955694 11551 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:34.956251 10200 rpcz_store.cc:269] 0709 12:14:31.631946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.976580 (+1344634us) service_pool.cc:224] Handling call
0709 12:14:34.955647 (+1979067us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540007dd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.955818 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4418339072}
I20260709 12:14:34.957235 11703 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.957872 11551 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:34.654819 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 497) took 1980 ms (client timeout 1854 ms). Trace:
W20260709 12:14:34.958520 10734 rpcz_store.cc:269] 0709 12:14:32.674476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.708700 (+ 34224us) service_pool.cc:224] Handling call
0709 12:14:34.654319 (+1945619us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54005730d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.654590 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792058624}
I20260709 12:14:34.657450 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1614) took 1929 ms. Trace:
W20260709 12:14:34.659399 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 432) took 1775 ms (client timeout 2015 ms). Trace:
I20260709 12:14:34.669864  9951 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 270) took 6879 ms. Trace:
W20260709 12:14:34.958089 10052 rpcz_store.cc:269] 0709 12:14:33.288918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.333887 (+ 44969us) service_pool.cc:224] Handling call
0709 12:14:34.938645 (+1604758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.671357  9950 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 2 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:34.694875 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 889) took 2637 ms (client timeout 1800 ms). Trace:
I20260709 12:14:34.744342 11455 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:34.737689 10125 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.018s	sys 0.011s
W20260709 12:14:34.736580 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.733124 10731 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:34.959944 10730 rpcz_store.cc:269] 0709 12:14:32.883644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.930758 (+ 47114us) service_pool.cc:224] Handling call
0709 12:14:34.659092 (+1728334us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400159d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.659319 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3388786816}
I20260709 12:14:34.752265 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:34.962325 10729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 277) took 1677 ms (client timeout 1810 ms). Trace:
I20260709 12:14:34.767438 11594 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.768424 11651 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:34.482378 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 264) took 3744 ms. Trace:
I20260709 12:14:34.963141 10730 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:34.758374 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:34.788048 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:34.963445 10735 rpcz_store.cc:276] 0709 12:14:30.738458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.480926 (+3742468us) service_pool.cc:224] Handling call
0709 12:14:34.481386 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.482102 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.482300 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.964176 10123 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:34.964795 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 129) took 1675 ms. Trace:
I20260709 12:14:34.964612 11594 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:34.965435 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 504) took 1903 ms. Trace:
W20260709 12:14:34.788034 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 131) took 2063 ms (client timeout 2153 ms). Trace:
I20260709 12:14:34.789955 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 484) took 4880 ms. Trace:
W20260709 12:14:34.801340 10732 rpcz_store.cc:269] 0709 12:14:33.357758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.406977 (+1049219us) service_pool.cc:224] Handling call
0709 12:14:34.800910 (+393933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.839056 10728 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:34.615406 11501 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.961849 10731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 278) took 1676 ms (client timeout 1690 ms). Trace:
W20260709 12:14:34.961326 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.966859 11501 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:34.959862 10124 rpcz_store.cc:276] 0709 12:14:32.727777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.044852 (+317075us) service_pool.cc:224] Handling call
0709 12:14:33.073362 (+ 28510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.577343 (+1503981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.657110 (+ 79767us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000997d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:34.657331 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546446720}
I20260709 12:14:34.969146 10124 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:14:34.967676 10046 rpcz_store.cc:269] 0709 12:14:32.724425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.993174 (+268749us) service_pool.cc:224] Handling call
0709 12:14:34.787762 (+1794588us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003f98d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.787969 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389921664}
I20260709 12:14:34.969931 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 957) took 1682 ms. Trace:
W20260709 12:14:34.962044 10198 rpcz_store.cc:269] 0709 12:14:32.057602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.996866 (+939264us) service_pool.cc:224] Handling call
0709 12:14:34.694412 (+1697546us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54001036d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.694680 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157334400}
I20260709 12:14:34.970755 11635 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:34.967502 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 493) took 2486 ms (client timeout 3067 ms). Trace:
I20260709 12:14:34.965458 11651 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:34.947019 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1391) took 2435 ms (client timeout 2191 ms). Trace:
I20260709 12:14:34.971872 11701 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.971181 11635 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.972764 11635 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:34.972528 11651 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:34.960973 10125 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.721s	user 0.020s	sys 0.016s
I20260709 12:14:34.973780 11654 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:34.962855 10729 rpcz_store.cc:269] 0709 12:14:33.284782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.747798 (+463016us) service_pool.cc:224] Handling call
0709 12:14:34.962237 (+1214439us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.913733 10203 rpcz_store.cc:269] 0709 12:14:31.575677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.972513 (+1396836us) service_pool.cc:224] Handling call
0709 12:14:33.312607 (+340094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.973213 11501 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.966150 10733 rpcz_store.cc:276] 0709 12:14:29.909318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.061732 (+3152414us) service_pool.cc:224] Handling call
0709 12:14:33.083557 (+ 21825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.083758 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:33.208224 (+124466us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.789540 (+1581316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.789625 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:34.789681 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.789752 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.789888 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":170701,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":4353,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"spinlock_wait_cycles":311168,"thread_start_us":1704806,"threads_started":3,"wal-append.queue_time_us":913154}
W20260709 12:14:34.971710 10728 rpcz_store.cc:269] 0709 12:14:32.481023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.307903 (+1826880us) service_pool.cc:224] Handling call
0709 12:14:34.967281 (+659378us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5400159ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.967422 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108008320}
W20260709 12:14:34.975396 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1395) took 1907 ms (client timeout 1677 ms). Trace:
W20260709 12:14:34.977178 10203 rpcz_store.cc:269] 0709 12:14:33.068354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.975186 (+1906832us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.975336 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.943060 10195 rpcz_store.cc:269] 0709 12:14:31.585603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.942535 (+3356932us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.942659 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.978173 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 904) took 2049 ms (client timeout 1824 ms). Trace:
W20260709 12:14:34.978283 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1403) took 1652 ms (client timeout 1541 ms). Trace:
W20260709 12:14:34.966704 10731 rpcz_store.cc:269] 0709 12:14:33.285051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.323256 (+ 38205us) service_pool.cc:224] Handling call
0709 12:14:34.961727 (+1638471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.961922  9950 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 2 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.970932 10046 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:14:34.957278 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 900) took 2487 ms (client timeout 2246 ms). Trace:
W20260709 12:14:34.971146 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 903) took 2241 ms (client timeout 2003 ms). Trace:
I20260709 12:14:34.971165 11569 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:34.980326 11569 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.965188 10123 rpcz_store.cc:276] 0709 12:14:33.289063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.757790 (+1468727us) service_pool.cc:224] Handling call
0709 12:14:34.964615 (+206825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.982520 11660 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:34.972173 10199 rpcz_store.cc:269] 0709 12:14:32.511846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.946820 (+2434974us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.946960 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.983175 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 276) took 1885 ms. Trace:
I20260709 12:14:34.980963 11651 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:34.970937 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 183199us
I20260709 12:14:34.979889 11628 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:34.893402 10047 rpcz_store.cc:269] 0709 12:14:32.725550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.742338 (+ 16788us) service_pool.cc:224] Handling call
0709 12:14:34.892654 (+2150316us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.892836 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4720511872}
I20260709 12:14:34.979853 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 137) took 1883 ms. Trace:
I20260709 12:14:34.986817 10046 rpcz_store.cc:276] 0709 12:14:33.096764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.970241 (+1873477us) service_pool.cc:224] Handling call
0709 12:14:34.970600 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.979564 (+  8964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.979781 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.960191  9951 rpcz_store.cc:276] 0709 12:14:27.790318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.790515 (+   197us) service_pool.cc:224] Handling call
0709 12:14:34.669580 (+6879065us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:32.514102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:32.519286 (+  5184us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:32.519318 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:14:32.519335 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:32.574993 (+ 55658us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:32.575051 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:32.575076 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:32.575392 (+   316us) tablet.cc:701] Row locks acquired
0709 12:14:32.575409 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:14:32.575553 (+   144us) write_op.cc:270] Start()
0709 12:14:32.575672 (+   119us) write_op.cc:276] Timestamp: P: 1783599272575511 usec, L: 0
0709 12:14:32.575693 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:32.584157 (+  8464us) log.cc:844] Serialized 1302 byte log entry
0709 12:14:32.991655 (+407498us) op_driver.cc:464] REPLICATION: finished
0709 12:14:33.086749 (+ 95094us) write_op.cc:301] APPLY: starting
0709 12:14:33.086836 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:33.086973 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:33.202936 (+115963us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:33.256112 (+ 53176us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:33.256288 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:33.256330 (+    42us) write_op.cc:312] APPLY: finished
0709 12:14:33.256533 (+   203us) log.cc:844] Serialized 35 byte log entry
0709 12:14:33.256697 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:33.256788 (+    91us) write_op.cc:454] Released schema lock
0709 12:14:33.256843 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:33.257190 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:33.257216 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2467378,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":94862,"apply.run_cpu_time_us":2647,"apply.run_wall_time_us":170414,"num_ops":3,"prepare.queue_time_us":292359,"prepare.run_cpu_time_us":35291,"prepare.run_wall_time_us":306721,"raft.queue_time_us":52094,"raft.run_cpu_time_us":8598,"raft.run_wall_time_us":34636,"replication_time_us":415805,"thread_start_us":503829,"threads_started":4,"wal-append.queue_time_us":323595,"wal-append.run_cpu_time_us":28428,"wal-append.run_wall_time_us":1348677}]]}
I20260709 12:14:34.987401 11628 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:34.987941 11628 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.960384 11516 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:34.989625 11569 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:34.989243 10203 rpcz_store.cc:269] 0709 12:14:32.928920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.977956 (+2049036us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.978110 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.990362 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 161166us
I20260709 12:14:34.965924 10734 rpcz_store.cc:276] 0709 12:14:33.061841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.959347 (+1897506us) service_pool.cc:224] Handling call
0709 12:14:34.963852 (+  4505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.964104 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.964132 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.964170 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:34.964201 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.964254 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.965254 (+  1000us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5400450e50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.965364 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9556864}
I20260709 12:14:34.982656 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 965) took 1681 ms. Trace:
I20260709 12:14:34.991547 10123 rpcz_store.cc:276] 0709 12:14:33.300919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.981538 (+1680619us) service_pool.cc:224] Handling call
0709 12:14:34.982007 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.982283 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.982312 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.982357 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:34.982396 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.982486 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.982597 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.993196 10123 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:34.993867 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 971) took 1691 ms. Trace:
I20260709 12:14:34.989750 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:34.979265 10124 rpcz_store.cc:276] 0709 12:14:33.287043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.968445 (+1681402us) service_pool.cc:224] Handling call
0709 12:14:34.968854 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.969708 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.969885 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.974169 11654 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.975164 10054 rpcz_store.cc:276] 0709 12:14:32.763578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.952178 (+2188600us) service_pool.cc:224] Handling call
0709 12:14:34.952553 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.952791 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.952816 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.952874 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.952901 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.952950 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.953045 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.996836 11654 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:34.983639 10730 rpcz_store.cc:276] 0709 12:14:33.097511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.962289 (+1864778us) service_pool.cc:224] Handling call
0709 12:14:34.962704 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.982888 (+ 20184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.983094 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.999583 11516 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:35.000068 11516 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:34.973258 10052 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.000509 11516 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.000777 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1405) took 1711 ms. Trace:
I20260709 12:14:35.001147 10052 rpcz_store.cc:276] 0709 12:14:33.289166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.972578 (+1683412us) service_pool.cc:224] Handling call
0709 12:14:34.972889 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.000522 (+ 27633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.000704 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.979683 10200 rpcz_store.cc:269] 0709 12:14:32.469742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.957104 (+2487362us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.957232 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:35.002038 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1398) took 1919 ms (client timeout 1874 ms). Trace:
I20260709 12:14:34.945833 10130 rpcz_store.cc:276] 0709 12:14:33.066921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.944210 (+1877289us) service_pool.cc:224] Handling call
0709 12:14:34.944574 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.945269 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.945461 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.002770 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1402) took 1752 ms (client timeout 1752 ms). Trace:
I20260709 12:14:35.003039 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:34.978706 10195 rpcz_store.cc:269] 0709 12:14:33.524843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.978108 (+1453265us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.978228 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.980468 10198 rpcz_store.cc:269] 0709 12:14:32.729850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.970965 (+2241115us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.971082 (+   117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.950606 11597 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.002038 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:34.996088 10124 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:35.004899 10054 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.005203 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 974) took 1702 ms. Trace:
I20260709 12:14:35.005575 10124 rpcz_store.cc:276] 0709 12:14:33.302649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.995417 (+1692768us) service_pool.cc:224] Handling call
0709 12:14:34.995771 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.004950 (+  9179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.005134 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.818289 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 203) took 2314 ms (client timeout 1924 ms). Trace:
W20260709 12:14:35.006494 10202 rpcz_store.cc:269] 0709 12:14:32.504250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.818145 (+2313895us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.818248 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:34.922271 11664 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:34.938022 10196 rpcz_store.cc:269] 0709 12:14:33.072900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.937524 (+1864624us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.937641 (+   117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:35.007460 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:35.003392 10200 rpcz_store.cc:269] 0709 12:14:33.250064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.002606 (+1752542us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:35.002719 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:34.953737 10121 rpcz_store.cc:269] 0709 12:14:32.727955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.861817 (+133862us) service_pool.cc:224] Handling call
0709 12:14:33.277477 (+415660us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:34.953103 (+1675626us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:34.953252 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303969920}
I20260709 12:14:35.008145 10202 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.008255 11566 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:35.003204 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 128) took 2282 ms. Trace:
I20260709 12:14:34.932739 10050 rpcz_store.cc:276] 0709 12:14:32.734727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.931335 (+2196608us) service_pool.cc:224] Handling call
0709 12:14:34.931733 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.931937 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.931966 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.932010 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:34.932046 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.932102 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.932218 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.010028 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.010442 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1409) took 1720 ms. Trace:
I20260709 12:14:35.010944 10050 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:34.983769 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1397) took 1909 ms (client timeout 1837 ms). Trace:
W20260709 12:14:35.011790 10199 rpcz_store.cc:269] 0709 12:14:33.074693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.983567 (+1908874us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.983709 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:35.012300 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.012778 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.013176 10050 raft_consensus.cc:2368] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.013499 10199 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
W20260709 12:14:35.013981 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 204) took 1961 ms (client timeout 2142 ms). Trace:
I20260709 12:14:35.004572 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:34.970366 11676 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:34.969969 11594 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.014346 10050 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:35.039039 11566 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.933032 10122 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.046598 11529 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.914148 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1715) took 2190 ms. Trace:
I20260709 12:14:35.047016 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:35.002549 10203 rpcz_store.cc:269] 0709 12:14:33.082667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.001842 (+1919175us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:35.001977 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:35.047206 11529 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.020926 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 62646.2us
I20260709 12:14:35.048147 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.048455 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.056802 10195 raft_consensus.cc:2376] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4. Re-sending same reply.
I20260709 12:14:35.051923 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:35.057380 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 207) took 2004 ms (client timeout 2213 ms). Trace:
W20260709 12:14:35.057734 10195 rpcz_store.cc:269] 0709 12:14:33.052972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.048177 (+1995205us) service_pool.cc:224] Handling call
0709 12:14:35.057312 (+  9135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.949802 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:35.053323 11571 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.059670 11571 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.020547 10095 connection.cc:256] RPC call timeout handler was delayed by -1.6013879130000532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:14:34.994204 10123 rpcz_store.cc:276] 0709 12:14:33.302130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.992617 (+1690487us) service_pool.cc:224] Handling call
0709 12:14:34.993003 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.993580 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.993812 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.061144 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.008917 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:34.984922 11420 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:34.975804 11646 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:14:35.062569 11691 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:35.063161 11646 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.062920 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.047235 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 958) took 1760 ms. Trace:
I20260709 12:14:35.064144 10122 rpcz_store.cc:276] 0709 12:14:33.287269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.925268 (+1637999us) service_pool.cc:224] Handling call
0709 12:14:35.047160 (+121892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.046314 11566 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:34.780565 11634 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:35.050096 10019 leader_election.cc:336] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.824s (SENT)
I20260709 12:14:35.066051 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:35.066556 11634 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:35.034376 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 74880.1us
I20260709 12:14:35.051254 11379 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.068451 10019 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.923s (SENT)
W20260709 12:14:34.945927 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1379) took 3225 ms (client timeout 2976 ms). Trace:
I20260709 12:14:35.067962 10200 raft_consensus.cc:2376] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2. Re-sending same reply.
I20260709 12:14:35.020037 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.009409 10049 rpcz_store.cc:276] 0709 12:14:32.721248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.853219 (+2131971us) service_pool.cc:224] Handling call
0709 12:14:34.853657 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.853911 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.894280 (+ 40369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.894368 (+    88us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.894410 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.003047 (+108637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.003152 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.010842 10046 rpcz_store.cc:276] 0709 12:14:33.290058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.987523 (+1697465us) service_pool.cc:224] Handling call
0709 12:14:34.987924 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.988904 (+   980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.988925 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.010140 (+ 21215us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.010211 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.010274 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.010376 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.024319 11570 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.035507 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 127) took 2362 ms. Trace:
I20260709 12:14:35.008191 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.015975 10121 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:35.038956 11660 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.008674 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 206) took 1955 ms (client timeout 2014 ms). Trace:
I20260709 12:14:35.002103 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:34.971252 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49893us
I20260709 12:14:35.050004 10130 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:35.049594 11529 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.065320 11691 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:35.066404 11695 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:14:35.050732 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 209) took 1997 ms (client timeout 2009 ms). Trace:
W20260709 12:14:35.035734 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.053936 11516 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.066603 11566 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.047374 10055 rpcz_store.cc:276] 0709 12:14:32.723354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.912662 (+2189308us) service_pool.cc:224] Handling call
0709 12:14:34.913101 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.913861 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.914093 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.103000 10197 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.116727 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.117057 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.044471 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.118672 11594 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:35.119081 11594 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.119452 11594 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.120296 10122 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:35.122357 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.036944 11569 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.123529 10122 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:35.123762 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 964) took 1831 ms (client timeout 2022 ms). Trace:
I20260709 12:14:35.074808 11605 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.124627 10126 rpcz_store.cc:269] 0709 12:14:33.292313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.345444 (+ 53131us) service_pool.cc:224] Handling call
0709 12:14:35.123584 (+1778140us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400174154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:35.123708 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4083918720}
I20260709 12:14:35.125576 11605 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.126058 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.058650 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.063576 11646 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:35.126077 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.127539 11570 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.066875 11420 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.067962 11379 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.128316 10126 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.069151 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1400) took 1826 ms (client timeout 1922 ms). Trace:
I20260709 12:14:35.028904 11635 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:35.128991 10200 rpcz_store.cc:269] 0709 12:14:33.242453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.008634 (+1766181us) service_pool.cc:224] Handling call
0709 12:14:35.069093 (+ 60459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.128239 11646 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:35.130276 11646 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.130537 11635 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.131286 11516 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:35.131140 10198 rpcz_store.cc:269] 0709 12:14:33.053538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.004257 (+1950719us) service_pool.cc:224] Handling call
0709 12:14:35.050652 (+ 46395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.132481 11682 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.126839 10122 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:35.132789 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.132980 11682 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.133680 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:35.133553 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 891) took 3075 ms (client timeout 3350 ms). Trace:
W20260709 12:14:35.134372 10198 rpcz_store.cc:269] 0709 12:14:32.058073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.132497 (+3074424us) service_pool.cc:224] Handling call
0709 12:14:35.133500 (+  1003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.135367 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.135545 11682 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.130769 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.136073 11379 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:35.137153 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 205) took 2084 ms (client timeout 2257 ms). Trace:
I20260709 12:14:35.128244 11605 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:35.059628 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 109946us
W20260709 12:14:35.138073 10200 rpcz_store.cc:269] 0709 12:14:33.052508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.130221 (+2077713us) service_pool.cc:224] Handling call
0709 12:14:35.137081 (+  6860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.140435 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:35.138209 10125 rpcz_store.cc:276] 0709 12:14:32.675380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.037186 (+361806us) service_pool.cc:224] Handling call
0709 12:14:33.037497 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.037887 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.037913 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.043909 (+  5996us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.212229 (+168320us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:34.973611 (+1761382us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.035121 (+ 61510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.035232 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.035291 (+    59us) raft_consensus.cc:1685] finished
0709 12:14:35.035302 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.035456 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":889579,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":198,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":10025,"thread_start_us":1926884,"threads_started":3,"wal-append.queue_time_us":332919,"wal-append.run_cpu_time_us":1826,"wal-append.run_wall_time_us":1018893}
W20260709 12:14:35.068940 10201 rpcz_store.cc:269] 0709 12:14:31.720353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.945744 (+3225391us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.945880 (+   136us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:35.142665 10127 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.142957 11682 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.141757 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.128376 11660 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.143976 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 897) took 2692 ms (client timeout 3241 ms). Trace:
W20260709 12:14:35.144342 10200 rpcz_store.cc:269] 0709 12:14:32.451923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.141446 (+2689523us) service_pool.cc:224] Handling call
0709 12:14:35.143899 (+  2453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.138947 10122 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:35.137868 10198 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
W20260709 12:14:35.138017 10202 rpcz_store.cc:269] 0709 12:14:33.052737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.007167 (+1954430us) service_pool.cc:224] Handling call
0709 12:14:35.008600 (+  1433us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.128885 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 210) took 2075 ms (client timeout 2096 ms). Trace:
I20260709 12:14:35.146005 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.027487 10048 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.146878 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.147447 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.147699 10202 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:35.069235 10701 leader_election.cc:336] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.924s (SENT)
I20260709 12:14:35.148329 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.148737 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.149176 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.166916 10202 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:35.067312 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.138060 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
W20260709 12:14:35.167870 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 100672us
I20260709 12:14:35.168005 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:35.145486 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1393) took 2091 ms (client timeout 2368 ms). Trace:
I20260709 12:14:35.169190 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.149900 11691 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.150240 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.172070 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 500) took 2325 ms. Trace:
I20260709 12:14:35.173034 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.138516 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.175854 10130 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:35.153182 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.153481 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.177417 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.178078 10200 raft_consensus.cc:2368] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.179064 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.179631 10200 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.180612 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.172739 10736 rpcz_store.cc:276] 0709 12:14:32.846596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.799102 (+1952506us) service_pool.cc:224] Handling call
0709 12:14:34.799568 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.800038 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.800064 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.800560 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.806606 (+  6046us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:35.170838 (+364232us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.171768 (+   930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.171842 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.171881 (+    39us) raft_consensus.cc:1685] finished
0709 12:14:35.171893 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.172026 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364189,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":969,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"thread_start_us":369518,"threads_started":2,"wal-append.queue_time_us":5433}
I20260709 12:14:35.155911 10050 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.183199 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.181838 10200 raft_consensus.cc:2410] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:35.183666 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.184777 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.185285 10200 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.185487 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.186121 10201 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.186488 11654 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.187012 11646 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.186364 10050 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:35.187662 11646 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.154261 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:35.070587 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 906) took 1652 ms (client timeout 1776 ms). Trace:
I20260709 12:14:35.189291 10121 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.014295 10199 rpcz_store.cc:269] 0709 12:14:33.052233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.012464 (+1960231us) service_pool.cc:224] Handling call
0709 12:14:35.013927 (+  1463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.189965 10050 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:35.191462 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1305977580000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:14:35.191633 11451 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.156109 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:35.147732 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 127) took 2426 ms (client timeout 2213 ms). Trace:
I20260709 12:14:35.162055 10128 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:14:35.122520 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78268.4us
I20260709 12:14:35.154798 11559 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.192936 11451 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:35.191143 11646 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:35.193972 10048 rpcz_store.cc:269] 0709 12:14:32.720998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.433823 (+1712825us) service_pool.cc:224] Handling call
0709 12:14:35.147437 (+713614us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400321c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:35.147672 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811541888}
W20260709 12:14:35.164353 10197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 893) took 3035 ms (client timeout 1939 ms). Trace:
I20260709 12:14:35.164605 11660 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.046145 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.207810 10050 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:35.208679 10200 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.210071 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.165459 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:35.211629 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 69079.4us
I20260709 12:14:35.211767 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.212549 10094 leader_election.cc:400] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.213411 10200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:35.165482 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.214349 10200 raft_consensus.cc:606] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.214181 11655 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.215081 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45090 (request call id 13) took 2498 ms. Trace:
I20260709 12:14:35.213505 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:35.215466 10200 rpcz_store.cc:276] 0709 12:14:32.716325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.213176 (+2496851us) service_pool.cc:224] Handling call
0709 12:14:35.215007 (+  1831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.215941 11655 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:35.217000 10200 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.166978 10049 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.168623 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:35.217906 11660 raft_consensus.cc:2764] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:14:35.218046 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49521.6us
I20260709 12:14:35.219130 11420 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.219774 11420 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.221060 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.221259 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.221683 10730 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:35.221863 11420 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.124634 11569 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.222784 11569 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:35.223110 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.223457 10730 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:35.222587 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:35.168685 10198 rpcz_store.cc:269] 0709 12:14:33.053987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.135084 (+2081097us) service_pool.cc:224] Handling call
0709 12:14:35.145434 (+ 10350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.224773 10728 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:35.225268 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.170387 11379 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:35.146234 10196 rpcz_store.cc:269] 0709 12:14:33.053753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.007887 (+1954134us) service_pool.cc:224] Handling call
0709 12:14:35.128808 (+120921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.225924 11379 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:35.226919 11379 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.228991 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.229352 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.230242 10054 raft_consensus.cc:2368] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
I20260709 12:14:35.115157 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.231160 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:35.231387 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 162988us
I20260709 12:14:35.231814 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
W20260709 12:14:35.149410 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 80231.6us
W20260709 12:14:35.189138 10203 rpcz_store.cc:269] 0709 12:14:33.418343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.047840 (+1629497us) service_pool.cc:224] Handling call
0709 12:14:35.070504 (+ 22664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.233462 10203 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.234069 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 198) took 3639 ms. Trace:
I20260709 12:14:35.234539 10203 rpcz_store.cc:276] 0709 12:14:31.594384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.232928 (+3638544us) service_pool.cc:224] Handling call
0709 12:14:35.233295 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.233807 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.233981 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.234886 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.234545 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.236397 10734 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.236574 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1366) took 3623 ms. Trace:
I20260709 12:14:35.236925 10203 rpcz_store.cc:276] 0709 12:14:31.613587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.235671 (+3622084us) service_pool.cc:224] Handling call
0709 12:14:35.235981 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.236222 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.236252 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.236315 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.236347 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.236402 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.236511 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.239281 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.158977 10195 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.080106 11681 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.095556 11677 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.206321 10197 rpcz_store.cc:269] 0709 12:14:32.083001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.042165 (+959164us) service_pool.cc:224] Handling call
0709 12:14:35.118165 (+2076000us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400103bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:35.118399 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4286565120}
I20260709 12:14:35.222954 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.225399 10198 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:35.229707 10199 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.230160 10736 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:14:34.930290 10204 rpcz_store.cc:269] 0709 12:14:32.718157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.929855 (+2211698us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:34.929958 (+   103us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:35.173506 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.170790 10055 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:35.181898 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.222711 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.241505 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.262280 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 195) took 3681 ms. Trace:
W20260709 12:14:35.262668 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 208) took 2205 ms (client timeout 2241 ms). Trace:
I20260709 12:14:35.262698 10198 rpcz_store.cc:276] 0709 12:14:31.577683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.224757 (+3647074us) service_pool.cc:224] Handling call
0709 12:14:35.225082 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.258707 (+ 33625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.258906 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.263105 10195 rpcz_store.cc:269] 0709 12:14:33.053320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.058323 (+2005003us) service_pool.cc:224] Handling call
0709 12:14:35.258882 (+200559us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.246157 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53154.7us
I20260709 12:14:35.240633 10203 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.247505 10052 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:35.247888 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 882) took 3662 ms. Trace:
I20260709 12:14:35.234069 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.248852 11433 raft_consensus.cc:1064] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:35.247099 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1717) took 2512 ms. Trace:
I20260709 12:14:35.249744 11677 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.251080 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.216668 11559 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.277598 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.252486 10094 leader_election.cc:400] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.253829 10202 raft_consensus.cc:2368] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.255594 10734 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:35.261991 10731 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:35.246708 10126 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.257161 10049 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:35.277371 11594 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.280985 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.280229 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.282845 11594 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.283090 11605 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.258010 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 193) took 3670 ms. Trace:
I20260709 12:14:35.283790 10200 rpcz_store.cc:276] 0709 12:14:31.575911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.216436 (+3640525us) service_pool.cc:224] Handling call
0709 12:14:35.216784 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.245640 (+ 28856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.245847 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.165782 11628 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.276819 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:35.277038 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1367) took 3653 ms. Trace:
I20260709 12:14:35.277277 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.273092 10127 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.279539 10204 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
W20260709 12:14:35.271940 10701 leader_election.cc:336] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 2.009s (SENT)
I20260709 12:14:35.268543 10046 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.282244 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.294209 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.294904 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.275689 11651 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.295463 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.290057 11571 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.275405 10053 rpcz_store.cc:276] 0709 12:14:32.735028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.934080 (+2199052us) service_pool.cc:224] Handling call
0709 12:14:34.934493 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.934897 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:34.935221 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.199718 (+264497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.240877 (+ 41159us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:35.246842 (+  5965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.246922 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.247032 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":177,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":147,"raft.run_cpu_time_us":1821,"raft.run_wall_time_us":29120,"spinlock_wait_cycles":230849408,"thread_start_us":257873,"threads_started":1,"wal-append.queue_time_us":254027}
I20260709 12:14:35.286273 10203 rpcz_store.cc:276] 0709 12:14:31.624127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.237836 (+3613709us) service_pool.cc:224] Handling call
0709 12:14:35.238142 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.266005 (+ 27863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.276968 (+ 10963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.286475 10730 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.290518 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:35.299432 10130 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:35.292438 11451 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.297308 10125 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.291368 11654 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.284359 11691 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:14:35.298032 11719 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:14:35.296245 10126 raft_consensus.cc:2368] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
I20260709 12:14:35.278923 10123 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.307060 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.305730 11677 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:35.319531 10127 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 2: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:35.309090 10121 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:35.310014 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49264.5us
I20260709 12:14:35.310181 11664 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.310402 11605 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:35.308249 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.313346 10054 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:35.293648 11433 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.320078 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53459.6us
W20260709 12:14:35.323556 10701 leader_election.cc:336] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 2.014s (SENT)
I20260709 12:14:35.323711 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.325098 11663 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:35.325335 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.325559 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.326474 10121 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.326987 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.327162 11664 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.326581 11663 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.328191 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:35.330483 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.302685 10729 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.328567 11677 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:35.332428 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.324586 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.327802 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:35.334867 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.333822 11635 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:35.336582 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:35.339764 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 87443.1us
I20260709 12:14:35.339795 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.340713 10052 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.340750 10049 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.324314 11605 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:35.343758 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.343035 10127 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.352990 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.322688 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.336512 11635 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.349635 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.330628 11663 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:35.349689 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.354734 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:35.357538 10094 leader_election.cc:400] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.358088 10094 leader_election.cc:403] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:35.359043 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.361406 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.357548 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:35.362077 10125 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.360908 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.340925 11379 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:35.365418 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:35.365967 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.359066 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.352604 11605 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.378319 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.379134 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.355422 11594 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.356197 11635 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.377732 10701 leader_election.cc:336] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 2.213s (SENT)
W20260709 12:14:35.399665 10701 leader_election.cc:336] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 2.241s (SENT)
I20260709 12:14:35.399343 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.359963 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.359495 10050 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.383183 11455 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:35.404088 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.421281 11455 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.404247 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 975) took 2093 ms. Trace:
I20260709 12:14:35.421435 11629 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:35.421806 10204 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:35.400373 10202 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:35.364557 11655 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.361572 11451 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:35.423804 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:35.423945 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66469.3us
W20260709 12:14:35.415431 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 95687.1us
I20260709 12:14:35.427196 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:35.380084 11379 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:35.400326 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:35.467811 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 111799us
I20260709 12:14:35.461066 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.421741 10124 rpcz_store.cc:276] 0709 12:14:33.302814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.006555 (+1703741us) service_pool.cc:224] Handling call
0709 12:14:35.006936 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.041736 (+ 34800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.041763 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.042284 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.069646 (+ 27362us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.069684 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.069747 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.297415 (+227668us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:35.380858 (+ 83443us) raft_consensus.cc:1685] finished
0709 12:14:35.380878 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.396642 (+ 15764us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":139,"spinlock_wait_cycles":504113408,"thread_start_us":26980,"threads_started":1,"wal-append.queue_time_us":26613}
I20260709 12:14:35.441066 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.485471 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.265501 10196 rpcz_store.cc:276] 0709 12:14:31.585347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.226353 (+3641006us) service_pool.cc:224] Handling call
0709 12:14:35.226712 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.247491 (+ 20779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.247529 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.247600 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:35.247633 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.247696 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.247819 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16427,"raft.queue_time_us":20468,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201}
I20260709 12:14:35.399353 11654 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:35.436751 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.497313 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.499382 10736 raft_consensus.cc:2368] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.500061 10195 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.421909 11629 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:35.500834 10127 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.503201 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.503760 10127 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.503860 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.504333 10199 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.425027 11455 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.495137 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:35.507249 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.507665 10095 leader_election.cc:400] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.508020 10095 leader_election.cc:403] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:35.507934 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.468446 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.508824 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:35.489697 11451 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.507278 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.511870 10200 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.500780 11654 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.511610 10130 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:35.515051 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.516600 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.516429 10204 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.426081 11594 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.505105 11629 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.523567 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1374) took 3854 ms. Trace:
I20260709 12:14:35.517761 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.501968 10126 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:35.512964 11723 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:14:35.523959 10204 rpcz_store.cc:276] 0709 12:14:31.663573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.456201 (+3792628us) service_pool.cc:224] Handling call
0709 12:14:35.500454 (+ 44253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.517256 (+ 16802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.517442 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.524315 10200 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.525777 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 98649.9us
I20260709 12:14:35.499961 11551 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:14:35.496694 11571 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:14:35.513585 11451 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.513304 11660 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:35.436631 11677 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.518975 11654 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:35.527978 11724 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:14:35.514707 11655 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.502285 11501 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:35.516253 11682 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:14:35.527154 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.528494 10199 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.553871 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 887) took 3496 ms. Trace:
I20260709 12:14:35.554216 10199 rpcz_store.cc:276] 0709 12:14:32.057113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.510330 (+3453217us) service_pool.cc:224] Handling call
0709 12:14:35.528170 (+ 17840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.553570 (+ 25400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.553809 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.539443 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.498462 11646 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:14:35.540203 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.555554 10130 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:35.541244 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.526779 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.535358 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.527206 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.533151 10201 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.526023 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.526243 10121 raft_consensus.cc:2368] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:35.528468 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:35.546547 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.525347 11664 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.563225 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.564116 10199 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.526284 10729 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:35.534512 10730 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:35.516150 11597 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:35.533679 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.535959 11594 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.534602 11703 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:35.527086 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.559347 10204 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.546335 11660 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.549093 10196 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.567634 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.577476 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:35.597747 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53793.6us
W20260709 12:14:35.559518 11715 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.418s	user 0.003s	sys 0.003s
I20260709 12:14:35.599896 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.504208 11663 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.600589 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 72239.6us
I20260709 12:14:35.602078 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.619130 10054 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.619899 10127 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:14:35.548669 10225 debug-util.cc:398] Leaking SignalData structure 0x7b080014c8c0 after lost signal to thread 8907
I20260709 12:14:35.603026 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.617744 10202 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.566841 10124 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.615116 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 885) took 3558 ms. Trace:
I20260709 12:14:35.621096 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:35.621209 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.633014 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:35.633507 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 131135us
I20260709 12:14:35.636934 10200 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.553150 11420 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:14:35.638586 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.597103 11691 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:35.611903 11718 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.450s	user 0.000s	sys 0.014s
I20260709 12:14:35.598387 11571 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:35.640792 10200 raft_consensus.cc:2368] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.639767 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.641636 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:35.621368 10225 debug-util.cc:398] Leaking SignalData structure 0x7b080017e460 after lost signal to thread 8910
I20260709 12:14:35.644237 10199 raft_consensus.cc:2368] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.640532 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:35.644389 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76538.6us
I20260709 12:14:35.644939 10127 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.601336 11660 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:35.643592 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.646400 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:35.614907 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.612187 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:35.615396 11728 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.648904 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:35.620102 11664 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:35.646469 10130 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.651465 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.652712 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.656932 10124 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.658277 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.643961 11695 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:35.614580 11559 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:35.643343 11551 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:35.672367 10225 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3fa0 after lost signal to thread 9987
I20260709 12:14:35.672706 10123 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.674242 10200 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:35.616976 11629 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.678519 10054 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:35.651772 11516 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:35.561560 11379 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.640108 11569 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:35.684969 10046 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.690312 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.636188 10196 rpcz_store.cc:276] 0709 12:14:32.056581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.509294 (+3452713us) service_pool.cc:224] Handling call
0709 12:14:35.536115 (+ 26821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.614805 (+ 78690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.615049 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.701866 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.667487 11726 raft_consensus.cc:2764] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:35.708865 10200 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:35.661514 10201 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.671823 11551 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:35.691063 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.716658 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.726193 10200 raft_consensus.cc:2368] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:35.690817 11663 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.700719 11695 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:35.715903 10225 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9b20 after lost signal to thread 10079
I20260709 12:14:35.725628 11551 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:35.734227 11709 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.545s	user 0.013s	sys 0.000s
I20260709 12:14:35.735281 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1612) took 3194 ms. Trace:
I20260709 12:14:35.691684 11691 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:14:35.736222 11714 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.553s	user 0.007s	sys 0.000s
I20260709 12:14:35.692992 11728 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:35.756930 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 101434us
I20260709 12:14:35.738626 10203 raft_consensus.cc:2368] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:35.738977 10130 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.700696 11516 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:35.743163 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1407) took 2453 ms. Trace:
I20260709 12:14:35.741621 11695 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.746271 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.747157 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.752689 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.753430 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.690618 11597 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:14:35.766172 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 113518us
I20260709 12:14:35.725265 11605 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.755739 10128 rpcz_store.cc:276] 0709 12:14:32.541170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.027383 (+486213us) service_pool.cc:224] Handling call
0709 12:14:33.042743 (+ 15360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.194785 (+2152042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.734953 (+540168us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54001284d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:35.735198 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4872989952}
I20260709 12:14:35.738086 11594 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.760203 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:35.744089 10225 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa0c0 after lost signal to thread 10154
I20260709 12:14:35.740236 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.764111 10204 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:35.767683 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.789816 10046 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
W20260709 12:14:35.730930 10019 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.810s (SENT) [suppressed 77 similar messages]
I20260709 12:14:35.761261 10047 rpcz_store.cc:276] 0709 12:14:33.289616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.987005 (+1697389us) service_pool.cc:224] Handling call
0709 12:14:34.987439 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.987919 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.987949 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.988569 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.162546 (+173977us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.162581 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.162651 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.600829 (+438178us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:35.739961 (+139132us) raft_consensus.cc:1685] finished
0709 12:14:35.739980 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.743080 (+  3100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":682,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"spinlock_wait_cycles":290996608,"thread_start_us":173558,"threads_started":1,"wal-append.queue_time_us":172318}
I20260709 12:14:35.783492 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:35.786978 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 140705us
I20260709 12:14:35.759362 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:35.791225 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 60337.7us
I20260709 12:14:35.764629 11695 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.755877 11455 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.765807 11639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.005s	sys 0.036s
I20260709 12:14:35.761096 11571 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:35.797837 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:35.787544 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.813524 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.781359 11594 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:35.797957 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.766929 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:35.787349 10225 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2460 after lost signal to thread 10155
I20260709 12:14:35.799923 11691 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.789557 10053 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
W20260709 12:14:35.806516 11639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.006s	sys 0.036s
I20260709 12:14:35.839856 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:35.849543 10049 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.855273 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:35.851696 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53887.5us
I20260709 12:14:35.856185 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.835553 11559 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:35.857635 10049 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:35.858142 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.860147 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:35.804100 10196 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:35.839155 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.844003 11691 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:35.867503 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.807090 11651 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:14:35.877660 11736 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:35.878300 11710 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.618s	user 0.002s	sys 0.003s
I20260709 12:14:35.878655 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:35.879499 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 502) took 3032 ms. Trace:
I20260709 12:14:35.870941 11516 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.866657 10197 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:35.859361 11559 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.879868 10737 rpcz_store.cc:276] 0709 12:14:32.847349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.825882 (+1978533us) service_pool.cc:224] Handling call
0709 12:14:34.826328 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.935026 (+108698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.935079 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.935907 (+   828us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.206844 (+270937us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.206878 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.206938 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.799328 (+592390us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:35.879201 (+ 79873us) raft_consensus.cc:1685] finished
0709 12:14:35.879220 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.879439 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":41871104,"thread_start_us":270080,"threads_started":1,"wal-append.queue_time_us":255164}
I20260709 12:14:35.861608 11629 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.883509 11743 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:35.874998 10225 debug-util.cc:398] Leaking SignalData structure 0x7b0800370f60 after lost signal to thread 10228
I20260709 12:14:35.886919 11654 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.899569 11605 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.900226 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.900416 11654 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.900815 10048 raft_consensus.cc:2376] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4. Re-sending same reply.
I20260709 12:14:35.876857 11737 raft_consensus.cc:2764] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:14:35.901295 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55763.8us
I20260709 12:14:35.888536 11703 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.902657 10201 raft_consensus.cc:2410] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:14:35.903347 11711 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.799s	user 0.000s	sys 0.014s
I20260709 12:14:35.903934 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:35.874559 11728 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.888175 10202 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.877653 11738 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.808326 11732 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:14:35.871062 11735 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:35.894835 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:35.895444 11571 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.896250 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:35.900911 11731 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:35.898797 11712 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.809s	user 0.014s	sys 0.000s
W20260709 12:14:35.908519 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 110850us
I20260709 12:14:35.853246 11635 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.893828 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.917447 11605 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.917814 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1620) took 2851 ms. Trace:
I20260709 12:14:35.918018 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.900694 11455 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:35.918351 11628 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:35.892432 11559 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.922058 10052 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:35.924376 10129 rpcz_store.cc:276] 0709 12:14:33.066652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.940317 (+1873665us) service_pool.cc:224] Handling call
0709 12:14:34.940718 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.941197 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.941226 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.941712 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.104658 (+162946us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:35.206374 (+101716us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.206589 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.206655 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.902628 (+695973us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:35.910702 (+  8074us) raft_consensus.cc:1685] finished
0709 12:14:35.917561 (+  6859us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.917729 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141419,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4841,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":274,"spinlock_wait_cycles":422837632,"thread_start_us":263849,"threads_started":2,"wal-append.queue_time_us":162117}
W20260709 12:14:35.917474 10225 debug-util.cc:398] Leaking SignalData structure 0x7b0800359400 after lost signal to thread 10761
I20260709 12:14:35.926990 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:35.916666 11703 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:35.928756 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 365893us
W20260709 12:14:35.941635 10094 connection.cc:256] RPC call timeout handler was delayed by -2.1926306230000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3047s for a response
W20260709 12:14:35.942003 10094 connection.cc:256] RPC call timeout handler was delayed by -2.1570758840000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:14:35.942286 10094 connection.cc:256] RPC call timeout handler was delayed by -2.102175883999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 12:14:35.930207 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.931957 11635 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:35.921984 11732 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:35.919066 11735 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.908396 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:35.927716 11651 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:35.947403 10204 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.940819 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:35.920627 11731 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.951524 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.952209 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:35.920257 11743 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:35.951975 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:35.954555 11597 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:35.955497 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.954716 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.957701 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:35.957896 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.922878 11660 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.958729 10196 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.956692 11691 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:35.961653 10733 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:35.954079 10094 connection.cc:256] RPC call timeout handler was delayed by -1.8787093139999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 12:14:35.956156 10736 raft_consensus.cc:2376] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3. Re-sending same reply.
W20260709 12:14:35.968988 10094 connection.cc:256] RPC call timeout handler was delayed by -1.8303758839999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 12:14:35.948386 11639 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:35.950940 10203 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:35.947444 11703 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.975497 10129 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:35.975767 11703 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:35.976759 11726 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:35.969278 10094 connection.cc:256] RPC call timeout handler was delayed by -1.696909314000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:14:35.978701 10094 connection.cc:256] RPC call timeout handler was delayed by -1.553809314000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:14:35.979082 10094 connection.cc:256] RPC call timeout handler was delayed by -1.5126537180001378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:14:35.979375 10094 connection.cc:256] RPC call timeout handler was delayed by -1.5115093140000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 12:14:35.950690 11732 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:35.974875 10729 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:35.956143 11735 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:35.979660 10094 connection.cc:256] RPC call timeout handler was delayed by -1.4283345660001032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 12:14:35.960855 11731 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:35.982666 10094 connection.cc:256] RPC call timeout handler was delayed by -1.4184345660000872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 12:14:35.982996 10094 connection.cc:256] RPC call timeout handler was delayed by -1.4003080730001329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:14:35.983270 10094 connection.cc:256] RPC call timeout handler was delayed by -1.3248345660001632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 12:14:35.983547 10094 connection.cc:256] RPC call timeout handler was delayed by -1.3217825650001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:14:35.983889 10094 connection.cc:256] RPC call timeout handler was delayed by -1.2136093139999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
W20260709 12:14:35.984213 10094 connection.cc:256] RPC call timeout handler was delayed by -1.2010372170002483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:14:35.984485 10094 connection.cc:256] RPC call timeout handler was delayed by -1.1808345660001578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:14:35.984737 10094 connection.cc:256] RPC call timeout handler was delayed by -1.1634758840000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29760000000000003s for a response
W20260709 12:14:35.984994 10094 connection.cc:256] RPC call timeout handler was delayed by -1.147534566000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 12:14:35.985141 11743 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:35.962706 10053 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:35.979664 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:35.978740 10169 leader_election.cc:400] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
W20260709 12:14:35.987422 10094 connection.cc:256] RPC call timeout handler was delayed by -1.131882565000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:14:35.950371 11451 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:35.987829 10094 connection.cc:256] RPC call timeout handler was delayed by -1.1043345660000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:14:35.991425 10094 connection.cc:256] RPC call timeout handler was delayed by -1.0323345660001451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:14:35.987583 10050 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 12:14:35.980664 11728 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:36.120060 10094 leader_election.cc:336] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items
W20260709 12:14:36.120777 11742 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.160s	user 0.005s	sys 0.000s
I20260709 12:14:36.122228 11651 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:35.988142 11754 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.129062 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1718) took 3393 ms. Trace:
I20260709 12:14:36.138024 10051 rpcz_store.cc:276] 0709 12:14:32.735279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.947458 (+2212179us) service_pool.cc:224] Handling call
0709 12:14:34.947928 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.948469 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.948507 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.949121 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.090673 (+141552us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.090719 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.090820 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.891312 (+800492us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:36.128711 (+237399us) raft_consensus.cc:1685] finished
0709 12:14:36.128731 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.128979 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9483,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":451214208,"thread_start_us":141053,"threads_started":1,"wal-append.queue_time_us":140225}
I20260709 12:14:36.140789 11754 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:36.141636 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.148877 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 196929us
W20260709 12:14:36.149488 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.130226 10050 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:36.130076 11728 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.131296 10055 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:36.134562 11420 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.160380 11420 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:36.160830 11420 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.161078 11664 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.161484 11664 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.161684 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.134860 10094 leader_election.cc:400] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:36.163172 10094 leader_election.cc:403] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:36.164408 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.165191 11516 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:36.165861 11516 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.166770 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.136264 11695 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:36.136929 11721 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.963s	user 0.000s	sys 0.025s
I20260709 12:14:36.167512 10737 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:36.132122 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 153518us
I20260709 12:14:36.168426 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 976) took 1020 ms. Trace:
I20260709 12:14:36.169052 11695 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.169456 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.142742 11732 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.171066 11732 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.168864 10122 rpcz_store.cc:276] 0709 12:14:35.147726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.150528 (+  2802us) service_pool.cc:224] Handling call
0709 12:14:35.150872 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.152105 (+  1233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.152139 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.152707 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.183938 (+ 31231us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:35.183977 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.184055 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:36.136415 (+952360us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:36.168118 (+ 31703us) raft_consensus.cc:1685] finished
0709 12:14:36.168148 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.168360 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1279,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":561,"spinlock_wait_cycles":293590912,"thread_start_us":30808,"threads_started":1,"wal-append.queue_time_us":21075}
I20260709 12:14:36.174048 11637 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.174496 11637 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:36.174908 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.177043 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.177707 10122 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.170313 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.144572 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:36.145478 11655 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:36.145745 11559 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.141767 11754 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.147269 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:36.188783 10200 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:36.148159 11660 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.152874 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.153281 11681 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.192615 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:36.155509 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 300292us
I20260709 12:14:36.157390 10195 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:36.153120 10197 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:36.159505 11551 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.191354 11451 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:36.201853 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49057.8us
I20260709 12:14:36.193496 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.174880 11637 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.200381 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.191977 10094 leader_election.cc:336] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:38758 dropped due to backpressure: service queue is full with 50 items
I20260709 12:14:36.180253 11728 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.178493 11569 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.202806 10734 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:36.202750 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 223152us
I20260709 12:14:36.202838 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:36.201781 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.205734 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.207263 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.207641 10200 raft_consensus.cc:2376] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4. Re-sending same reply.
I20260709 12:14:36.208532 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.208942 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.207859 10737 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:36.204838 11651 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.210595 11651 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.210937 11651 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.212815 11420 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.217036 11736 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:36.217608 11736 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:36.218482 11736 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.219344 10094 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:36.204921 11660 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.220227 11660 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.220592 11660 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.222011 10729 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:36.199450 11735 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.222689 10169 leader_election.cc:400] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
I20260709 12:14:36.223027 10169 leader_election.cc:403] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:36.223407 11420 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.223955 11732 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.224355 11735 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.203950 11605 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:36.225111 11605 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:36.225517 11605 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.220041 11551 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.226949 11753 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.206526 10730 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:36.227391 11753 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.227754 11753 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.220021 10201 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:36.228224 11433 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.228626 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 892) took 4170 ms. Trace:
I20260709 12:14:36.228865 11433 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
I20260709 12:14:36.229287 11691 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.231122 11551 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:36.231947 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.187870 11655 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.224790 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.256754 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 112282us
W20260709 12:14:36.251734 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47640us
I20260709 12:14:36.204195 11639 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:36.258023 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49456.9us
I20260709 12:14:36.259948 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.261157 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52276.9us
I20260709 12:14:36.263525 10095 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:36.263904 10095 leader_election.cc:403] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:36.265856 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.257524 11726 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.206768 11569 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:36.224388 11732 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:36.251688 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 211) took 1214 ms. Trace:
I20260709 12:14:36.271376 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:36.272871 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.273132 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.275893 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.276664 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.277667 11655 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.279110 11655 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.279458 11635 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:36.280180 11737 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.280452 11664 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.229453 11433 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:36.282995 11654 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.283773 11433 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.284458 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.284771 11501 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:36.285169 11501 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:36.277420 11756 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.259204 10196 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:36.295610 10200 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.280953 11559 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.268139 11597 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:36.298856 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:36.277321 10094 leader_election.cc:336] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:14:36.307631 10202 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:36.309085 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:36.306483 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 46627.6us
I20260709 12:14:36.274887 11732 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.285599 11743 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:36.274639 11639 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.269865 11420 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:14:36.324368 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.296036 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 103479us
I20260709 12:14:36.298300 11628 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.305755 11551 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.233225 10201 rpcz_store.cc:276] 0709 12:14:32.058338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.903407 (+3845069us) service_pool.cc:224] Handling call
0709 12:14:36.219522 (+316115us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:36.219749 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.228301 (+  8552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.228553 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14001536}
I20260709 12:14:36.308352 11654 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:36.332393 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48017.8us
W20260709 12:14:36.331534 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63822.5us
W20260709 12:14:36.334919 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.335696 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52323.4us
I20260709 12:14:36.307937 11664 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.319311 11682 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.327214 11730 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.339607 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.337620 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.345292 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.345715 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.332301 10730 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEARNER]: Advancing to term 5
I20260709 12:14:36.333566 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.352587 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.342490 11682 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.335834 11654 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.383682 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:36.389258 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52961.7us
I20260709 12:14:36.275096 10197 rpcz_store.cc:276] 0709 12:14:35.018823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.906759 (+887936us) service_pool.cc:224] Handling call
0709 12:14:36.148722 (+241963us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:36.152704 (+  3982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.200947 (+ 48243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.233151 (+ 32204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6695808}
W20260709 12:14:36.394949 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49301.3us
I20260709 12:14:36.393006 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:36.393661 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.320308 11703 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:36.337988 11639 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.410079 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:36.392735 11663 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.638s	user 0.015s	sys 0.000s
I20260709 12:14:36.404755 10050 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:36.348294 11730 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.347944 11551 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.416455 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:36.417560 11682 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.418018 10201 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:36.418569 11770 raft_consensus.cc:2764] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:36.341998 11731 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.405619 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:36.455917 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50385.7us
W20260709 12:14:36.422120 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79506.1us
I20260709 12:14:36.425097 10049 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.426239 10204 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:36.430305 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 97367us
I20260709 12:14:36.395584 11635 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.338029 11501 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.462541 11765 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:36.463280 11770 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.463687 11501 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.464078 10051 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:36.414543 10729 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:36.430953 11743 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:36.466544 10094 leader_election.cc:336] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:14:36.336643 11569 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.467422 11569 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:36.468189 11559 consensus_queue.cc:1175] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:36.452003 10052 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:36.469324 11605 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.469485 11594 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.463726 11770 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.470607 10198 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:36.470780 11770 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.471450 11605 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.471750 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 895) took 4387 ms. Trace:
I20260709 12:14:36.410028 11597 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.472110 10198 rpcz_store.cc:276] 0709 12:14:32.083935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.904974 (+3821039us) service_pool.cc:224] Handling call
0709 12:14:36.350138 (+445164us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:36.350312 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.471035 (+120723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.471527 (+   492us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002634d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:36.471676 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286803584}
I20260709 12:14:36.452602 11762 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:14:36.473107 11651 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.473870 10047 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:36.466570 11769 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.475785 11769 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.453727 10202 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.393098 11455 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:14:36.430361 11736 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:36.456462 10200 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:36.460182 11764 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:14:36.486577 11681 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:36.486928 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.466838 11743 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:36.487601 11743 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.487444 11681 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.488006 11660 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.489140 11681 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.489507 11681 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.477385 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.470643 11654 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.463383 11744 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:14:36.481369 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47558.3us
I20260709 12:14:36.477185 10122 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:36.475292 11730 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.421439 11754 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:36.483363 11629 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:36.483783 10126 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:36.484298 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.521450 10124 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.484829 11747 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:36.404449 11768 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:14:36.478739 11769 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.487128 10197 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:14:36.498694 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:36.495990 10055 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:36.498836 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.432163 11691 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:14:36.532490 10198 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:36.501668 10020 leader_election.cc:400] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:36.505381 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.504968 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.478482 10199 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:36.532821 10020 leader_election.cc:403] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:36.491889 11731 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:36.491511 10094 leader_election.cc:336] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:14:36.490327 11681 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.492022 11765 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:36.512400 11594 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.513309 10736 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:14:36.514358 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.514920 10730 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:36.491890 11737 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:14:36.516012 11761 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.325s	user 0.002s	sys 0.001s
I20260709 12:14:36.516750 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.538450 10733 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:36.517220 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 246492us
I20260709 12:14:36.517443 11455 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:36.492413 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 888) took 4435 ms. Trace:
I20260709 12:14:36.518102 11651 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.492694 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.492928 11654 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.495128 11703 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.493232 11655 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.517134 11571 raft_consensus.cc:2764] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:14:36.497845 11637 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.519469  9950 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 264) took 6078 ms. Trace:
I20260709 12:14:36.466346 11728 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.473878 11762 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.496091 11744 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.581223 11744 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.582052 11744 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.583071 11744 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.533484 10734 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:36.535950 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56348us
W20260709 12:14:36.536154 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44693.1us
I20260709 12:14:36.490012 11660 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.542057 11771 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:36.529458 11754 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:36.542376 11629 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:36.545567 11770 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:36.554072 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55463.4us
W20260709 12:14:36.520411 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.592607 10204 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.517226 11753 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.542965 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:36.537979 11737 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.554175 11664 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.553681 11605 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.575210 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.580756 11728 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:36.586561 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.563645 11681 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.564154 10729 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:36.589323 11629 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.607626 11629 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:36.609071 11629 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.553748 10203 rpcz_store.cc:276] 0709 12:14:32.057364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.878925 (+3821561us) service_pool.cc:224] Handling call
0709 12:14:35.879310 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.975430 (+ 96120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.492188 (+516758us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:36.492354 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122963200}
I20260709 12:14:36.612238 11637 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.613135 11754 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.605238 10126 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.601514 11455 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:36.571861 10202 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:36.618070 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:36.593475 10169 leader_election.cc:400] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3.
W20260709 12:14:36.596668 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.592329 11770 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.575101 11762 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:36.599399 10094 leader_election.cc:336] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:14:36.603282 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:36.574267 11677 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:14:36.621691 10019 leader_election.cc:400] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3.
I20260709 12:14:36.598824 11605 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.644235 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.642975 11777 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.571955  9950 rpcz_store.cc:276] 0709 12:14:30.441062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.441196 (+   134us) service_pool.cc:224] Handling call
0709 12:14:36.519406 (+6078210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:35.090822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:35.091518 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:35.091563 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:14:35.091582 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:35.092053 (+   471us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:35.092158 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:35.092185 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:14:35.092591 (+   406us) tablet.cc:701] Row locks acquired
0709 12:14:35.092638 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:14:35.092807 (+   169us) write_op.cc:270] Start()
0709 12:14:35.092942 (+   135us) write_op.cc:276] Timestamp: P: 1783599275092746 usec, L: 0
0709 12:14:35.092976 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:14:35.093693 (+   717us) log.cc:844] Serialized 929 byte log entry
0709 12:14:35.300546 (+206853us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17b6860ac 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b
0709 12:14:35.638483 (+337937us) op_driver.cc:464] REPLICATION: finished
0709 12:14:35.745350 (+106867us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17b6860ac 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc1821c6ef0
0709 12:14:35.879521 (+134171us) write_op.cc:301] APPLY: starting
0709 12:14:35.879615 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:35.879739 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:35.879772 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:35.883381 (+  3609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:35.883627 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:14:35.883692 (+    65us) write_op.cc:312] APPLY: finished
0709 12:14:35.883966 (+   274us) log.cc:844] Serialized 29 byte log entry
0709 12:14:35.884145 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:35.884231 (+    86us) write_op.cc:454] Released schema lock
0709 12:14:35.884285 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:35.884616 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:35.884647 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1632335,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":239050,"apply.run_cpu_time_us":2222,"apply.run_wall_time_us":5089,"num_ops":2,"prepare.queue_time_us":106792,"prepare.run_cpu_time_us":47495,"prepare.run_wall_time_us":337398,"raft.queue_time_us":44115,"raft.run_cpu_time_us":37637,"raft.run_wall_time_us":259348,"replication_time_us":507364,"spinlock_wait_cycles":452957824,"thread_start_us":605418,"threads_started":4,"wal-append.queue_time_us":366358}]]}
I20260709 12:14:36.586692 11663 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:14:36.598686 11747 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.599146 10731 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:36.666678 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 79241.8us
W20260709 12:14:36.667618 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77988.8us
I20260709 12:14:36.670625 11770 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.671612 11762 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.685961 10733 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:36.673939 11743 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:36.693379 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49228.7us
I20260709 12:14:36.694142 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.695181 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.655287 11660 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:36.696741 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 148057us
I20260709 12:14:36.698354 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.701206 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:36.670677 11781 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.688974 11770 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:36.696885 11771 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.707049 11785 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:36.711313 11785 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.711648 11785 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.712486 11785 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.716002 11743 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.699049 11728 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.709194 11771 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:36.717873 11771 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.614444 11737 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.719276 11737 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.710075 11765 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:14:36.721007 11732 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.710361 11664 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:36.722752 11664 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.722836 11762 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.723395 11551 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.723737 11664 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.727344 11753 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.728078 11605 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.688786 11747 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.729156 11781 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.730933 11747 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.731387 11781 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.732769 10731 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:36.713861 11785 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.740435 10124 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:36.759951 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.703612 11738 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:36.762739 10126 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:36.731504 11770 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:36.705579 11660 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:36.757354 11737 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.767007 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 68635.9us
I20260709 12:14:36.681659 11777 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.771474 11771 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.703742 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1631) took 1521 ms. Trace:
I20260709 12:14:36.782418 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.788707 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.808353 10049 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:36.790943 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:36.791287 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:36.769744 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.795550 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:36.809840 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.761096 11747 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:36.726186 11769 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:36.812462 10046 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:36.813794 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:36.821805 10126 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:36.823170 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.822958 11660 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.823885 11769 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.824465 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.825573 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.826684 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:36.827775 10128 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:36.828418 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.828707 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:36.829298 10128 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:36.829609 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.810791 11756 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.830745 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:36.837503 10125 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:36.830979 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.831710 10055 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:36.835155 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1417) took 1269 ms. Trace:
I20260709 12:14:36.840020 10199 rpcz_store.cc:276] 0709 12:14:35.566160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.645023 (+ 78863us) service_pool.cc:224] Handling call
0709 12:14:36.834984 (+1189961us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400361354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:36.835095 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780766592}
I20260709 12:14:36.830397 10128 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:36.844285 10125 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:36.845427 10129 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:36.780292 11455 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:14:36.846148 11753 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.791072 11738 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:36.846941 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55741.5us
I20260709 12:14:36.851301 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.851683 10128 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:36.849361 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.847995 10094 leader_election.cc:400] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:36.848156 11551 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.865489 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.865705 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:36.806989 11737 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:36.848987 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:36.860508 11628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.025s
I20260709 12:14:36.807101 10121 rpcz_store.cc:276] 0709 12:14:35.182710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.611866 (+429156us) service_pool.cc:224] Handling call
0709 12:14:36.692807 (+1080941us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400230854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:36.701393 (+  8586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240036096}
I20260709 12:14:36.854118 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:36.877324 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.815915 11747 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.878962 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:36.863680 11703 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.885000 10048 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:36.886220 10048 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:36.886870 11738 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.888343 11747 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.895334 11771 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:36.870565 11732 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.896847 10128 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:36.897202 11777 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:36.898303 10053 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:36.899255 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.899740 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.900470 10052 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:36.901214 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.902341 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.902875 11605 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.904101 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:36.904724 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.905364 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:36.910982 10049 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:36.911862 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:36.876222 11628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.007s	sys 0.026s
I20260709 12:14:36.907298 10052 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:36.904807 11783 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:14:36.908164 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.907385 10130 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:36.919284 10049 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:14:36.900388 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:36.914914 11628 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:36.921407 10053 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:36.921041 11628 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.926906 11737 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:36.928285 10127 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:14:36.930867 10052 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:36.931324 11768 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.931702 11768 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:36.873500 11754 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:36.932565 11768 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:36.935567 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 70213.9us
W20260709 12:14:36.936513 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.937036 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 150990us
I20260709 12:14:36.938004 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:36.938232 10054 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:14:36.940948 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47846.2us
I20260709 12:14:36.944861 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:36.943466 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:36.947166 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:36.951786 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.968442 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55263.1us
W20260709 12:14:36.968966 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.905467 11744 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:36.969955 11559 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.970413 11559 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.970825 11559 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.972968 10053 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:36.972795 11770 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.974619 11703 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.975477 10094 leader_election.cc:400] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:36.977136 10094 leader_election.cc:400] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:36.977942 10094 leader_election.cc:400] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:36.978179 10094 leader_election.cc:403] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:14:36.978602 11790 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:14:36.980621 11551 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:36.914199 11756 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:14:36.940356 11794 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:36.982359 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.972841 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.991731 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.941305 11768 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:36.995678 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.941282 11763 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.994115 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.002948 10122 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:37.003098 11756 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:37.003517 11756 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.003839 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.004264 11756 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.005038 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.005630 11756 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.994812 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:36.999867 11739 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:14:37.006949 10128 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:37.007701 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:36.995738 11501 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:36.954548 11655 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:36.966948 11379 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.013130 11379 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:36.968365 11743 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:36.999827 11765 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.014613 11743 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:37.015064 11743 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.014811 11765 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.016762 11654 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:37.000610 10199 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.017154 11654 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.001573 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.018801 11788 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:37.019351 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.011018 11501 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.020535 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.021160 10123 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.014066 11379 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:36.970237 11744 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.954947 11660 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.009763 10094 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:37.031796 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.017175 11765 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.036872 11788 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.037420 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.006160 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.052711 10733 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:14:37.056458 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.050676 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.010272 11571 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.010802 11655 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.018033 11654 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.030653 11744 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:37.069160 10130 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:37.072661 11759 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.072824 11695 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.072912 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.030277 11754 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:14:37.074640 10094 leader_election.cc:400] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.077473 10052 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.050174 11660 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:37.083341 11660 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:37.084893 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 271150us
I20260709 12:14:37.075404 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:37.088300 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.047788 11732 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:14:37.021025 11501 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.093991 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.063879 11655 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.098694 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:37.099979 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.103822 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.104321 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.075367 11559 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.060053 11651 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.010461 11763 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.069618 11770 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:37.110481 10202 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:37.088368 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.088742 11664 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.117312 10121 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:37.118295 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.119287 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:37.096369 11695 raft_consensus.cc:2764] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:14:37.113680 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.118541 10733 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.100497 11455 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:37.122454 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.101389 11794 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:37.107007 11605 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.131626 11605 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.133725 11605 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.135859 10204 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:37.138115 10129 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.138747 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.138999 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.139451 10122 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:37.142093 11551 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.143004 10051 raft_consensus.cc:2376] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5. Re-sending same reply.
I20260709 12:14:37.143574 11753 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.144457 11420 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:37.145100 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.144510 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.145249 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.102720 11777 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.147229 11559 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.107190 11654 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.153242 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:37.111800 10731 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:37.112330 11759 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:37.160116 11594 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.005s
I20260709 12:14:37.211225 10737 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:37.211601 10055 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.162468 10195 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.165927 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.170698 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:37.212518 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.213294 10052 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:37.166026 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.214123 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:37.150539 11794 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:37.216023 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.161530 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.156102 11637 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.155812 11664 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.154829 11730 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.158939 11420 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.159513 11501 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.222522 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:37.160290 11788 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:37.250972 10048 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.255743 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.258821 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.259603 10047 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:37.292304 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.295033 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.297968 10049 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:37.171502 11551 raft_consensus.cc:2764] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:37.162375 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.176113 11455 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.303581 10733 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:37.121044 11744 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.160441 11765 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:14:37.304981 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.311381 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.319780 10054 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:37.314417 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:37.222084 11691 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.323720 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:37.324584 10733 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:37.222545 11629 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.214883 11777 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.223953 11794 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.249406 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.217362 11516 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:14:37.299885 11732 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.317255 10203 raft_consensus.cc:2410] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:37.335528 10047 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.310160 11753 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.315068 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.315798 11594 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.319124 11677 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:37.342830 11726 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.321856 11730 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:37.331085 11768 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:37.372017 11730 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.373128 11768 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:37.338085 11801 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:14:37.355154 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.374997 10047 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:37.346900 11800 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:14:37.327316 11629 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:37.265990 11637 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.322160 11691 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.358574 10049 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.300137 11681 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:14:37.360766 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 43924.5us
W20260709 12:14:37.361627 11802 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:14:37.362275 11804 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:14:37.366176 11743 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.335147 11744 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.366876 10046 raft_consensus.cc:2410] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:37.353860 11732 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.369112 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.368992 11794 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.369809 11677 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:37.370688 11726 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.302491 11635 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:14:37.347756 11455 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.370723 11788 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.382417 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.382827 11777 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.384063 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.384191 10124 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:37.447966 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.318056 11785 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:37.386216 10048 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.340814 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.338605 11651 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:14:37.397010 10050 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:37.375073 10053 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.387343 11629 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.395926 11691 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:37.409287 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.384526 11763 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.384436 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:37.414616 10129 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.447779 10198 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:37.449076 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.376693 11594 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.360351 11753 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.410223 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.399010 11571 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:14:37.464674 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.467576 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 153466us
I20260709 12:14:37.457046 10122 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:37.459779 11738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.004s	sys 0.038s
I20260709 12:14:37.477150 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:37.477339 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:37.479101 11798 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:14:37.482044 11743 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:37.482573 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.404002 11664 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.489292 10198 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:37.492595 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.476341 10196 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:37.486603 11738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.038s
I20260709 12:14:37.490083 11639 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.504801 10094 leader_election.cc:400] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3.
I20260709 12:14:37.508875 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.514925 10198 raft_consensus.cc:2368] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.510228 11637 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.518496 11816 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:37.518674 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:37.519793 11682 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:37.520141 11682 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:37.520681 11682 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.521423 11682 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.523798 11753 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:37.506669 11571 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.524765 11571 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.525812 11691 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.526701 11571 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:37.526600 11815 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:14:37.504729 11605 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:14:37.527623 11605 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:37.527951 11605 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.528580 11605 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.529323 11605 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.496573 11785 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:14:37.530594 11785 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:37.530937 11785 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.531675 11785 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.532747 11785 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.516929 10203 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:37.490986 11732 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.535429 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.536621 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.537297 10203 raft_consensus.cc:2368] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.538053 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.513819 11639 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:37.548923 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.538093 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.549424 10203 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 2: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:37.545228 11655 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:37.550907 11809 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:14:37.551247 10195 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:37.552163 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.552821 10195 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:37.553401 11594 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:37.553572 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.555395 10198 raft_consensus.cc:2368] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
W20260709 12:14:37.556593 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 46193.6us
I20260709 12:14:37.558705 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:37.560925 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.562081 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.564229 10128 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:37.563375 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.554793 11639 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.554996 11663 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.566882 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.567674 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.568403 10195 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:37.566226 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.570798 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.556380 11738 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.565224 11637 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:37.579255 11810 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:14:37.557798 11763 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.560406 11785 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.579548 11655 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:37.579725 10053 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:37.581313 11635 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.582640 11738 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.580914 11663 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:37.593389 11782 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.766s	user 0.002s	sys 0.004s
I20260709 12:14:37.584555 11815 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:37.596629 11691 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.598685 11763 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.619858 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:37.644030 10198 raft_consensus.cc:606] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:37.644487 10198 raft_consensus.cc:614] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:37.550581 11455 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:14:37.580740 11744 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.627898 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:37.636489 11756 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.006s
W20260709 12:14:37.628538 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70017.6us
I20260709 12:14:37.635763 10195 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:37.665943 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:37.640779 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.584698 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.632923 11677 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:37.650889 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.672225 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 87604.2us
I20260709 12:14:37.695468 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.704803 10094 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.723779 10196 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:37.724045 11637 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.725697 10196 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:37.726135 11660 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:37.727280 10196 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:37.727715 10196 pending_rounds.cc:85] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:37.728035 11455 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.728132 10196 pending_rounds.cc:107] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:37.728551 10196 raft_consensus.cc:2889] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.728825 11455 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:37.730180 11738 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:37.731259 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.727779 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.730158 10196 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:37.734764 10196 pending_rounds.cc:85] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:37.735073 10196 pending_rounds.cc:107] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:37.735390 10196 raft_consensus.cc:2889] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.735621 11637 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:37.736893 10196 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.734911 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:37.731048 11819 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:37.735303 10198 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.740275 11637 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.741034 11654 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:37.741444 11654 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:37.730979 11455 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:14:37.716348 11744 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:37.719139 11655 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:37.743201 11455 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:37.717092 10197 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:37.744912 10198 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:37.743263 11763 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:37.745340 11605 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.745836 10197 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:37.742408 11654 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.723985 11639 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.746896 11654 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.669651 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.741523 10051 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.748483 11639 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.673840 11794 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:37.748649 11629 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.731032 11738 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:37.749737 11738 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:37.751222 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.741439 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.752279 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:37.752941 10734 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:37.752472 10198 pending_rounds.cc:85] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:37.753008 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.753443 10198 pending_rounds.cc:107] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:37.753752 10198 raft_consensus.cc:2889] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.753619 11639 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:37.754756 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.750600 11738 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.755715 11682 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:37.756469 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.756579 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.756858 10123 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.757577 10121 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.756008 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.758637 10122 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:37.760787 10055 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:37.753849 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.761722 10731 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.762841 10736 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:37.755955 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.763437 11682 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.765439 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.765744 11682 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:37.768069 10732 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.768249 10121 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:37.768746 11769 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:37.769136 11769 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.768900 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:37.770022 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:37.769951 11769 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.771132 11769 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.771432 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.772006 10198 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:37.772921 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.773907 10198 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:37.775117 10198 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:14:37.775413 10198 pending_rounds.cc:85] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:14:37.775610 10198 pending_rounds.cc:107] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:37.775813 10198 raft_consensus.cc:2889] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.776654 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.750664 11629 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:37.777758 10200 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:37.778396 10198 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.781199 10731 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:37.786329 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:37.787264 11763 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.787658 11763 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.747133 10197 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:37.787990 11763 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.796185 11639 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:37.797165 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44228.7us
W20260709 12:14:37.798146 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.799172 10046 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:37.800668  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:37.803035  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:37.804057  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:37.804946 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.807714 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:37.816129 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 43613.8us
I20260709 12:14:37.817569 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.636034 11785 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.822932 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.826833 10048 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.824753 11806 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:14:37.832708 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.833861 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:37.822722 11433 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.834578 10124 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.847229 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.848855 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.850243 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:14:37.853368 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.853924 10129 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:37.837747 10125 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:37.860407 10124 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:37.867641 10048 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:37.864509 10203 raft_consensus.cc:2376] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3. Re-sending same reply.
I20260709 12:14:37.834532 11455 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:37.873003 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.872972 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:37.861629 11501 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.861436 11737 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:37.826264 11756 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:14:37.863430 11651 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.834172 11763 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.884208 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.870597 11728 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.845783 11735 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:14:37.892408 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.880035 11732 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:37.896916 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.870309 11551 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:14:37.884514 11594 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.900732 10129 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:37.871984 11757 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:14:37.904431 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 239596us
I20260709 12:14:37.900383 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.905875 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.906229 10129 pending_rounds.cc:85] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 2
I20260709 12:14:37.910663 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:37.912387 10129 pending_rounds.cc:107] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:37.912585 10735 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:37.912694 10129 raft_consensus.cc:2889] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:37.914791 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.915036 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:37.915926 10200 raft_consensus.cc:2368] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.915009 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.877395 11455 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.905524 10201 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:37.904659 10121 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.900107 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.924850 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:37.891707 11737 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:37.899495 11732 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.903937 11664 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.919271 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:37.933538 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.917824 11594 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:37.921918 11747 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.924640 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:37.936146 10731 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:37.947628 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.946321 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:37.949272 10048 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:37.934938 11732 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.937723 11628 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.957823 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:37.950923 11814 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:37.944597 11825 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:37.969983 11824 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:14:37.970937 11824 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:37.971249 11824 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:37.971630 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.971908 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:37.972002 11824 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.972369 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:37.973115 10121 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:37.973251 11824 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.975114 10048 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:37.968847 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:37.957540 11806 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:37.977128 11806 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:37.953874 11762 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:37.966670 11826 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:37.978973 10055 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:37.972447 10049 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:37.978168 11762 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.940032 11664 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.992533 10049 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:37.990693 11785 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:37.987776 11806 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:37.966157 11788 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:37.986150 10094 leader_election.cc:400] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:37.998953 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:37.985642 11821 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:14:38.045800 10204 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:38.046765 10129 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:38.047418 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48670.8us
I20260709 12:14:38.048789 10094 leader_election.cc:400] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.049620 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.050295 11629 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:38.050628 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.050895 11629 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.052603 10129 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:38.052981 10130 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.039407 10730 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:37.997685 11664 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.060973 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.053030 11655 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:38.062345 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:38.061777 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 89614.7us
I20260709 12:14:38.065275 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:38.067222 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:38.059890 11763 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.076604 10094 leader_election.cc:400] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.065860 11744 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:38.085233 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:38.087244 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.088840 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.067896 11691 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:38.097328 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.068799 11826 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:38.058256 11594 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.066779 11735 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:38.093863 11639 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:38.144484 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47243.4us
I20260709 12:14:38.096109 11551 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:38.100610 11654 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:38.148015 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 43881.2us
I20260709 12:14:38.094550 11785 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.145361 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.149590 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.100095 11826 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:38.102000 11677 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:14:38.150897 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:38.102769 11691 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:38.154187 10734 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:38.104334 11655 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:38.152990 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.105859 11651 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:38.143584 11728 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.162302 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:38.152067 11756 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:38.154641 11826 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.100821 11757 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 12:14:38.159111 11828 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:14:38.155092 11703 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.148512 11639 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.161391 11551 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:38.181110 11735 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.181704 11735 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.183971 11735 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.184497 11735 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:38.184944 11735 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.187101 11735 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.187811 11735 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:38.193356 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:38.195056 11840 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:14:38.195812 11835 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:14:38.154407 11785 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.151516 11654 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:38.198477 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45555.5us
I20260709 12:14:38.165189 11663 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:38.200827 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.196182 11651 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:38.201035 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.161458 11728 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:38.197866 11836 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:14:38.205804 11843 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:14:38.199649 11551 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:38.206736 11839 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:14:38.198457 10728 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:38.207088 11551 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:38.200522 11451 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:38.211738 11451 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.212080 11451 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.212674 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:38.195672 11691 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.202720 11651 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.213245 10200 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.213171 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.202318 11849 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:14:38.216933 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.208048 11757 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:38.214547 11651 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.221799 11639 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.204432 11655 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:38.220050 11781 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.216671 11815 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.221215 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1021) took 1240 ms. Trace:
I20260709 12:14:38.242271 10128 rpcz_store.cc:276] 0709 12:14:36.980301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.007470 (+ 27169us) service_pool.cc:224] Handling call
0709 12:14:38.221003 (+1213533us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b5400409054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:38.221131 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278329216}
I20260709 12:14:38.243465 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.226361 11777 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.208985 11703 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:14:38.245117 11777 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.245461 11850 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:38.245822 11850 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:38.246193 11850 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.245925 11777 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.246523 11629 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:38.227989 11785 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.234740 11655 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:38.225647 11762 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.225510 11747 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.247660 11420 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.226697 11728 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.246523 11826 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.248543 11777 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.250293 11826 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.222770 11847 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:14:38.247601 11655 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.232087 11726 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.244311 11757 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.250741 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.252744 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.248594 11420 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:38.252727 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.253831 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.241568 11639 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.251995 11757 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:38.257498 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 95289.8us
I20260709 12:14:38.259862 10054 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:38.260509 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.262274 10053 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:38.218392 11654 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.233345 11651 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:38.264453 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.271521 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.276211 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:38.280439 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.281173 10200 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:38.282997 10200 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:38.283361 10200 pending_rounds.cc:85] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:38.283581 10200 pending_rounds.cc:107] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:38.283802 10200 raft_consensus.cc:2889] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.242039 11781 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:38.257723 11728 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.288285 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.288527 11501 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.242296 10197 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:38.263154 11605 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:38.276348 11785 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:38.292515 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:38.298545 11781 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.299943 11781 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.300426 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 946) took 1186 ms. Trace:
I20260709 12:14:38.295351 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:38.301324 10733 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:38.285280 11756 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.301426 10129 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.284802 11663 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:38.263135 11726 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:14:38.300822 10201 rpcz_store.cc:276] 0709 12:14:37.113503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.118037 (+  4534us) service_pool.cc:224] Handling call
0709 12:14:37.127003 (+  8966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.928360 (+801357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.300130 (+371770us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54000622d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:38.300337 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747432192}
I20260709 12:14:38.305442 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.303277 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.287494 11551 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.258165 11639 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.288703 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.289386 11654 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:38.288964 11501 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.257608 11815 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.293285 10200 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:38.292721 11605 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.292212 10122 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:38.257789 11732 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.284806 11433 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:38.315511 11850 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.294533 11753 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:14:38.307359 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.316165 11654 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.309974 11728 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:38.327605 11785 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:38.342032 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.331288 11605 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.308355 11756 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.344117 10053 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:38.348242 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76799.1us
I20260709 12:14:38.324434 11451 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.343457 11785 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.339505 11744 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:38.344612 11849 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.328455 11703 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:14:38.318136 11551 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.342413 11728 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.356237 11728 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.343914 10201 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:38.342159 11654 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.351289 10197 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:38.353600 11785 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.366346 11703 consensus_queue.cc:1243] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:38.387933 11732 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.388300 11851 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.389014 11639 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.389252 11728 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.390856 11551 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.394541 11451 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.375401 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 530) took 1271 ms. Trace:
I20260709 12:14:38.366827 11849 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.406773 10730 rpcz_store.cc:276] 0709 12:14:37.103512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.106806 (+  3294us) service_pool.cc:224] Handling call
0709 12:14:37.350024 (+243218us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:37.350237 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:38.059309 (+709072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.355557 (+296248us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003cd054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:38.374026 (+ 18469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412936320}
I20260709 12:14:38.403352 11703 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 12:14:38.401669 11829 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 12:14:38.415755 10129 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:38.403079 11851 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.470172 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:38.471009 10055 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:38.438889 11851 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.438117 11856 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:38.474890 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.475667 11677 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.442579 11605 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:38.475131 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:38.474440 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:38.479261 10055 raft_consensus.cc:2368] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.442263 11738 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.486445 10200 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:38.487425 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.500121 10047 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:38.460606 11451 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:38.506078 10125 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:14:38.509858 10047 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.506783 10127 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:38.509114 10052 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:38.511893 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.444566 11815 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.477059 11850 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.467995 11655 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.475400 11856 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.484961 11677 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:38.485704 10126 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:38.511971 11433 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.531719 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.537709 10047 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:38.508263 10121 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:38.436574 11865 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:14:38.503860 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.534355 10052 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:38.514358 11605 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.502688 11781 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:38.519341 11635 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:38.518965 11867 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.479305 11756 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.533098 10053 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:38.513932 11451 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.539088 11663 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:38.566011 10127 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:38.552021 11635 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:38.559376 11379 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:38.541057 11433 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.565433 11728 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.560973 11867 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:38.593983 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.597252 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 117751us
I20260709 12:14:38.603075 10095 leader_election.cc:400] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.603406 10095 leader_election.cc:403] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.594036 11849 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.583678 11379 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.609022 11870 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:38.618221 11870 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:38.618775 11812 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.154s	user 0.000s	sys 0.005s
I20260709 12:14:38.599243 11663 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.620805 11870 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.622521 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.624152 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.624457 11677 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.625056 11677 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:38.625624 11677 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:38.627288 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:38.627475 11856 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.628016 10202 raft_consensus.cc:2368] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.629201 10202 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:38.629491 11655 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.624778 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.631124 11735 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:38.631613 11735 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:38.631819 11379 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.632315 11785 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:38.633874 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.634771 11867 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.635311 11879 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.635677 11879 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:38.636088 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.636528 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.636994 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.513499 11664 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:38.601282 11635 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.632391 11735 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.611964 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 238) took 1590 ms. Trace:
I20260709 12:14:38.636449 11879 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.652050 11654 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.615929 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.645455 10094 leader_election.cc:400] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.649292 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:38.650746 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.651247 10199 rpcz_store.cc:276] 0709 12:14:37.021231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.021394 (+   163us) service_pool.cc:224] Handling call
0709 12:14:37.021697 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.109629 (+ 87932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.109663 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.134353 (+ 24690us) log.cc:844] Serialized 26 byte log entry
0709 12:14:38.327213 (+1192860us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18002f2240. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:14:38.516008 (+188795us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:38.516051 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.516121 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.611664 (+ 95543us) raft_consensus.cc:1685] finished
0709 12:14:38.611683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.611896 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102430,"raft.queue_time_us":80972,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15196,"spinlock_wait_cycles":31937408,"thread_start_us":188585,"threads_started":1,"wal-append.queue_time_us":1427246}
I20260709 12:14:38.649761 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.654866 10094 leader_election.cc:400] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.629113 11737 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.650146 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.661273 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.655058 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:38.608510 11781 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.650820 11635 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.669735 10202 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
W20260709 12:14:38.673998 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 73133.2us
I20260709 12:14:38.651438 11451 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:38.672359 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.677817 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.662418 10094 leader_election.cc:403] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.674645 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:38.675531 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:38.671065 10733 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:38.680212 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:38.680783 10199 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.681381 10202 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.663093 11420 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:38.666623 10732 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.671875 11728 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:14:38.665982 11879 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.667912 10196 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:38.662984 11691 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:14:38.667228 11433 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.693778 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:38.672426 11777 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:38.692762 11827 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.735s	user 0.000s	sys 0.003s
I20260709 12:14:38.679296 11379 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:38.662014 11867 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:14:38.727908 11881 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:38.665093 11763 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:38.715559 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:38.715706 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:38.667902 11757 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:14:38.692562 11629 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.662004 11871 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:14:38.685837 11756 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:38.718231 11379 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.692515 11785 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.691439 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.696754 11655 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.698061 11850 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.700886 11651 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:38.752578 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:38.680442 11826 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:14:38.739001 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:38.738174 11379 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.740175 11849 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.742606 11628 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:38.743741 11841 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:38.717965 10730 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:38.698863 11420 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.746659 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:38.742645 11852 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:38.731189 11738 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:38.737455 11756 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.691015 11880 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:14:38.751606 11882 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:14:38.729990 11825 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:38.738283 10199 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:38.767516 10049 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:38.752391 11651 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.755024  9951 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 2 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.792218 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.792855 10127 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:38.779891 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:38.781699 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:38.782114 11757 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:38.730909 11781 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:14:38.786221 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.772846 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:38.839043 10125 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:38.768914 11747 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:38.791779 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:38.844228 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52533.7us
I20260709 12:14:38.776571 11628 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.755807 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:38.774098 11856 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:38.793191  9951 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 3, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 3 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.755463 11850 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.780737 11654 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:38.791610 11852 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:38.789724 11703 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:14:38.836863 10127 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:14:38.869225 10127 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 4
I20260709 12:14:38.869572 10127 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:14:38.869980 10127 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.785503 11738 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.788651 11756 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.785032 11777 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:14:38.685168 11854 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:14:38.875509 10729 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:38.789398 11824 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:14:38.848394 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 949) took 1734 ms. Trace:
I20260709 12:14:38.876578 10195 rpcz_store.cc:276] 0709 12:14:37.114393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.665939 (+551546us) service_pool.cc:224] Handling call
0709 12:14:37.666226 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.722615 (+ 56389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.722646 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.723373 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.873089 (+149716us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:37.873148 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.873234 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.692176 (+818942us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:38.839911 (+147735us) raft_consensus.cc:1685] finished
0709 12:14:38.839934 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.848328 (+  8394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45433,"raft.queue_time_us":54338,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":10728192,"thread_start_us":149089,"threads_started":1,"wal-append.queue_time_us":202676}
I20260709 12:14:38.791610 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:38.755947 11655 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:38.879254 11878 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.202s	user 0.000s	sys 0.003s
I20260709 12:14:38.880731 11655 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.881325 11655 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.881986 11655 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:38.837075 10126 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.776968 11677 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:14:38.836196 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:38.882927 10121 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:38.869488  9951 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:38.884415  9951 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:38.885751  9951 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:14:38.886960 10195 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:38.870920 11420 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.850926 10196 raft_consensus.cc:2393] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:38.887259  9951 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 3 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.851205 11732 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:38.889554  9951 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 3 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.851385 11628 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.851506 11728 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:38.893791  9951 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 4 to 5, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:38.868098 10050 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:14:38.895839 10198 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:38.887032 11738 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:38.892292 11747 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.915341 10050 pending_rounds.cc:85] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:14:38.921590 11744 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:38.892777 11732 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.915555 11728 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:38.882378 11651 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.929638 11728 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.930823 11651 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.920733 11747 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:38.922034 10050 pending_rounds.cc:107] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:38.925583 11744 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:38.942667 11852 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.944274 11850 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.946525 11880 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.947074 11880 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.949079 11880 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:38.949359 11629 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:38.942836 11744 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:38.949786 11732 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.935257 11747 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.951058 11732 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.951329 11747 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:38.937225 10050 raft_consensus.cc:2889] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:38.954268 11379 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:38.955168 10732 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:38.957366 11379 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.001222 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:38.976876 10196 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:39.036530 11880 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:39.036986 11880 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.037312 11880 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.038722 11879 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.039098 11628 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.039309 11879 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.041301 11628 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.041492 11879 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:38.969717 11738 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.043747 11738 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:39.017441 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.048251 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.049386 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.050009 10196 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.056303 10126 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:39.041989 11501 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.057569 11501 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.058073 11756 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.072337 11756 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.042091 11879 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.074295 11879 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.076838 11879 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.078212 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.081001 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.081765 10202 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:39.082939 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.088706 11771 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.089460 11771 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.114253 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1442) took 1636 ms. Trace:
I20260709 12:14:39.114727 10203 rpcz_store.cc:276] 0709 12:14:37.478154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.562911 (+ 84757us) service_pool.cc:224] Handling call
0709 12:14:39.114027 (+1551116us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400103bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:39.114177 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683068672}
I20260709 12:14:39.096652 11771 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.116681 11879 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:39.130962 11882 consensus_queue.cc:1243] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:39.128393 11879 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.138615 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:39.141485 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.120720 11880 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:39.142110 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:39.142721 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:39.145411 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:39.147119 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:39.150036 11882 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.143375 11879 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.143287 10196 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:39.162513 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:39.164319 11882 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.154440 11898 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.174773 11738 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.175343 11738 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.177405 11738 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:39.181025 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.181564 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.181717 10199 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.151880 11814 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:14:39.185406 10736 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:39.188771 10199 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:14:39.189996 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.190651 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.192962 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.193898 10124 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:39.194257 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.194692 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.195231 10055 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:39.196123 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.196650 10055 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:39.197826 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.198628 10046 raft_consensus.cc:2410] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:39.194845 10130 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:39.199067 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.199715 10047 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:39.175885 11880 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.202180 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:39.202826 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 408555us
I20260709 12:14:39.192777 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.203080 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.208209 10047 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:39.204351 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:39.208667 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.209232 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.209908 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.210784 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.211890 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.184113 11882 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:39.214269 11420 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:39.214706 11420 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.214310 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.215376 10128 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:39.215612 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:39.216270 11771 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:39.216895 11771 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:39.217247 11771 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.217569 11771 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.223199 11501 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:39.223901 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.224218 11420 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.180817 11738 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:39.225548 11738 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.227607 11738 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.228217 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.229419 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.230208 10127 raft_consensus.cc:2410] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:39.232050 10049 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:14:39.232415 10049 pending_rounds.cc:85] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:14:39.232729 10049 pending_rounds.cc:107] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:39.232957 10049 raft_consensus.cc:2889] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.232383 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.234122 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.210227 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:39.237178 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:39.239802 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:39.240401 10046 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.241519 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.223181 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.245253 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.256949 10047 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:39.258085 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:39.261400 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71493.3us
I20260709 12:14:39.258697 10124 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:39.260063 10047 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:39.241603 11728 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:39.284898 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.288045 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 80493.5us
I20260709 12:14:39.289776 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.256884 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.263641 11756 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.317091 10046 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:39.312644 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:39.267670 11882 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:39.320874 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:39.324625 10130 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:39.325672 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:39.326226 10130 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.329825 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:39.267632 11894 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:39.342085 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:39.342732 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:39.344075 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:39.292729 11455 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.347756 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:39.350754 10126 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:39.351711 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.352365 10126 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:39.351049 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.346128 11732 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:39.354799 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.354977 11732 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.355525 10050 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:39.337222 11866 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:39.356158 11866 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.356489 11866 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.356518 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.357177 11732 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.306843 11814 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:39.332615 11664 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.337491 11654 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:39.359364 11874 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:39.333122 11756 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.369784 11893 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.366974 11654 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:39.306632 11728 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:39.332468 11635 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:39.301014 11663 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:14:39.394971 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.373965 11882 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.370797 11874 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.388757 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:39.377758 11732 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.390965 11654 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.362949 11455 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:39.367110 11664 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.403954 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.405174 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.410110 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.410645 10202 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.364692 11814 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.409209 10200 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:39.417855 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.418375 10200 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.354719 10130 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:39.420714 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.397774 11635 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.423425 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.424492 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.425051 10195 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:39.359270 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:39.397233 11738 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.397416 11874 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.426827 10046 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.427699 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:39.430747 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:39.441089 10202 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
W20260709 12:14:39.449061 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.431717 11738 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.451393 11871 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.451500 11806 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.401201 11420 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.451692 11660 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:39.400058 10051 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:39.458369 10200 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
W20260709 12:14:39.487462 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.490439 10198 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:39.490991 10127 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:39.517349 10127 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:39.516655 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.521972 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.522516 10198 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:39.432262 11852 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.409154 11732 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.526485 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.527652 10204 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.452389 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.479562 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.453354 11892 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:39.481258 11757 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.516655 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:39.536460 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.465343 11660 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:39.476197 10732 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:39.541196 10196 raft_consensus.cc:2376] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5. Re-sending same reply.
I20260709 12:14:39.474546 11747 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:39.552788 11747 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:39.553208 11747 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.554865 11852 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.555400 11852 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.557389 11852 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.462555 11814 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.523373 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.465641 11420 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.460865 11744 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.460788 11738 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.476981 11756 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.461352 11806 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.565271 10200 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:39.542276 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:39.507871 11871 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.543557 10122 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:39.465854 11879 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.475530 11635 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.523900 11769 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:39.545174 11663 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.476727 11664 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.485669 11841 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:14:39.547724 11771 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.550094 11732 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.540803 11892 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.559717 10198 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:39.525532 10127 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.553247 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:39.690577 10128 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.516321 11866 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.540388 10124 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.496973 10046 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:39.559590 11660 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.466058 11728 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.692055 10130 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:39.700670 11629 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.701313 11629 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.703140 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:39.599740 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 251382us
I20260709 12:14:39.703951 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.707093 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.703451 11629 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.711409 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:39.712248 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:39.737833 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 129645us
I20260709 12:14:39.558950 11757 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.764434 11629 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:39.589066 11756 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:39.772830 10124 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:39.768857 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:39.781225 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74211.6us
I20260709 12:14:39.781916 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.803732 10200 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:39.804342 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.775321 10048 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:39.689719 11895 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.818140 11895 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.818991 11738 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:39.819592 11738 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.820402 11895 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.821170 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:39.821683 11866 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:39.822172 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:39.822257 11703 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.822881 11703 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.823491 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:39.805972 10198 raft_consensus.cc:2410] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:39.712189 11781 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.824919 11703 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.825227 10198 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.825659 11757 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.822268 11866 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.800132 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:39.828500 11866 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:39.828871 11866 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.829157 11866 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.766084 10122 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:39.832021 11747 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.845702 11866 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.848044 11806 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.851953 11866 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:39.855012 11866 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:39.857582 11654 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.859581 11871 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:39.860260 11871 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:39.860687 11871 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.860296 11654 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:39.823904 11879 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.872047 10128 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:39.834213 11747 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.712385 11664 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:39.690752 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.599849 11663 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:39.871318 11756 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.765100 11660 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.886705 10046 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:39.861034 11871 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:39.774519 11851 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:39.888692 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.775483 11732 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:39.849924 11771 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:39.878592 11896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.014s	sys 0.043s
I20260709 12:14:39.712863 11501 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 12:14:39.821578 11738 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:39.878504 11629 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.893477 10196 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:39.689738 11651 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.194s
I20260709 12:14:39.895915 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:39.923354 10046 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.895929 10200 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:39.886893 11895 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:39.827775 11874 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.880234 10204 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:39.901902 11896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.044s
I20260709 12:14:39.895287 11756 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:39.928175 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:39.935637 10701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.033s	sys 0.017s
W20260709 12:14:39.935993 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 464879us
W20260709 12:14:39.950944 10050 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.036s	sys 0.049s
I20260709 12:14:39.902971 11771 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.950079 10701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.034s	sys 0.017s
W20260709 12:14:39.952436 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 521722us
W20260709 12:14:39.957422 10047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.006s	sys 0.023s
W20260709 12:14:39.957813 10047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.023s
I20260709 12:14:39.951655 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:14:39.951508 10050 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.037s	sys 0.049s
I20260709 12:14:39.981097 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.988600 10200 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:39.950606 10121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.010s
W20260709 12:14:39.993093 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.090505 10199 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:40.091606 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.093151 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.088626 10204 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:40.094794 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.095409 10204 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:40.096278 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.899012 11732 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.948474 11703 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:39.950052 11894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.009s	sys 0.041s
I20260709 12:14:40.097404 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:39.948334 10122 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:40.114751 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.115525 10047 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:40.117345 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.120545 10736 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:40.124795 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:39.922410 11629 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.088660 11814 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:40.098017 11852 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:40.108661 11894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.009s	sys 0.042s
W20260709 12:14:40.098513 10201 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.013s	sys 0.021s
I20260709 12:14:39.951915 11851 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:40.089499 10121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.012s	sys 0.011s
I20260709 12:14:40.103226 11703 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:40.089253 11771 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:39.951529 11895 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.240406 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:40.183845 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.013s
W20260709 12:14:40.183671 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.146816 11911 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:14:40.357071 11874 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.145643 11894 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:40.360558 11896 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.361017 11896 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.361403 11894 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:40.266381 10197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.019s	sys 0.045s
I20260709 12:14:40.266224 10204 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:40.157407 10200 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:40.367867 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.364652 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.369091 10204 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:40.145920 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.009s	sys 0.046s
W20260709 12:14:40.371135 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.009s	sys 0.046s
W20260709 12:14:40.371543 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 1.02569e+06us
W20260709 12:14:40.196983 10055 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.003s	sys 0.018s
W20260709 12:14:40.372634 10055 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.012s	sys 0.019s
I20260709 12:14:40.351408 10733 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:40.234211 10054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.016s	sys 0.029s
W20260709 12:14:40.373293 10054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.019s	sys 0.030s
W20260709 12:14:40.146440 10201 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.013s	sys 0.022s
I20260709 12:14:40.233891 10736 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEARNER]: Advancing to term 6
W20260709 12:14:40.225577 11850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.015s	sys 0.024s
I20260709 12:14:40.241879 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:40.377424 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 135599us
I20260709 12:14:40.378335 10204 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:40.267526 11919 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:40.184114 10051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.033s
W20260709 12:14:40.164713 11744 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 12:14:40.160869 11559 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:40.171129 11660 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:40.358235 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.012s	sys 0.022s
I20260709 12:14:40.373992 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1777) took 1113 ms. Trace:
I20260709 12:14:40.370546 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.143981 11852 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.307253  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.171998 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.300305 11651 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.245529 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.256435 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:40.246043 11856 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:40.291210 11663 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:40.271807 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:40.272343 11629 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:40.300392 11757 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:40.379871 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:40.113917 10046 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:40.378892 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:40.388366 11559 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:40.374146 10197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.021s	sys 0.047s
I20260709 12:14:40.382936 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.408747 11744 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:40.386476 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1043) took 1086 ms. Trace:
I20260709 12:14:40.159533 10732 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:40.389410 10047 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:40.146021 11814 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.375208 11732 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.377192 11847 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:40.396157 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:40.384416 10051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.012s	sys 0.041s
I20260709 12:14:40.380971 11893 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:40.411132 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.022s
I20260709 12:14:40.383744 11896 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:40.412134 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 255) took 1007 ms. Trace:
I20260709 12:14:40.267621 11924 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:40.405920 11824 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:40.387308 10054 rpcz_store.cc:276] 0709 12:14:39.260331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.261392 (+  1061us) service_pool.cc:224] Handling call
0709 12:14:39.261654 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.261825 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:39.600710 (+338885us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.373662 (+772952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.373715 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:40.373756 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.373816 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.373938 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":694489,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":737,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":101,"thread_start_us":1094011,"threads_started":2,"wal-append.queue_time_us":776070}
W20260709 12:14:40.417114 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 324012us
I20260709 12:14:40.417024 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1781) took 1105 ms. Trace:
W20260709 12:14:40.377126 11850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.017s	sys 0.024s
I20260709 12:14:40.390895 11874 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.406131 10729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 299) took 2639 ms (client timeout 2204 ms). Trace:
I20260709 12:14:40.406445 11728 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.388689 11879 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.409047 11856 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:40.441839 10736 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:40.411218 11852 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.410087 10730 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
W20260709 12:14:40.437086 11420 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.017s
I20260709 12:14:40.413152 10122 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:40.423418 11629 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:40.423208 11660 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:40.451867 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.451064 10195 rpcz_store.cc:276] 0709 12:14:39.404776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.432175 (+ 27399us) service_pool.cc:224] Handling call
0709 12:14:39.432488 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.432705 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:39.924547 (+491842us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.410844 (+486297us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.411802 (+   958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.411851 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:40.411893 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.411968 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.412081 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":841662,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":1288,"raft.queue_time_us":1270,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3532,"spinlock_wait_cycles":19900672,"thread_start_us":921886,"threads_started":2}
I20260709 12:14:40.384161 11919 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:40.450409 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.022s
W20260709 12:14:40.456828 10020 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.011s	sys 0.020s
W20260709 12:14:40.507009 10020 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.011s	sys 0.020s
W20260709 12:14:40.507318 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 949038us
W20260709 12:14:40.506372 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 126587us
I20260709 12:14:40.503998 10127 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.438751 11744 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.408324 11913 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:14:40.513811 10054 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:14:40.506806 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 683322us
W20260709 12:14:40.489457 11420 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.017s
I20260709 12:14:40.413501 11851 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.410532 11651 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.459137 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.458006 11824 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.441416 11892 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:40.463375 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:40.523036 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.459332 10050 rpcz_store.cc:276] 0709 12:14:39.311247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.357476 (+ 46229us) service_pool.cc:224] Handling call
0709 12:14:39.357756 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.357947 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:39.983085 (+625138us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.416700 (+433615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.416752 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:40.416795 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.416859 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.416972 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":778435,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":28590,"raft.run_wall_time_us":13031,"thread_start_us":1058122,"threads_started":2}
I20260709 12:14:40.438091 11757 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.458262 11635 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:40.458043 11924 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.458215 11847 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:40.504142 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1046) took 1196 ms. Trace:
I20260709 12:14:40.530947 10130 rpcz_store.cc:276] 0709 12:14:39.307512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.420414 (+112902us) service_pool.cc:224] Handling call
0709 12:14:39.420686 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.692490 (+271804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.503882 (+811392us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400243e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:40.504073 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623637888}
I20260709 12:14:40.415388 10123 raft_consensus.cc:2376] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4. Re-sending same reply.
I20260709 12:14:40.515122 10054 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:40.536201 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:40.382542 11703 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.515350 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:40.516707 10195 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:40.458274 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 256) took 1050 ms. Trace:
I20260709 12:14:40.537818 10202 rpcz_store.cc:276] 0709 12:14:39.407789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.445462 (+ 37673us) service_pool.cc:224] Handling call
0709 12:14:40.311746 (+866284us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:40.311974 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.312181 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:40.356924 (+ 44743us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.457944 (+101020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.458003 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:40.458042 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.458102 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.458222 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61759,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":32334,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":23017,"spinlock_wait_cycles":15482624,"thread_start_us":100650,"threads_started":1}
I20260709 12:14:40.524147 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.525219 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.541079 10047 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:40.527004 11824 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.527050 10052 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:40.492183 11629 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:40.530150 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 71127.6us
I20260709 12:14:40.550794 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:40.466192 11874 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.552356 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.518950 11744 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.521390 11771 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:40.465291 10729 rpcz_store.cc:269] 0709 12:14:37.767099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.776421 (+  9322us) service_pool.cc:224] Handling call
0709 12:14:40.405919 (+2629498us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:40.406041 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072652544}
I20260709 12:14:40.531973 11924 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.490079 11879 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.489972 11728 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.553102 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1464) took 1784 ms. Trace:
I20260709 12:14:40.575927 10052 rpcz_store.cc:276] 0709 12:14:38.768641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.768957 (+   316us) service_pool.cc:224] Handling call
0709 12:14:40.526710 (+1757753us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:40.526887 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.552862 (+ 25975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.553051 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12130560}
I20260709 12:14:40.553059 10047 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:40.526105 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 181) took 1014 ms. Trace:
I20260709 12:14:40.544411 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 253) took 1140 ms. Trace:
I20260709 12:14:40.552762 11629 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.493332 11559 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.540825 11850 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.559913 10127 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:14:40.560384 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:40.572225 11931 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:14:40.584820 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.587687 10127 pending_rounds.cc:85] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 4
I20260709 12:14:40.544925 11738 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:40.591619 11937 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:14:40.592221 11939 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:40.556320 11914 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:40.595351 10127 pending_rounds.cc:107] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 12:14:40.582516 10196 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 12:14:40.573729 11913 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.589846 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.534210 11856 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:40.546089 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1030) took 2065 ms (client timeout 2065 ms). Trace:
I20260709 12:14:40.442387 10121 rpcz_store.cc:276] 0709 12:14:39.300116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.301060 (+   944us) service_pool.cc:224] Handling call
0709 12:14:39.366723 (+ 65663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.376830 (+ 10107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.384740 (+  7910us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.385327 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.364165 (+978838us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:40.375254 (+ 11089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.380994 (+  5740us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.381994 (+  1000us) raft_consensus.cc:1685] finished
0709 12:14:40.384258 (+  2264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.386393 (+  2135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107038,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":966688,"threads_started":1,"wal-append.queue_time_us":886606}
I20260709 12:14:40.594066 11896 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.618058 11871 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.000s
I20260709 12:14:40.603238 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:40.604064 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:40.578675 10732 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:40.604168 11651 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:40.597482 11892 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:40.606585 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 180) took 1169 ms. Trace:
I20260709 12:14:40.611080 10127 raft_consensus.cc:2889] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.594890 11847 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.577083 11825 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.614476 11930 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:14:40.618309 11904 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.796s	user 0.006s	sys 0.004s
I20260709 12:14:40.621707 11728 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.607476 11942 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:40.726923 10052 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:40.723563 11756 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.003s
I20260709 12:14:40.598750 11941 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:40.725854 11771 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:40.748226 10052 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:40.748452 11771 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:40.749233 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.749347 11771 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.749859 10052 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:40.750811 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:40.750934 11874 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:40.751756 11949 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:14:40.598047 11850 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.621763 11951 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.619514 11918 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.615350 10196 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:40.736093 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1047) took 1428 ms. Trace:
I20260709 12:14:40.618783 11738 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:40.687798 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 248) took 1284 ms. Trace:
I20260709 12:14:40.735764 10124 rpcz_store.cc:276] 0709 12:14:39.436737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.806922 (+370185us) service_pool.cc:224] Handling call
0709 12:14:39.807289 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.873818 (+ 66529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.873848 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.887575 (+ 13727us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.389027 (+501452us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:40.505624 (+116597us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.519199 (+ 13575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.519287 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.606343 (+ 87056us) raft_consensus.cc:1685] finished
0709 12:14:40.606368 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.606524 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72408,"prepare.queue_time_us":192049,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":86343,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":11523,"thread_start_us":582320,"threads_started":2,"wal-append.queue_time_us":567291}
I20260709 12:14:40.625772 11660 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:40.767887 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:40.707311 11871 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:40.742775 11677 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:40.742908 11728 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:40.744437 11945 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.629684 11814 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:40.729038 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 178305us
I20260709 12:14:40.733284 11896 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.747944 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1042) took 1975 ms. Trace:
I20260709 12:14:40.752209 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:40.735498 11937 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:14:40.753819 10095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.672s (SENT) [suppressed 17 similar messages]
I20260709 12:14:40.730212 11856 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:40.687111 11952 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.652406 11914 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:40.756063 10127 rpcz_store.cc:276] 0709 12:14:39.307732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.424208 (+116476us) service_pool.cc:224] Handling call
0709 12:14:39.490873 (+ 66665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.503576 (+1012703us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b58007403d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4
0709 12:14:40.735851 (+232275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.736041 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109378944}
I20260709 12:14:40.758147 10054 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:40.797220 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.797967 10736 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:40.757937 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1044) took 1457 ms. Trace:
I20260709 12:14:40.741694 11942 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:40.624624 10123 rpcz_store.cc:269] 0709 12:14:38.477149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.478935 (+  1786us) service_pool.cc:224] Handling call
0709 12:14:40.271668 (+1792733us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:40.542265 (+270597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7717632}
I20260709 12:14:40.765290 10199 rpcz_store.cc:276] 0709 12:14:39.402997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.404886 (+  1889us) service_pool.cc:224] Handling call
0709 12:14:39.426864 (+ 21978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.092073 (+665209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.687502 (+595429us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540003c5d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:40.687727 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524026240}
I20260709 12:14:40.758342 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:40.739434 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.806998 10050 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:40.771400 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.622885 11913 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.758301 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:40.762042 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 976) took 1187 ms. Trace:
I20260709 12:14:40.784672 10200 raft_consensus.cc:2368] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5.
I20260709 12:14:40.780040 11757 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.747560 11892 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.826588 11879 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:40.828015 11957 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:14:40.828092 11892 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.836215 11924 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.837631 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1772) took 1645 ms. Trace:
I20260709 12:14:40.838973 11914 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.842118 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.842989 10204 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:40.785455 10052 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:40.768111 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 179) took 1252 ms. Trace:
I20260709 12:14:40.758632 11951 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.785128 10129 rpcz_store.cc:276] 0709 12:14:38.772981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.839467 (+ 66486us) service_pool.cc:224] Handling call
0709 12:14:38.839735 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.125812 (+286077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.125841 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.128820 (+  2979us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.443879 (+315059us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:39.443922 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.444010 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.617753 (+1173743us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:40.746319 (+128566us) raft_consensus.cc:1685] finished
0709 12:14:40.746339 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.747879 (+  1540us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65682,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3398,"spinlock_wait_cycles":37331840,"thread_start_us":555630,"threads_started":2,"wal-append.queue_time_us":435737}
I20260709 12:14:40.732540 11825 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.787501 11871 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.789211 11896 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:40.804617 11894 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:40.803941 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.867201 10736 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:40.867545 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.806903 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:40.768522 10124 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:40.746999 11756 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:40.807981 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 68670.7us
I20260709 12:14:40.871622 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:40.807432 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.813515 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:40.813747 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.813381 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.811398 10196 rpcz_store.cc:276] 0709 12:14:39.574776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.585080 (+ 10304us) service_pool.cc:224] Handling call
0709 12:14:40.758047 (+1172967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:40.814584 10121 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.887001 11849 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:40.870949 11894 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.889709 11851 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:40.813417 11660 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.803368 10126 rpcz_store.cc:276] 0709 12:14:39.300518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.353004 (+ 52486us) service_pool.cc:224] Handling call
0709 12:14:39.353335 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.802849 (+449514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.879474 (+ 76625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.901586 (+ 22112us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.442814 (+541228us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:40.444672 (+  1858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.460156 (+ 15484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.752934 (+292778us) raft_consensus.cc:1685] finished
0709 12:14:40.754544 (+  1610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.757870 (+  3326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5842,"raft.queue_time_us":70120,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":26365,"thread_start_us":910627,"threads_started":2,"wal-append.queue_time_us":563127}
I20260709 12:14:40.811954 11664 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:40.804335 11629 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.853459 11757 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:40.818620 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1766) took 1628 ms. Trace:
I20260709 12:14:40.819088 11882 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.807080 11959 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:40.824157 11946 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:14:40.824129 11559 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.897009 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:40.838037 10048 rpcz_store.cc:276] 0709 12:14:39.192018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.232636 (+ 40618us) service_pool.cc:224] Handling call
0709 12:14:39.232946 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.805330 (+572384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.837388 (+1032058us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54002747d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:40.837571 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246780288}
I20260709 12:14:40.973666 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:40.855062 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:40.858497 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:40.806777 11942 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.789657 11850 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:40.863643 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.868558 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.869189 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.033083 10202 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
W20260709 12:14:41.032543 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 135635us
W20260709 12:14:40.842219 11938 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:14:40.873005 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.034133 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:40.838339 11924 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:40.878785 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:40.853035 11954 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.895371 10729 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:41.040282 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 161551us
I20260709 12:14:40.876570 11635 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:40.946943 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 193139us
I20260709 12:14:41.059551 10124 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:40.890152 11744 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.060220 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:40.941862 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:40.949045 10050 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:40.785007 11945 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.975039 10129 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.065893 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.066584 10129 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.067458 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:40.890197 11851 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:14:41.032975 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.074005 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:40.766350 11918 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:40.881250 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:40.893124 11922 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.624s	user 0.000s	sys 0.001s
I20260709 12:14:40.809206 11738 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:40.875846 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.061373 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:40.953697 10049 rpcz_store.cc:276] 0709 12:14:39.190559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.197209 (+  6650us) service_pool.cc:224] Handling call
0709 12:14:39.197461 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.233353 (+ 35892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.818355 (+1585002us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54003f93d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:40.818559 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78843648}
I20260709 12:14:40.895798 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.068023 10129 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:40.991222 10048 raft_consensus.cc:2410] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:40.948424 11895 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.018253 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.075637 10733 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.058051 11934 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:40.807390 11952 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.076436 10052 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:41.032187 11664 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:41.103513 11953 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:14:41.103381 10728 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.104698 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:41.106272 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.107383 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.955049 11882 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.108191 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:41.113317 10733 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:41.059195 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1462) took 2273 ms (client timeout 1672 ms). Trace:
I20260709 12:14:41.058804 11728 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:41.063735 11628 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:40.584142 10201 rpcz_store.cc:276] 0709 12:14:39.404295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.408916 (+  4621us) service_pool.cc:224] Handling call
0709 12:14:39.486741 (+ 77825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.486962 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:40.381942 (+894980us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.543709 (+161767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.543852 (+   143us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:40.543964 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.544097 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.544306 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55556,"prepare.queue_time_us":810622,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":9301,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2222,"thread_start_us":1015739,"threads_started":2,"wal-append.queue_time_us":319869}
I20260709 12:14:41.070580 11850 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.119683 10127 raft_consensus.cc:2410] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:41.068744 11814 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.121497 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:41.091140 11896 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.066370 11874 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:41.143105 11950 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 12:14:41.135308 11728 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:41.105927 11759 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:14:41.141645 11628 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:41.141961 11948 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.074630 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:40.955832 11757 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:41.164096 11960 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:14:41.092780 11794 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:41.031982 11559 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.146325 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.142380 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:41.163002 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 208662us
I20260709 12:14:41.110925 11895 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:41.185595 10733 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:41.140280 10129 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.101990 11677 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.192307 11628 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.150282 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:41.297595 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.050s	sys 0.063s
W20260709 12:14:41.293143 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 146879us
I20260709 12:14:41.155485 11896 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.163657 11924 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:41.150513 11651 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 12:14:41.188313 11894 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.190249 11951 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.156706 11850 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.032977 11959 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.061918 11954 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:41.299072 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.050s	sys 0.063s
I20260709 12:14:41.367791 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 251) took 1964 ms. Trace:
W20260709 12:14:41.120836 10053 rpcz_store.cc:269] 0709 12:14:38.768150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.774496 (+  6346us) service_pool.cc:224] Handling call
0709 12:14:40.810653 (+2036157us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:41.041585 (+230932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4181248}
I20260709 12:14:41.400020 10130 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:41.409961 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 188) took 1424 ms. Trace:
I20260709 12:14:40.856144 10051 rpcz_store.cc:276] 0709 12:14:39.511380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.515372 (+  3992us) service_pool.cc:224] Handling call
0709 12:14:39.545605 (+ 30233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.545955 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.545985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.546488 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.460330 (+913842us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:40.464886 (+  4556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.488328 (+ 23442us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:40.752306 (+263978us) raft_consensus.cc:1685] finished
0709 12:14:40.754686 (+  2380us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.763481 (+  8795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8663,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":901821,"threads_started":1,"wal-append.queue_time_us":832995}
I20260709 12:14:41.301077 10126 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:41.371469 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.307569 10204 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:41.293720 11948 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.406140 10203 rpcz_store.cc:276] 0709 12:14:39.403825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.404435 (+   610us) service_pool.cc:224] Handling call
0709 12:14:39.404742 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.487731 (+ 82989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.487759 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.487798 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:39.487824 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.367530 (+1879706us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54000e92d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:41.367588 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.367728 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190456704}
I20260709 12:14:41.352520 11913 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.334815 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.410398 10130 rpcz_store.cc:276] 0709 12:14:39.985525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.539748 (+554223us) service_pool.cc:224] Handling call
0709 12:14:41.399507 (+859759us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:41.399707 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.409693 (+  9986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.409903 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6692096}
I20260709 12:14:41.389814 11682 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.389400 10121 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 12:14:41.413096 10124 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:41.328097 11896 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.196406 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:41.363696 11771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.001s	sys 0.015s
W20260709 12:14:41.340246 11824 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.770s	user 0.002s	sys 0.009s
W20260709 12:14:41.415071 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 113188us
I20260709 12:14:41.415395 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.433072 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.433931 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.434746 10130 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:41.406090 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:41.344635 11756 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.367004 11952 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.368631 11806 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:41.416894 11951 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.364252 11744 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.363921 11945 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:41.195906 11664 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.292914 10196 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:41.413353 11924 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.390925 11559 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:41.419909 10737 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.298849 11974 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.194033 11967 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:41.300733 11955 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.389906 11757 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.298401 10123 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.360646 11629 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.351867 11898 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:41.307632 11972 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.535575 11972 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.537828 11972 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.425208 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.345418 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 187) took 1359 ms. Trace:
I20260709 12:14:41.189620 11874 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.527999 11918 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.300902 11677 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.539287 11628 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.540118 11874 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.540416 11677 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.298209 11895 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.490527 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:41.427124 11771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.002s	sys 0.016s
I20260709 12:14:41.542073 11850 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.540997 10122 rpcz_store.cc:276] 0709 12:14:39.984964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.521966 (+537002us) service_pool.cc:224] Handling call
0709 12:14:40.550021 (+ 28055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:40.582097 (+ 32076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.587881 (+  5784us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:40.725831 (+137950us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.061744 (+335913us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:41.066158 (+  4414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.073831 (+  7673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.327473 (+253642us) raft_consensus.cc:1685] finished
0709 12:14:41.327500 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.344178 (+ 16678us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12001,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":22070,"thread_start_us":286542,"threads_started":1,"wal-append.queue_time_us":410340}
I20260709 12:14:41.541218 11628 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:41.544482 11964 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 12:14:41.517724 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 219539us
I20260709 12:14:41.547173 11942 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.548239 10728 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:41.548693 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:41.517491 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 111496us
I20260709 12:14:41.423049 10121 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:41.430400 10731 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.553355 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.516971 10729 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.555358 11895 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.555387 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:41.489516 11847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.015s	sys 0.014s
W20260709 12:14:41.556058 11847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.016s	sys 0.019s
I20260709 12:14:41.556607 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.557996 11942 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:41.434082 11856 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.000s
I20260709 12:14:41.424503 11682 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.558949 11874 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.559386 11874 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.559753 11874 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.560068 11682 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.336404 11851 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.336551 11728 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.524704 11880 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:41.513248 11882 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.517491 11879 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:41.526751 11921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.002s	sys 0.020s
I20260709 12:14:41.521404 11968 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:41.521426 11913 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.521530 11951 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.435832 11824 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.524950 11806 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:41.534948 11976 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:14:41.579777 11824 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.534683 11955 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.538475 10124 raft_consensus.cc:2376] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4. Re-sending same reply.
I20260709 12:14:41.543339 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:41.549880 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:41.551568 10737 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:41.514202 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.553470 11814 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:40.577450 10046 rpcz_store.cc:276] 0709 12:14:39.511946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.415894 (+903948us) service_pool.cc:224] Handling call
0709 12:14:40.416189 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.416365 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:40.447361 (+ 30996us) log.cc:844] Serialized 14 byte log entry
0709 12:14:40.525796 (+ 78435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.525848 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:40.525888 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.525950 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:40.526054 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2531,"prepare.queue_time_us":28361,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":49243,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5241,"thread_start_us":75541,"threads_started":1,"wal-append.queue_time_us":98474}
W20260709 12:14:41.525300 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 236098us
I20260709 12:14:41.584452 11959 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.584798 11955 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.585470 11948 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.585773 10124 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:41.574122 11913 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.587147 10124 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:14:41.587397 11968 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.588078 11913 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.587864 11968 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.588295 10124 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:41.589727 10122 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.589979 11968 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:41.590734 11852 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.087s	user 0.000s	sys 0.010s
I20260709 12:14:41.591133 11852 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.592038 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1681) took 1010 ms. Trace:
I20260709 12:14:41.592410 10126 rpcz_store.cc:276] 0709 12:14:40.581965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.894770 (+312805us) service_pool.cc:224] Handling call
0709 12:14:41.591841 (+697071us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b5400408154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:41.591980 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192540928}
I20260709 12:14:41.582832 11850 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.568501 11880 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.594400 11850 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.598877 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.599491 10124 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.599702 11880 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.600440 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.531335 11974 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.603576 11974 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.603927 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.605615 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1477) took 1081 ms. Trace:
I20260709 12:14:41.565243 11728 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.606871 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 186) took 1622 ms. Trace:
I20260709 12:14:41.607059 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.607218 10128 rpcz_store.cc:276] 0709 12:14:39.984212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.984360 (+   148us) service_pool.cc:224] Handling call
0709 12:14:40.102739 (+118379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.375555 (+272816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.375584 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:40.375620 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:40.375647 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.606682 (+1231035us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400212854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:41.606722 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.606823 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627014400}
I20260709 12:14:41.608531 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:41.609035 10128 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.610628 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.610750 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.611238 10049 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:41.611863 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.612035 11851 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.612439 10052 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
W20260709 12:14:41.538501 11916 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.258s	user 0.005s	sys 0.000s
I20260709 12:14:41.566269 10731 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:41.614338 11852 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.614749 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1679) took 2374 ms. Trace:
W20260709 12:14:41.566774 11944 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.779s	user 0.001s	sys 0.000s
I20260709 12:14:41.549747 11898 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:41.600358 11850 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.615947 11898 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:41.616427 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.616916 11898 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.617287 10195 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:41.597086 10199 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:41.546360 11954 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.598022 11924 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.594770 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.602767 11874 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.574532 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:41.562932 11945 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.569414 11901 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 2.299s	user 0.012s	sys 0.016s
I20260709 12:14:41.562777 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 189) took 1576 ms. Trace:
I20260709 12:14:41.573971 11951 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.573705 11879 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.594743 10732 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:41.590652 11972 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.550288 10733 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:41.579824 11806 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:41.602622 11825 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.603186 10122 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:41.605952 10054 rpcz_store.cc:276] 0709 12:14:40.524621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.543356 (+ 18735us) service_pool.cc:224] Handling call
0709 12:14:41.605479 (+1062123us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003f1954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:41.605567 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391297920}
I20260709 12:14:41.612399 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.619777 10736 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:41.596674 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.618480 11663 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.637921 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:41.638418 10048 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.615110 10125 rpcz_store.cc:276] 0709 12:14:39.240505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.240659 (+   154us) service_pool.cc:224] Handling call
0709 12:14:39.264171 (+ 23512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.282087 (+ 17916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.282121 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.299987 (+ 17866us) log.cc:844] Serialized 26 byte log entry
0709 12:14:39.601177 (+301190us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:39.699445 (+ 98268us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.699913 (+   468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.699993 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.391425 (+1691432us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:41.614498 (+223073us) raft_consensus.cc:1685] finished
0709 12:14:41.614585 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.614701 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10505,"prepare.queue_time_us":97752,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":13155,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":19935,"spinlock_wait_cycles":10319232,"thread_start_us":235832,"threads_started":1,"wal-append.queue_time_us":602303}
W20260709 12:14:41.620057 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45626.2us
I20260709 12:14:41.623582 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:41.624199 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74391.2us
I20260709 12:14:41.621126 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:41.617515 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.597949 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:41.624364 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.639518 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:41.650744 10202 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.650717 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:41.651728 10046 raft_consensus.cc:606] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:41.652100 10046 raft_consensus.cc:614] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.636444 10049 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:41.653005 10195 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:14:41.573432 11921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.003s	sys 0.020s
I20260709 12:14:41.596197 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:41.598250 10196 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:41.614992 11852 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.632174 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 193883us
I20260709 12:14:41.632768 11756 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:41.636929 11952 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.634888 10052 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:41.620518 11913 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:41.636931 10203 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:41.637337 10130 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.636444 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.628929 11968 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.627316 10124 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:41.622030 10121 rpcz_store.cc:276] 0709 12:14:39.986277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.557820 (+1571543us) service_pool.cc:224] Handling call
0709 12:14:41.558114 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.558280 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.558308 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.558357 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.558386 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.558458 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.561263 (+  2805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:41.598097 11824 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:41.651301 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.654247 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:41.654448 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.653280 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.657632 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.681672 10049 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.649076 11908 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.656639 11655 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.633309 11850 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:41.661334 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:41.617476 10123 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.636933 11771 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.664522 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:41.616467 11896 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.638217 11663 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.631317 11841 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:14:41.630270 11954 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:41.621466 11945 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.682521 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:41.681221 10047 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:41.683676 10046 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:14:41.670812 11852 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.686830 11955 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.687481 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.690567 11738 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.686096 10202 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:41.632823 11972 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.693228 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.697080 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:41.696943 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.658666 11664 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:41.711030 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:41.663515 11952 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.700847 10048 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:41.673080 11968 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.659106 11882 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:14:41.701253 11850 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.701601 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1685) took 1101 ms. Trace:
I20260709 12:14:41.661064 11769 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:14:41.713600 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:41.691919 11824 consensus_queue.cc:1243] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:41.692165 11655 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.695529 11651 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:41.717540 10054 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:41.718849 11952 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.719883 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:41.701774 11501 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.705605 11663 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.724385 11871 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:41.695216 11908 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.714869 11738 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.713730 11956 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:14:41.726173 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:41.714417 10126 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:41.727487 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.776131 10736 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:41.717419 11934 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.710064 11955 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.730746 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:41.674010 11757 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:41.721937 11968 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.720971 11455 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:41.701737 11771 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.721017 11635 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.702565 10130 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:41.673591 11756 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.729935 11655 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.755501 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:41.792992 11955 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.757283 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:41.807569 10199 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:41.766198 10047 raft_consensus.cc:2368] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5.
I20260709 12:14:41.773378 11664 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:41.729918 11825 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:41.748062 11972 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.790485 10054 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.732431 11501 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.747411 11912 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.367s	user 0.003s	sys 0.003s
I20260709 12:14:41.725081 10123 rpcz_store.cc:276] 0709 12:14:40.600570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.142055 (+541485us) service_pool.cc:224] Handling call
0709 12:14:41.697842 (+555787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:41.792514 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.741966 11769 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.870921 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:41.749548 11914 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.790261 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.740765 11651 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:41.748457 11850 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.740950 11879 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.741317 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:41.795269 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.748975 11871 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:41.804486 11635 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.739351 11874 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:41.765074 11738 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.789901 11934 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.756880 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.805416 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:41.800431 11988 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:14:41.800784 11925 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.283s	user 0.007s	sys 0.000s
I20260709 12:14:41.907621 10198 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.911576 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.912773 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.913334 10198 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:41.873092 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.873167 10203 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:41.800215 11455 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.819644 11501 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.749125 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:41.918969 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:41.892508 10201 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:41.895898 10122 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:41.896173 11871 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:41.871706 11948 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:41.870111 10196 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:14:41.899403 10199 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:41.900502 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1062) took 1159 ms. Trace:
I20260709 12:14:41.941053 10127 rpcz_store.cc:276] 0709 12:14:40.740960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.805976 (+ 65016us) service_pool.cc:224] Handling call
0709 12:14:41.900271 (+1094295us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400173254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:41.900427 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577451392}
I20260709 12:14:41.871188 11852 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:41.908720 10054 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:41.907030 10195 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:41.943734 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:41.800681 11962 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:41.910642 11934 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:41.890200 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 550) took 1031 ms. Trace:
I20260709 12:14:41.949391 10735 rpcz_store.cc:276] 0709 12:14:40.859000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.859140 (+   140us) service_pool.cc:224] Handling call
0709 12:14:41.795137 (+935997us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:41.890126 (+ 94989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10725760}
I20260709 12:14:41.920878 10130 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:41.873756 11825 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:41.890482 11651 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:41.897713 11896 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:41.875864 11769 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:41.919533 11989 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.235s	user 0.003s	sys 0.000s
I20260709 12:14:41.916167 11945 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:41.874233 11977 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.220s
I20260709 12:14:41.888128 11914 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.950307 10054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:41.924508 10123 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:41.953356 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 180) took 2441 ms. Trace:
I20260709 12:14:41.927026 10731 raft_consensus.cc:2376] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3. Re-sending same reply.
W20260709 12:14:41.964216 11993 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:14:41.953464 11994 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:41.983896 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 264078us
I20260709 12:14:41.980332 10055 rpcz_store.cc:276] 0709 12:14:39.511682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.511784 (+   102us) service_pool.cc:224] Handling call
0709 12:14:39.512086 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.512279 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:40.374455 (+862176us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.748048 (+1373593us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18003998e0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:14:41.748263 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.953009 (+204746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.953061 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.953100 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.953167 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.953278 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39422,"prepare.queue_time_us":1975694,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4223,"raft.queue_time_us":1653,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":9557,"spinlock_wait_cycles":9429760,"thread_start_us":1156166,"threads_started":3,"wal-append.queue_time_us":195759,"wal-append.run_cpu_time_us":1191,"wal-append.run_wall_time_us":1030058}
I20260709 12:14:41.985189 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:42.057987 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 364826us
I20260709 12:14:41.918506 11664 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:41.982115 11908 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.057291 11919 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.090516 11651 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:42.147759 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 162634us
I20260709 12:14:42.149123 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:42.091245 11973 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.724s	user 0.012s	sys 0.002s
I20260709 12:14:42.094099 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.159392 11874 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:42.160303 11874 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:42.160630 11874 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:42.160845 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.161531 10122 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:42.161831 11972 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.162205 11972 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.162537 11972 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.167958 11914 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.170270 11968 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.171998 10049 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:42.095237 10734 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:42.173369 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 551) took 1299 ms. Trace:
I20260709 12:14:42.173686 10734 rpcz_store.cc:276] 0709 12:14:40.873692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.873859 (+   167us) service_pool.cc:224] Handling call
0709 12:14:42.094721 (+1220862us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:42.094917 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.173121 (+ 78204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.173312 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7138560}
I20260709 12:14:42.095992 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 549) took 1241 ms. Trace:
I20260709 12:14:42.073158 11945 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.075903 11420 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:42.076117 11728 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:14:42.098359 10736 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:14:42.099363 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1482) took 1236 ms. Trace:
I20260709 12:14:42.177443 10204 rpcz_store.cc:276] 0709 12:14:40.862889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.863929 (+  1040us) service_pool.cc:224] Handling call
0709 12:14:40.864266 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.414488 (+550222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.099070 (+684582us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400103bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:42.099301 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018920192}
I20260709 12:14:42.178114 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.179045 10204 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:14:42.103400 11769 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:42.101794 11998 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:14:42.182209 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.105077 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.105924 11825 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:41.953987 11962 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:41.953790 11933 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:42.066357 11757 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.112011 11896 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:42.066216 11771 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.122979 11635 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.198956 11635 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:42.199450 11635 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:42.200157 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 543) took 1416 ms. Trace:
I20260709 12:14:42.200277 11635 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.200528 10732 rpcz_store.cc:276] 0709 12:14:40.783957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.784744 (+   787us) service_pool.cc:224] Handling call
0709 12:14:40.842557 (+ 57813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.629963 (+787406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.199907 (+569944us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54007102d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:42.200099 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704498560}
I20260709 12:14:42.123301 11756 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.188338 11958 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:14:42.123317 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1682) took 1539 ms. Trace:
I20260709 12:14:42.203644 11958 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:42.204020 11958 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:42.125052 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1066) took 1007 ms. Trace:
I20260709 12:14:42.204804 11958 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.197682 11896 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.126047 11703 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:42.077904 11990 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:14:42.207078 11896 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.207103 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 192) took 1053 ms. Trace:
I20260709 12:14:42.207856 10128 rpcz_store.cc:276] 0709 12:14:41.153944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.610376 (+456432us) service_pool.cc:224] Handling call
0709 12:14:41.625403 (+ 15027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.625761 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.625793 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.629395 (+  3602us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.722723 (+ 93328us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:41.722997 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.723173 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.723240 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.206920 (+483680us) raft_consensus.cc:1685] finished
0709 12:14:42.206940 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.207050 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2818,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":614,"raft.queue_time_us":1780,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4448,"spinlock_wait_cycles":4899712,"thread_start_us":63881,"threads_started":1,"wal-append.queue_time_us":97576}
W20260709 12:14:42.126820 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 267) took 1702 ms (client timeout 1616 ms). Trace:
W20260709 12:14:42.127688 11999 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:14:42.078918 11997 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:14:42.199208 11974 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 12:14:42.210974 11974 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.211445 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 193) took 1057 ms. Trace:
I20260709 12:14:42.105823 11852 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:42.129191 10046 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:14:42.133069 11966 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:42.077593 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 963) took 3431 ms. Trace:
I20260709 12:14:42.133496 11455 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.134379 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.244746 10130 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:42.150835 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.155658 11995 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:42.156107 11994 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:42.174674 10737 rpcz_store.cc:276] 0709 12:14:40.854411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.854743 (+   332us) service_pool.cc:224] Handling call
0709 12:14:42.095801 (+1241058us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54006455d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:42.095928 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023462784}
I20260709 12:14:42.174389 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.178907 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.068607 11732 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:42.184444 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.248260 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.190907 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.185827 11945 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:14:42.197808 11898 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.580s	user 0.004s	sys 0.006s
I20260709 12:14:42.197880 11933 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:42.209916 10200 rpcz_store.cc:269] 0709 12:14:40.424806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.446639 (+ 21833us) service_pool.cc:224] Handling call
0709 12:14:42.126626 (+1679987us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000eabd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:42.126756 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600393472}
W20260709 12:14:42.182996 11851 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.570s	user 0.003s	sys 0.008s
I20260709 12:14:42.211819 10125 rpcz_store.cc:276] 0709 12:14:41.154169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.661998 (+507829us) service_pool.cc:224] Handling call
0709 12:14:41.669355 (+  7357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.678765 (+  9410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.678795 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.695758 (+ 16963us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.817673 (+121915us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:41.817709 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.817778 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:42.211240 (+393462us) raft_consensus.cc:1685] finished
0709 12:14:42.211258 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.211392 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3304,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12054,"thread_start_us":113031,"threads_started":1,"wal-append.queue_time_us":238603}
I20260709 12:14:42.209825 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:42.181432 11914 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:14:42.220331 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.254310 10046 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:42.250382 11995 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:42.255167 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.255378 10127 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:14:42.255765 10046 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:42.255779 10127 pending_rounds.cc:85] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 1
I20260709 12:14:42.257284 10127 pending_rounds.cc:107] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:42.257531 10127 raft_consensus.cc:2889] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:42.161406 11874 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.233747 11655 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.234920 11968 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.235321 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:42.235596 11996 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 12:14:42.190825 11962 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.205392 10126 rpcz_store.cc:276] 0709 12:14:41.117194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.593262 (+476068us) service_pool.cc:224] Handling call
0709 12:14:41.697877 (+104615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.789697 (+ 91820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.124815 (+335118us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400212350. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:42.124979 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235267328}
I20260709 12:14:42.265344 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.244374 10197 rpcz_store.cc:276] 0709 12:14:38.643050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.482393 (+839343us) service_pool.cc:224] Handling call
0709 12:14:39.482785 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.483173 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.483203 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:39.483700 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:14:40.443091 (+959391us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:40.446693 (+  3602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:40.450867 (+  4174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.660770 (+1209903us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:41.977620 (+316850us) raft_consensus.cc:1685] finished
0709 12:14:41.980897 (+  3277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.071878 (+ 90981us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61852,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":47395072,"thread_start_us":940132,"threads_started":1,"wal-append.queue_time_us":899903}
I20260709 12:14:42.266075 11968 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.237011 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.237736 11924 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:42.236260 11948 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:42.266325 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.266793 11924 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:42.267153 10197 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:42.267674 11924 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.268146 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.268617 11924 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.269387 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.269877 12000 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.237869 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.270641 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.271102 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.271298 11995 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:42.273164 11952 consensus_meta.cc:287] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 12:14:42.273568 11952 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:42.246193 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 95434.9us
I20260709 12:14:42.273934 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:42.245683 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.275137 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.275660 10130 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:42.276388 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:42.277300 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.277065 11871 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.248526 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.251659 10128 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.203583 10129 rpcz_store.cc:276] 0709 12:14:40.583510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.576788 (+993278us) service_pool.cc:224] Handling call
0709 12:14:41.577136 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.577462 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:41.577490 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:41.577915 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:14:41.660544 (+ 82629us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:41.698185 (+ 37641us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.698370 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.698464 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.795172 (+ 96708us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:42.114493 (+319321us) raft_consensus.cc:1685] finished
0709 12:14:42.123125 (+  8632us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.123259 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53174,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8965,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7398,"spinlock_wait_cycles":14084992,"thread_start_us":95977,"threads_started":2,"wal-append.queue_time_us":82725}
I20260709 12:14:42.253568 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.259258 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:42.261350 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.292927 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.262802 10124 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:42.263931 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:42.293763 10129 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:42.293931 10046 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:42.262635 11663 consensus_meta.cc:287] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:14:42.262578 11917 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.265561 11655 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.212304 11757 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.270368 12000 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.271647 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.223308 11926 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.249102 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74788.3us
I20260709 12:14:42.266497 11968 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.241719 11974 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.273061 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.239714 11501 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.280040 11738 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.281015 11955 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.278270 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.282682 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.283103 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.412475 10200 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:42.412492 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 129887us
I20260709 12:14:42.261862 10053 raft_consensus.cc:2368] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:42.256016 11732 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.253314 11455 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.266456 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.256292 11958 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:42.299187 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.437502 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.284184 11934 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.301482 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.301721 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.441607 10047 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:42.442307 10736 raft_consensus.cc:2368] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5.
W20260709 12:14:42.377612 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51387.8us
W20260709 12:14:42.442939 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.389540 10204 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:42.391636 10054 raft_consensus.cc:606] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.391510 10195 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:42.287220 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:42.290046 11948 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:42.394388 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 337739us
I20260709 12:14:42.395790 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:42.523571 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 127862us
I20260709 12:14:42.398063 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.523864 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.401492 10128 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:42.403568 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 335341us
I20260709 12:14:42.408470 10046 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:42.525759 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.334708 11898 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.413287 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:42.529747 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 116549us
I20260709 12:14:42.288156 10051 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:42.389113 11914 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:42.436021 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.394953 11945 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.290799 11972 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.398877 11968 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.303088 11663 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.462646 11934 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:42.420776 11951 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.789s	user 0.006s	sys 0.004s
I20260709 12:14:42.468451 10202 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:42.441517 10737 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:42.403467 11926 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.388943 11917 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.512130 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.551441 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.556070 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.433686 11974 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:42.552718 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.518519 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.519546 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.558560 10200 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:42.434319 11455 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:42.521065 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.467474 11871 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.440866 11655 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.526926 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.567454 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.460702 11919 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.531992 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.535211 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.535622 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:42.569187 10052 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.536463 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.528548 10126 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:42.543080 11896 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.537642 11703 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:42.515064 11732 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.575811 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.557181 11974 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.544580 11977 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:42.473450 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:42.533725 11420 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.559970 10048 raft_consensus.cc:2368] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:42.541013 11994 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.561414 10735 raft_consensus.cc:2368] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:42.555626 11945 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:42.563020 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.562301 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:42.573944 11896 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.592885 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:14:42.589912 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 116548us
I20260709 12:14:42.591214 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.538581 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:42.601218 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62736.6us
I20260709 12:14:42.568572 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1483) took 1997 ms. Trace:
I20260709 12:14:42.568333 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.571765 10199 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:42.547741 11969 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:42.561589 11455 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.541378 11898 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.613795 11972 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.614080 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1688) took 1018 ms. Trace:
I20260709 12:14:42.614464 10124 rpcz_store.cc:276] 0709 12:14:41.595378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.699471 (+104093us) service_pool.cc:224] Handling call
0709 12:14:41.710508 (+ 11037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.294983 (+584475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.613827 (+318844us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400197dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:42.614001 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269755776}
I20260709 12:14:42.615006 11663 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.615531 11898 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.545217 11914 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.617537 11914 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.618673 11501 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.574585 11954 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.550037 11651 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:14:42.619539 11501 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.583949 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.620314 11501 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:42.563398 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.587754 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.621572 10737 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:42.621634 10203 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:42.622506 11732 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:42.622778 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.557557 11951 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.623363 10203 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.599571 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.582871 11974 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.585335 11420 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.586671 11703 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:42.591517 10197 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:42.604194 10050 rpcz_store.cc:276] 0709 12:14:40.571176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.064417 (+493241us) service_pool.cc:224] Handling call
0709 12:14:41.064745 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.064958 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:42.111436 (+1046478us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.568227 (+456791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.568275 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:42.568344 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.568404 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:42.568516 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724757,"prepare.queue_time_us":744920,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":644914,"threads_started":2}
W20260709 12:14:42.564240 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 382075us
I20260709 12:14:42.604676 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.606120 10052 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:42.635179 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:42.585542 11994 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.588984 11977 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:42.606073 12004 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.552805 10732 raft_consensus.cc:2376] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5. Re-sending same reply.
I20260709 12:14:42.609918 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.620807 11501 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:42.576540 11919 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.632225 11757 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.596833 11880 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.574167 11655 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.589506 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.596257 11896 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.631160 10735 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEARNER]: Advancing to term 7
I20260709 12:14:42.662015 12004 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.606009 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.607247 11794 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:42.681247 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 75319.7us
I20260709 12:14:42.638216 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.653342 10702 leader_election.cc:400] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5.
I20260709 12:14:42.682497 10702 leader_election.cc:403] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:42.606029 11635 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.650307 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.634828 11703 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.626878 11651 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:14:42.688994 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50832.1us
I20260709 12:14:42.676723 11880 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.642702 11914 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:42.674785 10050 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:42.691967 10050 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:42.619594 11954 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:42.695564 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 160089us
I20260709 12:14:42.643122 11994 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.659302 11955 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.658779 11898 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:42.630362 11420 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.683215 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:42.700959 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.681953 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:42.665566 11728 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:42.673934 11917 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.671114 10126 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:42.646651 11738 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:42.659994 11972 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:14:42.587441 11952 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:42.683665 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.665664 11933 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.689227 11703 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:42.747186 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.689733 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.687439 11982 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5.
I20260709 12:14:42.724396 11924 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:42.717005 11455 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.711109 11898 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.692189 11880 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.686852 12004 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.680446 11664 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:42.726959 10735 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:42.699322 10051 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:42.693420 10050 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:42.691563 11995 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:42.727406 11926 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.727452 11956 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:14:42.698863 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:42.732743 11501 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.765878 10050 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:42.731258 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.688365 11635 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.713198 12019 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.723470 11728 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.717135 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.772426 10198 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.732924 11951 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.698930 12017 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:14:42.733820 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:42.760957 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 161446us
I20260709 12:14:42.727679 11825 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:42.764217 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.768739 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.759230 11924 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:42.770898 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 234530us
W20260709 12:14:42.771162 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 81491.4us
I20260709 12:14:42.777112 11664 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.774789 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:42.776758 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 94880.5us
I20260709 12:14:42.796866 10050 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:14:42.797438 10050 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:14:42.797662 10050 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:14:42.757333 11898 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.797919 10095 leader_election.cc:400] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:42.798228 10095 leader_election.cc:403] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:42.798561 10052 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:42.799414 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:42.801904 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.801363 10050 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:42.774340 11728 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:42.806335 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:42.773945 11501 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.799988 10052 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:42.813848 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.814013 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.814397 10052 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:42.815315 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.815937 10052 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:42.816610 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.817564 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:42.770336 11995 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.825690 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.801627 11951 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:42.821970 10203 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:42.826881 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.800767 11919 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.830127 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.803777 11455 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.805517 11738 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:42.837891 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:42.848910 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.849642 10203 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:42.810560 12030 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:42.809906 12027 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:42.822346 12019 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.835286 10201 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:42.811924 11664 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:42.846225 11732 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:42.854671 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:42.865522 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.866093 10203 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:42.851903 11655 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.861639 12027 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.867897 11732 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.869360 12027 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.869920 11956 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:42.870404 11956 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.871253 12019 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:42.873788 12019 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.874536 11664 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.876585 11664 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.878603 12000 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.879715 11995 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:42.881580 12035 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:42.882344 12035 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.883150 12035 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:42.883586 12035 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:42.884402 12035 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.887431 11635 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:42.889357 12024 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:14:42.890831 12023 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:14:42.863243 11871 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:42.894953 11871 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:42.897680 11948 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.900141 11948 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:42.900935 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.859079 11977 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:42.846997 11501 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:42.847469 11738 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:42.835844 12028 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:42.894865 12022 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:14:42.905853 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:42.911655 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.913640 11501 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.918735 11954 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:42.920256 11756 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:14:42.920001 11896 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:42.924417 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:42.846319 12032 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:14:43.080542 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:42.979835 10203 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:43.083530 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:42.955207 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.080644 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 174913us
I20260709 12:14:42.927218 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.089906 10736 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.985442 10198 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:42.941156 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37150 (request call id 7) took 1211 ms. Trace:
I20260709 12:14:43.090937 10054 rpcz_store.cc:276] 0709 12:14:41.729935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.950173 (+220238us) service_pool.cc:224] Handling call
0709 12:14:42.940982 (+990809us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002751d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78a853 00007fc18375860a 00007fc17ccde7d4 00007fc17ccde762 00007fc17ccde691 00007fc17ccde60c 00007fc17ccdd8c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:42.941068 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945102720}
I20260709 12:14:42.930835 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 188) took 1230 ms. Trace:
I20260709 12:14:43.092514 10047 rpcz_store.cc:276] 0709 12:14:41.700364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.814054 (+113690us) service_pool.cc:224] Handling call
0709 12:14:42.930654 (+1116600us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54003f93d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:42.930774 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310286720}
I20260709 12:14:43.091296 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.094312 10198 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:42.939551 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.096891 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:43.097153 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 290873us
I20260709 12:14:42.853660 11951 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:43.093713 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.094796 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.098297 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:43.070180 11958 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 12:14:43.101655 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:42.929641 11962 consensus_meta.cc:287] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.000s
I20260709 12:14:43.102490 10203 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:42.862190 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:43.105430 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:42.910246 12030 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:43.106864 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:43.117594 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.118187 10736 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:43.121081 10198 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:43.121763 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.122841 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:42.906194 12033 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.908480 12011 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:43.097303 12038 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:43.044785 12006 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:42.942934 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:42.908232 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.088310 11501 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.086414 12042 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:43.126911 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.139266 10733 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:43.127887 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:42.945959 10126 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:43.127054 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:42.861959 11924 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:42.938274 11994 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.134989 10198 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:43.117221 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.137136 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:43.052995 11968 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.140348 10733 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEARNER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:43.140739 10736 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:43.140822 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 191) took 1431 ms. Trace:
I20260709 12:14:43.153903 10055 rpcz_store.cc:276] 0709 12:14:41.709889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.140008 (+430119us) service_pool.cc:224] Handling call
0709 12:14:42.151293 (+ 11285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.151619 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.151649 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.176073 (+ 24424us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.642453 (+466380us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.642496 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:42.642563 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:43.140636 (+498073us) raft_consensus.cc:1685] finished
0709 12:14:43.140656 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.140767 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42341,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":387021,"threads_started":1,"wal-append.queue_time_us":499238}
I20260709 12:14:43.090345 11703 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.143221 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:43.127913 12011 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.135589 11956 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.164683 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:43.060949 11871 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.144624 11926 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:14:43.144804 12042 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.137439 11738 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.139353 11664 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:43.170837 10049 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:43.119825 11962 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.131232 12038 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:43.131873 11958 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:43.128818 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 316) took 1399 ms. Trace:
I20260709 12:14:43.136729 11948 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.129992 12043 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:43.161892 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.147024 11655 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.177825 10735 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:14:43.181339 12044 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.155134 10736 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:43.202594 10046 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:14:43.146449 11732 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:43.206489 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 392520us
W20260709 12:14:43.176964 11974 consensus_meta.cc:287] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 12:14:43.163676 12011 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.205735 12038 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:43.181094 11919 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.214816 10055 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:43.137718 12006 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.173259 10197 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:43.175769 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.166401 10094 leader_election.cc:400] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
W20260709 12:14:43.256389 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 90115.3us
I20260709 12:14:43.257079 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:43.175184 12004 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.176409 11898 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.263392 10128 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:43.264339 11898 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:43.221681 11738 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.205487 11958 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.266764 11958 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:43.266914 12042 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:43.219956 12030 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.273706 11501 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.159469 11951 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.206677 11420 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.242651 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:43.237422 10198 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:43.283730 11958 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:43.284173 11958 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:43.284512 10198 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:43.253185 11917 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.292869 11917 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.295431 11917 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.253332 11896 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.229107 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:43.254302 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.260674 12004 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.261409 11933 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:43.305774 10055 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:43.274820 10201 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 1.
I20260709 12:14:43.275400 10731 raft_consensus.cc:2376] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5. Re-sending same reply.
I20260709 12:14:43.249791 11655 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:14:43.252959 12032 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:14:43.249048 12006 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:43.225080 11880 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.244673 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:43.321913 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 77326.6us
W20260709 12:14:43.301162 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44168.9us
I20260709 12:14:43.325999 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.326699 10736 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:43.301600 10198 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:43.326752 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:43.303398 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.306965 10054 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:43.307343 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.234630 11974 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.276078 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1496) took 1029 ms. Trace:
W20260709 12:14:43.309077 10168 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.681s (SENT)
I20260709 12:14:43.239511 11732 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.205662 10729 rpcz_store.cc:276] 0709 12:14:41.729732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.731077 (+  1345us) service_pool.cc:224] Handling call
0709 12:14:42.911461 (+1180384us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:43.127432 (+215971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24249216}
I20260709 12:14:43.284545 11958 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:43.245122 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.328406 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:43.328576 10055 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 1.
I20260709 12:14:43.331043 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:43.331725 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.318670 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 564) took 1138 ms. Trace:
W20260709 12:14:43.353724 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44677.6us
I20260709 12:14:43.308055 11917 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:43.334496 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.352952 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:43.343676 11732 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.358032 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:43.359036 10735 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:43.351096 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:43.300683 11728 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.373930 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:43.379048 10125 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.373266 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:43.310010 11933 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.336853 11968 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:43.351315 11896 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.365428 10198 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:43.357708 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.374148 12006 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:43.415711 10055 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:43.372637 12048 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:43.382349 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.383554 11945 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:43.381377 12044 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:43.389353 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:43.373558 11926 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.392714 10125 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:43.395362 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1484) took 1793 ms (client timeout 1554 ms). Trace:
W20260709 12:14:43.428829 10053 rpcz_store.cc:269] 0709 12:14:41.602342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.603699 (+  1357us) service_pool.cc:224] Handling call
0709 12:14:43.395151 (+1791452us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002a1554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:43.395285 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471666560}
I20260709 12:14:43.429211 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:43.429998 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.430209 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:43.431218 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.398042 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:43.410063 11962 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.400477 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 281) took 1503 ms. Trace:
I20260709 12:14:43.337350 11994 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:43.329367 12004 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.343704 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:43.335749 12042 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:14:43.332407 12038 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.421954 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1694) took 1702 ms. Trace:
I20260709 12:14:43.459522 10127 rpcz_store.cc:276] 0709 12:14:41.719857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.942018 (+222161us) service_pool.cc:224] Handling call
0709 12:14:41.952693 (+ 10675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.257936 (+305243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.421726 (+1163790us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400232654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:43.421887 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695289728}
I20260709 12:14:43.330749 10197 rpcz_store.cc:276] 0709 12:14:42.246749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.136335 (+889586us) service_pool.cc:224] Handling call
0709 12:14:43.163718 (+ 27383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:43.252704 (+ 88986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.275997 (+ 23293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:43.399684 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 985) took 1644 ms. Trace:
I20260709 12:14:43.449502 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.424891 11945 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:43.415896 12006 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:43.450066 11968 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:43.359735 10731 rpcz_store.cc:276] 0709 12:14:42.179997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.182560 (+  2563us) service_pool.cc:224] Handling call
0709 12:14:43.175612 (+993052us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:43.311753 (+136141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34309376}
I20260709 12:14:43.473834 10127 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:43.458282 10053 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:43.448606 10195 rpcz_store.cc:276] 0709 12:14:41.897420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.943775 (+ 46355us) service_pool.cc:224] Handling call
0709 12:14:41.944078 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.479646 (+535568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.400258 (+920612us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54003142d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:43.400414 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028574976}
I20260709 12:14:43.463105 10198 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:43.462888 10202 rpcz_store.cc:276] 0709 12:14:41.755366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.755480 (+   114us) service_pool.cc:224] Handling call
0709 12:14:41.793478 (+ 37998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.550776 (+757298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.399423 (+848647us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400314cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:43.399616 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551856384}
I20260709 12:14:43.450639 10051 raft_consensus.cc:2368] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7.
I20260709 12:14:43.427372 12044 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.414227 11896 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:43.469233 11945 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:43.457437 10055 raft_consensus.cc:2410] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:43.629494 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:43.465173 11917 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:43.473656 12006 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:43.481105 12053 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:14:43.424283 12048 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.661378 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.478492 11420 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:43.659719 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 90144.3us
I20260709 12:14:43.662557 11917 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:43.681461 12033 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.004s
I20260709 12:14:43.480767 10196 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
W20260709 12:14:43.482363 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1073) took 1328 ms (client timeout 1566 ms). Trace:
W20260709 12:14:43.779424 10123 rpcz_store.cc:269] 0709 12:14:42.151752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.397713 (+1245961us) service_pool.cc:224] Handling call
0709 12:14:43.479921 (+ 82208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:43.481937 11968 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:43.781212 11968 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.784947 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:43.785861 10204 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:43.763120 12056 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:14:43.766543 12033 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:43.658231 11501 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.682565 11951 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
W20260709 12:14:43.871382 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.812240 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:43.851696 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:43.872166 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:43.853426 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 58378.5us
I20260709 12:14:43.767980 12038 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:43.664776 12032 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:43.896296 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.712090 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.903800 10125 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:43.911481 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.913621 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.914515 10202 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:43.893589 12030 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.900004 11919 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.910070 10126 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.481808 12044 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:43.944391 11771 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:43.945066 12048 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:43.945554 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.946676 11771 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:43.947206 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 571) took 1752 ms (client timeout 1607 ms). Trace:
W20260709 12:14:43.947587 10730 rpcz_store.cc:269] 0709 12:14:42.194903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.202897 (+  7994us) service_pool.cc:224] Handling call
0709 12:14:43.945399 (+1742502us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:43.947131 (+  1732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41569664}
I20260709 12:14:43.947770 11771 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:43.949065 11958 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.001s
I20260709 12:14:43.949317 11771 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:43.950521 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:43.938341 11635 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:43.920931 12033 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:43.988519 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:43.990875 10736 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:43.951354 11933 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:43.912766 12032 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:43.995362 10204 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:43.990414 12017 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.936393 11728 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:43.936610 12030 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:43.993577 11635 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:44.012738 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 208) took 1203 ms. Trace:
I20260709 12:14:44.036259 10051 rpcz_store.cc:276] 0709 12:14:42.809011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.204967 (+395956us) service_pool.cc:224] Handling call
0709 12:14:44.012508 (+807541us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540019e454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.012671 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252202752}
I20260709 12:14:44.013746 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 195) took 1327 ms. Trace:
I20260709 12:14:44.037218 10052 rpcz_store.cc:276] 0709 12:14:42.686127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.817345 (+131218us) service_pool.cc:224] Handling call
0709 12:14:44.013545 (+1196200us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54003f9dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.013685 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355657472}
I20260709 12:14:44.038309 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.038902 10052 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:43.994153 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 239872us
I20260709 12:14:44.014360 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:44.017942 12038 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.019484 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 322) took 1374 ms. Trace:
I20260709 12:14:44.051074 10737 rpcz_store.cc:276] 0709 12:14:42.644881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.645004 (+   123us) service_pool.cc:224] Handling call
0709 12:14:42.645332 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:42.725948 (+ 80616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:42.725979 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:42.726469 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:14:42.859123 (+132654us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:42.859162 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.019080 (+1159918us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:44.019141 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.019183 (+    42us) raft_consensus.cc:1685] finished
0709 12:14:44.019197 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.019426 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":728,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2294,"spinlock_wait_cycles":184506624,"thread_start_us":105597,"threads_started":1,"wal-append.queue_time_us":208198,"wal-append.run_cpu_time_us":1469,"wal-append.run_wall_time_us":1004729}
I20260709 12:14:44.021343 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.053325 10050 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:44.028321 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:44.029716 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1493) took 1795 ms (client timeout 2139 ms). Trace:
W20260709 12:14:44.054565 10199 rpcz_store.cc:269] 0709 12:14:42.234202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.270900 (+ 36698us) service_pool.cc:224] Handling call
0709 12:14:44.029470 (+1758570us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000eb0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.029648 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689925504}
I20260709 12:14:44.032058 10126 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:44.033190 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.033957 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.058279 10048 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:44.035768 12017 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:44.059707 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1498) took 1863 ms. Trace:
I20260709 12:14:44.060156 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:44.042601 11874 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.045313 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 199) took 1355 ms. Trace:
I20260709 12:14:44.046375 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 193) took 2327 ms. Trace:
I20260709 12:14:44.068506 10055 rpcz_store.cc:276] 0709 12:14:42.691309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.373017 (+681708us) service_pool.cc:224] Handling call
0709 12:14:44.045091 (+672074us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400321c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.045247 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82524032}
I20260709 12:14:44.068987 10046 rpcz_store.cc:276] 0709 12:14:41.719397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.620846 (+901449us) service_pool.cc:224] Handling call
0709 12:14:42.621185 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.228226 (+607041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.046104 (+817878us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003f1954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:44.046304 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336557440}
I20260709 12:14:44.057539 10198 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:44.069878 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.060058 10048 rpcz_store.cc:276] 0709 12:14:42.196447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.585260 (+388813us) service_pool.cc:224] Handling call
0709 12:14:44.022375 (+1437115us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:44.059650 (+ 37275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885888}
I20260709 12:14:43.993745 11958 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.064319 10053 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
W20260709 12:14:44.074918 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 361167us
I20260709 12:14:44.075299 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:43.986578 11917 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.076108 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 202) took 1375 ms. Trace:
I20260709 12:14:44.093727 10051 rpcz_store.cc:276] 0709 12:14:42.700268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.052697 (+1352429us) service_pool.cc:224] Handling call
0709 12:14:44.076044 (+ 23347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.077812 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:44.098332 10055 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:44.075608 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:44.078999 12042 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.078742 11635 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:44.079756 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 561) took 1901 ms (client timeout 1770 ms). Trace:
I20260709 12:14:44.100869 10130 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:44.079932 11880 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.087121 11825 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:44.088058 11958 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:44.002918 12033 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.090445 10197 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:44.090721 11898 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:44.091791 10702 connection.cc:256] RPC call timeout handler was delayed by -1.1404038440000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3285s for a response
I20260709 12:14:44.092594 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.156338 10046 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:44.156234 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.057782 11703 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:44.123011 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47473.5us
I20260709 12:14:44.157058 10050 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:44.184860 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:44.186874 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 335229us
I20260709 12:14:44.160985 10052 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:44.167784 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.189617 10051 raft_consensus.cc:2368] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:44.190754 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.191267 10050 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.193755 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:44.194734 10129 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:44.194885 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.195468 10046 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:44.161931 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.198051 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:44.161865 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:44.199086 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:44.233064 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71288us
I20260709 12:14:44.233479 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.234248 10127 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:44.235061 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.200325 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.237329 10052 raft_consensus.cc:2410] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:44.237776 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 196) took 1551 ms. Trace:
I20260709 12:14:44.238081 10052 rpcz_store.cc:276] 0709 12:14:42.686395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.200084 (+1513689us) service_pool.cc:224] Handling call
0709 12:14:44.237714 (+ 37630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.239004 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.240164 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.240860 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1800) took 1543 ms. Trace:
I20260709 12:14:44.241173 10052 rpcz_store.cc:276] 0709 12:14:42.697719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.239848 (+1542129us) service_pool.cc:224] Handling call
0709 12:14:44.240806 (+   958us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:44.159578 11794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.469s	user 0.000s	sys 0.032s
I20260709 12:14:44.068886 12038 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.202498 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:44.088006 11945 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.133728 12048 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:44.200279 10130 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:44.133402 11962 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.185323 11635 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.214247 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.161432 11898 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.160919 11825 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:44.133631 11663 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:14:44.133857 11926 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 12:14:44.240240 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.133493 10728 rpcz_store.cc:269] 0709 12:14:42.178207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.182840 (+  4633us) service_pool.cc:224] Handling call
0709 12:14:44.014227 (+1831387us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:44.079678 (+ 65451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8292736}
I20260709 12:14:44.221072 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.206914 12017 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.211441 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.134413 12042 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.211884 11919 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.223124 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.228694 12030 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.242758 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.245798 11933 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.222409 11896 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.248278 10046 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:44.274214 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 200) took 1581 ms. Trace:
I20260709 12:14:44.249799 11898 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.253074 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.225024 11958 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:44.230242 12032 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.257660 10050 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:44.277390 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1810) took 1431 ms. Trace:
I20260709 12:14:44.262418 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1819) took 1345 ms. Trace:
W20260709 12:14:44.244352 11794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.554s	user 0.001s	sys 0.033s
I20260709 12:14:44.280618 11958 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.281495 11794 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:44.282377 11794 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.283236 11958 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:44.283686 12068 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:44.284209 12068 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.286139 12068 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.247499 12048 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.269635 10052 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:44.274603 10046 rpcz_store.cc:276] 0709 12:14:42.692677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.199486 (+1506809us) service_pool.cc:224] Handling call
0709 12:14:44.274148 (+ 74662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.204419 11880 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:44.277953 10051 rpcz_store.cc:276] 0709 12:14:42.916851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.210952 (+1294101us) service_pool.cc:224] Handling call
0709 12:14:44.262355 (+ 51403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.277750 10050 rpcz_store.cc:276] 0709 12:14:42.846549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.190535 (+1343986us) service_pool.cc:224] Handling call
0709 12:14:44.277318 (+ 86783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.280603 11663 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:44.281042 12033 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.269420 11962 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:44.294615 10200 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:44.294957 10130 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:44.281262 12061 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:44.299975 10169 leader_election.cc:400] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:44.358742 10169 leader_election.cc:403] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:14:44.358923 10130 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 12:14:44.359339 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59479.2us
W20260709 12:14:44.354394 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 166072us
I20260709 12:14:44.299901 12048 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:44.378921 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 143149us
I20260709 12:14:44.357800 12063 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.407163 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:44.408128 12063 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:44.408560 12063 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.408879 12063 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.276409 12030 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:14:44.413816 12038 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:44.417557 12006 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.737s	user 0.003s	sys 0.004s
I20260709 12:14:44.299415 11880 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.401696 11962 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:44.408198 12019 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:44.417987 12006 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:44.466286 12011 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.214s	user 0.006s	sys 0.005s
I20260709 12:14:44.464834 12044 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:44.492318 12045 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.352s	user 0.008s	sys 0.005s
I20260709 12:14:44.481164 11962 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:44.493664 12050 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.260s	user 0.003s	sys 0.009s
I20260709 12:14:44.607998 12011 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.610348 12011 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.489547 12019 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:44.500520 11974 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.492471 12063 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.614647 12063 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:44.612201 12019 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:44.599050 12034 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.225s	user 0.024s	sys 0.056s
W20260709 12:14:44.620507 12034 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.024s	sys 0.058s
W20260709 12:14:44.519263 12049 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.279s	user 0.005s	sys 0.018s
I20260709 12:14:44.620021 12019 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.652329 12048 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.654794 12048 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.734925 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.300077 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:44.287688 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44288.7us
W20260709 12:14:44.737272 10127 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.017s
W20260709 12:14:44.741274 10127 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.001s	sys 0.017s
I20260709 12:14:44.741564 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.735605 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 206) took 1725 ms. Trace:
I20260709 12:14:44.737923 10051 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:44.318305 10123 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:14:44.783406 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 995) took 2132 ms (client timeout 1890 ms). Trace:
W20260709 12:14:44.783972 10201 rpcz_store.cc:269] 0709 12:14:42.650676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.942618 (+291942us) service_pool.cc:224] Handling call
0709 12:14:44.783015 (+1840397us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540007ec54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.783202 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314737408}
I20260709 12:14:44.784699 12042 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.785284 10123 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:44.785387 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.301204 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1809) took 1495 ms. Trace:
I20260709 12:14:44.787292 10052 rpcz_store.cc:276] 0709 12:14:42.805791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.242527 (+1436736us) service_pool.cc:224] Handling call
0709 12:14:44.301142 (+ 58615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.788530 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.786228 12048 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:44.318697 11663 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:44.278083 11933 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.792575 11933 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.794203 10203 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:44.739876 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 998) took 2088 ms (client timeout 2115 ms). Trace:
W20260709 12:14:44.754920 10128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 209) took 1687 ms (client timeout 1635 ms). Trace:
I20260709 12:14:44.786888 10047 raft_consensus.cc:2368] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:44.796262 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1517) took 1545 ms. Trace:
I20260709 12:14:44.759063 10122 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:44.761233 10195 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:44.799240 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 202) took 1855 ms. Trace:
I20260709 12:14:44.799721 10122 rpcz_store.cc:276] 0709 12:14:42.943875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.971896 (+ 28021us) service_pool.cc:224] Handling call
0709 12:14:44.757752 (+1785856us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:44.758237 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.798937 (+ 40700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.799178 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70560000}
W20260709 12:14:44.761708 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1502) took 2471 ms (client timeout 2082 ms). Trace:
I20260709 12:14:44.793002 12048 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.762393 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:44.801932 10199 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:44.802835 10054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1814) took 1922 ms (client timeout 1799 ms). Trace:
W20260709 12:14:44.803221 10054 rpcz_store.cc:269] 0709 12:14:42.880228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.101159 (+220931us) service_pool.cc:224] Handling call
0709 12:14:44.802382 (+1701223us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003d0254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.802610 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427906944}
W20260709 12:14:44.763190 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1086) took 1406 ms (client timeout 1723 ms). Trace:
W20260709 12:14:44.804141 10125 rpcz_store.cc:269] 0709 12:14:43.356238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.428982 (+ 72744us) service_pool.cc:224] Handling call
0709 12:14:44.762703 (+1333721us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54001284d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.762967 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089913728}
W20260709 12:14:44.763515 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 363122us
W20260709 12:14:44.764638 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1080) took 1410 ms (client timeout 1863 ms). Trace:
I20260709 12:14:44.401960 11874 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.797931 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.786386 10201 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:44.808030 10126 rpcz_store.cc:269] 0709 12:14:43.353772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.358136 (+  4364us) service_pool.cc:224] Handling call
0709 12:14:44.764273 (+1406137us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400231254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.764487 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101981056}
W20260709 12:14:44.800900 10200 rpcz_store.cc:269] 0709 12:14:42.290415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.581155 (+290740us) service_pool.cc:224] Handling call
0709 12:14:44.761247 (+2180092us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540007dd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.761458 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3909536128}
I20260709 12:14:44.769964 11501 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:44.816823 11501 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.818755 11871 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.819226 11501 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.761710 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 477) took 1075 ms. Trace:
I20260709 12:14:44.821444 12065 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:44.294178 11825 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.822757 12065 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:44.821923 11921 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:44.822633 11982 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:44.824419 12064 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:44.825038 12064 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:44.826503 12064 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.823223 12065 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:44.770993 12044 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:44.795099 10196 rpcz_store.cc:269] 0709 12:14:42.651402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.086036 (+434634us) service_pool.cc:224] Handling call
0709 12:14:44.739183 (+1653147us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000e83d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.739506 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742651264}
I20260709 12:14:44.770728 11794 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:14:44.795552 10128 rpcz_store.cc:269] 0709 12:14:43.082143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.128997 (+ 46854us) service_pool.cc:224] Handling call
0709 12:14:44.754269 (+1625272us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400408154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.754621 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263242624}
W20260709 12:14:44.775656 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 366995us
I20260709 12:14:44.743546 10124 rpcz_store.cc:276] 0709 12:14:43.010003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.010169 (+   166us) service_pool.cc:224] Handling call
0709 12:14:43.045053 (+ 34884us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:43.045434 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.045462 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:43.065894 (+ 20432us) log.cc:844] Serialized 52 byte log entry
0709 12:14:43.136130 (+ 70236us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:43.136170 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.136859 (+   689us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.493080 (+1356221us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:44.734570 (+241490us) raft_consensus.cc:1685] finished
0709 12:14:44.734630 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.735219 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":515,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9732,"spinlock_wait_cycles":2620672,"thread_start_us":39153,"threads_started":1,"wal-append.queue_time_us":130212}
W20260709 12:14:44.777946 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.764539 10204 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:44.375885 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:44.834415 10198 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:44.836246 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.751278 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1820) took 1463 ms. Trace:
I20260709 12:14:44.837582 10046 rpcz_store.cc:276] 0709 12:14:43.282124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.726370 (+1444246us) service_pool.cc:224] Handling call
0709 12:14:44.745220 (+ 18850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.838827 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.755543 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:44.839267 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1817) took 1922 ms (client timeout 2182 ms). Trace:
W20260709 12:14:44.839839 10053 rpcz_store.cc:269] 0709 12:14:42.916247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.895761 (+979514us) service_pool.cc:224] Handling call
0709 12:14:44.838895 (+943134us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400087354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.839080 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384554880}
I20260709 12:14:44.841383 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.839933 10121 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.842665 10050 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:44.834172 10049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1508) took 2422 ms (client timeout 2301 ms). Trace:
W20260709 12:14:44.843372 10049 rpcz_store.cc:269] 0709 12:14:42.413846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.562029 (+148183us) service_pool.cc:224] Handling call
0709 12:14:44.833752 (+2271723us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400140354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.833979 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335733504}
I20260709 12:14:44.844380 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.842139 10053 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.845997 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.851913 10122 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:44.853106 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.844470 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.820014 10729 rpcz_store.cc:276] 0709 12:14:43.686183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.714357 (+ 28174us) service_pool.cc:224] Handling call
0709 12:14:43.790345 (+ 75988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:43.790835 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:43.790867 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:43.791446 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.006740 (+215294us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:44.007611 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.009790 (+  2179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.761143 (+751353us) raft_consensus.cc:1685] finished
0709 12:14:44.761180 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.761462 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":201520,"threads_started":1,"wal-append.queue_time_us":419952}
I20260709 12:14:44.803668 11917 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.796720 10051 rpcz_store.cc:276] 0709 12:14:43.251225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.299809 (+1048584us) service_pool.cc:224] Handling call
0709 12:14:44.796169 (+496360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.809108 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1511) took 1446 ms. Trace:
I20260709 12:14:44.855872 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.856091 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:44.465508 11880 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.823711 12062 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:14:44.828311 12064 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.830199 12065 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.789302 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:44.856885 10049 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:44.864874 11982 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:44.837198 10054 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.865388 11982 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:44.865674 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1822) took 1558 ms. Trace:
I20260709 12:14:44.847033 10046 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:44.834152 10047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1815) took 1925 ms (client timeout 1760 ms). Trace:
I20260709 12:14:44.848660 10126 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:44.860080 11917 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:44.867686 11917 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.868171 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.842067 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:44.757030 12006 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.849611 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.870610 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:44.871398 10125 raft_consensus.cc:2410] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:44.871876 12062 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:44.872557 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.854892 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.872761 12062 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:44.874754 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.875401 10128 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:44.876677 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.887408 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1492) took 2653 ms. Trace:
W20260709 12:14:44.881991 10055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1816) took 1966 ms (client timeout 2447 ms). Trace:
I20260709 12:14:44.887708 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:44.769968 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:44.879428 10126 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.887904 10203 rpcz_store.cc:276] 0709 12:14:42.233974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.130238 (+896264us) service_pool.cc:224] Handling call
0709 12:14:44.793634 (+1663396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.794711 (+  1077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.887125 (+ 92414us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540007ec50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.887309 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3804524288}
I20260709 12:14:44.876926 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.855891 10197 rpcz_store.cc:276] 0709 12:14:43.360673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.953426 (+592753us) service_pool.cc:224] Handling call
0709 12:14:43.953754 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.185493 (+231739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.782102 (+596609us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400002154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:44.797322 (+ 15220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313737472}
I20260709 12:14:44.794641 11663 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.893983 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.894258 11663 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.895354 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:44.888392 10055 rpcz_store.cc:269] 0709 12:14:42.915962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.069604 (+1153642us) service_pool.cc:224] Handling call
0709 12:14:44.881626 (+812022us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54002f85d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.881814 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63849216}
I20260709 12:14:44.896301 12044 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:44.896700 12044 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:44.897049 12044 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.897404 11974 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:44.866942 10047 rpcz_store.cc:269] 0709 12:14:42.908741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.093506 (+184765us) service_pool.cc:224] Handling call
0709 12:14:44.833858 (+1740352us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400086e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:44.834080 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3756685056}
I20260709 12:14:44.878412 10124 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:44.899868 11974 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.900430 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.900712 11974 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:44.901176 10124 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.856844 10051 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:44.903033 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 133509us
I20260709 12:14:44.904356 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:44.904536 11974 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:44.905022 11974 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:44.880213 11917 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:44.874704 12065 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.908596 12044 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:44.851526 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.878964 11982 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.866830 10049 rpcz_store.cc:276] 0709 12:14:43.307288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.855546 (+1548258us) service_pool.cc:224] Handling call
0709 12:14:44.865529 (+  9983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.878856 11794 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.913141 11794 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.915767 11794 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.854225 10122 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:44.906024 11974 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:44.917788 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.864482 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.904778 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:44.920794 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:44.881096 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.923640 10125 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:44.925853 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:44.926970 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.927850 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.914563 11982 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:44.931602 11794 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.932298 11945 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:44.933109 11934 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:44.933501 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.934406 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:44.966557 11934 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:44.968066 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.936007 10203 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:14:44.938362 10198 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:44.939513 10204 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:44.940606 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.942065 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.943454 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:44.944535  9951 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 172) took 8775 ms. Trace:
I20260709 12:14:44.944896 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:44.922606 10122 raft_consensus.cc:2376] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4. Re-sending same reply.
W20260709 12:14:44.946208 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.947600 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:44.945129 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:44.951351 11974 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:44.952430 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1511) took 2483 ms. Trace:
I20260709 12:14:44.820143 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:44.955761 12062 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.924626 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:44.960305 10054 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
I20260709 12:14:44.961839 10051 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:14:44.966794 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.969548 10053 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:44.969242 10203 pending_rounds.cc:85] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 2
I20260709 12:14:44.971589 10050 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:45.033536 10046 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.033807 10046 raft_consensus.cc:614] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:44.969012 11934 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:44.968940 10197 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.032671 10049 rpcz_store.cc:276] 0709 12:14:42.460538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.913645 (+2453107us) service_pool.cc:224] Handling call
0709 12:14:44.915000 (+  1355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.916265 (+  1265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.916343 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:44.916570 (+   227us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:44.928933 (+ 12363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.929081 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.929216 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.041086 10047 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:45.012848 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.044775 12044 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:45.019606 11898 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.725s	user 0.002s	sys 0.011s
W20260709 12:14:45.047003 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 123260us
I20260709 12:14:44.971897 10201 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.052570 10124 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:45.051795 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.051401 11945 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:45.058168 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.997339 12048 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.058737 10055 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:14:45.063027 10128 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.039915 10203 pending_rounds.cc:107] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:14:45.065552 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:45.069597 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 122247us
I20260709 12:14:45.060871  9953 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 2 to 3, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.080087 10048 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:45.083389 10203 raft_consensus.cc:2889] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.084110 10198 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:45.062387 11898 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.092196 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.092482 10049 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.093240 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 203) took 2377 ms. Trace:
I20260709 12:14:45.094364 10129 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.094975 11794 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:45.095810 11794 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.097136 10094 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4.
I20260709 12:14:45.056380 12062 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.100786 12062 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.093818 11945 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.063396 12044 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.098685 11874 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:45.102746 10053 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:45.126725 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 201) took 2431 ms. Trace:
I20260709 12:14:45.127063 10053 rpcz_store.cc:276] 0709 12:14:42.695247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.045766 (+2350519us) service_pool.cc:224] Handling call
0709 12:14:45.079654 (+ 33888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.126490 (+ 46836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.126673 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.093550 10049 rpcz_store.cc:276] 0709 12:14:42.716102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.056830 (+2340728us) service_pool.cc:224] Handling call
0709 12:14:45.092232 (+ 35402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.092989 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.093156 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.109023 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.110301 11945 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.111089 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1514) took 2600 ms. Trace:
I20260709 12:14:45.131177 10054 rpcz_store.cc:276] 0709 12:14:42.510699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.038262 (+2527563us) service_pool.cc:224] Handling call
0709 12:14:45.087534 (+ 49272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.110715 (+ 23181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.110741 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.110813 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.110846 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.110904 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.111012 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.112282 10048 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:45.112689 10204 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:14:45.083431 10168 leader_election.cc:336] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.629s (SENT)
I20260709 12:14:45.109061 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.115638 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1799) took 2418 ms. Trace:
I20260709 12:14:45.124032 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.119082 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.119346 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:45.120070 12006 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.093720 11898 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.132920 10051 rpcz_store.cc:276] 0709 12:14:42.697425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.047576 (+2350151us) service_pool.cc:224] Handling call
0709 12:14:45.087584 (+ 40008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.115340 (+ 27756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.115365 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.115404 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:45.115434 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.115486 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.115583 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.094892 12071 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:45.134851 10053 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.136376 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.136914 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.137754 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.138913 12079 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:45.139612 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 204) took 2417 ms. Trace:
I20260709 12:14:45.159435 10048 rpcz_store.cc:276] 0709 12:14:42.722139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.111776 (+2389637us) service_pool.cc:224] Handling call
0709 12:14:45.112134 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.139311 (+ 27177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.139533 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.159927 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:45.160494 11934 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:45.160912 10048 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:14:45.140053 11871 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.141371 12034 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.161135 11934 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.161984 10204 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.161634 12034 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.141772 10121 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:45.162931 11994 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:45.163340 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1081) took 1809 ms (client timeout 1934 ms). Trace:
W20260709 12:14:45.163740 10121 rpcz_store.cc:269] 0709 12:14:43.354124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.358011 (+  3887us) service_pool.cc:224] Handling call
0709 12:14:44.755034 (+1397023us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:45.163279 (+408245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14329600}
I20260709 12:14:45.164642 12034 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.141420 10054 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:14:45.162051 11871 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.166101 10728 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:45.159524 12079 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:45.167419 11871 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.142941  9953 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.167557 12079 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.144340 12011 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.105654 12044 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.144862 11501 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.145336 11933 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.146848 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.153977 10126 raft_consensus.cc:2410] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:45.155999 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 206) took 2425 ms. Trace:
I20260709 12:14:45.157356 12028 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:45.157609 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.157898 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:45.158854 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.161681 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1808) took 2388 ms. Trace:
I20260709 12:14:45.199251 10051 rpcz_store.cc:276] 0709 12:14:42.773767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.160826 (+2387059us) service_pool.cc:224] Handling call
0709 12:14:45.161150 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.161346 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.161369 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.161424 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:45.161454 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.161507 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.161607 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.200239 12065 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.201047 10051 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:45.201717 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 209) took 2363 ms. Trace:
W20260709 12:14:45.160171 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 97731us
W20260709 12:14:45.203559 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.168946 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1804) took 2433 ms. Trace:
I20260709 12:14:45.204582 10054 rpcz_store.cc:276] 0709 12:14:42.735867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.140617 (+2404750us) service_pool.cc:224] Handling call
0709 12:14:45.141047 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.168694 (+ 27647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.168895 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.206097 10054 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:14:45.206693 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1812) took 2327 ms. Trace:
I20260709 12:14:45.207001 10054 rpcz_store.cc:276] 0709 12:14:42.879689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.205411 (+2325722us) service_pool.cc:224] Handling call
0709 12:14:45.205848 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.206454 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.206638 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:44.970238  9951 rpcz_store.cc:276] 0709 12:14:36.168572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.169635 (+  1063us) service_pool.cc:224] Handling call
0709 12:14:44.943865 (+8774230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:39.272307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:39.394685 (+122378us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:39.395226 (+   541us) write_op.cc:435] Acquired schema lock
0709 12:14:39.396156 (+   930us) tablet.cc:662] Decoding operations
0709 12:14:39.430295 (+ 34139us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:39.430355 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:39.430391 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:39.431003 (+   612us) tablet.cc:701] Row locks acquired
0709 12:14:39.431021 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:14:39.431162 (+   141us) write_op.cc:270] Start()
0709 12:14:40.724144 (+1292982us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5400035b28. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc184b4c9e1 00007fc184b4b64c 00007fc1821db624 00007fc1821c6286 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901 00007fc1821c9b2d 0000000000388634
0709 12:14:40.724409 (+   265us) write_op.cc:276] Timestamp: P: 1783599279431118 usec, L: 0
0709 12:14:40.724433 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:40.758906 (+ 34473us) log.cc:844] Serialized 3281 byte log entry
0709 12:14:41.658781 (+899875us) op_driver.cc:464] REPLICATION: finished
0709 12:14:41.685499 (+ 26718us) write_op.cc:301] APPLY: starting
0709 12:14:41.685588 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:41.685792 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:41.685814 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:41.687150 (+  1336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:41.687356 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:14:41.687403 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:41.687674 (+   271us) log.cc:844] Serialized 65 byte log entry
0709 12:14:41.687846 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.687988 (+   142us) write_op.cc:454] Released schema lock
0709 12:14:41.688030 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:41.688404 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.688437 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":358099,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":24822,"apply.run_cpu_time_us":2763,"apply.run_wall_time_us":2883,"num_ops":8,"prepare.queue_time_us":289103,"prepare.run_cpu_time_us":94571,"prepare.run_wall_time_us":1874423,"raft.queue_time_us":81476,"raft.run_cpu_time_us":11152,"raft.run_wall_time_us":60395,"replication_time_us":909198,"spinlock_wait_cycles":4998400,"thread_start_us":602285,"threads_started":4,"wal-append.queue_time_us":432173,"wal-append.run_cpu_time_us":7259,"wal-append.run_wall_time_us":1402222}]]}
I20260709 12:14:45.172284 10200 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:45.151017 10196 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:45.212823 10168 leader_election.cc:336] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.770s (SENT)
I20260709 12:14:45.202031 10051 rpcz_store.cc:276] 0709 12:14:42.838618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.200279 (+2361661us) service_pool.cc:224] Handling call
0709 12:14:45.200719 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.201453 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.201641 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.144438 10128 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:45.168403 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1805) took 2432 ms. Trace:
I20260709 12:14:45.177593 10204 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:45.193133 10053 rpcz_store.cc:276] 0709 12:14:42.730919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.129587 (+2398668us) service_pool.cc:224] Handling call
0709 12:14:45.134635 (+  5048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.155749 (+ 21114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.155946 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.151275 11794 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.165107 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:45.209326 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.215081 10048 rpcz_store.cc:276] 0709 12:14:42.736137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.160243 (+2424106us) service_pool.cc:224] Handling call
0709 12:14:45.160604 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.168113 (+  7509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.168320 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.215494 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.217134 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37150 (request call id 8) took 2052 ms. Trace:
I20260709 12:14:45.224439 10050 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.222729 10046 rpcz_store.cc:276] 0709 12:14:43.144278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.887429 (+1743151us) service_pool.cc:224] Handling call
0709 12:14:45.196032 (+308603us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002a0b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78a853 00007fc18375860a 00007fc17ccde7d4 00007fc17ccde762 00007fc17ccde691 00007fc17ccde60c 00007fc17ccdd8c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:45.196153 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240058112}
W20260709 12:14:45.230355 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71608.6us
I20260709 12:14:45.231603 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1509) took 2786 ms. Trace:
I20260709 12:14:45.231979 10047 rpcz_store.cc:276] 0709 12:14:42.434306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.898949 (+2464643us) service_pool.cc:224] Handling call
0709 12:14:45.032296 (+133347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.045592 (+ 13296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.220340 (+174748us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400321750. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:45.220472 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305815424}
I20260709 12:14:45.233655 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.193329 12044 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.235420 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1507) took 2832 ms. Trace:
I20260709 12:14:45.235801 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1801) took 2527 ms. Trace:
I20260709 12:14:45.236454 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.237329 10055 rpcz_store.cc:276] 0709 12:14:42.399496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.896513 (+2497017us) service_pool.cc:224] Handling call
0709 12:14:45.035080 (+138567us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.082894 (+ 47814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.227172 (+144278us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002a0b50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:45.231523 (+  4351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317682432}
I20260709 12:14:45.238117 10050 rpcz_store.cc:276] 0709 12:14:42.697996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.048003 (+2350007us) service_pool.cc:224] Handling call
0709 12:14:45.107617 (+ 59614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.224857 (+117240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.225056 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.194789 12048 raft_consensus.cc:2764] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:45.242282 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.241072 10128 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.244239 10053 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:45.244715 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1823) took 1840 ms. Trace:
I20260709 12:14:45.155583 12006 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.249363 10053 rpcz_store.cc:276] 0709 12:14:43.404400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.215842 (+1811442us) service_pool.cc:224] Handling call
0709 12:14:45.244026 (+ 28184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.244512 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.244673 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.228036 11874 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.251271 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.257208 10048 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:45.258246 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1525) took 1386 ms. Trace:
I20260709 12:14:45.258757 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.259222  9953 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.261238  9953 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.263525 10736 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:45.264029 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50934.5us
W20260709 12:14:45.264643 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 355557us
I20260709 12:14:45.236012 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:45.268066 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 148884us
I20260709 12:14:45.268569 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.248592 11982 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:14:45.258616 10048 rpcz_store.cc:276] 0709 12:14:43.871748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.246568 (+1374820us) service_pool.cc:224] Handling call
0709 12:14:45.256920 (+ 10352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.257913 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.258180 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.267350 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.279302 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.279743 10735 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.270841 10736 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:45.280984 11880 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.284919 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 205) took 2558 ms. Trace:
I20260709 12:14:45.287214  9953 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.288604 12048 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.303743 10126 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:45.220912 11933 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.243294 12028 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.239930 12011 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.304471 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.374747 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.249171 11945 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:45.319293 10199 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:45.377974 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:45.324077 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68767.9us
I20260709 12:14:45.300099 10733 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:45.362138  9953 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.391796 10128 raft_consensus.cc:2410] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:45.390887 10051 pending_rounds.cc:85] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 2
W20260709 12:14:45.353358 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57000.1us
W20260709 12:14:45.390934 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 100153us
I20260709 12:14:45.363104 10047 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:45.243111 10125 raft_consensus.cc:2376] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5. Re-sending same reply.
I20260709 12:14:45.305197 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1093) took 1146 ms. Trace:
I20260709 12:14:45.402074 10051 pending_rounds.cc:107] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:45.301776 10049 rpcz_store.cc:276] 0709 12:14:42.726054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.128187 (+2402133us) service_pool.cc:224] Handling call
0709 12:14:45.142226 (+ 14039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.142584 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:45.142925 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.284543 (+141618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.284601 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:45.284657 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.284725 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.284856 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1091,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":35,"raft.queue_time_us":35644,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":105604,"threads_started":1}
W20260709 12:14:45.319597 10702 connection.cc:256] RPC call timeout handler was delayed by -1.1501524100001461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
I20260709 12:14:45.375505 10046 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:45.399128 10198 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:45.402721 10051 raft_consensus.cc:2889] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:45.310786 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.404719 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1526) took 1478 ms. Trace:
I20260709 12:14:45.405804 10047 rpcz_store.cc:276] 0709 12:14:43.926779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.248173 (+1321394us) service_pool.cc:224] Handling call
0709 12:14:45.355041 (+106868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.401891 (+ 46850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.404659 (+  2768us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:45.379853 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.372931 12087 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:45.384321 10197 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:45.407869 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.408726 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.409009 10052 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:45.360617 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.373693 10731 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.375837 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.411794 10053 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.375973 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1100) took 1162 ms. Trace:
I20260709 12:14:45.399855 11945 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:45.430008 11945 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.430598 11880 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.409711 11703 raft_consensus.cc:2764] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:45.381259 11934 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.402249 10127 rpcz_store.cc:276] 0709 12:14:44.158389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.235806 (+ 77417us) service_pool.cc:224] Handling call
0709 12:14:44.236075 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.236289 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:44.741991 (+505702us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.235893 (+493902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.241690 (+  5797us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:45.246597 (+  4907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.270397 (+ 23800us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.305135 (+ 34738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7429,"prepare.queue_time_us":955815,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":36709,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11683,"thread_start_us":933607,"threads_started":2}
I20260709 12:14:45.411352  9953 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.432566 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.432839  9953 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.433718 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.434856 10122 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:45.436203 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:45.436540 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 305231us
I20260709 12:14:45.439023 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.439687 10124 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:45.442090 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.443614 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.444653 10731 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:45.400293 12048 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.446539 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.426633 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.447846 10126 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.365342 11898 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:14:45.448733 11898 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:45.449098 11898 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:45.451340 12028 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.451911 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.453876 10728 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:45.454788 10049 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:14:45.455132 10049 pending_rounds.cc:85] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:14:45.422937 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.425889 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.455737 10733 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:45.455835 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:45.456591 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.456916 10128 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.458005 10128 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.297250 11501 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.462812 10049 pending_rounds.cc:107] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:14:45.449048 10126 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:45.439282 10737 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:45.455261 10130 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:45.379354 11794 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:14:45.460579 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.460531 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.461091 12065 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:45.461560 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.461874 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.425542 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.463335 10127 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.463336 10049 raft_consensus.cc:2889] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:45.462729 10122 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:45.473430 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1519) took 2221 ms. Trace:
I20260709 12:14:45.473904 10054 rpcz_store.cc:276] 0709 12:14:43.251820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.207674 (+1955854us) service_pool.cc:224] Handling call
0709 12:14:45.208022 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.208289 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:45.219537 (+ 11248us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.473123 (+253586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.473168 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:45.473214 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.473277 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.473378 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6617,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":217200,"threads_started":1}
I20260709 12:14:45.475628 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:45.479470 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.479876 10124 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:45.478134 10052 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:45.483811 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 84583.8us
I20260709 12:14:45.486872 10126 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:45.468245 11921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.021s	sys 0.036s
I20260709 12:14:45.488046 10048 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.475648  9953 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.450121 11898 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.473079 10121 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.493857 10204 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:45.498153 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 73467us
I20260709 12:14:45.495329 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:45.493134 11921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.022s	sys 0.036s
I20260709 12:14:45.500165 10730 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:45.499261  9953 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.504920 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.488363 11663 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:45.499459 11738 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:45.488039 12028 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.505614 10204 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:45.489193 12071 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:45.493738 12048 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.470322 11917 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:14:45.506408 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.496541 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.514107 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.506563 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.515731 10169 leader_election.cc:400] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:45.518090 10169 leader_election.cc:403] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:45.509200 11663 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.509995 11738 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:45.517709 10019 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.511570 12071 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.522147 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.518898 11663 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.511902 11794 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:45.512923 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.516776 11933 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.514287 11703 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:45.525697 10204 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:45.517320 12011 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:45.552137 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54338.3us
I20260709 12:14:45.524405 11738 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.524899 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.530939 10729 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:45.558127 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 146941us
I20260709 12:14:45.560194 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:45.561146 10168 leader_election.cc:336] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.607s (SENT)
I20260709 12:14:45.561345 11728 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:14:45.562784 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48582.8us
I20260709 12:14:45.530761 11934 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4.
I20260709 12:14:45.553164 11974 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.566634 11703 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:45.567298 11455 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.465829 10123 rpcz_store.cc:276] 0709 12:14:44.199592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.786303 (+586711us) service_pool.cc:224] Handling call
0709 12:14:44.847486 (+ 61183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.848108 (+   622us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:14:44.848143 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.848799 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.219594 (+370795us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:45.228387 (+  8793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.234751 (+  6364us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.318712 (+ 83961us) raft_consensus.cc:1685] finished
0709 12:14:45.319673 (+   961us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.360547 (+ 40874us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3320,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":343457,"threads_started":1,"wal-append.queue_time_us":417651}
I20260709 12:14:45.571723 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.525110 12071 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.573079 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.556118 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.612247 11728 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:45.612463 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59492.4us
I20260709 12:14:45.614277 11728 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:45.615166 11728 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.576629 11501 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.615967 11728 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:45.615516 11933 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:45.616380 11728 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:45.582499 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1097) took 1423 ms (client timeout 1882 ms). Trace:
I20260709 12:14:45.616708 11933 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:45.616869 10129 rpcz_store.cc:269] 0709 12:14:44.159442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.213217 (+ 53775us) service_pool.cc:224] Handling call
0709 12:14:45.582261 (+1369044us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54001e3f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:45.582407 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933703552}
I20260709 12:14:45.617559 11933 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.618006 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1825) took 1597 ms. Trace:
I20260709 12:14:45.618834 11933 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.619963 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.620792 11974 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.622275 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.622589 11974 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.622893 10202 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:45.585681 11917 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.587704 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.618498 10053 rpcz_store.cc:276] 0709 12:14:44.021057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.268954 (+1247897us) service_pool.cc:224] Handling call
0709 12:14:45.269323 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.424981 (+155658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.617771 (+192790us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400276ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:45.617938 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326885632}
I20260709 12:14:45.624197 10733 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:45.589867 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.596201 10731 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.624528 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:45.599522 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.601153 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:45.601970 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.554605 11898 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:45.602782 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.604264 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:45.607192 11738 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.608465 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:45.532178 11794 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.631780 11794 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.576742 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:45.626638 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.639704 10198 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:45.625058 11455 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.640522 10046 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:45.640957 11501 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.641476 11501 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.641875 11455 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:45.644621 10200 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:45.641418 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:45.646960 10046 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:45.646737 12044 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.647794 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:45.649423 10046 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:45.651880 12006 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.653087 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:45.646878 12104 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.625916 12034 raft_consensus.cc:2764] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:14:45.654877 12104 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.655846 12070 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:45.656401 12070 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:45.657131 12104 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.657774 12104 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.657343 12070 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:45.655268 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52561.2us
I20260709 12:14:45.638355 11917 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.658941 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.648474 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.638017 10053 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:45.649616 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59878.7us
I20260709 12:14:45.638818 10702 leader_election.cc:400] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7.
I20260709 12:14:45.623239 11974 consensus_queue.cc:1243] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:45.662993 10199 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.638229 11874 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:45.668300 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.669544 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:45.627781 11703 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.673621 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.674329 10202 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:45.661398 12048 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:45.675009 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.675385 12048 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.676304 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.676443 10736 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.677454 10736 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.678555 12011 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:45.678948 12011 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.679282 12034 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.679616 12071 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.679278 12011 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.680708 11738 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.681591 12071 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.684373 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.684947 10121 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.686991 10122 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:45.687564 10123 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:45.688880 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:45.680123  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:45.666930 11934 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.693181 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:45.679559 10201 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.003s
I20260709 12:14:45.696408 10125 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:45.697897 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70570us
I20260709 12:14:45.669438 12044 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.705881 10731 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:45.706660 11934 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.706703 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.708916 11934 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:45.709558 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.709893 10201 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:45.710320 12106 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.710799 10200 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:45.693122 11871 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:45.677479 12048 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.711295 10196 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:45.716269 10199 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:45.694061 11874 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:45.695933 11898 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:45.721031 11874 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.727739 10736 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.727970 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.731336 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.732117 10199 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:45.732879 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.732992 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.733444 12104 raft_consensus.cc:1064] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:14:45.733701 10730 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:14:45.733985 12104 raft_consensus.cc:1068] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Unable to promote non-voter 4b3390fbbe574de7bf154b5a6cc35677: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:14:45.734330 11880 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:45.734690 11880 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:45.734964 11794 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:45.735818 12085 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:14:45.736930 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.737669 11794 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.738842 11501 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.739085 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:45.743270  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:45.752974 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1826) took 1731 ms. Trace:
I20260709 12:14:45.753896 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.741756 11728 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.697772 11974 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:14:45.748860 11898 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:45.722214 11871 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:45.766840 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.764966 10048 rpcz_store.cc:276] 0709 12:14:44.021320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.294395 (+1273075us) service_pool.cc:224] Handling call
0709 12:14:45.297424 (+  3029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.491884 (+194460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.752756 (+260872us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002a2454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:45.752916 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417577344}
I20260709 12:14:45.734735 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:45.770345 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.769032 10199 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:45.775419 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 97403.9us
I20260709 12:14:45.777333 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.774282 11934 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.782765 11934 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.784368 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.776582 12104 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.785384 12104 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.785651 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1098) took 1603 ms. Trace:
I20260709 12:14:45.785756 12104 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.723694 11945 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.786012 12044 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.782552 11794 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:45.787388 11794 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.787756 11794 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.786185 12048 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.785516 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:45.786137 11917 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.790810 12048 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.791196 12048 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:45.791590 12048 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.793332 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.794530 11917 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.795008 11728 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.795353 11917 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:45.795836 11917 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.796820 11945 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:45.797467 10204 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:45.786340 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.778215 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.786010 10130 rpcz_store.cc:276] 0709 12:14:44.182817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.360083 (+177266us) service_pool.cc:224] Handling call
0709 12:14:44.360433 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.478626 (+1118193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.785401 (+306775us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001d6854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:45.785600 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413582592}
W20260709 12:14:45.800803 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.801621 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.803493 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.776324 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.805866 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.806622 11880 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:45.807355 12095 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260709 12:14:45.807551 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:45.809834 12048 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.810709 12071 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:45.810907 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88421.3us
W20260709 12:14:45.813371 12110 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:14:45.814203 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.810240 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1523) took 2427 ms. Trace:
I20260709 12:14:45.815341 10054 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:45.817103 11738 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.817787 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.849359 10051 rpcz_store.cc:276] 0709 12:14:43.383129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.214233 (+1831104us) service_pool.cc:224] Handling call
0709 12:14:45.214635 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.442692 (+228057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.442725 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.443211 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.724688 (+281477us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:45.724719 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.809873 (+ 85154us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54002f76d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:45.809917 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.809961 (+    44us) raft_consensus.cc:1685] finished
0709 12:14:45.809974 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.810170 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404903680,"thread_start_us":281104,"threads_started":1,"wal-append.queue_time_us":335396}
I20260709 12:14:45.855006 10198 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:45.785027 11934 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.818512 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:45.783182  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:45.839564 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 180720us
W20260709 12:14:45.897341 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.855356 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:45.806113 11898 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:45.850677 11880 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:45.892592 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.844256 12044 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:45.794919 11871 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:45.902051 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65990.4us
I20260709 12:14:45.905679 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:45.849352 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.845323 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:14:45.891794 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 43874.6us
I20260709 12:14:45.908578 12048 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.910943 11825 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:14:45.911806 11825 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:45.912138 11825 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:45.912899 11825 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.913740 12120 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:45.903141 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.916265 10121 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:14:45.916502 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.917217 11917 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.902878 12044 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:45.919025 12044 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:45.918582 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63290.8us
I20260709 12:14:45.921947 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:45.924386 12065 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.924425 11874 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.844321 11663 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:45.936903 10198 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:45.872315 11794 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.872174 11738 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:45.873358 11921 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:45.941229 10130 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:45.904054 12071 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:45.933975 12106 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.963320 10127 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:14:45.962932 11921 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:45.970366 11825 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.962617 11874 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:14:45.959707 11934 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:45.959864 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:45.976866 10204 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:45.977219 10168 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:45.958293 12006 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:45.941449 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:45.945631 11994 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:14:45.981107 10124 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:45.940533 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:45.977921 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.882s (SENT) [suppressed 28 similar messages]
I20260709 12:14:45.983184 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:45.945150 11738 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.943575 11794 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:45.952082 12120 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:45.980191 12048 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:45.983809 11934 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.978294 11921 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:46.005815 11921 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.007041 11921 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.004910 12112 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.011513 12104 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:46.013665 12104 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:45.997874 11738 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.014514 11738 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.016703 11738 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:46.019284 11455 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:46.021348 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.001170 12006 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:14:45.993963 11945 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:46.025382 11945 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:46.026168 11945 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.027493 11945 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:46.030917 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 124105us
I20260709 12:14:46.034832 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:45.983646 12079 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:46.038357 10169 connection.cc:256] RPC call timeout handler was delayed by -1.133191590000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:14:45.994486 10197 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:45.989557 11898 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:46.046741 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.046808 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.044716 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.032073 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.048571 10126 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:46.054448 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.059429 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:46.061164 10051 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:46.064396 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.064958 10052 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:46.059983 10130 raft_consensus.cc:2376] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5. Re-sending same reply.
I20260709 12:14:46.071527 11738 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.073521 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.063877 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.080509 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:46.138458 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66225.8us
I20260709 12:14:46.138988 10047 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:14:46.142853 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 131050us
I20260709 12:14:46.143219 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:46.144176 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.144349 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:46.045957 12079 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.063088 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:46.145859 11898 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:46.058830 12065 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.072010 11738 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.063416 12116 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:46.059023 12048 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:14:46.155685 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 308748us
W20260709 12:14:46.157716 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 125743us
I20260709 12:14:46.154059 12079 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.146696 10123 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:46.046944 11728 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
W20260709 12:14:46.166823 12115 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:14:46.162060 12065 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.176622 11738 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.177431 11898 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.152129 11934 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.194301 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:46.150660 11917 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:46.231508 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.204861 10196 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:46.151684 12112 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:46.255657 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.264003 11934 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.236580 12070 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:46.204227 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.208348 10124 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 2.
W20260709 12:14:46.278687 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84446.5us
W20260709 12:14:46.283027 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51610.6us
I20260709 12:14:46.284487 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.285094 10048 raft_consensus.cc:2410] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:46.285149 10734 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:46.283809 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.287086 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:46.194623 11921 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:14:46.286571 11703 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:46.288332 12112 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:46.295121 11703 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:46.272480 12104 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:46.289469 11934 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:46.178342 12011 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.295184 12112 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:46.295746 11703 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.283236 12070 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.256917 11880 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:14:46.325981 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 420357us
I20260709 12:14:46.299064 10124 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:46.161469 12116 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:46.296911 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.184973 11874 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:14:46.318137 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:46.314491 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.319211 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:46.331019 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:46.320815 12124 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:46.321518 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.191155 11663 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:46.184864 12044 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.333783 10130 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:46.194710 11825 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
W20260709 12:14:46.316998 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 112976us
I20260709 12:14:46.327105 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:46.285934 12064 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:46.320166 10123 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:46.335721 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:46.337064 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:46.326891 12112 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.340401 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:46.341681 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.342418 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:46.180685 12120 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.329385 12126 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:46.339311 12106 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:46.333392 12124 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.345997 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:46.335368 11982 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:46.350907 11982 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:46.341625 11917 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:46.346009 12064 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:46.352052 11917 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:46.352559 11917 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.340154 11728 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:46.364423 12006 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:46.347695 12028 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:46.345799 11794 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:14:46.351804 11982 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.345811 11825 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:46.352696 12064 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.366650 12131 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:46.345750 12122 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.345628 11880 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:14:46.371295 12065 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.348013 12070 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:46.353507 12124 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.375556 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.376103 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:46.376739 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:46.381573 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:46.392046 10199 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.392400 10198 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.351812 12044 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.386289 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:46.387321 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:46.390517 10202 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:46.379225 12006 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:46.400337 12114 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.245s	user 0.003s	sys 0.000s
I20260709 12:14:46.401538 12123 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:46.337672 12048 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:46.403709 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57791.3us
W20260709 12:14:46.390115 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50727.3us
I20260709 12:14:46.409157 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:46.404615 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.402565 12104 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:46.416846 12104 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:46.418937 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:46.423725 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.424137 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.433264 10199 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:46.440472 10198 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:46.416754 10197 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:46.408423 12123 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:46.351195 12126 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.415840 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:46.426779 12044 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.456771 10128 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:14:46.503557 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.367336 12116 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.532585 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:46.532989 12114 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:46.533281 10125 raft_consensus.cc:2376] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5. Re-sending same reply.
I20260709 12:14:46.510866 12044 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.504529 12140 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
W20260709 12:14:46.536342 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.448606 11880 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:46.438515 11728 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:46.572875 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.585256 10124 raft_consensus.cc:2368] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:46.538791 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.586201 10122 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:46.448976 12123 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.582490 11880 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:46.590481 12006 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.590342 12140 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:46.591552 12140 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:14:46.592483 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 177418us
I20260709 12:14:46.593019 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:46.597676 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 182676us
I20260709 12:14:46.593694 10127 raft_consensus.cc:2376] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4. Re-sending same reply.
I20260709 12:14:46.575834 11738 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.613246 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:46.591506 12127 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:46.616384 10122 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:46.572906 11703 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.598784 12126 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:46.617352 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.618160 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.618986 10051 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:46.626006 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.629627 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.634941 12132 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:46.635159 10052 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:46.635358 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.635591 12132 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:46.635972 10050 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.636338 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.636574 12132 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.590883 11880 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.638609 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.638933 11880 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:46.639568 12137 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:14:46.639739 12129 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.344s	user 0.004s	sys 0.005s
I20260709 12:14:46.632843 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.642299 10055 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.642503 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:46.643056 10049 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:46.644371 10050 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:46.646656 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:46.608290 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:46.607523 12144 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:46.648542 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.618141 12127 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:46.650555 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:46.615638 12011 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:46.657006 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:46.663132 10196 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:46.663097 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.663888 10199 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:46.675124 10054 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.681861 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:46.627082 11738 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.617576 11728 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.652041 12028 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:46.707063 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.667356 11663 raft_consensus.cc:2764] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 12:14:46.710223 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 67819.3us
I20260709 12:14:46.687533 12071 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:46.805502 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.676542 11917 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.807608 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:46.814951 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 206547us
I20260709 12:14:46.815838 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:46.771358 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:46.821929 10019 connection.cc:256] RPC call timeout handler was delayed by -1.8691885060000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:14:46.713958 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.826650 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.827760 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.830394 10200 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:46.812566 12079 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.001s
I20260709 12:14:46.840035 10200 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:46.834465 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.835060 12147 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.847342 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 249205us
I20260709 12:14:46.835414 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.835739 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.836036 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:46.836220 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.836592 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:46.634057 12140 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.712617 12142 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:14:46.805109 12071 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.838975 10196 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:46.835431 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:46.814627 12144 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.853821 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.857621 10734 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.837380 12028 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.863061 10054 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:46.854151 10200 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:46.866010 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:46.808617 11898 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:14:46.867043 10198 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.861554 11874 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.870798 12144 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.871629 12141 raft_consensus.cc:2764] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:46.872040 12145 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:46.897799 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 82032.6us
W20260709 12:14:46.883172 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:46.883101 10046 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:14:46.862320 10732 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:46.891366 11703 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.892369 10054 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:46.863062 12071 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.903546 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:46.866748 12011 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.908007 10198 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:46.863348 12147 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.913879 12147 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:46.914853 12156 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:46.912102 11917 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.843629 12079 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.935829 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:46.901037 12145 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:46.958961 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 93665.8us
I20260709 12:14:46.912218 12011 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:46.951886 11982 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.956300 12145 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.966817 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:46.969995 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:46.855202 12127 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.971961 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:46.972203 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50427.3us
I20260709 12:14:46.965937 12156 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:46.971201 12126 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.015734 10734 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:47.030344 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.004680 11738 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:46.972123 11917 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.012327 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.019887 12142 consensus_queue.cc:1243] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:47.050936 12106 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.051518 12106 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:47.052171 12119 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.896s	user 0.000s	sys 0.016s
I20260709 12:14:47.053656 12157 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:47.054039 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1529) took 1534 ms. Trace:
I20260709 12:14:47.054561 10195 rpcz_store.cc:276] 0709 12:14:45.519399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.519904 (+   505us) service_pool.cc:224] Handling call
0709 12:14:45.744062 (+224158us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:14:45.744205 (+   143us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:45.776814 (+ 32609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.776848 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:45.805203 (+ 28355us) log.cc:844] Serialized 52 byte log entry
0709 12:14:45.858977 (+ 53774us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:45.934998 (+ 76021us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.939685 (+  4687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.939751 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.051599 (+1111848us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:47.053816 (+  2217us) raft_consensus.cc:1685] finished
0709 12:14:47.053838 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.053979 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21581,"prepare.queue_time_us":76549,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7839,"raft.queue_time_us":10199,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":20135,"spinlock_wait_cycles":25610496,"thread_start_us":53095,"threads_started":1,"wal-append.queue_time_us":191555}
I20260709 12:14:47.056972 12168 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.058303 12044 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.056635 12104 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.059419 12104 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.058845 12044 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.061399 12044 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.061700 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.063434 12044 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:47.067022 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 95135.2us
I20260709 12:14:47.068481 12153 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.069021 12153 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.971956 11982 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.071036 12153 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.049456 11917 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.071900 11917 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:47.073019 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.054183 12079 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.074812 12044 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.075389 12044 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.077518 12044 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.078851 12144 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:47.079288 12133 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.759s	user 0.012s	sys 0.000s
I20260709 12:14:47.080639 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:47.081262 12112 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.000s
I20260709 12:14:47.081662 12112 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:47.083091 12163 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:47.083493 12147 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.084022 12147 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:46.973662 12162 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:14:47.071096 11982 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.087386 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:47.088459 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 53243.8us
W20260709 12:14:47.092124 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 80297.7us
W20260709 12:14:47.092765 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55843.6us
I20260709 12:14:47.094391 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.095257 10020 leader_election.cc:400] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:47.049754 12156 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.095546 10020 leader_election.cc:403] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:47.096076 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:47.096958 10048 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.090737 12147 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.091601 12044 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.053668 12106 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.100090 11880 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.104249 11994 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:47.100293 11874 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.103574 11738 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.133922 12158 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.141680 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:47.143513 12064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.029s	sys 0.055s
W20260709 12:14:47.152014 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57682.4us
I20260709 12:14:47.140767 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:47.156184 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62297.8us
I20260709 12:14:47.143103 12044 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:47.145684 11994 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.156941 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.161708 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:47.155087 12064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.029s	sys 0.055s
I20260709 12:14:47.161561 10732 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.167202 11994 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.168267 11917 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.170238 10123 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:14:47.150794 11880 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:47.181315 12157 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.182950 11880 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:47.155311 12144 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:47.150563 12145 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.176774 12165 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.185679 12165 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.186894 12145 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.189780 12165 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.191144 12165 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.197144 12126 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.197696 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.198323 10124 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:47.205538 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.207427 12112 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.207799 12156 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.209419 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.210309 10123 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:47.212046 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:47.178849 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:47.176929 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 76695.8us
W20260709 12:14:47.219087 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 58221.4us
I20260709 12:14:47.219445 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.219785 12006 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.220623 12064 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.221276 12064 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:47.222074 12064 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.222246 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.223457 12141 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.223768 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:47.227404 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65744.1us
I20260709 12:14:47.152585 11738 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.250639 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.251199 12065 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:47.176574 11874 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.253140 10127 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:47.257184 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.259486 12065 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.260888 10123 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:47.261999 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.262496 12165 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:47.230530 12131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.016s	sys 0.007s
W20260709 12:14:47.263198 12131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.016s	sys 0.007s
I20260709 12:14:47.263249 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.263564 12131 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:47.264797 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.260067 12065 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.265386 10735 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:47.236136 12028 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:47.266858 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.158674 12173 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:14:47.253790 12147 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.266779 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.228765 12064 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:47.223654 12153 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:47.259385 11794 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:47.258402 12124 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.002s
I20260709 12:14:47.270025 12028 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:47.275022 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.270887 12158 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.275586 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:47.253556 12132 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.269901 12165 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:47.269268 12065 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.289062 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:47.290849 10053 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:47.281322 12028 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.288713 12132 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.293978 11738 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:47.294631 12123 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.004s
I20260709 12:14:47.295164 11917 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.310997 12158 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.311404 12064 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.283000 12131 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.314741 12132 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.317939 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.318728 10126 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:47.297122 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.319423 10737 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.281999 11794 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:47.298753 12173 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:14:47.303176 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.304013 11738 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:47.305056 10125 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:47.305387 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47216.7us
I20260709 12:14:47.291124 11874 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.321542 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.292312 12147 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:47.291041 12156 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:47.312696 12064 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.323845 10055 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:47.277686 12044 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.314199 12071 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.346673 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.327801 10126 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:47.346966 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.335320 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.347885 10055 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.346728 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.348512 10054 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:47.348730 10203 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:47.326242 10053 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:47.336061 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.349401 10052 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.325541 10730 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:47.350317 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.284253 12124 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.351552 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:47.353940 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.355677 10053 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.289906 12184 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:14:47.328446 12147 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:47.352849 10046 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.365126 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.371407 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.375041 10055 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:14:47.373584 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.346555 12148 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.378819 10121 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:47.339876 11794 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:47.351322 12156 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.380597 10054 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.381958 11794 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.323709 12123 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:47.387732 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 87706.6us
I20260709 12:14:47.356503 11917 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.388866 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.388863 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.392639 12156 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:47.393230 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.376428 12147 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.390671 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.398993 10204 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:47.370954 10732 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:47.374663 12006 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:47.401046 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.404098 10737 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:47.406735 12142 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:47.408509 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:47.403091 10126 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
I20260709 12:14:47.405200 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.387061 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:47.414692 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49652.4us
I20260709 12:14:47.415304 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.416321 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.391425 11874 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:47.418244 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.410338 12011 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.419662 12135 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:47.419834 10201 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:47.420176 12135 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.421659 12123 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.422443 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.423141 12131 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:47.423712 12131 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:47.424623 12131 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.426653 12157 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.427035 12157 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.427345 12157 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.427735 12144 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.422367 12135 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:47.430958 12135 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.431381 12135 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.417395 12162 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.433347 12135 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.423959 10126 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.433941 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.435063 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:47.419551 12011 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.439477 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.377447 11994 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.440109 10130 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:47.447783 10046 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:47.448566 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.446867 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.406502 12006 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:47.403270 11917 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.405536 12153 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:47.466940 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.418795 11874 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:47.482618 11874 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.490836 12173 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.462360 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.491382 12173 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.492254 12144 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.492910 12144 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.493153 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.493366 12173 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:47.493634 12144 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.493793 12147 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.463899 12197 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:47.494580 12197 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:47.494534 12165 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.495024 12197 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.495327 12165 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.495519 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.496102 12165 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.497130 12165 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.417932 12122 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.496111 10053 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:47.499171 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.500020 12188 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:47.500430 12188 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:47.501223 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.501363 12188 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.494758 12141 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:47.501879 10054 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:47.502472 12141 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.502923 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.472577 12071 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.389910 12148 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.503343 12141 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.506034 12148 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.474536 12184 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.506642 12184 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.507010 12184 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.476543 11917 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.503723 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.476722 10049 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:14:47.476987 10052 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.508200 10126 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.463248 11945 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.495086 10055 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:47.480981 12157 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.490731 12135 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.493985 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.522936 10051 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.461988 12006 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.501883 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.525586 10053 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.477864 12124 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.513896 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.526664 10737 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:14:47.515390 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.515955 10054 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:47.528935 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.467658 10046 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:47.508493 10052 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.517153 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.537057 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.537376 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.541663 10735 raft_consensus.cc:2368] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:47.472589 11994 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.542847 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.546813 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.551412 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.563031 10125 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.563647 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:47.571223 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.572795 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.575556 10053 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:47.573346 10200 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
W20260709 12:14:47.576951 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 137647us
I20260709 12:14:47.584472 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.585031 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.564953 10052 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.583875 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.587284 10196 raft_consensus.cc:2410] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:47.587535 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.585973 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.588548 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.588948 10729 raft_consensus.cc:2376] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6. Re-sending same reply.
I20260709 12:14:47.588701 12155 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.592268 10052 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.591612 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.570375 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.594468 10728 raft_consensus.cc:2376] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5. Re-sending same reply.
I20260709 12:14:47.594468 10201 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.599777 10126 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:47.574631 10123 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.576954 11917 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.577309 12148 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.597648 12155 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.540529 12028 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:47.627730 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 209544us
I20260709 12:14:47.629017 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.605871 11994 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.632375 12144 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:47.615702 12079 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.615581 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.599015 12065 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.625932 12155 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.647117 10047 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:47.642675 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.661504 12156 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.663501 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.614243 11917 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:47.678774 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.680123 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.680934 10737 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:47.678211 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.700659 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.702071 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.702646 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:47.709498 10729 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:47.642045 12157 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.700131 10202 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:47.674363 12149 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:47.715682 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:47.715884 10199 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:47.713032 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.674865 10201 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.719583 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.720132 10202 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.713929 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:47.716893 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.676563 12173 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.641443 12112 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:14:47.727556 12139 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:47.730113 12139 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.730540 12139 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.725206 12132 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.731488 12132 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.731814 12132 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:47.736308 12205 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:47.711342 11994 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.711689 12142 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.662482 12079 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.741518 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.745278 10199 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:47.729943 10019 leader_election.cc:400] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:47.742862 12142 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.743314 11794 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.720734 12198 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.747113 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.750355 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.751022 10199 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:47.751802 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.753944 11917 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.755929 12127 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.756230 12028 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:47.757421 12194 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:14:47.177969  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:47.759932 12079 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:47.762871 11874 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:47.766750 12203 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:14:47.767156 10122 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.766064 10168 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:47.725577 12173 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.776472 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.753851 12116 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.795737 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.749836 12142 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:47.798070 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 68256.7us
I20260709 12:14:47.893916 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.773752 12197 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:47.801678 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 61350.9us
I20260709 12:14:47.775060 11794 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.804873 12200 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.898983 12200 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:47.900115 11794 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.900054 12200 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.902356 10046 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:14:47.902230 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.794265 12173 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.796877 12070 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.905205 12070 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:47.908749 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.909412 10046 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:47.797825 12124 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.910725 12124 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:47.912361 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:47.912839 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.803251 10197 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.808554 12188 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.813644 10202 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:47.929462 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.929670 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.802727 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:47.825407 10052 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:47.825408 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.934531 10049 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.825763 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.827281 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:47.906152 12070 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.939061 12124 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.828683 11728 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:47.939867  9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 284) took 11253 ms (client timeout 15000 ms). Trace:
I20260709 12:14:47.941738 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.830633 11880 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.792827 12147 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.942734 12201 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:47.943261 12141 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:47.943773 12141 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.831965 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:47.826040 12148 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:14:47.839035 12065 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:47.839290 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:47.840881 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:47.850538 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.851997 10201 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:47.948848 11728 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:47.949208 11728 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:47.949733 10201 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.950631 12065 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:47.951018 12065 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:47.885707 12155 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.951129 10201 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:47.952528 10201 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:47.853255 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.952740 12155 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.857786 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:47.954268 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 96561.2us
I20260709 12:14:47.954403 12173 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.954985 11994 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:47.955317 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 116122us
I20260709 12:14:47.956060 10201 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:47.957333 12064 consensus_meta.cc:287] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.002s
I20260709 12:14:47.957511 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:47.860656 11874 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:47.958261 11794 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.863082 12184 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:47.959252 11794 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.960603 12184 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:47.867403 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1555) took 1157 ms. Trace:
I20260709 12:14:47.868775 11825 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.873941 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.958084 11921 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:47.877221 12139 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.968155 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.880244 10737 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:47.972327 10049 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:47.940269  9953 rpcz_store.cc:269] 0709 12:14:36.686348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.701718 (+ 15370us) service_pool.cc:224] Handling call
0709 12:14:47.939807 (+11238089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:45.925081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:45.946341 (+ 21260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:45.946389 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:14:45.946407 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:45.947481 (+  1074us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:45.947556 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:45.947583 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:14:46.151925 (+204342us) tablet.cc:701] Row locks acquired
0709 12:14:46.158296 (+  6371us) write_op.cc:260] PREPARE: finished
0709 12:14:46.180875 (+ 22579us) write_op.cc:270] Start()
0709 12:14:46.181048 (+   173us) write_op.cc:276] Timestamp: P: 1783599286158467 usec, L: 0
0709 12:14:46.181077 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:14:46.181791 (+   714us) log.cc:844] Serialized 4009 byte log entry
0709 12:14:46.604470 (+422679us) op_driver.cc:464] REPLICATION: finished
0709 12:14:46.808525 (+204055us) write_op.cc:301] APPLY: starting
0709 12:14:46.829302 (+ 20777us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:46.902093 (+ 72791us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:46.955792 (+ 53699us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:47.002626 (+ 46834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:47.062602 (+ 59976us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:14:47.062649 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:47.062997 (+   348us) log.cc:844] Serialized 77 byte log entry
0709 12:14:47.063202 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:47.063318 (+   116us) write_op.cc:454] Released schema lock
0709 12:14:47.063388 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:47.063756 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:47.063784 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3158,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":78958,"apply.run_cpu_time_us":4431,"apply.run_wall_time_us":353062,"num_ops":10,"prepare.queue_time_us":363855,"prepare.run_cpu_time_us":21386,"prepare.run_wall_time_us":403363,"raft.queue_time_us":231978,"raft.run_cpu_time_us":2573,"raft.run_wall_time_us":6128,"replication_time_us":423196,"thread_start_us":604516,"threads_started":4,"wal-append.queue_time_us":187849}]]}
I20260709 12:14:47.883106 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:47.865919 12006 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:47.884301 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 159685us
I20260709 12:14:47.977536 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.885839 10200 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:47.903141 10054 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:47.930940 10046 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:47.892490 11945 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:47.935381 10127 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:47.828753 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.980533 10129 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:47.829643 10729 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.831207 12028 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:47.944679 12141 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:47.959478 12147 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:47.872784 10198 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:47.933504 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.875945 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.877686  9950 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 4, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:47.965092 10095 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.961117 10197 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:47.957877 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:47.986894 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53502.1us
I20260709 12:14:47.966639 10019 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:47.961169 10048 rpcz_store.cc:276] 0709 12:14:46.710162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.710323 (+   161us) service_pool.cc:224] Handling call
0709 12:14:46.710712 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.097337 (+386625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.867164 (+769827us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002f85d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:47.867320 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887022848}
I20260709 12:14:47.951408 12065 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:47.970377 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:47.970520 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.987931 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.961566 12149 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:47.984517 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 108635us
I20260709 12:14:47.994498 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:47.940150 12197 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:47.969643 10125 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:47.964607 11921 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:47.988698 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.988001 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:47.957468 10201 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:14:47.993482 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:48.006175 10052 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:47.991111  9950 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 4 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.987424 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:47.992754 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:47.997991 10125 pending_rounds.cc:85] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 2
I20260709 12:14:47.954125 12132 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.018036 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.989327 12064 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.998931 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:47.999668 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:48.000890 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.003650 10195 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:48.005043 10047 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:14:48.008426 10125 pending_rounds.cc:107] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:48.035512 10125 raft_consensus.cc:2889] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.008378 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:47.942693 11880 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.036229 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:48.037153 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:47.968910 11825 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.027513 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:48.040115 10052 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:47.996157 12122 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:48.035739 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.990875 11917 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:48.042806 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:48.043678 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:47.997992 12127 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:47.996536 12135 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.047791 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.062925 10125 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:48.046511 10046 raft_consensus.cc:2376] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6. Re-sending same reply.
I20260709 12:14:47.993276 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.050359 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:48.052484 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:48.069523 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.069726 10048 raft_consensus.cc:2376] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6. Re-sending same reply.
I20260709 12:14:48.070637 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.071684 10048 pending_rounds.cc:85] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 5
I20260709 12:14:48.071630 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.072002 10048 pending_rounds.cc:107] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:14:48.069511 10052 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
W20260709 12:14:48.072374 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.073303 11663 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.073695 10125 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:48.056123 10054 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:47.949949 11728 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.019444 12147 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:48.065732 10047 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:48.027640 11874 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:48.083806 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 95181.3us
I20260709 12:14:48.053102 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.086335 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.041939 12064 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.076344 10125 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:48.066365 11455 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.077324 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:48.077677 10046 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:48.087986  9950 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 4 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.072592 12079 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.077574 10199 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:48.049927 12197 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:48.072422 10048 raft_consensus.cc:2889] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.055125 12127 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.182886 12127 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.055368 12122 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:48.186666 12122 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.049767 11917 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:48.187796 11917 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:48.057305 11898 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.191143 11898 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:48.192545 11898 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:48.193812 11898 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:48.065295 12124 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:48.195039 12124 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.197098 12124 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:48.027019 12153 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:14:48.074486 12104 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:48.171346 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 94111.4us
I20260709 12:14:48.089228 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.198630 12104 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.199880 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:48.074352 12144 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.200786 12104 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.202342 10203 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:48.201803 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:48.203364 10204 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:14:48.203747 10204 pending_rounds.cc:85] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:48.203955 10204 pending_rounds.cc:107] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:14:48.204164 10204 raft_consensus.cc:2889] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.202262  9950 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 2 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:14:48.207513 10122 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:48.112159 12064 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.084457 12147 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.081171 12011 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.081336 12156 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.199033 10130 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:14:48.086187 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84682us
I20260709 12:14:48.221496  9950 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.173098 12028 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:48.215876 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 228499us
I20260709 12:14:48.217489 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.089259 11874 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:48.225754 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:48.201014 12144 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:48.229055 12214 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:14:48.229662 10735 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.205374 11994 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.214768 10125 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:14:48.239753 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:48.225515 12147 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.231303  9950 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 3, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.230775 12028 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.232385 11874 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:48.230563 12112 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.312124 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:48.215835 11703 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:14:48.343291 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 274318us
I20260709 12:14:48.358927 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:48.344089 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.344990 10203 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:48.245342 12006 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:48.361444 10125 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.227341 12011 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.229650 12156 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.055933 12198 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.301s
I20260709 12:14:48.080823 12210 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.285s
W20260709 12:14:48.396044 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 224309us
I20260709 12:14:48.406250 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:48.407454 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:48.398706 12104 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.408550 12104 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.409647 12156 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.412590 12011 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.413154 10200 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.413404 11921 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.414914 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.415529 10128 raft_consensus.cc:2376] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4. Re-sending same reply.
I20260709 12:14:48.342260 12028 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.399534 10729 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:48.419548 12132 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:48.109409 12148 consensus_queue.cc:1175] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 6 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.7-5.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:48.423388 12028 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.423731 12144 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.424391 12124 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:48.424770 12124 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.425240 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:48.426074 12028 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.429299 12044 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:48.429796 12044 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:48.430655 12044 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.433079 10124 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:48.434659 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1126) took 1235 ms. Trace:
I20260709 12:14:48.434989 10124 rpcz_store.cc:276] 0709 12:14:47.199615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.200117 (+   502us) service_pool.cc:224] Handling call
0709 12:14:47.200391 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.433484 (+1233093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.434401 (+   917us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400172d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:48.434598 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834476288}
I20260709 12:14:48.437074 12135 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:48.437510 12135 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:48.358721 12158 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:48.404482 10129 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:14:48.425102 12124 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.251348 11994 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:48.450878 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 249142us
I20260709 12:14:48.384393 12079 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:48.455365  9950 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.465126 10200 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:48.458355  9950 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 2, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 2 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.388901 12139 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.468835 10049 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:14:48.452988 12211 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 12:14:48.475878  9950 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.401644 12224 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:48.494863 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:48.388172 12116 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:14:48.449689 12104 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.452245 12156 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:48.461642 12209 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.397s	user 0.001s	sys 0.001s
I20260709 12:14:48.461282 12011 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:48.463356 12200 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.451231 12006 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:14:48.462086 12079 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.467926 11880 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:48.472220 12216 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:14:48.471928 11825 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.471465 12158 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:48.453737 11945 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.586747 11703 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:48.586760 12011 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:48.438361 12135 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:48.609596 12213 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 12:14:48.591799 12224 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:48.603281 12079 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.621340 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1138) took 1051 ms. Trace:
I20260709 12:14:48.633940 10126 rpcz_store.cc:276] 0709 12:14:47.570131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.600395 (+ 30264us) service_pool.cc:224] Handling call
0709 12:14:47.600599 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:47.719656 (+119057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.719689 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:47.720166 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:14:48.011973 (+291807us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:48.012030 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.417445 (+405415us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:48.586878 (+169433us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001900d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:48.586931 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:48.621142 (+ 34211us) raft_consensus.cc:1685] finished
0709 12:14:48.621159 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.621285 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":871,"raft.queue_time_us":703,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5614,"spinlock_wait_cycles":299666944,"thread_start_us":262539,"threads_started":1,"wal-append.queue_time_us":574195}
W20260709 12:14:48.630511 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.630064 12028 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.637248 12227 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:14:48.637586 12028 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.596977 12156 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.640583 12232 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.641121 12232 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.641944 10728 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:48.603618 12200 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:48.648365 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.656214 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:48.613787 11703 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.613618 11945 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.584755 12149 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:48.604691 12104 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 12:14:48.659961 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 416940us
I20260709 12:14:48.660852 10125 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:48.663043 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:48.662461 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 253496us
W20260709 12:14:48.636111 12142 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.696s	user 0.005s	sys 0.005s
I20260709 12:14:48.666929 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:48.653002 12135 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.667562 10202 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:48.672133 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.025s	sys 0.010s
W20260709 12:14:48.672534 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.025s	sys 0.010s
I20260709 12:14:48.672433 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:48.673262 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 652310us
I20260709 12:14:48.674280 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:48.621076 12147 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.678196 10049 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:48.681164 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:48.681715 10199 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.686968 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:48.687655 10049 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:48.688627 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:48.689281 10052 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:48.690280 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:48.690941 10049 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:48.692075 10052 pending_rounds.cc:85] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 1
I20260709 12:14:48.692399 10052 pending_rounds.cc:107] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:48.692668 10052 raft_consensus.cc:2889] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.699879 10735 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:48.702817 10198 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:48.703508 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:48.704839 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:48.628145 12225 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:14:48.708253 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:48.678586 12131 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:48.713532 10127 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:48.712415 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:48.719265 10734 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:48.726012 10202 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:14:48.729112 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:48.667742 12142 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:48.717108 11917 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.002s
I20260709 12:14:48.694520 11794 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:14:48.736702 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:48.775368 10199 raft_consensus.cc:2410] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:48.729564 12223 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.804360 10737 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:48.730643 12225 consensus_queue.cc:1243] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:48.713217 11982 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:48.710013 11880 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:14:48.676977 12011 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.733026 12210 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:48.737264 12104 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:48.814524 12222 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:48.815047 12215 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:14:48.815351 12235 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.815758 12212 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:48.676831 12158 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:48.818660 12234 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:14:48.820152 12200 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:48.825284 12188 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.003s
W20260709 12:14:48.829422 12065 consensus_meta.cc:287] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.826s	user 0.006s	sys 0.002s
I20260709 12:14:48.831434 11794 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:48.833063 12228 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:48.708074 12224 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:48.850003 12064 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.002s
I20260709 12:14:48.852831 11874 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.737349 12131 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:48.854014 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 117399us
I20260709 12:14:48.856729 12173 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.739018 12006 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 12:14:48.806689 12116 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:48.866259 12122 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.000s
I20260709 12:14:48.739862 11917 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.802021 12112 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:14:48.923647 10126 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:48.885681 12104 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.950824 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:48.951962 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.919747 12011 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:48.898767 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:48.975183 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:48.976867 11945 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:48.970324 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:48.918296 12233 consensus_queue.cc:1175] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a29bed9eb81541dba9ec7a447986e01e" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:14:48.980391 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 270738us
I20260709 12:14:48.938249 12234 consensus_queue.cc:1243] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:48.986379 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:48.989590 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.006955 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:48.977548 11880 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.980221 12212 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:48.984488 11703 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:48.957752 12065 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.022548 10130 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:48.919303 12222 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:48.882407 12210 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.004951 12147 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.026729 10128 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:49.026352 10122 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:49.031540 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.936571 12235 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.009792 12122 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:49.034623 12124 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.002s
I20260709 12:14:49.058720 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:49.059508 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.060305 10202 raft_consensus.cc:2410] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:49.011715 12244 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:14:49.053675 10130 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:48.985030 12064 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.014803 10197 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:49.088660 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:49.023875 12116 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.015966 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.063059 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:49.015902 12104 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.064009 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.065016 12235 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.065249 11917 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.065466 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.066243 11874 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.067816 12065 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.143966 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:49.070716 10122 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:49.145501 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.146675 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.073323 12239 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:14:49.056281 12142 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.042037 11945 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:49.074999 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:49.035054 11982 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.054124 11794 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:49.078006 11921 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.036824 12149 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.065249 10736 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:49.080225 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.080771 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.038100 11880 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:14:49.182691 12242 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:14:49.183785 11880 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.055902 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:49.185334 12135 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.510s	user 0.000s	sys 0.013s
I20260709 12:14:49.155038 12251 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.186224 12251 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.090750 10195 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:49.188033 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.188635 10195 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:49.189042 12253 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:49.189455 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:49.089357 10128 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:49.132516 12116 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.193964 12116 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.175354 11982 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:49.162694 12079 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 12:14:49.199791 12079 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.201684 12079 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:49.202315 11794 consensus_queue.cc:1243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:49.202666 12184 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:49.203094 12184 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:49.203981 12184 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.204993 12184 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.129820 11703 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:49.206617 11703 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:49.206943 11703 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:49.207676 11703 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.208804 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.209168 11728 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.211447 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:49.211615 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.212049 10050 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:14:49.212381 11917 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:49.212915 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.202366 12222 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.213032 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1050) took 1126 ms. Trace:
I20260709 12:14:49.214309 10200 rpcz_store.cc:276] 0709 12:14:48.086541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.239501 (+152960us) service_pool.cc:224] Handling call
0709 12:14:49.212888 (+973387us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:49.212978 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397392640}
W20260709 12:14:49.216450 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.218883 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.219623 12155 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:49.219761 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.219933 12232 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.221077 12149 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.223073 12149 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.222160 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:49.224176 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.212201 10054 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.226681 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.227254 10199 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:49.230751 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.092120 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.092777 12147 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.092990 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:49.099699 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 102681us
I20260709 12:14:49.054975 12210 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.081179 12124 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:49.061744 12127 consensus_meta.cc:287] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.000s
I20260709 12:14:49.127705 10125 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:49.134575 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.150717 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:49.163450 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.165720 10122 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:49.136204 12131 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:49.142647 12230 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.264s	user 0.000s	sys 0.003s
I20260709 12:14:49.162912 12112 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:49.295188 12112 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.296689 10198 pending_rounds.cc:85] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:14:49.297112 10198 pending_rounds.cc:107] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:49.170161 12250 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:14:49.298498 10730 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:49.297407 10198 raft_consensus.cc:2889] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:49.155085 12241 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
I20260709 12:14:49.300390 11982 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:49.137089 12200 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.174515 10734 raft_consensus.cc:2410] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:49.292325 10049 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:49.078781 12212 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.177183 12064 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:49.181236 12122 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.181888 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.316119 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.090152 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:49.317337 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 227264us
I20260709 12:14:49.233700 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.307358 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:49.223546 12139 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:49.324371 10121 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:49.220134 12222 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:14:49.238543 10051 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:14:49.294122 12127 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.301419 10049 pending_rounds.cc:85] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:14:49.330351 10049 pending_rounds.cc:107] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:49.330649 10049 raft_consensus.cc:2889] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:49.238579 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:49.305352 10201 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:49.262086 12228 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:49.234095 12044 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:49.233304 12144 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:49.236977 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.323675 10737 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:49.343586 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 106679us
I20260709 12:14:49.329787 10736 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:49.291467 12261 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:49.297338 12112 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.239168 12232 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:49.325453 10054 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:49.169270 12011 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:49.239203 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 102307us
I20260709 12:14:49.337889 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.352084 10735 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:49.341256 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.237066 12155 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.344959 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.347776 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:49.262223 12201 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
W20260709 12:14:49.353049 10127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1751) took 1387 ms (client timeout 1509 ms). Trace:
W20260709 12:14:49.374864 10127 rpcz_store.cc:269] 0709 12:14:47.966065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.984248 (+ 18183us) service_pool.cc:224] Handling call
0709 12:14:49.352875 (+1368627us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400230854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:49.352989 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560480640}
I20260709 12:14:49.376345 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:49.328060 11728 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.324204 12139 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:49.377365 11728 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.377851 12139 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.379065 12139 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.379755 11728 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.324206 12149 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:49.363912 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:49.381673 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.365041 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:49.351532 10122 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:49.383127 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:49.239732 12147 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.383818 10122 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:49.384598 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:49.336069 12228 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.367226 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.368935 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:49.369845 10737 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:49.373557 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 227) took 1379 ms. Trace:
I20260709 12:14:49.390583 10737 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:49.387180 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:49.348044 12131 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:49.385226 10122 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:49.335834 12079 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:49.365851 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:49.384224 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.348233 12261 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.398401 10050 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.348232 12044 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.406678 12044 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.407505 12235 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:49.306540 12200 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.400807 10737 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.238085 11663 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 12:14:49.390730 10053 rpcz_store.cc:276] 0709 12:14:47.994271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.039820 (+ 45549us) service_pool.cc:224] Handling call
0709 12:14:48.064557 (+ 24737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:48.067061 (+  2504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.067090 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:48.423654 (+356564us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b2c000014c8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:14:48.424007 (+   353us) log.cc:844] Serialized 26 byte log entry
0709 12:14:48.715987 (+291980us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:49.024995 (+309008us) log.cc:844] Serialized 14 byte log entry
0709 12:14:49.334491 (+309496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.334569 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.334611 (+    42us) raft_consensus.cc:1685] finished
0709 12:14:49.373335 (+ 38724us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.373483 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2142,"prepare.queue_time_us":365021,"prepare.run_cpu_time_us":2127,"prepare.run_wall_time_us":31815,"raft.queue_time_us":52778,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":6113,"spinlock_wait_cycles":21778816,"thread_start_us":887609,"threads_started":3,"wal-append.queue_time_us":554539}
I20260709 12:14:49.347425 12144 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.342706 12122 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:49.402104 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.403419 12147 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.376922 10127 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.324409 12104 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.392874 12006 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:49.408211 11945 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:49.399320 12224 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:49.363042 11982 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.414714 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.450687 10733 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:49.374670 12244 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:49.362897 12270 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:49.417321 10202 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:14:49.417933 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 237) took 1384 ms. Trace:
I20260709 12:14:49.414351 12237 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:49.403368 12256 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:49.422775 10737 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:49.427744 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.409257 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.394356 12228 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.440337 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:49.393042 11874 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:14:49.462747 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.463893 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.440939 11738 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.441407 12238 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:49.396672 12131 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:49.410472 10050 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:49.392719 10123 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:49.411283 12261 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.371779 12011 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:49.364727 12116 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:14:49.383396 12250 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:14:49.451517 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.373171 12232 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:49.455662 10124 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:49.454785 10048 rpcz_store.cc:276] 0709 12:14:48.033286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.071241 (+ 37955us) service_pool.cc:224] Handling call
0709 12:14:48.071528 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:48.181640 (+110112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.181671 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:48.182083 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:14:48.611700 (+429617us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:48.611741 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.611862 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.417706 (+805844us) raft_consensus.cc:1685] finished
0709 12:14:49.417730 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.417874 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":429308,"threads_started":1,"wal-append.queue_time_us":555095}
I20260709 12:14:49.438093 12144 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:49.460559 10736 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:14:49.464573 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 75939.7us
I20260709 12:14:49.463056 12244 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:49.419467 12165 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:49.471283 10737 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:49.475150 12071 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.475716 12224 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.476714 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.549578 10733 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:49.457249 11982 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.452334 12006 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:49.454582 12270 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.444924 12122 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.538556 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.462072 12222 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.461016 11728 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:14:49.467120 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 101333us
I20260709 12:14:49.471485 12064 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:49.465562 11945 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:49.531617 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.546321 10737 pending_rounds.cc:85] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 6
I20260709 12:14:49.571560 10737 pending_rounds.cc:107] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:49.571862 10737 raft_consensus.cc:2889] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:49.489283 12267 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:49.486543 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:49.553814 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:49.463588 12237 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:49.595245 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53612.2us
I20260709 12:14:49.596025 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:49.546733 11921 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:49.483429 11738 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.568069 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.572796 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:49.575912 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:49.559301 12124 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.608562 10127 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
W20260709 12:14:49.609938 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 123494us
I20260709 12:14:49.563359 12270 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:49.586789 10737 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:49.596131 12237 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.530954 12280 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.596985 12292 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:49.577991 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:49.597527 10048 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.599159 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:50.026397 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 427292us
I20260709 12:14:49.580094 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:49.667238 10195 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:49.668773 10736 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:49.733655 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 162040us
I20260709 12:14:49.550727 12244 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.731196 12104 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:49.605675 12258 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:49.717294 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1550) took 2111 ms. Trace:
I20260709 12:14:49.601006 12184 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:49.606252 11738 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.621713 11874 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:14:49.605837 12275 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:14:50.044458 12239 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.044297 11874 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.606118 12281 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:50.044934 12239 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.045428 12281 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:49.605965 12283 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.045637 12244 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.046257 11874 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.045997 12283 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.036204 12289 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:50.047272 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:49.717294 12006 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.047868 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:50.048353 12283 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.555135 12224 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.036460 12292 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.049329 12292 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.589818 12064 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:50.050559 12064 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.048825 12239 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.052229 12028 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:49.555449 12071 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.609709 12127 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:49.726876 11663 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:14:49.721475 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.565197 12131 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.553874 12232 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:49.672245 12142 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:49.675522 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:49.570480 12222 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:49.573920 11728 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:49.606685 12269 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:14:49.621702 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:50.030122 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.589563 12116 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:14:50.027258 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:49.784674 11982 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.067873 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:50.068563 12131 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.069075 12281 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.069912 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:50.070081 12281 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:49.611506 12267 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.072400 12267 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.072960 11874 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:50.073248 12223 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:50.073591 11874 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:50.074054 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.074834 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.778107 12274 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:14:50.075912 11728 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.076324 12028 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.076423 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:50.076862 12028 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.078558 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1580) took 1025 ms. Trace:
W20260709 12:14:49.787150 12282 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:14:50.068522 12071 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:50.079456 11663 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:49.779124 12271 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:14:50.041308 10196 rpcz_store.cc:276] 0709 12:14:47.606368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.606483 (+   115us) service_pool.cc:224] Handling call
0709 12:14:47.624459 (+ 17976us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:47.632109 (+  7650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:47.632140 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:47.641864 (+  9724us) log.cc:844] Serialized 52 byte log entry
0709 12:14:47.890165 (+248301us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:47.950516 (+ 60351us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.950724 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.950786 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.581632 (+1630846us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b2400260228. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e1fb0 00007fc17e358488 00007fc17e358be8 00007fc17e330398 00007fc17e32b76a 00007fc17e32abb6
0709 12:14:49.696883 (+115251us) raft_consensus.cc:1685] finished
0709 12:14:49.717030 (+ 20147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.717202 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5000,"prepare.queue_time_us":48171,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":9623,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":36803,"spinlock_wait_cycles":8715008,"thread_start_us":178961,"threads_started":1,"wal-append.queue_time_us":306731}
I20260709 12:14:50.025974 12122 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:50.039883 12280 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:50.122226 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52376.2us
I20260709 12:14:50.122596 12244 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:50.121713 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.123031 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:50.123970 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.124537 10198 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:50.125406 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.122382 12028 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.126379 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:50.127377 12290 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 12:14:50.127566 10198 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:50.128234 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.129030 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:50.047870 10203 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:50.128583 10200 rpcz_store.cc:276] 0709 12:14:49.052898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.216177 (+163279us) service_pool.cc:224] Handling call
0709 12:14:49.216436 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.216762 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.216787 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:49.217197 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:14:49.373035 (+155838us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:49.373223 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.373484 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:50.078346 (+704862us) raft_consensus.cc:1685] finished
0709 12:14:50.078365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.078504 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1570,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":155294,"threads_started":1,"wal-append.queue_time_us":253529}
I20260709 12:14:50.048933 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.131248 10202 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:50.062238 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.016479 12238 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.062700 10122 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:50.126855 12135 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:50.139357 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:50.140072 10122 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:50.140702 12149 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:50.140858 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:50.141129 12149 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:50.141607 10122 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:50.073616 12223 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:50.043294 12184 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.121690 12116 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:50.142784 12116 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:50.141973 12149 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.078846 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:50.143594 12116 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.144511 12122 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:50.144620 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65858.5us
I20260709 12:14:50.146833 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:50.143978 12184 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.148864 12223 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.149837 12223 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.150216 11994 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.138679 12238 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:50.151647 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.152227 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:49.785985 12011 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.123018 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 323) took 2159 ms. Trace:
I20260709 12:14:50.121415 11663 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.137604 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.172035 10200 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:50.139930 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:50.172984 10130 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:50.174044 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:50.146754 12122 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.734651 12200 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.176451 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.154145 12279 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:50.155362 12238 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:50.155891 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:50.156358 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.179314 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.157083 12184 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:50.177781 12279 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.180209 12184 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.157503 12267 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.158893 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:50.141908 12280 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:50.159436 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 507) took 1113 ms. Trace:
I20260709 12:14:50.152951 12188 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:50.186789 10735 rpcz_store.cc:276] 0709 12:14:49.046078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.058493 (+ 12415us) service_pool.cc:224] Handling call
0709 12:14:50.159198 (+1100705us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400453154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:50.159331 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662806272}
I20260709 12:14:50.160636 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1149) took 1174 ms. Trace:
W20260709 12:14:50.161437 11825 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:14:50.161976 12296 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:14:50.172170 11994 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.163646 12156 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:50.201917 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.165491 12270 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.081000 10053 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.078567 12222 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.062817 12289 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.076478 12142 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:50.081143 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.143797 12149 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:50.174296 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:50.178064 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.178365 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:50.144870 12116 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:50.149875 12144 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.599s	user 0.001s	sys 0.007s
I20260709 12:14:50.181041 12279 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:50.184275 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:50.342180 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157974us
I20260709 12:14:50.135525 10048 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:14:50.343748 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 238) took 1003 ms. Trace:
I20260709 12:14:50.344106 10048 rpcz_store.cc:276] 0709 12:14:49.340597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.554078 (+213481us) service_pool.cc:224] Handling call
0709 12:14:50.343682 (+789604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.178527 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:50.185760 10122 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:50.345012 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 166592us
I20260709 12:14:50.345177 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 247) took 1005 ms. Trace:
I20260709 12:14:50.345537 10122 rpcz_store.cc:276] 0709 12:14:49.339369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.185218 (+845849us) service_pool.cc:224] Handling call
0709 12:14:50.185574 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.344933 (+159359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.345127 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:50.177096 12228 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.002s
W20260709 12:14:50.242849 12212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.036s	sys 0.027s
I20260709 12:14:50.195003 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:50.359349 10198 raft_consensus.cc:2376] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6. Re-sending same reply.
I20260709 12:14:50.153576 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1575) took 1478 ms. Trace:
I20260709 12:14:50.360214 10051 rpcz_store.cc:276] 0709 12:14:48.675561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.675679 (+   118us) service_pool.cc:224] Handling call
0709 12:14:48.702844 (+ 27165us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:49.327470 (+624626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.153318 (+825848us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.153521 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231376640}
I20260709 12:14:49.758666 11945 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.201617 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.202808 10735 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:50.191409 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.185313 12122 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:50.383522 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1142) took 1411 ms. Trace:
I20260709 12:14:50.383958 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.384703 10735 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:50.240197 11728 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:50.336505 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 162288us
I20260709 12:14:50.202440 12233 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.340974 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.346752 10733 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:50.333388 12188 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:50.239933 12028 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:50.213294 12011 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:50.353509 10122 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:50.362257 12184 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.364174 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 602) took 2139 ms. Trace:
I20260709 12:14:50.185114 12267 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.335492 10130 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:50.401860 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1156) took 1237 ms. Trace:
I20260709 12:14:50.434603 10121 rpcz_store.cc:276] 0709 12:14:49.164082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.185553 (+ 21471us) service_pool.cc:224] Handling call
0709 12:14:49.185845 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.324817 (+138972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.401569 (+1076752us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001d6354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.401789 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318182656}
I20260709 12:14:50.441704 10130 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:50.442341 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 251) took 1100 ms. Trace:
I20260709 12:14:50.442658 10130 rpcz_store.cc:276] 0709 12:14:49.345623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.441239 (+1095616us) service_pool.cc:224] Handling call
0709 12:14:50.441531 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:50.442102 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.442287 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.444182 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:50.438512 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:50.436251 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:50.349692 12144 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.410317 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:50.383975 10124 rpcz_store.cc:276] 0709 12:14:48.972596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.972742 (+   146us) service_pool.cc:224] Handling call
0709 12:14:48.993974 (+ 21232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.537100 (+543126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.383300 (+846200us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400231254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.383470 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061285248}
I20260709 12:14:50.192689 10128 rpcz_store.cc:276] 0709 12:14:48.986184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.046732 (+ 60548us) service_pool.cc:224] Handling call
0709 12:14:49.047010 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.190615 (+143605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.160396 (+969781us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54000992d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.160577 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84194688}
I20260709 12:14:50.171730 10197 rpcz_store.cc:276] 0709 12:14:47.963224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.058691 (+ 95467us) service_pool.cc:224] Handling call
0709 12:14:48.174914 (+116223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.131462 (+956548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.122755 (+991293us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54000ea1d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.122940 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908751232}
I20260709 12:14:50.412864 10736 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:50.348770 12200 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:50.419600 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:50.422005 10053 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:50.241055 11994 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.423571 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:50.398962 12212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.036s	sys 0.027s
I20260709 12:14:50.352644 12280 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:50.426385 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:50.426959 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 248) took 1087 ms. Trace:
W20260709 12:14:50.414150 12153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.026s
I20260709 12:14:50.427568 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.353957 12156 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:50.429782 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:50.336089 12289 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.421555 12239 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.451552 10121 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:50.436566 12261 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.001s
I20260709 12:14:50.417666 11728 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.421694 12233 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.428131 10730 rpcz_store.cc:276] 0709 12:14:48.224452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.226259 (+  1807us) service_pool.cc:224] Handling call
0709 12:14:48.307185 (+ 80926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.298990 (+991805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.363912 (+1064922us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b5400646ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.364093 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268748032}
I20260709 12:14:50.448307 12006 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:50.455456 12044 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.048s	user 0.009s	sys 0.000s
I20260709 12:14:50.457003 10128 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:50.500453 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.482355 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.512428 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:50.513339 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 103172us
I20260709 12:14:50.513774 10055 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:50.515697 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:50.516481 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.510744 12200 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:50.517591 12079 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:50.514672 12285 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:50.518216 12188 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.520191 10124 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:50.527136 10129 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:50.527412 12292 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:50.352825 12228 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.434386 12011 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:50.448407 12142 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.994860 12184 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.109220 10736 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:51.109953 11728 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.110546 12006 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:51.007340 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.532191 11921 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.529852 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.119987 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.120618 10198 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:51.109714 12184 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.549119 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1587) took 1339 ms. Trace:
I20260709 12:14:51.121495 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:50.541538 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:50.533573 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.004s	sys 0.020s
I20260709 12:14:51.122781 12239 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:50.991214 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.801538 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:51.135721 10046 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:51.009835 12270 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.136202 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 245) took 1063 ms. Trace:
W20260709 12:14:50.548097 12210 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.271s	user 0.007s	sys 0.003s
W20260709 12:14:50.544800 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1582) took 1489 ms (client timeout 1668 ms). Trace:
I20260709 12:14:51.108669 12044 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.136550 10046 rpcz_store.cc:276] 0709 12:14:50.072396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.673029 (+600633us) service_pool.cc:224] Handling call
0709 12:14:51.136141 (+463112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:50.533332 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.137430 10202 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:51.137250 12210 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:50.530853 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:51.138775 10732 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:51.136941 10201 rpcz_store.cc:269] 0709 12:14:49.055240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.074749 (+ 19509us) service_pool.cc:224] Handling call
0709 12:14:50.544601 (+1469852us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b540007dd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:50.544740 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130977664}
I20260709 12:14:51.138310 10127 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:51.139312 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.139880 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.140409 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:50.654696 11663 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.140756 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1060) took 1677 ms. Trace:
I20260709 12:14:51.141228 11663 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.142460 12210 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.143396 11663 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.143980 11663 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.144438 11663 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.124353 12212 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.123220 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.019s	sys 0.055s
W20260709 12:14:51.123646 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 356) took 1801 ms (client timeout 2211 ms). Trace:
I20260709 12:14:50.547780 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:51.145517 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 1.46971e+06us
I20260709 12:14:51.145864 10733 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:51.111410 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1866) took 1069 ms. Trace:
I20260709 12:14:51.147418 10051 rpcz_store.cc:276] 0709 12:14:50.042502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.456878 (+414376us) service_pool.cc:224] Handling call
0709 12:14:51.111347 (+654469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.145488 12212 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:51.148939 10728 rpcz_store.cc:269] 0709 12:14:49.321874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.324411 (+  2537us) service_pool.cc:224] Handling call
0709 12:14:50.541390 (+1216979us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:51.123582 (+582192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49966336}
W20260709 12:14:51.149523 10702 connection.cc:256] RPC call timeout handler was delayed by -1.4057432739998603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:14:51.149952 10702 connection.cc:256] RPC call timeout handler was delayed by -1.3409432739997555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 12:14:51.138374 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.150305 12212 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.125931 12233 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.151012 10202 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:51.151204 12233 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:51.151952 12233 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:50.550129 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:50.549860 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:51.153201 10050 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:14:51.153816 10050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 243) took 1799 ms (client timeout 2210 ms). Trace:
I20260709 12:14:51.118845 11921 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:51.153322 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 603255us
I20260709 12:14:51.156117 10203 raft_consensus.cc:2410] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:51.156307 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.156919 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.157560 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.733s (SENT) [suppressed 17 similar messages]
I20260709 12:14:51.115123 12251 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.128919 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1764) took 1540 ms. Trace:
I20260709 12:14:51.126309 10128 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:51.118893 12156 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.128474 10048 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:51.168718 12228 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.206648 10121 rpcz_store.cc:276] 0709 12:14:49.588384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.435422 (+847038us) service_pool.cc:224] Handling call
0709 12:14:50.451394 (+ 15972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.128673 (+677279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.128863 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.210549 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:51.120278 10200 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:51.132902 12289 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:51.122223 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 702658us
I20260709 12:14:51.212567 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:51.133522 10052 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:51.134505 12011 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.115001 12006 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:51.137568 10126 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:51.139039 12044 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.116732 10122 rpcz_store.cc:276] 0709 12:14:49.339704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.352937 (+1013233us) service_pool.cc:224] Handling call
0709 12:14:50.353273 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:50.426724 (+ 73451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.426907 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.237372 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:51.238047 10122 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:51.239044 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:51.240135 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:51.148453 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:51.153290 10702 connection.cc:256] RPC call timeout handler was delayed by -1.3391432739997526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
I20260709 12:14:50.898885 12144 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.295038 12144 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:51.121845 10047 rpcz_store.cc:276] 0709 12:14:49.209591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.217462 (+  7871us) service_pool.cc:224] Handling call
0709 12:14:49.217757 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.565105 (+347348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.565137 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:49.584114 (+ 18977us) log.cc:844] Serialized 26 byte log entry
0709 12:14:50.199136 (+615022us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:50.199176 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.548727 (+349551us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54002742d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:50.548770 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:50.548815 (+    45us) raft_consensus.cc:1685] finished
0709 12:14:50.548830 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:50.549061 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22099,"raft.queue_time_us":11876,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8887,"spinlock_wait_cycles":758479232,"thread_start_us":306515,"threads_started":1,"wal-append.queue_time_us":836475}
W20260709 12:14:51.128085 12153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.016s	sys 0.045s
I20260709 12:14:51.160369 11728 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.154265 10050 rpcz_store.cc:269] 0709 12:14:49.353980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.573682 (+219702us) service_pool.cc:224] Handling call
0709 12:14:50.549727 (+976045us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:51.153756 (+604029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5276416}
I20260709 12:14:51.162736 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1059) took 1714 ms. Trace:
I20260709 12:14:50.810983 12116 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:51.141248 10201 rpcz_store.cc:276] 0709 12:14:49.463856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.139628 (+1675772us) service_pool.cc:224] Handling call
0709 12:14:51.140697 (+  1069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.158135 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.118273 11994 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.168547 11921 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.170375 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 339) took 1021 ms. Trace:
W20260709 12:14:51.303675 12303 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:14:51.152490 12233 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.174857 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1770) took 1579 ms. Trace:
I20260709 12:14:51.361733 10129 rpcz_store.cc:276] 0709 12:14:49.595704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.526567 (+930863us) service_pool.cc:224] Handling call
0709 12:14:50.526914 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.174589 (+647675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.174802 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.175668 11663 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:50.661725 12306 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:51.175674 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1767) took 1586 ms. Trace:
I20260709 12:14:51.178622 12079 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:51.371366 11921 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.372097 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:51.371919 12079 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.373031 12079 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:51.179054 12200 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:51.183983 11945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.009s	sys 0.005s
I20260709 12:14:51.186563 12141 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:51.188176 10197 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:51.295410 12011 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:14:51.194855 12261 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.196002 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:51.196823 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.196998 12155 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:50.514814 11917 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:51.125713 12184 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.199139 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1048) took 3113 ms. Trace:
W20260709 12:14:51.195479 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 240) took 1854 ms (client timeout 1682 ms). Trace:
W20260709 12:14:51.201465 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.395150 10053 rpcz_store.cc:269] 0709 12:14:49.341108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.452535 (+111427us) service_pool.cc:224] Handling call
0709 12:14:51.195287 (+1742752us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54002a2454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:51.195408 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420532608}
I20260709 12:14:51.394995 12285 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:51.395908 12317 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:51.396201 12285 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.396600 12285 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:51.396646 10053 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:51.397435 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1861) took 1768 ms. Trace:
I20260709 12:14:51.397729 10053 rpcz_store.cc:276] 0709 12:14:49.629539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.395967 (+1766428us) service_pool.cc:224] Handling call
0709 12:14:51.396306 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.397163 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.397378 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.174161 12292 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.203562 12270 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.137598 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:51.398785 12270 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.400695 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:51.118445 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1860) took 1525 ms. Trace:
I20260709 12:14:51.401348 10122 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:51.240887 10051 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:51.302909 10048 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:51.209473 12156 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:51.402534 10046 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:51.402462 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:51.403113 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1871) took 1266 ms. Trace:
I20260709 12:14:51.403380 10122 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:51.345994 10203 rpcz_store.cc:276] 0709 12:14:49.448634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.140182 (+1691548us) service_pool.cc:224] Handling call
0709 12:14:51.162669 (+ 22487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.349133 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:51.401979 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1870) took 1265 ms. Trace:
I20260709 12:14:51.347918 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1069) took 1272 ms. Trace:
W20260709 12:14:51.305227 11982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.017s	sys 0.035s
I20260709 12:14:51.359134 10198 rpcz_store.cc:276] 0709 12:14:50.149215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.121250 (+972035us) service_pool.cc:224] Handling call
0709 12:14:51.170304 (+ 49054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.303625 12144 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.365576 10124 rpcz_store.cc:276] 0709 12:14:49.589132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.467686 (+878554us) service_pool.cc:224] Handling call
0709 12:14:50.519970 (+ 52284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.175431 (+655461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.175620 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.368860 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:51.370206 12233 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.362537 11994 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.358409 12116 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.370888 12309 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.373051 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1868) took 1247 ms. Trace:
W20260709 12:14:51.377372 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.033s
I20260709 12:14:51.190022 11703 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:51.351931 10021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.022s
I20260709 12:14:51.396485 12317 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.400929 12270 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.298817 12270 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.299322 12270 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.301404 12270 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.206879 12267 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.371953 11921 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:53.302265 11921 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.304322 11921 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.384521 12141 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:53.304991 12141 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.307103 12141 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.351235 11728 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.308962 11728 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.406543 11917 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.310812 11917 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.406049 10046 rpcz_store.cc:276] 0709 12:14:50.137111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.137304 (+1000193us) service_pool.cc:224] Handling call
0709 12:14:51.403040 (+265736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.401345 10049 rpcz_store.cc:276] 0709 12:14:49.592594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.606404 (+ 13810us) service_pool.cc:224] Handling call
0709 12:14:49.606740 (+   336us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:49.607104 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.607130 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:49.608191 (+  1061us) log.cc:844] Serialized 78 byte log entry
0709 12:14:49.696471 (+ 88280us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:49.696513 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.696594 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.118168 (+1421574us) raft_consensus.cc:1685] finished
0709 12:14:51.118198 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.118363 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":680,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":87922,"threads_started":1,"wal-append.queue_time_us":200150}
W20260709 12:14:51.404515 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1864) took 1490 ms (client timeout 1592 ms). Trace:
W20260709 12:14:53.435316 10048 rpcz_store.cc:269] 0709 12:14:49.914012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.408191 (+494179us) service_pool.cc:224] Handling call
0709 12:14:51.404450 (+996259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.408991 10047 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:14:53.439043 10047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1867) took 3372 ms (client timeout 2232 ms). Trace:
W20260709 12:14:53.439414 10047 rpcz_store.cc:269] 0709 12:14:50.067098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.304242 (+1237144us) service_pool.cc:224] Handling call
0709 12:14:53.438961 (+2134719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.404228 10051 rpcz_store.cc:276] 0709 12:14:50.136802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.148167 (+1011365us) service_pool.cc:224] Handling call
0709 12:14:51.401927 (+253760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.434561 10050 rpcz_store.cc:276] 0709 12:14:50.125224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.361850 (+1236626us) service_pool.cc:224] Handling call
0709 12:14:51.372977 (+ 11127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.414419 10054 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:14:53.442759 10054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1862) took 3776 ms (client timeout 1795 ms). Trace:
W20260709 12:14:53.443147 10054 rpcz_store.cc:269] 0709 12:14:49.666656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.076169 (+409513us) service_pool.cc:224] Handling call
0709 12:14:53.442517 (+3366348us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002774d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.442682 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075258240}
I20260709 12:14:51.433456 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1865) took 1415 ms. Trace:
I20260709 12:14:53.445087 10053 rpcz_store.cc:276] 0709 12:14:50.018529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.405976 (+1387447us) service_pool.cc:224] Handling call
0709 12:14:51.432923 (+ 26947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.433116 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.433142 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:51.433186 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:51.433215 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.433266 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.433394 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:51.386454 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 190509us
I20260709 12:14:51.207348 10128 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.407229 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 343) took 1059 ms. Trace:
I20260709 12:14:51.431794 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.404387 10202 rpcz_store.cc:276] 0709 12:14:50.075038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.157878 (+1082840us) service_pool.cc:224] Handling call
0709 12:14:51.347855 (+189977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:51.405248 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:51.463588 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:53.565316 10203 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:51.401587 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:53.574115 10129 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:14:53.574676 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1776) took 2176 ms (client timeout 1823 ms). Trace:
I20260709 12:14:51.218518 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1075) took 1072 ms. Trace:
I20260709 12:14:53.575769 10200 rpcz_store.cc:276] 0709 12:14:50.146220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.529595 (+383375us) service_pool.cc:224] Handling call
0709 12:14:51.218448 (+688853us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:51.434208 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.002s	sys 0.033s
I20260709 12:14:51.394652 10204 rpcz_store.cc:276] 0709 12:14:48.085976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.324278 (+238302us) service_pool.cc:224] Handling call
0709 12:14:48.324735 (+   457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:48.707709 (+382974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.707737 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:48.718602 (+ 10865us) log.cc:844] Serialized 52 byte log entry
0709 12:14:49.159001 (+440399us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:49.462407 (+303406us) log.cc:844] Serialized 14 byte log entry
0709 12:14:49.567571 (+105164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:51.198803 (+1631232us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:51.198844 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.198883 (+    39us) raft_consensus.cc:1685] finished
0709 12:14:51.198964 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.199086 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19324,"prepare.queue_time_us":28068,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":25223,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":52986,"spinlock_wait_cycles":850559232,"thread_start_us":733584,"threads_started":3,"wal-append.queue_time_us":430297,"wal-append.run_cpu_time_us":8622,"wal-append.run_wall_time_us":1880970}
I20260709 12:14:53.575155 12347 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.410023 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.208734 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 359) took 1886 ms. Trace:
I20260709 12:14:53.587054 10729 rpcz_store.cc:276] 0709 12:14:49.322727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.327195 (+  4468us) service_pool.cc:224] Handling call
0709 12:14:49.398531 (+ 71336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:49.455398 (+ 56867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:49.457092 (+  1694us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:49.560247 (+103155us) log.cc:844] Serialized 52 byte log entry
0709 12:14:50.053484 (+493237us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:50.053533 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:50.053605 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:51.098992 (+1045387us) raft_consensus.cc:1685] finished
0709 12:14:51.199732 (+100740us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:51.206499 (+  6767us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3753,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":9022,"thread_start_us":431880,"threads_started":1,"wal-append.queue_time_us":834874,"wal-append.run_cpu_time_us":1723,"wal-append.run_wall_time_us":1119463}
I20260709 12:14:51.561385 12329 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.589671 12329 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.591913 12329 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.461244 10737 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:14:51.792163 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.077380 10020 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.029s	sys 0.030s
W20260709 12:14:53.128245 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 510) took 4076 ms (client timeout 1929 ms). Trace:
W20260709 12:14:53.595139 10020 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.388s	user 0.029s	sys 0.030s
W20260709 12:14:53.595078 10732 rpcz_store.cc:269] 0709 12:14:49.051686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.055284 (+  3598us) service_pool.cc:224] Handling call
0709 12:14:53.127907 (+4072623us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540015a754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.128115 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4601100544}
W20260709 12:14:53.285903 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.596187 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 2.43844e+06us
W20260709 12:14:53.596663 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.287564 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1146) took 4312 ms (client timeout 1733 ms). Trace:
W20260709 12:14:53.318470 10021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.532s	user 0.011s	sys 0.046s
I20260709 12:14:53.598274 12148 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.599653 12148 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.600419 12148 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:53.600893 12148 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:53.348470 10124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.877s	user 0.025s	sys 0.017s
W20260709 12:14:53.359443 10127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1765) took 3770 ms (client timeout 1795 ms). Trace:
W20260709 12:14:53.406011 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.602545 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:53.603034 12267 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:53.602957 12148 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.452457 11663 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.605052 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.605377 11663 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.604589 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:51.406884 11945 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:53.608845 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 364) took 3425 ms. Trace:
I20260709 12:14:53.608615 11945 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:51.408690 11982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.017s	sys 0.036s
I20260709 12:14:51.436764 11994 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.613698 11945 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.613926 11994 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.588361 12006 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.566730 12116 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.415017 12144 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:53.620710 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 336) took 4442 ms. Trace:
I20260709 12:14:53.621068 10200 rpcz_store.cc:276] 0709 12:14:49.178056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.576529 (+4398473us) service_pool.cc:224] Handling call
0709 12:14:53.576882 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.610123 (+ 33241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.610155 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.610196 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:53.610224 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.620491 (+ 10267us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400262fd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.620536 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.620654 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75995520}
W20260709 12:14:52.437537 12147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.005s
W20260709 12:14:53.623783 12147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.836s	user 0.006s	sys 0.006s
I20260709 12:14:53.624295 12147 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.624755 12147 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.607506 11663 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.416512 12153 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:53.627233 12153 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.629848 12153 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.408757 12155 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.634164 12155 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.636229 12155 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.636677 12155 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.637068 12155 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.705576 12156 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.640863 12156 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.567490 12200 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.643424 12200 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:52.732815 12224 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.759404 12232 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.645326 12232 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:51.778398 12235 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:53.651106 12235 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:53.652002 12235 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.652427 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:51.413933 12239 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:51.560386 12261 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.654821 12200 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.873946 12277 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 3.417s	user 0.015s	sys 0.028s
W20260709 12:14:51.637259 12279 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.250s	user 0.008s	sys 0.003s
W20260709 12:14:53.658170 10168 connection.cc:256] RPC call timeout handler was delayed by -1.818530199000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:14:53.658597 12279 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.660919 12279 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:51.675709 12285 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.663565 12329 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:53.664167 12349 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.664768 10121 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:53.664980 12329 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:53.667330 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 258) took 2464 ms (client timeout 1771 ms). Trace:
W20260709 12:14:53.667737 10121 rpcz_store.cc:269] 0709 12:14:51.203402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.210299 (+  6897us) service_pool.cc:224] Handling call
0709 12:14:53.667117 (+2456818us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b540009a6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.667251 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5642584320}
W20260709 12:14:53.668869 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1165) took 2209 ms (client timeout 1505 ms). Trace:
W20260709 12:14:53.669193 10121 rpcz_store.cc:269] 0709 12:14:51.459377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.668693 (+2209316us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.668794 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:51.379446 12289 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.670864 12289 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.672972 12289 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:53.418500 12297 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 2.883s	user 0.013s	sys 0.024s
I20260709 12:14:51.375283 12306 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.676640 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1583) took 4621 ms. Trace:
I20260709 12:14:53.677174 12306 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:51.444494 12309 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.679114 10204 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:53.680939 12309 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:51.553696 12310 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:14:51.571692 12313 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.683027 12313 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:51.519580 12316 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:53.298288 12317 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:53.429481 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.213s	user 0.012s	sys 0.028s
I20260709 12:14:53.432817 12337 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.686123 12316 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.686941 12337 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:53.688043 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.471s	user 0.013s	sys 0.029s
W20260709 12:14:53.688517 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.689021 12337 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:53.447067 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.880s	user 0.023s	sys 0.034s
I20260709 12:14:53.451113 12339 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:53.689332 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 519) took 3326 ms. Trace:
I20260709 12:14:53.689952 12339 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:53.689673 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.123s	user 0.023s	sys 0.034s
I20260709 12:14:53.664225 12285 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.690390 12339 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:53.688441 12316 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.690883 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 517) took 3328 ms. Trace:
I20260709 12:14:53.453869 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1859) took 3861 ms. Trace:
I20260709 12:14:53.459482 12344 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.461628 12340 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.464974 12346 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:53.469000 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.692101 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.691265 10736 rpcz_store.cc:276] 0709 12:14:50.362360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.110126 (+747766us) service_pool.cc:224] Handling call
0709 12:14:51.118393 (+  8267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.533619 (+415226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:51.533648 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:51.549679 (+ 16031us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.690560 (+2140881us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:53.690595 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.690667 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.690716 (+    49us) raft_consensus.cc:1685] finished
0709 12:14:53.690726 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.690835 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23992,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":2538171,"threads_started":2,"wal-append.queue_time_us":201912,"wal-append.run_cpu_time_us":1481,"wal-append.run_wall_time_us":1001513}
I20260709 12:14:53.692449 12141 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:53.478569 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1076) took 2088 ms (client timeout 1899 ms). Trace:
I20260709 12:14:53.692945 12141 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:53.693295 10198 rpcz_store.cc:269] 0709 12:14:51.390074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.478273 (+2088199us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.478461 (+   188us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:53.693771 12148 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:53.694298 12148 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.653209 12235 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:53.695423 12156 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.696290 12148 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.484002 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1872) took 3346 ms. Trace:
I20260709 12:14:53.696751 10048 rpcz_store.cc:276] 0709 12:14:50.137412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.436092 (+3298680us) service_pool.cc:224] Handling call
0709 12:14:53.436411 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.436611 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:53.442179 (+  5568us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.483638 (+ 41459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.483694 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:53.483740 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.483806 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.483939 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1180,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":81,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":913,"thread_start_us":46340,"threads_started":2,"wal-append.queue_time_us":41979}
W20260709 12:14:53.483035 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65449.7us
I20260709 12:14:53.491240 12338 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.669890 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1167) took 2210 ms (client timeout 1552 ms). Trace:
W20260709 12:14:53.701865 10121 rpcz_store.cc:269] 0709 12:14:51.459973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.669755 (+2209782us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.669846 (+    91us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:53.531582 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 516) took 4140 ms. Trace:
I20260709 12:14:53.691548 10055 rpcz_store.cc:276] 0709 12:14:49.592365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.599602 (+  7237us) service_pool.cc:224] Handling call
0709 12:14:49.599942 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:51.194579 (+1594637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.453507 (+2258928us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400321754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.453765 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101084928}
I20260709 12:14:53.552039 12028 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:53.708604 12028 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:53.708861 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1160) took 2250 ms (client timeout 1753 ms). Trace:
W20260709 12:14:53.709197 10121 rpcz_store.cc:269] 0709 12:14:51.457961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.708687 (+2250726us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.708806 (+   119us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:53.709909 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1169) took 2246 ms (client timeout 1899 ms). Trace:
W20260709 12:14:53.710197 10121 rpcz_store.cc:269] 0709 12:14:51.463190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.709766 (+2246576us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.709859 (+    93us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:53.710884 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1164) took 2251 ms (client timeout 1926 ms). Trace:
I20260709 12:14:53.538681 12334 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:14:53.553154 12210 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.547734 10052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 1869) took 3421 ms (client timeout 1712 ms). Trace:
W20260709 12:14:53.715847 10052 rpcz_store.cc:269] 0709 12:14:50.126051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.438279 (+312228us) service_pool.cc:224] Handling call
0709 12:14:53.547516 (+3109237us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54003f1454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.547660 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581481856}
I20260709 12:14:53.716866 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:53.717547 10052 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 3: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:53.543712 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1760) took 4622 ms. Trace:
I20260709 12:14:53.718570 10125 rpcz_store.cc:276] 0709 12:14:48.921451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.933689 (+ 12238us) service_pool.cc:224] Handling call
0709 12:14:48.934046 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:49.298552 (+364506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.543422 (+4244870us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400242f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.543624 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386303744}
W20260709 12:14:53.719674 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1168) took 2259 ms (client timeout 2174 ms). Trace:
W20260709 12:14:53.719976 10125 rpcz_store.cc:269] 0709 12:14:51.460218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.719529 (+2259311us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.719621 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:53.720746 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:53.721479 10125 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:14:53.721824 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1161) took 2263 ms (client timeout 2738 ms). Trace:
W20260709 12:14:53.559072 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.317s	user 0.044s	sys 0.055s
W20260709 12:14:53.722707 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.481s	user 0.045s	sys 0.056s
I20260709 12:14:53.724027 10736 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:53.725356 10736 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:53.725509 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.558836 10196 rpcz_store.cc:276] 0709 12:14:50.347979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.196561 (+848582us) service_pool.cc:224] Handling call
0709 12:14:51.407163 (+210602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.726209 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.726665 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:53.560976 11917 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.565165 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:53.728327 10202 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:14:53.565966 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1081) took 2174 ms (client timeout 1772 ms). Trace:
W20260709 12:14:53.728667 10203 rpcz_store.cc:269] 0709 12:14:51.391294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.405006 (+ 13712us) service_pool.cc:224] Handling call
0709 12:14:53.565890 (+2160884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.568508 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1766) took 3979 ms. Trace:
W20260709 12:14:53.711165 10121 rpcz_store.cc:269] 0709 12:14:51.459144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.710751 (+2251607us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:53.710841 (+    90us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:53.570619 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:53.730276 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1079) took 2339 ms (client timeout 3073 ms). Trace:
W20260709 12:14:53.730643 10195 rpcz_store.cc:269] 0709 12:14:51.390840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.570264 (+2179424us) service_pool.cc:224] Handling call
0709 12:14:53.730215 (+159951us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:53.548413 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.412s	user 0.030s	sys 0.046s
I20260709 12:14:53.572077 12270 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.739723 12270 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.707955 12144 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.741935 12270 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:53.575017 10129 rpcz_store.cc:269] 0709 12:14:51.398265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.401316 (+  3051us) service_pool.cc:224] Handling call
0709 12:14:53.574594 (+2173278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.582981 12347 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:53.602708 10124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.132s	user 0.026s	sys 0.017s
I20260709 12:14:53.742952 12144 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.743675 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1158) took 2286 ms. Trace:
I20260709 12:14:53.744084 10124 rpcz_store.cc:276] 0709 12:14:51.457253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.457365 (+   112us) service_pool.cc:224] Handling call
0709 12:14:51.462964 (+  5599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:51.463154 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:51.470781 (+  7627us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.743363 (+2272582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.743413 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:53.743459 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.743520 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.743625 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9736,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"thread_start_us":2272263,"threads_started":1,"wal-append.queue_time_us":232483,"wal-append.run_cpu_time_us":1093,"wal-append.run_wall_time_us":1001122}
I20260709 12:14:53.415786 12335 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.746337 12335 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.748453 12335 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.748888 12335 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.749276 12335 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.603884 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.750895 10053 raft_consensus.cc:2410] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:53.751726 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.743713 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:53.603608 10127 rpcz_store.cc:269] 0709 12:14:49.588664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.610983 (+ 22319us) service_pool.cc:224] Handling call
0709 12:14:53.358997 (+3748014us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001d6d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.359291 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464262016}
I20260709 12:14:53.752691 10197 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:53.753083 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:53.753752 10197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1078) took 2363 ms (client timeout 1880 ms). Trace:
W20260709 12:14:53.754164 10197 rpcz_store.cc:269] 0709 12:14:51.390609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.412900 (+ 22291us) service_pool.cc:224] Handling call
0709 12:14:53.753584 (+2340684us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.753685 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434453760}
I20260709 12:14:53.602555 12149 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.598590 10123 rpcz_store.cc:269] 0709 12:14:48.975344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.978224 (+  2880us) service_pool.cc:224] Handling call
0709 12:14:53.287277 (+4309053us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540039dfd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.287438 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587310848}
I20260709 12:14:53.607888 10054 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:53.603401 12267 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:53.603783 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.755990 10051 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:53.756134 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1163) took 2297 ms. Trace:
I20260709 12:14:53.756989 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.757962 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:53.758808 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.623s	user 0.031s	sys 0.046s
W20260709 12:14:53.611555 10701 connection.cc:256] RPC call timeout handler was delayed by -1.8232365219998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 12:14:53.608646 10050 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:53.614185 10201 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:53.761425 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.539877 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:53.762413 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 222591us
I20260709 12:14:53.763154 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:53.742980 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:53.764137 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:53.617894 12006 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:53.617888 10095 connection.cc:256] RPC call timeout handler was delayed by -2.8385319500000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:14:53.767743 10095 connection.cc:256] RPC call timeout handler was delayed by -2.4536119229999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 12:14:53.768095 10095 connection.cc:256] RPC call timeout handler was delayed by -2.3312119229997279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 12:14:53.768389 10095 connection.cc:256] RPC call timeout handler was delayed by -2.2610119229998418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 12:14:53.631114 12147 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.622381 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:53.648725 12232 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.653134 10047 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.655453 12200 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.656351 11663 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.656921 12348 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.657526 11945 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:53.664963 12349 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.677038 10199 rpcz_store.cc:276] 0709 12:14:49.055688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.228697 (+173009us) service_pool.cc:224] Handling call
0709 12:14:49.228949 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.229543 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:14:49.229572 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:49.236709 (+  7137us) log.cc:844] Serialized 26 byte log entry
0709 12:14:49.329337 (+ 92628us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:49.329373 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.329431 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:52.873286 (+3543855us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:53.676244 (+802958us) raft_consensus.cc:1685] finished
0709 12:14:53.676270 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.676540 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13917,"raft.queue_time_us":111,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5585,"spinlock_wait_cycles":8430464,"thread_start_us":14512,"threads_started":1,"wal-append.queue_time_us":107345}
I20260709 12:14:53.685180  9950 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 271) took 10535 ms. Trace:
I20260709 12:14:53.685215 12313 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.695945 12156 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.797616 12028 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:53.695035 12141 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.755219 12149 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.800354 12156 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.498713 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 244) took 3426 ms. Trace:
I20260709 12:14:53.699316 12346 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.800737 12028 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.801097 12149 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.767853 11917 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.802357 12346 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.681066 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 337) took 4456 ms. Trace:
I20260709 12:14:53.802969 10204 rpcz_store.cc:276] 0709 12:14:49.224997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.582934 (+4357937us) service_pool.cc:224] Handling call
0709 12:14:53.583243 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.679629 (+ 96386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.680809 (+  1180us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b54000636d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.681001 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219980544}
I20260709 12:14:53.803450 11917 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.700243 12344 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.701264 12155 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.802358 10122 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
W20260709 12:14:53.524583 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1157) took 4319 ms (client timeout 2575 ms). Trace:
W20260709 12:14:53.702621 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 91881us
I20260709 12:14:53.699136 12340 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.703485 10731 rpcz_store.cc:276] 0709 12:14:49.391656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.445614 (+ 53958us) service_pool.cc:224] Handling call
0709 12:14:49.451876 (+  6262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:49.669427 (+217551us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:49.679630 (+ 10203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:49.742832 (+ 63202us) log.cc:844] Serialized 26 byte log entry
0709 12:14:50.199776 (+456944us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:50.201139 (+  1363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.531167 (+3330028us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54004b9454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.531221 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.531273 (+    52us) raft_consensus.cc:1685] finished
0709 12:14:53.531284 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.531522 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48935,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":21730,"spinlock_wait_cycles":271204096,"thread_start_us":140499,"threads_started":1,"wal-append.queue_time_us":536303,"wal-append.run_cpu_time_us":1680,"wal-append.run_wall_time_us":1119583}
W20260709 12:14:53.817409 10122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1159) took 2359 ms (client timeout 1720 ms). Trace:
W20260709 12:14:53.817683 10020 connection.cc:256] RPC call timeout handler was delayed by -2.2223535359999005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2575s for a response
I20260709 12:14:53.557226 10128 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:53.817864 10122 rpcz_store.cc:269] 0709 12:14:51.457657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.457789 (+   132us) service_pool.cc:224] Handling call
0709 12:14:53.817228 (+2359439us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400230d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.817340 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543977344}
I20260709 12:14:53.705852 12317 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.701548 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:53.819005 10020 connection.cc:256] RPC call timeout handler was delayed by -2.09635226599994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:14:53.735950 10196 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:53.819363 10020 connection.cc:256] RPC call timeout handler was delayed by -2.0540522659998715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 12:14:53.820089 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1585) took 4449 ms. Trace:
I20260709 12:14:53.820423 10196 rpcz_store.cc:276] 0709 12:14:49.370385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.726742 (+4356357us) service_pool.cc:224] Handling call
0709 12:14:53.727014 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.819802 (+ 92788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.820030 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:53.821363 10020 connection.cc:256] RPC call timeout handler was delayed by -1.7507272010000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2738s for a response
I20260709 12:14:53.821748 10196 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:53.791301 12270 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:53.738139 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.739173 10732 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:53.745751 12309 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:53.752247 10053 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:53.803956 11917 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.609252 10737 rpcz_store.cc:276] 0709 12:14:50.168704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.169126 (+   422us) service_pool.cc:224] Handling call
0709 12:14:50.169444 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.593782 (+3424338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.594229 (+   447us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540062c854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.594401 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970240384}
I20260709 12:14:53.729498 10130 rpcz_store.cc:276] 0709 12:14:49.588898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.451975 (+863077us) service_pool.cc:224] Handling call
0709 12:14:53.455320 (+3003345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.455712 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.455740 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.456202 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.475862 (+ 19660us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:53.475892 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.475969 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.486240 (+ 10271us) raft_consensus.cc:1685] finished
0709 12:14:53.486257 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.568204 (+ 81947us) spinlock_profiling.cc:243] Waited 3 s on lock 0x7b540039dfd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.568416 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1339,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"spinlock_wait_cycles":6894532480,"thread_start_us":19215,"threads_started":1,"wal-append.queue_time_us":28717}
I20260709 12:14:53.610126 11728 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.761433 10701 connection.cc:256] RPC call timeout handler was delayed by -1.5334365220001018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 12:14:53.698606 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.767079 10054 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:53.768656 10095 connection.cc:256] RPC call timeout handler was delayed by -2.15031192299989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 12:14:53.835253 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1590) took 4446 ms. Trace:
W20260709 12:14:53.835501 10095 connection.cc:256] RPC call timeout handler was delayed by -2.0963119229998028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:14:53.835825 10095 connection.cc:256] RPC call timeout handler was delayed by -1.285411922999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29560000000000003s for a response
W20260709 12:14:53.836206 10095 connection.cc:256] RPC call timeout handler was delayed by -1.0640119229997254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32020000000000004s for a response
I20260709 12:14:53.836099 10200 rpcz_store.cc:276] 0709 12:14:49.388384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.816742 (+4428358us) service_pool.cc:224] Handling call
0709 12:14:53.834820 (+ 18078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.834992 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.835014 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.835051 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:53.835082 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.835130 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.835209 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.718389 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:53.771747 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1080) took 2380 ms (client timeout 2975 ms). Trace:
W20260709 12:14:53.722093 10125 rpcz_store.cc:269] 0709 12:14:51.458303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.720525 (+2262222us) service_pool.cc:224] Handling call
0709 12:14:53.721780 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.837248 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:53.773988 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:53.780589 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.781970 12351 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:53.783910 10051 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:53.788498 10201 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:53.789809 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.756515 10123 rpcz_store.cc:276] 0709 12:14:51.458835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.755345 (+2296510us) service_pool.cc:224] Handling call
0709 12:14:53.755647 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.755816 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.755841 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.755883 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:53.755921 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.755977 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.756081 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.762660 12210 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.796046 12335 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.796525 12200 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.796869 11663 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.797626 11945 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.689723 10730 rpcz_store.cc:276] 0709 12:14:50.362893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.111598 (+748705us) service_pool.cc:224] Handling call
0709 12:14:51.111932 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.677565 (+2565633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.677604 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.677678 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:53.677726 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.689063 (+ 11337us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b54006121d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.689113 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.689265 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5899836672}
I20260709 12:14:53.698699 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:53.701788 12338 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:53.911207 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 212576us
I20260709 12:14:53.911484 12149 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:53.911950 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:53.912446 12338 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.806106 10195 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:53.911207 11945 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:53.805954 10126 rpcz_store.cc:269] 0709 12:14:49.205345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:49.233475 (+ 28130us) service_pool.cc:224] Handling call
0709 12:14:53.524345 (+4290870us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400173254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:53.524506 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4176086272}
I20260709 12:14:53.777144 12235 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.913156 12028 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:53.913580 12235 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.914088 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1056) took 4532 ms. Trace:
I20260709 12:14:53.806372 10049 rpcz_store.cc:276] 0709 12:14:50.072144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.433515 (+3361371us) service_pool.cc:224] Handling call
0709 12:14:53.433858 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.434188 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.434214 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.441442 (+  7228us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.484508 (+ 43066us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:53.484547 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.484617 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.498486 (+ 13869us) raft_consensus.cc:1685] finished
0709 12:14:53.498505 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.498652 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26130,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":42765,"threads_started":1,"wal-append.queue_time_us":45416}
I20260709 12:14:53.799238 12334 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.914460 10195 rpcz_store.cc:276] 0709 12:14:49.381699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.788863 (+4407164us) service_pool.cc:224] Handling call
0709 12:14:53.805807 (+ 16944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.913841 (+108034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.914033 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.915180 10198 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:53.915457 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.914832 11663 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.736698 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.737447 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.869210 11917 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.916658 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 338) took 4380 ms. Trace:
I20260709 12:14:53.913111 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:53.914757 12334 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.917109 10195 rpcz_store.cc:276] 0709 12:14:49.536043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.915395 (+4379352us) service_pool.cc:224] Handling call
0709 12:14:53.915672 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.915843 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.916383 (+   540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:53.916429 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:53.916462 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.916514 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.916609 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.918138 12028 raft_consensus.cc:2764] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:53.918841 12334 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.918905 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:53.919736 12028 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:53.911867 12149 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.920517 12149 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:53.806461 12348 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.920104 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:53.922297 12028 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:53.922441 12348 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:53.922645 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:53.923363 12028 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:53.923662 12235 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.916069 10049 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:53.925060 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.926084 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:53.926746 10049 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:53.927866 12340 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.904862 10128 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:53.691322 12339 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.928537 10128 pending_rounds.cc:85] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 5
I20260709 12:14:53.822404 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1057) took 4423 ms. Trace:
I20260709 12:14:53.928874 10196 rpcz_store.cc:276] 0709 12:14:49.398924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.821164 (+4422240us) service_pool.cc:224] Handling call
0709 12:14:53.821520 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.822142 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.822346 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.929584 11917 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:53.821771 10020 connection.cc:256] RPC call timeout handler was delayed by -1.717452265999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:14:53.930063 10020 connection.cc:256] RPC call timeout handler was delayed by -1.3769328059997861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:14:53.819299 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 117815us
I20260709 12:14:53.930872 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:53.932195 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:53.755795 12267 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:53.928819 10128 pending_rounds.cc:107] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:53.933418 10128 raft_consensus.cc:2889] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:53.916584 10728 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:14:53.934018 12245 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:14:53.826617 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 53723.5us
I20260709 12:14:53.934363 12285 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.934829 12285 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.936781 10047 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:14:53.937932 12285 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.937940 12339 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:53.939872 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.940518 10729 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:53.941465 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.943060 10728 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:53.829371 10204 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:53.944383 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1058) took 4521 ms. Trace:
I20260709 12:14:53.944679 10204 rpcz_store.cc:276] 0709 12:14:49.422723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.828778 (+4406055us) service_pool.cc:224] Handling call
0709 12:14:53.829136 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.944156 (+115020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.944336 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.945391 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1051) took 4639 ms. Trace:
I20260709 12:14:53.833082 10121 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:14:53.945982 10121 pending_rounds.cc:85] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 2
I20260709 12:14:53.833964 10199 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:53.784070 12116 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:14:53.804273  9950 rpcz_store.cc:276] 0709 12:14:43.149441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:43.149701 (+   260us) service_pool.cc:224] Handling call
0709 12:14:53.685109 (+10535408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:49.045873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:49.128064 (+ 82191us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:49.130156 (+  2092us) write_op.cc:435] Acquired schema lock
0709 12:14:49.132383 (+  2227us) tablet.cc:662] Decoding operations
0709 12:14:49.178295 (+ 45912us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:49.178351 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:49.178376 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:14:49.179138 (+   762us) tablet.cc:701] Row locks acquired
0709 12:14:49.179155 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:14:49.179296 (+   141us) write_op.cc:270] Start()
0709 12:14:49.179454 (+   158us) write_op.cc:276] Timestamp: P: 1783599289179249 usec, L: 0
0709 12:14:49.179476 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:49.180154 (+   678us) log.cc:844] Serialized 3621 byte log entry
0709 12:14:51.371385 (+2191231us) op_driver.cc:464] REPLICATION: finished
0709 12:14:51.582141 (+210756us) write_op.cc:301] APPLY: starting
0709 12:14:51.582246 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:51.582531 (+   285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:51.592869 (+ 10338us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:51.760506 (+167637us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:51.760722 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:14:51.760763 (+    41us) write_op.cc:312] APPLY: finished
0709 12:14:51.760992 (+   229us) log.cc:844] Serialized 71 byte log entry
0709 12:14:51.761153 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:51.761286 (+   133us) write_op.cc:454] Released schema lock
0709 12:14:51.761335 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:51.761650 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:51.761675 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":244988,"reported_tablets":23,"spinlock_wait_cycles":301824,"child_traces":[["op",{"apply.queue_time_us":206577,"apply.run_cpu_time_us":3591,"apply.run_wall_time_us":179522,"num_ops":9,"prepare.queue_time_us":357429,"prepare.run_cpu_time_us":98343,"prepare.run_wall_time_us":392096,"raft.queue_time_us":1191325,"raft.run_cpu_time_us":32231,"raft.run_wall_time_us":212060,"replication_time_us":2185104,"spinlock_wait_cycles":47872,"thread_start_us":1016842,"threads_started":4,"wal-append.queue_time_us":308384,"wal-append.run_cpu_time_us":78444,"wal-append.run_wall_time_us":3270226}]]}
I20260709 12:14:53.767966 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.731878  9951 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:53.837200 10202 rpcz_store.cc:269] 0709 12:14:51.391068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.564882 (+2173814us) service_pool.cc:224] Handling call
0709 12:14:53.771682 (+206800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:53.836774 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:53.838277 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 64357.2us
W20260709 12:14:53.834648 10701 connection.cc:256] RPC call timeout handler was delayed by -1.4731365220000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:14:53.876849 10050 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:53.841279 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:53.841920 11982 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:53.869261 12261 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.827306 12317 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.827705 12006 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:53.827543 12270 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.868840 11728 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.839775 12309 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:53.909459 12344 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:53.784410 12279 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:53.932845 10019 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:53.946341 10121 pending_rounds.cc:107] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:54.220063 12028 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:54.208911 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.220824 12028 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:54.221278 12028 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:53.947252 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:54.222543 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 275355us
I20260709 12:14:54.223546 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:54.225205 10055 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
W20260709 12:14:54.226648 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 293849us
W20260709 12:14:54.001374 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1594) took 3570 ms (client timeout 3202 ms). Trace:
W20260709 12:14:54.230893 10201 rpcz_store.cc:269] 0709 12:14:50.430775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:51.364620 (+933845us) service_pool.cc:224] Handling call
0709 12:14:54.001140 (+2636520us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:54.001286 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5059450752}
I20260709 12:14:54.231792 11728 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.233072 10735 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:54.233251 12006 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.233624 12006 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.234027 12210 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.015074 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:54.235246 10046 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:53.919628 12347 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:54.131978 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.000231 12285 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.915653 12349 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:53.879611 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:53.901671 12351 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.238402 12285 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.241320 12317 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.242995 12285 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.243752 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.244789 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:54.227624 10202 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:54.246642 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.246348 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 344) took 3857 ms. Trace:
I20260709 12:14:54.247619 10729 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:54.239323 12338 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.248468 12144 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.248888 12144 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:54.249166 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:54.229604 12028 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.251139 12028 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.251884 12306 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:54.000063 12200 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.253s
I20260709 12:14:54.253384 12270 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:54.020819 12360 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
I20260709 12:14:53.945722 10198 rpcz_store.cc:276] 0709 12:14:49.305687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.694022 (+4388335us) service_pool.cc:224] Handling call
0709 12:14:53.694340 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.915574 (+221234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.945199 (+ 29625us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540007d854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:53.945343 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507494272}
I20260709 12:14:54.256526 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1162) took 2798 ms. Trace:
I20260709 12:14:54.002074 10196 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:54.239507 10053 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:54.257925 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1070) took 4182 ms. Trace:
I20260709 12:14:54.258261 10196 rpcz_store.cc:276] 0709 12:14:50.075294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.001350 (+3926056us) service_pool.cc:224] Handling call
0709 12:14:54.001706 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.257670 (+255964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.257872 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.259550 10196 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:14:54.260123 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1597) took 3771 ms. Trace:
I20260709 12:14:54.260488 10196 rpcz_store.cc:276] 0709 12:14:50.488418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.259035 (+3770617us) service_pool.cc:224] Handling call
0709 12:14:54.259315 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:54.259898 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.260066 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:54.156186 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.948225 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1769) took 4353 ms. Trace:
I20260709 12:14:54.023677 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:54.263060 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.930361 10020 connection.cc:256] RPC call timeout handler was delayed by -1.285967466999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 12:14:54.245618 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.263895 10052 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:54.059890 12340 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:54.265865 12340 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.266301 12340 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.249248 12144 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:53.933583 12267 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.027004 10200 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:54.268921 12337 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.257172 12210 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.269905 12210 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.270444 12210 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.271773 12338 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.272233 12338 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.233022 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.275978 12144 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.220594 10121 raft_consensus.cc:2889] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:54.278563 12144 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.278821 10121 pending_rounds.cc:107] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:54.304534 10121 raft_consensus.cc:2889] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:54.279347 12338 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:54.333964 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 497218us
I20260709 12:14:54.239060  9951 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.336316  9951 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.228013 12261 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.281996 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:54.283231 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:54.283422 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1587) took 4909 ms. Trace:
I20260709 12:14:54.239399 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1061) took 4706 ms. Trace:
I20260709 12:14:54.358642 10199 rpcz_store.cc:276] 0709 12:14:49.533412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.830177 (+4296765us) service_pool.cc:224] Handling call
0709 12:14:53.830485 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.239137 (+408652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.239345 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.338028  9951 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.359661 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.360213 10199 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.360025  9951 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.059600 11945 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.227s
I20260709 12:14:54.240048 12351 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.256917 10127 rpcz_store.cc:276] 0709 12:14:51.458568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.754032 (+2295464us) service_pool.cc:224] Handling call
0709 12:14:53.754311 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.754673 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:14:53.793394 (+ 38721us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.815431 (+ 22037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.816286 (+   855us) log.cc:844] Serialized 26 byte log entry
0709 12:14:53.816417 (+   131us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:53.816449 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.816512 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.930757 (+114245us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4800240258. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:14:54.020199 (+ 89442us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:54.256282 (+236083us) raft_consensus.cc:1685] finished
0709 12:14:54.256307 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.256463 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38716,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":22635,"raft.run_cpu_time_us":2561,"raft.run_wall_time_us":153781,"spinlock_wait_cycles":26765312,"thread_start_us":59990,"threads_started":2,"wal-append.queue_time_us":21964}
I20260709 12:14:54.287631 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1067) took 4593 ms. Trace:
I20260709 12:14:54.262217 10128 rpcz_store.cc:276] 0709 12:14:49.595040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:50.456628 (+861588us) service_pool.cc:224] Handling call
0709 12:14:50.456893 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:53.933848 (+3476955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.948170 (+ 14322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.257342 10198 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:54.229965 12309 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.239779 12149 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.291687 12235 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:54.292346 11728 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.293212 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.293674 12028 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.247634 10202 rpcz_store.cc:276] 0709 12:14:50.389064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.226992 (+3837928us) service_pool.cc:224] Handling call
0709 12:14:54.227298 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.246114 (+ 18816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.246294 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.295073 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1589) took 4907 ms. Trace:
I20260709 12:14:54.296131 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.297672 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:54.299391 10094 connection.cc:256] RPC call timeout handler was delayed by -3.3901660610001727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:14:54.302196 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77447.5us
I20260709 12:14:54.260176 10053 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:54.317625 10019 connection.cc:256] RPC call timeout handler was delayed by -2.9864394229998652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:14:54.333027 12245 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:54.374548 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.473923 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.475136 10019 connection.cc:256] RPC call timeout handler was delayed by -2.3257590010000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:14:54.347527 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 114569us
I20260709 12:14:54.361500  9951 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.476289 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1592) took 4058 ms. Trace:
I20260709 12:14:54.481901 10198 rpcz_store.cc:276] 0709 12:14:50.418393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.256753 (+3838360us) service_pool.cc:224] Handling call
0709 12:14:54.257104 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.475529 (+218425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.476235 (+   706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.434223 10199 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:14:54.357450 10203 rpcz_store.cc:276] 0709 12:14:49.374042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.729375 (+4355333us) service_pool.cc:224] Handling call
0709 12:14:53.766010 (+ 36635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.766366 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.766393 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.771226 (+  4833us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.128301 (+357075us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:54.128353 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.128419 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.283229 (+154810us) raft_consensus.cc:1685] finished
0709 12:14:54.283250 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.283370 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3914,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14038,"thread_start_us":311510,"threads_started":1,"wal-append.queue_time_us":489618}
W20260709 12:14:54.475801 10019 connection.cc:256] RPC call timeout handler was delayed by -1.9449042720000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 12:14:54.401294 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:54.474640 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.484917 10094 connection.cc:256] RPC call timeout handler was delayed by -2.2018942720001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 12:14:54.485338 10094 connection.cc:256] RPC call timeout handler was delayed by -2.0920942720001676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 12:14:54.485617 10094 connection.cc:256] RPC call timeout handler was delayed by -1.9696942719999697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 12:14:54.485880 10094 connection.cc:256] RPC call timeout handler was delayed by -1.788794272000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:14:54.486150 10094 connection.cc:256] RPC call timeout handler was delayed by -1.7347942720000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 12:14:54.486680 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:54.476912 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.333592 12239 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:54.475813 10200 rpcz_store.cc:276] 0709 12:14:49.693968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.946778 (+4252810us) service_pool.cc:224] Handling call
0709 12:14:54.026819 (+ 80041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.268759 (+241940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.287566 (+ 18807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.340590 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1166) took 2881 ms. Trace:
W20260709 12:14:54.483804 10019 connection.cc:256] RPC call timeout handler was delayed by -1.3827138889998878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 12:14:54.489830 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:54.488988 10121 rpcz_store.cc:276] 0709 12:14:51.459619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.757709 (+2298090us) service_pool.cc:224] Handling call
0709 12:14:53.757948 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.305077 (+547129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.340328 (+ 35251us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54001e4454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:54.340526 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172020608}
I20260709 12:14:54.425806 10728 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:54.479698 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.481779  9951 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 1 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 3 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.523913  9951 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 6 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.525063  9951 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:14:54.526859 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50009.8us
I20260709 12:14:54.528995 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:54.492139 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 239782us
I20260709 12:14:54.532267 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.534792 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:54.537254 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 342) took 4386 ms. Trace:
I20260709 12:14:54.530929  9951 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 2 to 4, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:54.537673 10195 rpcz_store.cc:276] 0709 12:14:50.151253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.012355 (+3861102us) service_pool.cc:224] Handling call
0709 12:14:54.012757 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.061343 (+ 48586us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:54.351206 (+289863us) log.cc:844] Serialized 14 byte log entry
0709 12:14:54.536790 (+185584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:54.536838 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:54.536883 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.537085 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.537198 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58694,"raft.queue_time_us":48491,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":47342,"thread_start_us":265050,"threads_started":2}
I20260709 12:14:54.538514  9951 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 3 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:54.539394 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.540071 10195 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:54.542346 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:54.544081 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 142845us
I20260709 12:14:54.545152 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:54.548067 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.548313 12235 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:54.550060 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.550630 10195 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:54.551672 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.542718  9951 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:54.552196 10195 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:54.553037 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.554292 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.555290 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.556484 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.553812  9951 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.557031 10195 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:54.558091 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.558604 10195 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:54.559613 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.560921 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.562983 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.563530 10199 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:54.462906 12261 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.460214 12313 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:54.560336  9951 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 3 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.564350 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.572588 10199 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:54.569836 12337 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.468276 12340 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.579391 11917 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.579828 11917 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.580228 11917 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:54.423084 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08002b86a0 after lost signal to thread 8910
I20260709 12:14:54.487785 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.574661 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.575031  9951 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 4, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.589227 10199 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:54.562435 11728 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.522626 12306 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:54.379142 12335 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:54.399248 12147 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:14:54.371730 12317 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.192s
I20260709 12:14:54.526851 12144 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:54.571713 12313 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:54.570472 12239 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:54.528569 12309 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:54.573850 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87250.2us
I20260709 12:14:54.491808 12245 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.607878 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.579741 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.611056 10200 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:54.575941 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.611779 10198 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:54.570307 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.612704 10202 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.584910 12334 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.575418 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:54.620124 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44775.3us
I20260709 12:14:54.620894 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.543738 11663 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:54.590443  9951 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 4, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 4 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:14:54.565130 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.594841 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.576367 10729 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:54.459553 12210 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.487572 12028 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:54.631471 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 99283.4us
I20260709 12:14:54.600523 11728 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:54.578079 12285 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:54.604374 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 124750us
I20260709 12:14:54.570298 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.602661 12306 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:54.603298 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57366.3us
I20260709 12:14:54.650871 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.651666 10203 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:54.618989 12334 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:54.626380 12279 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.616333 12347 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:54.606307 12144 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:54.643340 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.649240 10202 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:54.672422 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.672621 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.607275 10730 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:54.654443 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.673122 10198 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.673126 10202 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:54.673465 10203 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:54.674494 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.675275 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.675673 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.676959 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.677322 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:54.632660 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.633153 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.678056 10202 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:54.643267 12309 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.679550 12309 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:54.679597 12149 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:14:54.630854 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08002b37a0 after lost signal to thread 9987
I20260709 12:14:54.679982 12309 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.655437 12340 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:54.639441 12358 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:54.624327 11663 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:54.650025 11982 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:54.719882 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.644415 11728 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.726924 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.706463 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.728183 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.728892 10202 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:54.729306 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.624033 12359 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:14:54.730918 12149 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.739380 12368 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:54.733069 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.733371 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1603) took 1131 ms. Trace:
I20260709 12:14:54.733894 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1599) took 3557 ms. Trace:
W20260709 12:14:54.681226 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08003a76c0 after lost signal to thread 10079
I20260709 12:14:54.734644 12144 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.722203 12348 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:54.735622 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46021.1us
I20260709 12:14:54.662604 12334 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.722558 12335 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:54.737071 11663 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.737511 12358 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:54.722966 12338 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:54.740967 10196 rpcz_store.cc:276] 0709 12:14:51.176339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.261224 (+3084885us) service_pool.cc:224] Handling call
0709 12:14:54.261530 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:54.479342 (+217812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.479374 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:54.520894 (+ 41520us) log.cc:844] Serialized 52 byte log entry
0709 12:14:54.628291 (+107397us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:54.628360 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.628494 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.733679 (+105185us) raft_consensus.cc:1685] finished
0709 12:14:54.733698 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.733839 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134834,"raft.queue_time_us":181107,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14533,"thread_start_us":47705,"threads_started":1,"wal-append.queue_time_us":169049}
I20260709 12:14:54.740916 10046 rpcz_store.cc:276] 0709 12:14:53.602212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.235899 (+633687us) service_pool.cc:224] Handling call
0709 12:14:54.236228 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.236545 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.236572 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.236998 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.351698 (+114700us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:54.351738 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.353118 (+  1380us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.733170 (+380052us) raft_consensus.cc:1685] finished
0709 12:14:54.733190 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.733316 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7116,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":114423,"threads_started":1,"wal-append.queue_time_us":494170}
W20260709 12:14:54.740365 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 107300us
W20260709 12:14:54.742396 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 109891us
I20260709 12:14:54.742470 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:54.746713 10200 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:14:54.782169 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 347) took 1171 ms. Trace:
I20260709 12:14:54.805009 10196 rpcz_store.cc:276] 0709 12:14:53.611123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.781417 (+1170294us) service_pool.cc:224] Handling call
0709 12:14:54.781695 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.781871 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.781892 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:54.781930 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:54.781956 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.782013 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.782117 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:54.804761 10199 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:54.807920 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:54.755230 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:54.762670 10198 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:54.721333 12200 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.816975 10195 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:54.823375 10196 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:54.824136 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 348) took 1212 ms. Trace:
I20260709 12:14:54.824455 10196 rpcz_store.cc:276] 0709 12:14:53.612112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.822685 (+1210573us) service_pool.cc:224] Handling call
0709 12:14:54.823031 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.823850 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.824073 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:54.763876 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.671625 12279 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:54.692494 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.654925 12285 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:54.828016 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:54.890049 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 62119.8us
I20260709 12:14:54.892530 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:54.892165 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 356500us
I20260709 12:14:54.893679 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:54.897810 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:54.900452 12147 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:54.889797 12285 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:54.901018 12384 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:54.893446 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:54.898658 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:54.904362 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:54.776491 12335 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:54.778594 12144 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.817382 11663 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.826833 12347 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:54.894711 12006 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.002s
I20260709 12:14:54.826948 12200 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:54.481572 10197 rpcz_store.cc:276] 0709 12:14:49.387564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.796868 (+4409304us) service_pool.cc:224] Handling call
0709 12:14:53.797220 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:53.797573 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.797603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:53.798114 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.288763 (+490649us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:54.288811 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.288883 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.294835 (+  5952us) raft_consensus.cc:1685] finished
0709 12:14:54.294864 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.295017 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":675,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":490275,"threads_started":1,"wal-append.queue_time_us":490899}
W20260709 12:14:54.916548 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 295719us
W20260709 12:14:54.903745 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08003599e0 after lost signal to thread 10154
I20260709 12:14:54.726270 12239 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.860795 12279 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.905833 12359 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:54.943011 12028 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.917407 12382 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:14:54.776795 12306 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.909379 12261 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.890021 12149 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:14:54.907246 12374 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:54.939560 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:54.917542 12235 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.919626 12335 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:54.901644 12384 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.927687 12147 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:54.924878 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:54.941254 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb980 after lost signal to thread 10155
I20260709 12:14:54.936691 12200 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.900951 12402 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:54.938822 12347 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:54.906085 12386 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:14:54.970508 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:54.956246 12235 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:54.965801 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.939318 12006 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.965971 12147 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.955019 12261 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:54.975135 10733 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.963771 12400 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:54.986583 12377 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:54.986730 12210 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:54.986914 12392 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.987318 12392 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:54.987602 12245 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.987777 12392 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.983256 12147 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:54.978977 12235 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:54.991230 12380 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:14:54.991677 12382 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:54.992074 12382 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:54.992908 12382 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:54.994053 12382 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:54.981832 12344 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:54.994848 12344 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:54.995832 12344 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:54.997458 12344 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:54.998245 12306 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.000476 12006 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:55.004207 12370 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 12:14:55.006316 12374 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:55.006831 12374 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:55.007100 12351 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 12:14:55.007550 12351 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.009690 12351 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:54.981904 12261 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.987246 12347 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:55.044023 12334 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.046134 12334 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.064841 12369 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:55.065361 12369 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:55.068859 12374 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.071399 12374 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.072875 12384 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.066184 12369 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.076453 12369 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.115054 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 251) took 1416 ms. Trace:
I20260709 12:14:55.116178 10052 rpcz_store.cc:276] 0709 12:14:53.698364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.264567 (+566203us) service_pool.cc:224] Handling call
0709 12:14:54.264797 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.573227 (+308430us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:54.817614 (+244387us) log.cc:844] Serialized 14 byte log entry
0709 12:14:55.113803 (+296189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:55.113945 (+   142us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:55.114089 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.114226 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.114644 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74342,"prepare.queue_time_us":162860,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":122394,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":746760,"threads_started":3,"wal-append.queue_time_us":245287}
I20260709 12:14:54.907627 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:55.119787 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 212153us
W20260709 12:14:55.120940 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.121238 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:55.125284 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 227381us
W20260709 12:14:55.131219 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 375893us
I20260709 12:14:55.137203 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1077) took 3746 ms. Trace:
I20260709 12:14:55.146610 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.148619 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:55.142272 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.137913 10195 rpcz_store.cc:276] 0709 12:14:51.390353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.775634 (+3385281us) service_pool.cc:224] Handling call
0709 12:14:54.814679 (+ 39045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.817379 (+  2700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.136691 (+319312us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54002639d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:55.136967 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88993024}
I20260709 12:14:55.160596 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.161242 10198 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:54.965463 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 72078.3us
I20260709 12:14:55.143014 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1062) took 5593 ms. Trace:
I20260709 12:14:54.969702 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:54.978029 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.171841 10732 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:55.172847 10728 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:14:55.159032 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.174778 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.159703 10729 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:55.159360 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.171180 10204 rpcz_store.cc:276] 0709 12:14:49.549150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.945404 (+4396254us) service_pool.cc:224] Handling call
0709 12:14:53.945670 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.059268 (+113598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.059301 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.254521 (+195220us) log.cc:844] Serialized 26 byte log entry
0709 12:14:54.349213 (+ 94692us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:54.349256 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.349336 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:55.003623 (+654287us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:55.142242 (+138619us) raft_consensus.cc:1685] finished
0709 12:14:55.142292 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.142783 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54652,"raft.queue_time_us":114816,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":78919936,"thread_start_us":94289,"threads_started":1,"wal-append.queue_time_us":471486}
I20260709 12:14:55.178889 11982 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:55.179401 11945 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:55.181026 11917 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 12:14:55.180761 11945 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.180778 11982 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.181545 11917 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.181901 11945 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.182771 10733 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:14:55.163028 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08002c0a00 after lost signal to thread 10228
I20260709 12:14:55.173290 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.175138 11728 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:55.183883 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.137368 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 345) took 4729 ms. Trace:
I20260709 12:14:55.184828 11945 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.205631 12392 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.211074 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:55.212456 12309 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 12:14:55.213254 12392 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.212960 12309 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:55.215505 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 275884us
I20260709 12:14:55.216534 12028 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:55.192837 12386 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:55.217653 12155 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.218093 12386 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.218609 12386 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.218957 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.220264 12155 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.220960 12155 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.141063 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.199529 12384 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:55.222131 12384 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:55.222623 12384 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:55.224221 12309 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.203099 12399 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.226668 12399 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:55.227150 12399 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.227768 12313 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.228900 12313 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.205673 12409 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:55.203193 12400 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:55.215648 12149 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:55.231988 12149 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:55.232417 12400 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.216804 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.193267 12359 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:55.221562 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79958.7us
I20260709 12:14:55.233237 12149 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.207422 12368 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:55.238204 12392 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.238343 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:55.241111 10204 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:55.185177 11917 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.255692 12155 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.256320 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.259668 12245 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.260095 12245 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:55.256657 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 115889us
I20260709 12:14:55.260455 12245 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:55.260720 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 87872us
I20260709 12:14:55.262586 10199 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:55.266502 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.266688 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.267376 12374 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:55.267752 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.266659 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.268672 12374 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:55.269064 10052 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:55.269093 12374 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:55.260180 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.272264 12374 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.273257 12395 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:55.273824 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.275239 10050 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.275542 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:55.276742 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.277274 10121 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:55.278155 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.278923 12414 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:55.279770 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.280133 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.280562 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.261749 12335 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.292235 12374 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.288476 11945 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.283764 12414 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.293497 12414 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.293385 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.294139 10125 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.292431 10128 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.253278 10201 rpcz_store.cc:276] 0709 12:14:50.407593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.231756 (+3824163us) service_pool.cc:224] Handling call
0709 12:14:54.232031 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.232221 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:54.349560 (+117339us) log.cc:844] Serialized 14 byte log entry
0709 12:14:54.771514 (+421954us) log.cc:844] Serialized 14 byte log entry
0709 12:14:55.128812 (+357298us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18002bf660. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:14:55.136586 (+  7774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:55.136696 (+   110us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:55.136827 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.136952 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.137139 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47940,"prepare.queue_time_us":505745,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":447105,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":7086,"spinlock_wait_cycles":2804992,"thread_start_us":495022,"threads_started":3,"wal-append.queue_time_us":467436}
I20260709 12:14:55.308554 10127 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:55.310086 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.314484 12155 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:55.318835 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55793.1us
I20260709 12:14:55.321033 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:55.321740 12267 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.046s	user 0.011s	sys 0.001s
I20260709 12:14:55.321995 12309 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.321995 12200 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.324147 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.325102 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.325666 12200 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.325901 10052 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:55.332633 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.340294 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.340660 10125 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:55.341698 10046 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:55.341710 10126 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:14:55.346179 10020 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.733s (SENT)
I20260709 12:14:55.346863 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.347026 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.348250 10203 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:55.348524 10050 raft_consensus.cc:2376] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5. Re-sending same reply.
I20260709 12:14:55.352381 11945 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:55.353036 11945 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.345320 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.357412 12279 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.358381 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.359813 12279 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.339629 12309 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:55.355316 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.373602 12267 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:55.353040 12270 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.099s	user 0.006s	sys 0.006s
I20260709 12:14:55.374914 12270 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.367439 12386 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.367724 12235 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.377292 12270 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.355100 12285 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.379016 12235 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.379376 12285 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.368690 10204 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:55.383234 12335 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.384248 12261 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.385627 10052 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:55.385893 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:55.386634 12261 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.390718 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.391391 10733 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 2.
I20260709 12:14:55.392463 10055 raft_consensus.cc:2410] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:55.392023 12386 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.393189 12386 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.395215 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.396479 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.396870 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.397382 10053 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:55.397746 10050 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:14:55.398829 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.399938 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.400043 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.399106 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:55.401013 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44483.9us
I20260709 12:14:55.401309 10050 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:55.401800 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.394382 12386 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:55.403815 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.410892 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 134276us
I20260709 12:14:55.402776 10128 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:14:55.403019 10758 debug-util.cc:398] Leaking SignalData structure 0x7b0800358440 after lost signal to thread 10761
I20260709 12:14:55.423074 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:14:55.418390 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08003e29e0 after lost signal to thread 10762
W20260709 12:14:55.427364 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 103352us
I20260709 12:14:55.434890 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.438055 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.437175 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.439308 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.439630 10127 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.440687 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.454540 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.455304 10054 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.457501 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.458211 10052 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:55.459790 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.460579 10053 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:55.460983 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.461584 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.462898 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.463583 10046 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.454275 10055 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:55.466099 10049 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.470961 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:55.471189 11663 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.002s
I20260709 12:14:55.471724 10121 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.472959 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.473827 10130 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.474059 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.474901 10127 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.475787 12147 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.471246 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.478224 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:55.478610 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.480875 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.482785 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.483603 10051 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:55.484468 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:55.488883 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.485060 10122 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:55.489915 12200 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:55.490360 12200 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:55.490443 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.490814 12200 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.491155 10127 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:55.492594 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.493515 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.494172 10055 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:55.498311 10053 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 2.
I20260709 12:14:55.488219 10130 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:14:55.484777 12245 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.485205 11663 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:55.485930 12386 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.489776 12399 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.486784 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.484570 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.498901 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:55.488680 10128 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:14:55.500712 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 63340.4us
I20260709 12:14:55.485818 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.485759 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.485726 11728 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.516616 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:55.516615 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71159.1us
I20260709 12:14:55.521168 10121 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.525328 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.498046 12200 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.524763 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:55.478257 12147 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.530598 10049 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:55.536065 12313 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:55.536464 12313 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:55.537369 12313 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.439254 10203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:55.538667 12344 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:55.556823 12344 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:55.557768 12344 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.540552 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.559675 12340 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:55.560393 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.541518 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.541574 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.561823 10051 raft_consensus.cc:2368] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5.
I20260709 12:14:55.538405 11945 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.541713 11663 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.542677 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.563234 11663 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.545691 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.563468 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.563730 11663 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.564289 12399 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.564484 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.564678 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.565136 10122 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.565825 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:55.562669 12346 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:55.546167 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.567343 12387 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:55.567663 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.568285 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.568599 12338 raft_consensus.cc:2764] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:55.545356 10130 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:14:55.568980 12346 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.569316 12338 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:55.569743 12338 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:55.568167 10128 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.567826 12387 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:55.570636 12387 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.570783 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.568100 12348 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.571389 12348 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:55.571755 12348 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.548296 10203 raft_consensus.cc:606] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:55.572337 10203 raft_consensus.cc:614] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.568784 12340 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:55.573036 12414 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.573683 12340 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:55.567551 10124 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 4: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.498064 12384 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.574550 12338 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.575584 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.575811 12338 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:55.576107 10054 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.576241 12346 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.576673 12384 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.449683 12335 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:14:55.546610 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.577904 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.569923 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.541837 12313 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.578727 12335 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.579020 10130 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:55.539685 12245 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:55.547886 10046 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
W20260709 12:14:55.579730 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.579964 10124 raft_consensus.cc:2368] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6.
I20260709 12:14:55.580389 12335 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:55.580780 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.581611 10124 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.580791 12335 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.548851 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.578122 10121 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:55.571916 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.582391 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.588053 10052 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:14:55.556190 10127 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:14:55.574712 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.553192 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.593168 10125 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.593829 10053 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:55.552982 12421 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:14:55.596361 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:55.594683 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.570050 12395 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:55.571882 12306 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.002s
I20260709 12:14:55.574744 12340 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:55.603488 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:55.608503 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.614593 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.601953 12245 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:55.621500 12419 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
W20260709 12:14:55.622627 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.622866 10197 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.624011 12385 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:55.624475 12385 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.624665 10123 raft_consensus.cc:2410] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:55.624814 12385 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.625312 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.626116 12285 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:55.640599 11728 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:55.650918 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.657421 11663 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.681193 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:55.660076 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:55.682183 10046 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:55.661682 12200 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.662777 12346 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:55.664713 10053 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:55.689126 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.688418 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.690927 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.692252 10054 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.693523 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.694120 10051 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:55.694676 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74056.3us
W20260709 12:14:55.702626 12424 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 12:14:55.703074 10169 leader_election.cc:400] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5.
I20260709 12:14:55.703429 10169 leader_election.cc:403] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.703570 12348 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.704123 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.706314 10050 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:55.707965 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.688997 12346 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.704905 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.712437 10046 raft_consensus.cc:2368] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:55.694507 11728 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:55.737908 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.716807 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:55.742450 10124 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:55.744032 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.744216 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.716068 12346 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:55.741247 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 99623.5us
I20260709 12:14:55.751457 10122 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
W20260709 12:14:55.752243 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.717429 11728 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.753763 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.755833 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.725296 12200 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:55.756852 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.759886 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.756503 10736 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:55.761747 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.762769 10733 raft_consensus.cc:2410] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:55.755475 11728 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.742540 12414 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.768659 10127 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.766836 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.770884 10124 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.753825 12235 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:55.775630 10168 leader_election.cc:336] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.814s (SENT)
I20260709 12:14:55.776206 10122 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:55.760371 12386 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:55.829897 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.821370 10054 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:55.815008 11663 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.808049 12344 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:55.811803 10051 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:55.759058 12200 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:55.814924 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 61826.5us
I20260709 12:14:55.807876 12393 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.843639 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.844125 12344 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:55.844753 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.842284 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.846174 10051 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.845096 12344 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.847949 10195 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:55.851202 12436 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:14:55.852456 11945 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.836094 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.836356 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.832742 12399 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:14:55.836807 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:55.836172 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.863937 10127 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:55.863880 10051 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:55.839593 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.763916 12335 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.842674 12348 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:55.843122 10128 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:55.834882 12235 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.853299 12306 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:55.832842 12261 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.874670 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.875448 10122 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.859275 10129 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:55.859319 10121 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:55.844369 10125 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.864953 10130 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:55.869874 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:55.835023 10203 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:14:55.877750 10051 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:55.879596 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.888793 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.894129 10733 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:14:55.894224 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.862967 12200 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.894153 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.898881 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.904032 10199 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:55.908128 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.909389 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.917529 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:14:55.918169 10055 raft_consensus.cc:606] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:55.918960 10197 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:14:55.919982 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.907202 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:55.922520 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:14:55.926388 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 159782us
I20260709 12:14:55.929572 10127 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.931150 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.932241 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.934993 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:55.925082 12261 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:55.935581 10736 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.919224 12348 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:55.936086 12385 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.937322 12387 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:55.938076 12385 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:55.928331 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:55.939010 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.928515 11945 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:55.963431 11945 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:55.963896 11945 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.966801 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.967705 10124 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:55.969062 12346 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:55.971099 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.971808 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.972028 10733 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:55.973412 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.971134 10736 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:55.973812 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.974679 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.975250 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:55.975970 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.973416 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:55.974112 10735 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:55.978631 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.979001 10195 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.969076 10203 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:55.982918 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:55.983708 10130 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:55.942456 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.986527 10129 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:55.962917 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.002005 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.002832 10125 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:55.994303 10051 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:14:56.009462 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56430us
I20260709 12:14:56.009315 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.012499 10127 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:14:56.016538 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.017488 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.017395 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.024461 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:55.963577 12387 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:56.025686 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.015496 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:56.030711 10129 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:56.025090 10123 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:56.026944 10201 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:56.023470 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.034265 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.035045 10127 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 3: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:56.036672 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:14:56.038270 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 115837us
I20260709 12:14:56.042395 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:56.007999 12348 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:56.008517 11663 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.052481 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.053032 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.011620 12149 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:56.071295 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:56.014587 10729 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:56.073880 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.071146 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:56.028141 12147 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:56.078776 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.079028 10124 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:56.075119 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:56.076390 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 157743us
I20260709 12:14:56.083985 12147 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:56.086164 12147 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:56.077783 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.073256 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.062991 12348 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:56.084434 12428 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:14:56.075976 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.008695 11728 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.098909 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:56.101609 10124 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:56.089614 10121 raft_consensus.cc:2368] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:56.097400 10735 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:56.098577 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59595.9us
I20260709 12:14:56.106168 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.073282 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.109181 10195 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:56.096323 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.081489 12149 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:56.147773 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.149212 10125 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:56.072590 11663 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:56.153391 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:56.154264 12400 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:56.154647 12400 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.154729 10123 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:14:56.155149 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.155968 10730 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:56.156883 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.098300 12348 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:56.160419 10020 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.720s (SENT)
I20260709 12:14:56.159261 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.154660 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:56.177806 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.147058 12245 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:14:56.186450 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:56.184763 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.108618 12346 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.146556 12267 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:56.190567 10121 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:56.155014 12400 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.150305 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.176608 10730 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:56.192951 10124 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:56.206074 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.202890 10196 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:56.204330 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.206842 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.226788 10051 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:56.202719 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 96608.7us
I20260709 12:14:56.229023 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.229271 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.229806 10053 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 3.
I20260709 12:14:56.230482 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:56.230707 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.191061 12335 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.231842 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.203819 12245 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:56.232551 10053 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:56.232859 10735 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.233469 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.234069 10053 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:56.234841 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.235571 10054 raft_consensus.cc:2368] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6.
I20260709 12:14:56.235569 10733 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:56.205237 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:56.246575 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.226775 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:56.250605 10048 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:56.251211 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.234745 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.252182 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:56.253858 10049 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:14:56.255767 10168 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:56.254892 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.230543 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.260668 10196 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
W20260709 12:14:56.260948 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 106351us
I20260709 12:14:56.187224 12313 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.200242 12261 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:56.271799 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.270815 10046 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:56.278999 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:56.192700 12386 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:56.284758 10050 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 2.
W20260709 12:14:56.273413 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 191118us
I20260709 12:14:56.267841 10049 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.273242 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.208343 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.232606 12245 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:56.237483 12374 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.283756 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.250854 12285 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.299708 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:56.272912 12420 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:14:56.290452 10124 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.280715 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.295778 10055 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.296332 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:56.310216 10051 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:56.310206 10127 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:56.205237 11945 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.205430 12267 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:56.326092 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70421us
I20260709 12:14:56.326288 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.327044 10733 raft_consensus.cc:2368] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:56.326407 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.327553 10196 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:14:56.327991 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 97590.7us
W20260709 12:14:56.331671 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48884.1us
W20260709 12:14:56.332255 10020 leader_election.cc:336] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.753s (SENT)
I20260709 12:14:56.333310 10051 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:56.302680 12261 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:56.336164 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.338816 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.343089 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.343792 11945 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.344623 10198 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:56.344893 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:56.345608 10731 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:56.336934 12313 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:56.346947 10055 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:14:56.301061 12335 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:56.349059 10054 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:56.351328 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67624.2us
I20260709 12:14:56.352720 10734 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:56.354630 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:56.362545 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.354812 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:56.330121 10729 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:56.324033 12374 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.299149 12386 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:56.346655 10731 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEARNER]: Advancing to term 9
I20260709 12:14:56.381918 10734 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.382462 12386 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:56.349978 12335 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.383009 12335 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:56.384194 12445 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:14:56.390882 11728 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.391585 11728 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:56.391994 11728 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:56.392364 11728 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:56.390832 12453 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:56.382773 12147 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:56.396348 12147 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:56.397248 12147 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.390792 12399 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:56.398836 12399 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:56.399824 12399 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.400833 12399 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.401744 10735 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:56.368203 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:56.391466 12402 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:56.417433 12402 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:56.375550 10055 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:56.406733 11663 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:56.407123 12349 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:56.378980 12261 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:14:56.410615 12306 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:56.415035 10053 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:14:56.411703 12267 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:56.441915 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 89894.7us
I20260709 12:14:56.415975 10130 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:14:56.420734 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.438719 10202 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:56.423825 10195 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:56.422371 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:56.451767 10734 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.410267 12369 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:14:56.456914 10196 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:14:56.473110 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.447999 12270 raft_consensus.cc:2764] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:56.474363 10202 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:56.356536 12149 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.477109 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.452914 12346 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:56.410530 12245 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:56.452265 12455 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:14:56.441051 12335 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.487488 10202 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:56.487725 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:56.491463 10129 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:56.496788 10049 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:56.471850 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:56.532876 10047 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:56.481884 12200 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.002s
W20260709 12:14:56.478111 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 99178.8us
I20260709 12:14:56.480473 12346 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:56.479352 12387 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:56.497612 12393 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.001s
W20260709 12:14:56.540515 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 118228us
I20260709 12:14:56.478513 12402 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.492036 12309 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:56.850576 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.720899 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 159204us
W20260709 12:14:56.871392 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 394335us
W20260709 12:14:56.713191 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 380950us
W20260709 12:14:56.540900 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 208571us
W20260709 12:14:56.751580 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.884263 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:56.726150 10198 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:56.726737 10202 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:56.886855 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:56.689203 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.538241 12313 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.750025 10199 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:56.894810 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:56.552771 12346 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:56.539492 12384 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.897055 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:56.541877 11663 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.906790 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:56.907388 11728 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.005s
I20260709 12:14:56.961786 11728 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:56.724200 12454 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:56.718686 10729 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:14:56.753952 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.988s (SENT) [suppressed 33 similar messages]
I20260709 12:14:56.887283 12149 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:56.728504 11945 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:56.695108 12245 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:56.959064 12466 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:14:56.748838 12469 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.956871 10198 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:56.958545 12461 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:56.796788 12393 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5.
I20260709 12:14:56.878921 12471 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:56.748088 12335 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.883193 12309 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:56.872548 12385 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.015s	sys 0.023s
W20260709 12:14:56.954136 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.898023 12402 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:56.963544 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 66583.8us
I20260709 12:14:56.964007 12454 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.010191 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:56.753859 12468 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.542132 12200 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:56.976398 10731 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.003s
I20260709 12:14:56.966567 12384 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.016104 12465 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:57.016304 12459 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.017524 12454 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.018621 12454 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:57.021229 12440 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.844s	user 0.001s	sys 0.001s
I20260709 12:14:56.988247 12471 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:14:56.997654 12385 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.015s	sys 0.030s
W20260709 12:14:57.025146 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 130418us
I20260709 12:14:57.028165 10203 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:57.012953 12393 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:56.985689 11945 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:56.987519 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 80839us
I20260709 12:14:56.988729 11728 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:56.972920 12149 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.991724 12339 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:56.992962 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:57.041101 11728 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:56.994789 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 105822us
I20260709 12:14:56.963342 12470 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:56.996053 12348 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.000s
W20260709 12:14:56.996803 12400 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.000s
I20260709 12:14:56.953512 12261 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:14:57.034102 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:56.983294 12147 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:57.008735 12469 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.041363 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 538) took 1026 ms. Trace:
I20260709 12:14:57.042515 11728 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:57.032908 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.047317 10736 rpcz_store.cc:276] 0709 12:14:56.015044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.027957 (+ 12913us) service_pool.cc:224] Handling call
0709 12:14:56.992822 (+964865us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:57.041301 (+ 48479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3691392}
I20260709 12:14:57.050076 10702 leader_election.cc:400] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6.
I20260709 12:14:57.050478 10702 leader_election.cc:403] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.041893 12149 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.044296 10731 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:57.054808 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1631) took 1386 ms. Trace:
W20260709 12:14:57.054602 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 300666us
I20260709 12:14:57.058283 10052 rpcz_store.cc:276] 0709 12:14:55.664815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.665584 (+   769us) service_pool.cc:224] Handling call
0709 12:14:55.665879 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.699711 (+ 33832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.699746 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.743300 (+ 43554us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.009433 (+266133us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:56.040807 (+ 31374us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.052336 (+ 11529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.052419 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.489801 (+437382us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18003cf940. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:14:57.020465 (+530664us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:14:57.051273 (+ 30808us) raft_consensus.cc:1685] finished
0709 12:14:57.051295 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.051432 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2159,"prepare.queue_time_us":41762,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":8774,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":8769,"spinlock_wait_cycles":48572928,"thread_start_us":238329,"threads_started":1,"wal-append.queue_time_us":311882}
W20260709 12:14:57.062758 12457 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:14:57.064334 12384 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.064672 12235 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.070896 11728 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:57.052736 12399 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.001s
W20260709 12:14:57.074417 12472 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:57.023695 12468 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.084121 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.085345 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.046999 12475 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:57.045027 12348 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.092700 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:57.094560 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 84447.9us
W20260709 12:14:57.090164 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 122994us
I20260709 12:14:57.047338 12400 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.091041 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:57.110577 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.087049 12399 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6.
I20260709 12:14:57.032397 12471 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.123170 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:57.232620 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 109521us
W20260709 12:14:57.232903 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 122389us
W20260709 12:14:57.234082 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.049113 12339 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.126750 10201 raft_consensus.cc:2368] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:57.096643 12335 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:57.260135 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 169166us
W20260709 12:14:57.131965 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 172054us
I20260709 12:14:57.132149 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.090175 12475 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:57.133859 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:57.134786 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88490.7us
I20260709 12:14:57.266156 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:57.137342 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:57.096787 12478 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.140009 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.143563 12468 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.147254 12348 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.147773 12200 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.119757 12469 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.159467 12483 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:57.162845 12460 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.436s	user 0.000s	sys 0.002s
I20260709 12:14:57.166464 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.276116 10199 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:57.232064 12235 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.170931 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:57.281541 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:57.258859 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 160670us
W20260709 12:14:57.266721 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.268766 12482 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.166560 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.273330 10204 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:14:57.274716 10019 leader_election.cc:400] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:57.167044 12465 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:57.285633 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.315912 10129 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.286334 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.286494 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.280248 12348 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.286819 12470 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:57.287237 12480 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:57.333308 12480 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.335477 12480 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.280454 12468 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.336105 12468 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.336802 12374 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.338033 12468 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.341531 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1632) took 1271 ms. Trace:
I20260709 12:14:57.288619 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:57.291625 12267 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:57.292902 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.286129 12473 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:57.351476 12456 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.553s	user 0.001s	sys 0.000s
W20260709 12:14:57.351933 12441 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.146s	user 0.007s	sys 0.011s
I20260709 12:14:57.296888 10019 leader_election.cc:403] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:57.264163 12285 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:57.297997 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:57.298264 10731 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:57.272416 12306 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:57.356626 12306 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.357030 12306 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:57.357663 12444 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.158s	user 0.001s	sys 0.003s
I20260709 12:14:57.367779 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.299417 12482 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.299633 12235 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.383644 10049 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.384747 12482 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.300590 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.301505 12270 raft_consensus.cc:2764] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:57.282495 12483 consensus_queue.cc:1243] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:57.303166 12459 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.303534 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1630) took 1281 ms. Trace:
I20260709 12:14:57.368458 12485 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:57.301904 10095 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.305015 12349 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:57.306558 12487 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.308117 12339 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.308732 11945 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.389676 12270 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:57.390043 12270 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.390892 12270 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.392004 10049 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.392452 12471 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.392808 12459 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:57.327692 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.270864 12475 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.328080 10129 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:57.393246 12459 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.393724 12459 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.387176 10203 rpcz_store.cc:276] 0709 12:14:56.015364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.015614 (+   250us) service_pool.cc:224] Handling call
0709 12:14:57.290314 (+1274700us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54001040d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:57.296705 (+  6391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277227264}
W20260709 12:14:57.392539 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 90702.6us
W20260709 12:14:57.328908 12387 consensus_meta.cc:287] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.001s
I20260709 12:14:57.329571 12465 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.398706 12387 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.398165 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:57.355527 12285 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.299239 12400 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:57.358520 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 83966us
W20260709 12:14:57.365633 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67690.3us
I20260709 12:14:57.354796 12346 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:57.369058 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 537) took 1391 ms (client timeout 1535 ms). Trace:
I20260709 12:14:57.347642 12267 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:57.374909 12374 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:57.339083 12348 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.340462 12470 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.401278 12483 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.419620 12285 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.420678 12470 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:57.377969 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.422866 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.423566 10050 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:57.424513 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.425213 10050 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:57.425395 12306 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.425940 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.427137 10050 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:57.422765 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.428364 10051 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.379951 12149 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:57.380690 12462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.000s
I20260709 12:14:57.382753 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.368180 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.353289 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.385577 10204 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:57.329576 11728 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:57.341878 10201 rpcz_store.cc:276] 0709 12:14:56.070474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.070614 (+   140us) service_pool.cc:224] Handling call
0709 12:14:57.341341 (+1270727us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000e9cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:57.341466 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408328576}
I20260709 12:14:57.403631 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.406076 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.406208 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.407995 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.410708 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.412250 10202 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:57.384788 12235 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:57.415928 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88315.5us
I20260709 12:14:57.416319 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.417706 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.448818 10128 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.455009 10055 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.453013 10126 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:57.418641 10046 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:57.418708 12348 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.429302 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.430672 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.452699 10130 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.456489 10125 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.452764 10053 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.457710 10202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:57.428946 12374 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.432425 12470 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:57.433282 12346 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.434051 10054 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:57.427094 12369 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:57.435911 10124 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:57.437726 12473 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:57.403271 10732 rpcz_store.cc:269] 0709 12:14:55.977869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.987161 (+  9292us) service_pool.cc:224] Handling call
0709 12:14:57.292778 (+1305617us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:57.368962 (+ 76184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28925312}
W20260709 12:14:57.461231 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 629) took 1486 ms (client timeout 1789 ms). Trace:
W20260709 12:14:57.485069 10728 rpcz_store.cc:269] 0709 12:14:55.971009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.999949 (+ 28940us) service_pool.cc:224] Handling call
0709 12:14:57.288462 (+1288513us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:14:57.456873 (+168411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32178944}
I20260709 12:14:57.472458 12470 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:57.486783 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 86573.6us
I20260709 12:14:57.488394 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.490633 12483 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.490798 12485 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:57.491592 12485 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:57.492822 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.494140 12459 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.495026 12149 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.496853 12459 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.441213 12475 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.498786 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.499539 12475 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:57.442063 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43979.6us
I20260709 12:14:57.500560 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:57.447080 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.453608 10121 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:57.457811 11728 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.449113 10052 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.490624 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:57.503062 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 86829.3us
I20260709 12:14:57.504752 12467 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.505453 12467 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:57.505884 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.431394 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:57.506531 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.458247 12339 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.507210 12474 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:57.507309 12339 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.507854 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.508605 10733 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:57.488415 12235 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:57.451221 10051 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.509348 12235 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.506796 10730 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:57.457584 12393 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.507477 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.456806 11945 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.510824 11945 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.511723 12467 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:57.512079 12467 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.504189 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.515452 10130 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:57.509583 11728 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:57.516620 11728 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:57.519318 10052 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.458316 10202 raft_consensus.cc:606] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.461668 10123 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:14:57.448621 12462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.006s	sys 0.000s
I20260709 12:14:57.522586 10202 raft_consensus.cc:614] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:57.516043 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.524129 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:57.457198 12469 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.477298 12458 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.753s	user 0.002s	sys 0.000s
I20260709 12:14:57.478137 12374 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.479872 12306 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.530098 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:57.543605 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:57.544389 10050 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:57.462128 12487 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.539004 10052 pending_rounds.cc:85] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:14:57.534796 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.547248 10203 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:57.525883 10736 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 3.
I20260709 12:14:57.471974 10053 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:14:57.486359 12470 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.508143 12474 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:57.543496 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.528432 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:57.528975 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.527148 12385 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:57.527168 12346 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:57.525758 12393 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.529650 12459 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.525840 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.529630 10125 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.539505 12149 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:57.530515 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.534811 10733 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:57.535123 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:57.537674 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.529729 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.539727 10055 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:57.531431 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.513096 11945 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.627725 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.509709 12339 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.552742 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.537822 11728 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.546233 10052 pending_rounds.cc:107] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:14:57.617839 12492 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:14:57.618228 10202 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:57.531530 10199 pending_rounds.cc:85] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 1
I20260709 12:14:57.532037 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.628154 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:57.553954 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49862.6us
W20260709 12:14:57.539387 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 236550us
I20260709 12:14:57.631487 10130 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:57.632532 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 106808us
I20260709 12:14:57.542774 12455 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:57.532624 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:57.538098 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:57.698448 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:57.664186 10051 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:57.702334 10204 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:14:57.672529 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 134915us
I20260709 12:14:57.635134 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.702714 10052 raft_consensus.cc:2889] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:57.671487 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 141811us
I20260709 12:14:57.539583 12465 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.539947 12483 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.701277 10199 pending_rounds.cc:107] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:57.689149 10203 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:57.701957 10196 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:57.634083 12369 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:14:57.553619 12487 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.705868 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.628564 12306 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:57.633733 12346 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:57.535413 12469 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.701665 11728 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.633484 10200 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.671190 12385 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:57.706740 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71667.1us
I20260709 12:14:57.552098 12340 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 12:14:57.707831 12453 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:57.632171 12149 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.706997 12270 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.711593 12235 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.746690 12471 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:57.756958 12453 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.760511 12453 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.750222 12395 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.760780 12385 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.761381 12395 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.762540 12235 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.763129 12384 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:57.763516 12384 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:57.763944 12471 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.771291 12384 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.772377 12471 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.773582 12471 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.764765 12387 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.774390 12387 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.743880 12459 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:14:57.775491 12459 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:57.775815 12459 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.776458 12387 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.689682 12399 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:57.776966 12399 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.704473 10054 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:57.704660 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.716545 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:57.728076 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.741048 10199 raft_consensus.cc:2889] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:57.782238 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77645.2us
I20260709 12:14:57.744203 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.783433 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.616514 12461 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:57.670786 12485 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:57.785862 12485 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.786262 12485 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.787106 12149 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.668442 12348 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:57.790671 12348 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.791102 12348 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.793582 12470 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.794754 10123 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:57.689883 12285 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.739470 12455 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.796406 12455 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.797528 12455 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.752450 10095 leader_election.cc:400] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:57.798590 10095 leader_election.cc:403] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:14:57.799091 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46740.5us
I20260709 12:14:57.771967 12235 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.753599 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.710687 10730 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.539776 12467 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.756057 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1638) took 1549 ms. Trace:
I20260709 12:14:57.756958 10203 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:57.826697 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110209us
I20260709 12:14:57.741089 10729 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:57.712981 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.770154 12491 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:14:57.774721 12393 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.743758 12475 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:14:57.704610 10198 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:57.801070 12374 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.805706 12387 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:57.777356 12399 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:57.800625 10702 leader_election.cc:400] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6.
I20260709 12:14:57.553407 12474 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.752089 12306 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.806370 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:14:57.806212 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52715.1us
I20260709 12:14:57.757687 12339 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:57.772398 12384 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.842724 12309 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.842962 12474 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.843828 12309 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.843947 12474 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.845337 12393 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:57.827946 12488 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:57.809607 12469 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.805375 12285 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:57.831184 10731 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:14:57.784529 12461 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.807737 12261 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:57.868933 12261 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.869378 12261 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.870589 10201 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:14:57.818146 12485 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:57.821789 12348 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.828490 10204 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:14:57.826148 10047 rpcz_store.cc:276] 0709 12:14:56.206227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.285559 (+ 79332us) service_pool.cc:224] Handling call
0709 12:14:56.532703 (+247144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.533595 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.755864 (+1222269us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002a1f50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:57.755989 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497172352}
I20260709 12:14:57.827797 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.704661 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:57.874693 10203 raft_consensus.cc:2410] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:57.784497 11728 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:57.806095 12147 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.833773 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:57.771126 12346 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.881639 12467 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.877796 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.840804 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.885442 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.763532 12395 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.889122 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.850183 12393 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:57.895143 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61438.4us
I20260709 12:14:57.895936 10201 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:14:57.849164 10200 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:57.849921 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:57.819636 12487 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.855526 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.852671 12235 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:14:57.858615 12461 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.859095 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:57.859503 10168 leader_election.cc:336] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.789s (SENT)
I20260709 12:14:57.930516 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:57.931463 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71996.2us
I20260709 12:14:57.860138 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:57.860296 12469 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:57.934093 12469 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:57.938539 12469 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:57.939635 12469 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.941205 12469 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.864172 12400 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:57.942620 12400 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:57.943650 12400 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:57.944952 12400 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.949685 12200 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.863932 12267 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.951359 12267 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:57.951822 12485 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.956434 12348 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:57.850551 12149 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:14:57.874614 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 170352us
I20260709 12:14:57.959400 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:57.959683 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.960824 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:57.776656 12459 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:57.840199 12374 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.961939 12374 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.964218 12374 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:57.839833 12387 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:57.891269 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.965193 10050 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:57.891734 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.897392 11728 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:14:57.965837 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 110399us
I20260709 12:14:57.898396 12340 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:57.898855 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.899566 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.894361 10121 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:57.902695 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.870859 10730 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:57.903920 12491 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:57.909173 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.871338 12470 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:57.909364 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:57.910578 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:57.911391 10051 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:57.854571 12488 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:57.913018 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.004698 10048 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.915491 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:58.007614 10125 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:57.912388 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:58.008745 10127 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:57.918336 10049 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:57.916210 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.009747 10124 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.998364 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:58.010663 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 114867us
I20260709 12:14:57.922071 12453 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:57.862818 12463 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.898s	user 0.003s	sys 0.002s
I20260709 12:14:57.963925 12468 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:57.964659 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:58.017132 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.966209 11728 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:14:57.897296 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47464us
I20260709 12:14:58.018088 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:58.020059 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.019768 12488 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.995816 12461 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:57.966692 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.883306 12285 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:57.974249 10123 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:14:57.986698 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.898102 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:14:58.028988 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 130980us
W20260709 12:14:58.029647 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:57.903765 12455 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:57.996302 10054 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:57.910172 12473 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.995487 12475 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.998876 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:58.004129 10129 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:14:57.916968 12306 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:58.012172 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:57.962522 12270 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:58.050201 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:58.050694 10196 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:58.050812 10204 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.053613 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:58.013576 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:57.966830 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.893988 12147 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:57.967027 10202 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:14:57.973344 12348 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:58.030658 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:57.995703 12338 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:57.996515 12349 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.044468 10125 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:57.997478 12340 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:58.048501 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:58.014119 12491 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:58.056774 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:58.082592 10201 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:58.082890 10203 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 4: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:58.083175 10197 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:58.065718 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:58.083792 10195 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:58.006682 12374 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:14:58.051026 12475 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.069218 12200 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.068904 12393 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.046063 11945 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:58.069618 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 102848us
W20260709 12:14:58.070120 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 104446us
W20260709 12:14:58.071646 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59621.1us
W20260709 12:14:58.096387 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.072127 12270 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.081640 11663 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.099042 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:58.099735 10202 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:58.072371 11728 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.073093 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:58.051692 12285 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:14:58.076591 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46016.4us
I20260709 12:14:58.102841 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:14:58.069842 12465 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:58.035842 12455 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.069700 12473 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.069229 12459 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:58.093145 12384 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:58.059970 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:58.080334 12348 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:14:58.080999 12338 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.068244 12147 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:58.093588 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54979.4us
I20260709 12:14:58.048609 12339 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:14:58.109570 12455 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:58.104411 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:58.105778 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:58.098783 12500 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:14:58.155498 12261 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.157536 12261 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:58.110126 12395 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:14:58.158574 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48990.6us
I20260709 12:14:58.114966 10200 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.119316 10195 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:14:58.091351 10127 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:58.068279 12399 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.121381 10204 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:14:58.109675 12499 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:14:58.128304  9952 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:58.129278 12340 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.130352 12285 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.183081 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:14:58.131423  9951 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 173) took 12225 ms (client timeout 15000 ms). Trace:
I20260709 12:14:58.105053 12313 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:58.103364 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:58.108047 12483 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:58.111807 12346 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:58.134764 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:14:58.185395 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 82078.9us
I20260709 12:14:58.186158 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.187454 12339 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:58.127669 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:58.188654 12313 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.190521 12468 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:58.190908 12468 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:58.191705 12468 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.192569 12313 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:58.136057 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:58.193348 10729 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:58.193885 10195 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:14:58.194216 10195 pending_rounds.cc:85] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 6
I20260709 12:14:58.188591 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:58.194602  9952 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:58.195544 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.136511 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:14:58.195987 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.194943 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.196975 10046 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 3.
I20260709 12:14:58.196425  9952 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 3, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:14:58.110395 11945 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:58.185928 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51246.3us
I20260709 12:14:58.199046 11945 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.199791 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.200166 10736 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:58.201013 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.202019 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.202172 12385 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:58.141667 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.202589 11663 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:58.203002 11663 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.203315 11663 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.138607 12491 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.143437 12475 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:58.082353 12387 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.144944 12338 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:58.205616 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:58.149402 12384 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:14:58.217847 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:58.150877 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54989.5us
I20260709 12:14:58.151324 12485 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:58.166697 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.172062 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.222689 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.231622 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.234302 10130 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:58.127823 10731 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.178157 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.240888 10055 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:58.182027 10200 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:58.187994 12339 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:58.188993 12346 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:58.192870 12468 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.158710 12270 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:14:58.204823 10195 pending_rounds.cc:107] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:58.254278 10195 raft_consensus.cc:2889] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:58.142529 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47076.9us
I20260709 12:14:58.205339 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:58.255034 10197 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:58.210839 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.198088  9952 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:14:58.146344 12348 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:58.222821 10047 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:58.235802 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.221347 12235 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:58.266579 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43989.8us
I20260709 12:14:58.267290 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.223567 12384 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.224140 12338 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:58.233145 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:58.230530 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.280237 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:58.282188 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.182516 12488 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.247623 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.247922 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:58.199903 12399 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:58.202605 12385 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.251874 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.287762 10055 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:58.215715 12483 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:58.217056 12149 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:58.135878 12453 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:58.258713 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.260262 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:58.253866 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:58.294241 10127 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:58.262157 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.215319 12395 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:14:58.263100 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:58.263263 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:58.265493 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.297192 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.269560 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:58.237097 12485 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.270203 10198 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:58.276141 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.236881 12475 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:58.278283 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:58.285406 10052 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:58.289181 10055 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:14:58.289203 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.295795 10054 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:58.301087 10046 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:58.281373 12348 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.281523 12338 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.302634 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:58.310348 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:58.317485 10195 raft_consensus.cc:606] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:58.309850 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.298787 10048 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 3.
I20260709 12:14:58.331051 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:58.331125 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61635.5us
I20260709 12:14:58.274477 12339 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.291447 12385 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.292997 12149 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.347416 10054 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:58.351019 10048 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:58.303258 12485 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:58.357460 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.348174 10127 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:14:58.285040 12313 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:14:58.339491 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48342.5us
I20260709 12:14:58.325789 12393 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:58.308686 12340 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:58.326820 12338 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.371997 10052 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:14:58.365854  9952 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 5, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:58.362668 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.378175 10128 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
W20260709 12:14:58.349797 12309 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:14:58.386066 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:58.184975  9951 rpcz_store.cc:269] 0709 12:14:45.944924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.946165 (+  1241us) service_pool.cc:224] Handling call
0709 12:14:58.131168 (+12185003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:54.971070 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:55.034363 (+ 63293us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:55.035248 (+   885us) write_op.cc:435] Acquired schema lock
0709 12:14:55.036326 (+  1078us) tablet.cc:662] Decoding operations
0709 12:14:55.045351 (+  9025us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:55.045405 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:55.045431 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:14:55.074568 (+ 29137us) tablet.cc:701] Row locks acquired
0709 12:14:55.074593 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:14:55.074763 (+   170us) write_op.cc:270] Start()
0709 12:14:55.074956 (+   193us) write_op.cc:276] Timestamp: P: 1783599295074714 usec, L: 0
0709 12:14:55.074978 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:55.193624 (+118646us) log.cc:844] Serialized 6467 byte log entry
0709 12:14:55.374228 (+180604us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78be28 00007fc1821c6581 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901 00007fc1821c9b2d 0000000000388634 0000000000388479
0709 12:14:55.690872 (+316644us) op_driver.cc:464] REPLICATION: finished
0709 12:14:56.101406 (+410534us) write_op.cc:301] APPLY: starting
0709 12:14:56.101510 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:56.101887 (+   377us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:56.101923 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:56.153542 (+ 51619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:56.199021 (+ 45479us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:14:56.199088 (+    67us) write_op.cc:312] APPLY: finished
0709 12:14:56.199602 (+   514us) log.cc:844] Serialized 113 byte log entry
0709 12:14:56.199792 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:56.199983 (+   191us) write_op.cc:454] Released schema lock
0709 12:14:56.200048 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:56.200446 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:56.200473 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":395857,"apply.run_cpu_time_us":5095,"apply.run_wall_time_us":99041,"num_ops":16,"prepare.queue_time_us":274410,"prepare.run_cpu_time_us":20189,"prepare.run_wall_time_us":414663,"raft.queue_time_us":192503,"raft.run_cpu_time_us":36852,"raft.run_wall_time_us":418117,"replication_time_us":530834,"spinlock_wait_cycles":269057920,"thread_start_us":564876,"threads_started":4,"wal-append.queue_time_us":184174,"wal-append.run_cpu_time_us":8473,"wal-append.run_wall_time_us":1962163}]]}
I20260709 12:14:58.342600 12487 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:58.389115 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:58.356309 12149 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:58.312726 12395 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.391918  9952 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 4 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:58.381130 12235 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:58.364838 12453 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:58.308992 12510 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:14:58.363201 12503 raft_consensus.cc:2764] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:58.382252 12393 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:58.405174 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 137953us
I20260709 12:14:58.350068 12470 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:14:58.361974 12400 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:58.392349 12399 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:58.390461 12473 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:58.414808 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52207.9us
I20260709 12:14:58.382875 12344 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:14:58.394703 12309 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.419967 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:58.416378  9952 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 5, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:58.404282 10730 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:58.404655 12374 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:58.433110 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:14:58.396096 12270 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:14:58.453474 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:58.438186 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 72322.3us
I20260709 12:14:58.417865 12393 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:58.441018 10732 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:14:58.467438 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74332.2us
I20260709 12:14:58.434847 12516 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.470482 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:58.454790 12505 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:14:58.390578 12346 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.440241 12267 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:58.474965 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:58.426607 12499 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:14:58.440497 12399 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:14:58.403247 12483 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.479799 12261 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:14:58.522926 12491 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:14:58.590509 12520 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:58.614509 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.556227 12461 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 12:14:58.588547 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 168626us
I20260709 12:14:58.477401 10729 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:14:58.597327 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.697516 10197 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:58.463145 12465 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.463389 12487 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:58.701704 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 337743us
W20260709 12:14:58.703682 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 250232us
I20260709 12:14:58.493104 12516 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:58.889626 10731 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.006s
I20260709 12:14:58.778784  9952 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 3 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:14:59.005187 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1925) took 1111 ms. Trace:
W20260709 12:14:58.836633 11945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.017s
W20260709 12:14:58.841199 12513 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.548s	user 0.001s	sys 0.012s
W20260709 12:14:58.891433 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 412899us
W20260709 12:14:58.892325 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 190853us
W20260709 12:14:58.893309 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:58.752369 11728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.010s
I20260709 12:14:58.591966 12235 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:14:58.906711 12309 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:58.712361 12473 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:58.880362 12509 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.517s	user 0.001s	sys 0.007s
W20260709 12:14:58.892727 10167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.012s
W20260709 12:14:58.926875 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.926350 12520 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:58.853549 12393 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:58.922755 12455 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.006s
I20260709 12:14:58.892817 12459 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:58.963486 12399 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:58.917546 12534 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:58.923885 12469 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.925650 12400 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:14:58.927991 12338 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.002s
I20260709 12:14:59.005129 10731 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:59.045981 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:59.115325 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 546) took 1101 ms. Trace:
W20260709 12:14:59.049243 11728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.015s
W20260709 12:14:59.052184 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50612.3us
I20260709 12:14:59.118441 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:59.119478 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:59.005563 10053 rpcz_store.cc:276] 0709 12:14:57.893279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.893392 (+   113us) service_pool.cc:224] Handling call
0709 12:14:57.893710 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.894298 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.894323 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:57.964430 (+ 70107us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.087960 (+123530us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:58.087995 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.088060 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.004978 (+916918us) raft_consensus.cc:1685] finished
0709 12:14:59.004998 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.005130 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264,"raft.queue_time_us":731,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":123179,"threads_started":1,"wal-append.queue_time_us":142780}
I20260709 12:14:59.000598 12470 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.123296 10055 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:59.123096  9952 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.124557 12470 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.126041 12338 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:59.127959 12149 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.002s
I20260709 12:14:59.115679 10731 rpcz_store.cc:276] 0709 12:14:58.013495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.018924 (+  5429us) service_pool.cc:224] Handling call
0709 12:14:59.115252 (+1096328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:58.994923 12270 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.020504 12348 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.005s
W20260709 12:14:59.023162 12485 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
I20260709 12:14:59.137312 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:59.137653 12485 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:59.017841 12468 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.744s	user 0.014s	sys 0.000s
W20260709 12:14:59.025750 12530 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 12:14:59.093158 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:59.139988 10737 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:59.140741 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:59.141759 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:59.090574 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:59.090821 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:59.143677 10731 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:14:59.091885 10167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.015s	sys 0.014s
I20260709 12:14:59.107875 12395 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:59.183020 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 134124us
W20260709 12:14:59.017736 12384 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.002s
I20260709 12:14:59.086194 10734 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:59.021381 11945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.000s	sys 0.019s
W20260709 12:14:59.017015 12511 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.686s	user 0.011s	sys 0.000s
I20260709 12:14:59.078666 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:59.209612 10050 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:14:59.143630 12459 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.102533 10051 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
W20260709 12:14:59.051458 12453 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.005s
I20260709 12:14:59.054302 12473 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.006966 12488 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:59.125964  9952 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 3 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:59.128432 12149 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:59.133646 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 214269us
I20260709 12:14:59.221719 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:59.086645 12531 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.128027 12338 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.137145 12348 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:59.142364 12535 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:59.108618 12534 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:59.116979 12521 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.022172 11663 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.818s	user 0.017s	sys 0.000s
W20260709 12:14:59.159228 12475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.018s	sys 0.012s
I20260709 12:14:59.136544 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:59.106889 12455 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.138008 12270 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.211273 10130 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:14:59.017376 12523 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:59.155073 12313 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:59.116274 12469 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.218248 10735 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:59.219830 12473 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:59.220479 12519 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:14:59.223652 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:59.260423 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:14:59.227265 12531 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.227984 12261 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:59.264819 10733 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:59.228600 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 643) took 1723 ms (client timeout 2071 ms). Trace:
I20260709 12:14:59.222951  9952 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 2 to 3, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 3 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.229018 10020 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:59.266047 10020 leader_election.cc:403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:59.259632 11728 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.229550 12475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.018s	sys 0.013s
W20260709 12:14:59.226542 12385 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.006s
I20260709 12:14:59.225364 12535 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:14:59.269052 10168 leader_election.cc:336] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.505s (SENT)
I20260709 12:14:59.234890 10049 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:14:59.272809 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:14:59.217947 12453 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.266940 11728 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.225498 12534 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:59.214488 12384 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.276118 12546 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.276922 12532 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:59.278095 12147 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:59.296082 12147 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:59.297083 12147 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.298779 12147 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:59.283914 10737 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:59.267915 12514 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.286550 11728 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.210791 12487 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.231334 11663 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.287249 12400 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:59.294975 12546 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.254487 10729 raft_consensus.cc:2376] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9. Re-sending same reply.
I20260709 12:14:59.281433 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:14:59.274809 12340 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.002s
I20260709 12:14:59.264865 12499 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:59.303642 12261 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:59.230767 12521 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.261904 12523 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:14:59.218027 12459 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.274741 12535 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:59.271392 12475 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:59.301839 12540 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:14:59.330998 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49686.6us
I20260709 12:14:59.344863 12340 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.370920 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:59.281677 12385 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.375118 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:14:59.375895 10200 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:14:59.377929 10196 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:14:59.273257 10732 rpcz_store.cc:269] 0709 12:14:57.505167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.520502 (+ 15335us) service_pool.cc:224] Handling call
0709 12:14:59.228386 (+1707884us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400570dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:59.228538 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741579520}
I20260709 12:14:59.384271 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:59.394060 10196 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:59.502914 10204 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:14:59.362687 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.312229 12400 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.349786 12542 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.506517 10198 raft_consensus.cc:2368] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:14:59.363320 12393 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:59.550225 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 324817us
I20260709 12:14:59.550552 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:59.364796 12453 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:14:59.551309 10123 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
W20260709 12:14:59.504644 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 241325us
I20260709 12:14:59.561439 10050 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:59.563171 10052 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:59.563771 10054 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:59.563237 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:59.564663 10053 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:59.552739 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:14:59.566043 10195 raft_consensus.cc:606] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:14:59.566448 10195 raft_consensus.cc:614] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:59.545199 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:14:59.595810 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50724.2us
I20260709 12:14:59.596987 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:59.383786 12499 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.371377 12261 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:59.326752 12514 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.364085 12547 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:59.628006 10127 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:59.628538 10123 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:14:59.372516 12516 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.506706 12400 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:59.641672 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:59.634260 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:14:59.642319 10126 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:59.509116 12455 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.637812 10053 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:14:59.549455 12313 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.646497 10735 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:59.550806 12520 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.656586 10123 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:59.664736 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:14:59.666388 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:14:59.667418 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 115984us
I20260709 12:14:59.668108 10050 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:59.630363 12384 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.669836 10020 leader_election.cc:400] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:14:59.636453 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:59.671496 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.639719 12338 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.680653 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:14:59.681352 10735 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:14:59.555523 12468 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:14:59.687968 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:59.691679 10130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1221) took 1424 ms (client timeout 1637 ms). Trace:
I20260709 12:14:59.694977 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:14:59.692127 10130 rpcz_store.cc:269] 0709 12:14:58.256117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.260051 (+  3934us) service_pool.cc:224] Handling call
0709 12:14:59.680077 (+1420026us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400232654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:59.680195 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971204992}
I20260709 12:14:59.672483 12516 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.672650 12455 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.721267 10735 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:59.723475 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:59.726850 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.000s	sys 0.008s
W20260709 12:14:59.727221 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.008s
I20260709 12:14:59.656150 12313 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:14:59.727877 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.639211 12499 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.675678 12270 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.682960 12149 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.687502 10729 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:14:59.734402 12455 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.739861 12563 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.673089 12523 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.741281 12531 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.675828 12487 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:14:59.594588 12542 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.718333 12469 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.685428 12338 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.724081 10735 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:59.759812 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:14:59.760974 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:14:59.749579 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54758.4us
I20260709 12:14:59.699645 12349 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:59.765750 12552 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.766322 12552 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.768502 12552 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.768894 12533 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.769441 12533 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.771514 12533 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.742313 12453 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:59.775743 12555 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:14:59.776262 12455 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.776326 12555 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.690238 12475 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.777392 12562 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.777966 12562 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.778733 12529 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.781334 12554 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.781669 12562 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.781870 12554 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.750960 12543 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.782861 12543 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.784123 12554 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.784672 12559 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:14:59.785002 12543 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.785795 12559 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:59.786114 12559 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:14:59.745759 12539 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.758292 12270 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:59.731102 12516 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.782274 12313 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.807440 10129 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:59.807855 10168 leader_election.cc:336] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.988s (SENT)
I20260709 12:14:59.808591 10126 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:14:59.761386 11663 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.763159 12469 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.786943 12559 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.778587 12550 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:59.816442 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 218447us
I20260709 12:14:59.789362 12524 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:59.791590 12459 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.787551 12339 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:59.791981 12309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.026s	sys 0.018s
I20260709 12:14:59.779229 12529 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.772054 12548 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:14:59.735365 12261 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.810624 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:59.786060 12485 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.789867 12552 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.789773 12455 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.791239 12562 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.791875 12270 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:14:59.851080 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.857000 10046 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:59.858457 12542 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.859798 12499 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:14:59.882344 12545 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.817474 12385 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:14:59.893756 12537 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:14:59.849792 12524 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:59.894135 12455 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:59.894768 12556 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:14:59.895639 12338 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.884016 12548 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.897718 12529 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:59.899703 12534 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.002s
I20260709 12:14:59.902582 12557 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.902714 12514 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:14:59.903651 12569 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.883560 12559 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:59.845680 12339 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:14:59.908769 10737 consensus_meta.cc:287] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.003s
I20260709 12:14:59.912791 12235 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:59.851652 12309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.026s	sys 0.018s
W20260709 12:14:59.911239 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 69175.9us
I20260709 12:14:59.893287 12552 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:14:59.894083 12568 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:59.822324 12469 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.792488 12539 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.898085 12400 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.850263 12555 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:14:59.912174 12473 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.638s	user 0.003s	sys 0.006s
I20260709 12:14:59.932749 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:14:59.909585 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 99055.1us
I20260709 12:14:59.933970 10737 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:14:59.934818 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.927958 12547 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:14:59.935947 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:14:59.906116 12535 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.846273 12550 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.820653 12551 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.280s
I20260709 12:14:59.907761 12562 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:14:59.982117 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 397) took 1778 ms. Trace:
I20260709 12:15:00.139345 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.099684 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:14:59.937978 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.134284 10126 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:00.043892 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.141487 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.141666 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:14:59.983948 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1832) took 1753 ms. Trace:
I20260709 12:14:59.913940 12545 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:14:59.978698 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.143644 10127 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:14:59.997911 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:00.135663 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:59.937268 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 270409us
I20260709 12:15:00.138264 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.143287 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.138586 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.140780 10204 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:14:59.980103 12553 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:15:00.019507 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:59.980245 12560 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:15:00.048605 12515 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.081s	user 0.001s	sys 0.014s
I20260709 12:15:00.139943 10733 rpcz_store.cc:276] 0709 12:14:58.203560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.203706 (+   146us) service_pool.cc:224] Handling call
0709 12:14:58.203995 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:59.265282 (+1061287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.981799 (+716517us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002d5d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:14:59.982026 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439250304}
W20260709 12:14:59.995167 12556 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:00.174525 10204 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:00.175354 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:14:59.988405 12455 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.142513 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:00.146860 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:00.177419 10200 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:00.077329 12516 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:00.079802 11663 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:00.163968 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:00.045106 12453 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:59.979918 12575 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.169800 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:14:59.988368 12548 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:14:59.988826 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:00.142246 10121 rpcz_store.cc:276] 0709 12:14:58.230126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.238217 (+  8091us) service_pool.cc:224] Handling call
0709 12:14:58.238509 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:58.238811 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.238836 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.239233 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.702467 (+463234us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:58.702562 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.702735 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.983712 (+1280977us) raft_consensus.cc:1685] finished
0709 12:14:59.983733 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.983867 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9931,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":7128,"thread_start_us":462723,"threads_started":1,"wal-append.queue_time_us":1143506}
I20260709 12:15:00.178817 10195 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:00.195629 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.196481 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:14:59.965880 12488 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.004s
W20260709 12:15:00.165868 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 227964us
I20260709 12:15:00.206019 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:14:59.989337 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 547) took 1960 ms (client timeout 1670 ms). Trace:
I20260709 12:15:00.179787 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.167635 12385 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:14:59.936517 12529 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.236s
I20260709 12:15:00.188531 10047 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:00.187304 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:00.252950 10733 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:14:59.986860 12270 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:00.254673 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 119092us
I20260709 12:15:00.183193 12235 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:00.139084 12461 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:15:00.170680 12459 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:59.933044 12534 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:00.265992 12459 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:00.278223 12459 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:00.279479 12534 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:00.208611 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:00.280476 10197 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:00.234958 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.263788 12149 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:15:00.282975 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.284251 12261 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:59.979077 12475 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.206s
I20260709 12:14:59.936496 12569 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.235507 10055 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:00.234894 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.236227 10200 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:00.189028 12551 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:15:00.194326 12313 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.237850 12580 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.170600 12309 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:00.264770 12510 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:00.139348 12473 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.263762 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.265678 12384 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:00.265853 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.233071 12488 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:00.178933 12587 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:00.236459 10730 rpcz_store.cc:269] 0709 12:14:58.018318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.107824 (+ 89506us) service_pool.cc:224] Handling call
0709 12:14:59.937608 (+1829784us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400612e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:14:59.978677 (+ 41069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473053952}
I20260709 12:15:00.256572 12348 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:15:00.256742 12455 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:00.277431 12461 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.287046 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1651) took 2116 ms. Trace:
W20260709 12:15:00.287459 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 79486.1us
I20260709 12:15:00.015770 12546 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.288239 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:00.375509 10049 rpcz_store.cc:276] 0709 12:14:58.170249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.171815 (+  1566us) service_pool.cc:224] Handling call
0709 12:15:00.286855 (+2115040us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002a1554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:00.286969 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324463360}
W20260709 12:15:00.290302 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.288254 10729 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 4: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:14:59.935189 12557 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.193012 11663 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:00.379822 10731 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:15:00.379875 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 91713.9us
I20260709 12:15:00.368499 12531 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:15:00.232609 12553 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:15:00.364210 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 155656us
I20260709 12:15:00.264021 12554 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:15:00.169902 12547 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.283278 12149 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:00.366290 12313 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:00.293609 12556 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:15:00.186875 12338 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:15:00.373723 12587 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.368480 10195 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:00.365546 12580 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:00.444115 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.289932 12578 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:00.402455 12535 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:00.363394 12309 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.380066 11728 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:00.441905 12559 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
W20260709 12:15:00.382632 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 126212us
I20260709 12:15:00.365983 12510 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:00.459810 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:00.461663 10123 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:00.387040 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:00.361725 10198 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:15:00.462663 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75685.9us
I20260709 12:15:00.385689 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.378520 12461 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.401916 10734 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:00.392349 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.389537 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.369154 10094 leader_election.cc:400] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 4 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5.
I20260709 12:15:00.467429 10199 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
W20260709 12:15:00.467935 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 100770us
I20260709 12:15:00.386686 10204 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:00.433035 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:00.389923 12594 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.452420 12309 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:00.379751 12384 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:00.428205  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:00.429700 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 653) took 1382 ms. Trace:
I20260709 12:15:00.431111 12539 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:00.391682 12546 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:15:00.428287 10128 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:15:00.429092 12400 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.421958 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:00.423385 12521 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.200263 12575 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.385188 12571 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:15:00.377127 12455 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:00.379328 12475 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.427275 12545 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:00.435709 12592 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:15:00.436049 10054 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:00.436280 12552 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.437268 12550 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:00.394508 12582 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:14:59.982820 12524 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.390897 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 396) took 2187 ms. Trace:
I20260709 12:15:00.446861 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.537542  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:00.554622 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:00.403518 12149 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:00.448051 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:00.557644 10049 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:00.449013 10053 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:00.376672 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:00.448460 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.447481 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.382382 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:00.450812 11728 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.450758 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.433015 12587 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:00.438792 12469 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:00.439152 12548 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.461658 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:00.384753 12555 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:00.471700 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.447000 10730 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEARNER]: Advancing to term 10
I20260709 12:15:00.467458 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.421347 11663 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:00.472114 10203 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:00.448632 12578 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.474625 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.447588 12531 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:00.476333 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:00.477697 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.382140 12235 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:00.449319 12459 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:00.462981 12510 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:00.527295 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:00.534628 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:00.469153 10020 connection.cc:256] RPC call timeout handler was delayed by -2.6933471899999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 12:15:00.518272 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.479458 10737 rpcz_store.cc:276] 0709 12:14:59.047139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.141551 (+ 94412us) service_pool.cc:224] Handling call
0709 12:15:00.429510 (+1287959us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400453154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:00.429620 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325737856}
I20260709 12:15:00.483050 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:00.482487 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:00.531544 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:00.554953 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 656) took 1507 ms (client timeout 1953 ms). Trace:
I20260709 12:15:00.555509 10121 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:00.550293 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 276) took 1001 ms. Trace:
I20260709 12:15:00.559777 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:00.560070 11728 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:00.559791 10195 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:00.560253 10126 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:00.560047 10200 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:00.470973 12344 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.562469 10053 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:15:00.555536 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.562134 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:00.565337 10125 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:00.567067 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 190452us
I20260709 12:15:00.548131 12562 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:00.524309 12483 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.197s
I20260709 12:15:00.479300 12523 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.241s
I20260709 12:15:01.146102 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:01.151639 10123 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.021s
I20260709 12:15:01.152226 10123 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:00.477516 12520 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:01.153266 12520 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:01.153331 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 597808us
I20260709 12:15:00.905929 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1657) took 1524 ms. Trace:
I20260709 12:15:00.905629 12499 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:01.154896 12499 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:01.155213 10124 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:00.909874 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:01.156337 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 401) took 1225 ms. Trace:
I20260709 12:15:01.155817 12499 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:01.027608 12529 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.562230 12400 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.480875 12594 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.010021 12384 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.158739 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:01.160037 12594 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:01.160953 10020 leader_election.cc:336] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.637s (SENT)
I20260709 12:15:01.161715 10048 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:01.163061 12340 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:00.540481 12470 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.161514 10129 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:01.166483 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 690179us
I20260709 12:15:00.630684 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:00.570055 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:01.176831 10054 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:01.161218 12594 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:01.183413 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.184159 10126 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:01.175863 10128 rpcz_store.cc:276] 0709 12:14:59.549360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.549500 (+   140us) service_pool.cc:224] Handling call
0709 12:15:00.427853 (+878353us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:15:00.428037 (+   184us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:00.550000 (+121963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.550229 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4761344}
I20260709 12:15:01.156716 10735 rpcz_store.cc:276] 0709 12:14:59.930722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.987239 (+ 56517us) service_pool.cc:224] Handling call
0709 12:15:00.909707 (+922468us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:15:01.156282 (+246575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10241280}
I20260709 12:15:01.161041 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:01.185571 10195 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:00.518416 12559 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:01.187021 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:00.554358 12473 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:00.831285 12387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.012s	sys 0.030s
I20260709 12:15:00.613106 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:01.188374 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 557761us
I20260709 12:15:01.194162 10049 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:01.195143 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:00.561579 12313 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:00.556579 12455 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:01.162932 10736 rpcz_store.cc:269] 0709 12:14:59.047963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.122951 (+ 74988us) service_pool.cc:224] Handling call
0709 12:14:59.982567 (+859616us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:15:00.421809 (+439242us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66be9c 00007fc17b66ba5b 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:15:00.554890 (+133081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31694464}
I20260709 12:15:01.190500 10129 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:15:01.187415 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:01.153769 12520 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:01.195813 10127 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:00.631011 10729 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:00.609409 12571 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:01.157390 12499 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.154289 10202 rpcz_store.cc:276] 0709 12:14:59.381246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.381380 (+   134us) service_pool.cc:224] Handling call
0709 12:14:59.545188 (+163808us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:59.623930 (+ 78742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:59.625062 (+  1132us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:00.400518 (+775456us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b2c00107318. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:00.401070 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 12:15:00.476344 (+ 75274us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:00.476393 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:00.476464 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:00.905551 (+429087us) raft_consensus.cc:1685] finished
0709 12:15:00.905572 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:00.905854 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100472,"raft.queue_time_us":52285,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":65785,"spinlock_wait_cycles":14900480,"thread_start_us":74869,"threads_started":1,"wal-append.queue_time_us":432753}
W20260709 12:15:01.207465 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46542.8us
I20260709 12:15:01.166482 12340 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:01.183459 12594 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:01.211251 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.183485 12469 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:01.211971 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:01.185986 12578 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.155530 12557 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.184765 12483 consensus_queue.cc:1243] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:00.640698 12580 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.207329 12555 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:00.814932 12551 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.629395 12552 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.157941 12400 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.210891 12564 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:00.911741 12339 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.211041 12485 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:01.211848 12473 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.609771 12548 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.213937 12514 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:01.216322 12594 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:00.638864 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:00.560482 12475 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.221083 10125 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:01.221767 10054 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
W20260709 12:15:01.242568 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.192463 12470 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:01.157466 12529 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.190274 11663 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:15:01.225293 11728 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.193367 12559 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:00.649387 12149 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.187003 12344 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:01.220824 12465 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.220491 12516 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.265175 10199 raft_consensus.cc:2410] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:15:01.239818 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61573.9us
I20260709 12:15:01.225392 12551 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.227636 12552 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:01.193809 12387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.939s	user 0.020s	sys 0.035s
I20260709 12:15:01.252843 11728 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.239178 12339 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:01.258056 10196 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:01.236224 12461 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.222047 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:01.268092 10735 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:01.279731 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:01.232374 12564 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.253739 12470 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:01.235853 12473 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.259716 12575 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.286065 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:01.244468 12514 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.291113 12461 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:01.299045 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:01.303807 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:01.287295 12557 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:01.243705 12555 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:01.313196 12603 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.313792 12551 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.275826 12516 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.317127 12473 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.317751 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:01.272037 12465 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.317400 10121 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:01.247795 12531 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.314836 12470 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.296764 12459 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.336753 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:01.299829 10732 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:01.345814 10198 raft_consensus.cc:2410] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:15:01.312611 12557 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.277375 12340 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:01.353091 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 158040us
W20260709 12:15:01.380528 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 211527us
I20260709 12:15:01.320070 12571 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:01.424384 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.425274 10049 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:01.426441 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.427168 10121 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:01.439658 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.440409 10126 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:01.443009 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.443780 10121 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:01.444062 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.444733 10049 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:01.448182 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:01.452154 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:01.452903 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.452919 10121 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:01.470991 10052 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:15:01.487390 10125 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:15:00.553587 10728 rpcz_store.cc:276] 0709 12:14:58.203280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.221075 (+ 17795us) service_pool.cc:224] Handling call
0709 12:14:58.237046 (+ 15971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:58.237537 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.237569 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:58.238205 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:14:58.391217 (+153012us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:58.393278 (+  2061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.403762 (+ 10484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:00.047735 (+1643973us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:00.374521 (+326786us) raft_consensus.cc:1685] finished
0709 12:15:00.374987 (+   466us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:00.390799 (+ 15812us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10044,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12984,"spinlock_wait_cycles":23539072,"thread_start_us":112558,"threads_started":1,"wal-append.queue_time_us":234541}
W20260709 12:15:01.491019 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49418.2us
I20260709 12:15:01.492347 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:01.493827 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.493935 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.494606 10129 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:01.495255 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:01.496137 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:01.494720 10054 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:01.500952 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.349048 12557 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:01.505000 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:01.505643 10198 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.506461 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.507149 10052 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:01.501654 10046 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:01.509819 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1852) took 1028 ms. Trace:
I20260709 12:15:01.519207 10052 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 12:15:01.510187 10127 rpcz_store.cc:276] 0709 12:15:00.481446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.481588 (+   142us) service_pool.cc:224] Handling call
0709 12:15:01.509651 (+1028063us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400172854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:01.509764 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35709184}
I20260709 12:15:01.421442 12473 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:01.469792 12571 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:01.335690 12603 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.470247 12384 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.527014 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:01.535744 10054 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:01.485973 12613 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:01.537688 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 181663us
I20260709 12:15:01.548519 10047 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:01.549330 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.550076 10053 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:01.552757 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.556084 10055 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:15:01.504132 12400 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.564718 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.566035 10050 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:01.569115 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.569840 10051 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:01.579282 11728 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.590286 12400 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.591012 12400 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.593627 12547 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.594178 12547 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.597865 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.600302 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.556731 12609 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:01.559770 12613 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.603399 12609 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.603971 12609 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:01.557894 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:01.608592 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.609561 10121 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:01.611997 10052 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:15:01.612609 12609 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.615043 12609 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:01.625640 12575 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:15:01.626382 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 178285us
I20260709 12:15:01.627260 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.629098 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.629513 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.629803 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.646811 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:01.630672 10123 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [2.2-6.4]
I20260709 12:15:01.634857 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.648492 10121 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:01.635723 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.579921 11728 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.637310 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.637732 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.510141 12313 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:15:01.650938 10125 raft_consensus.cc:2376] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5. Re-sending same reply.
I20260709 12:15:01.646997 10124 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:01.652165 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:01.664120 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.676012 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.654809 10124 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:01.676765 10121 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:01.676731 10123 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:15:01.677974 10123 pending_rounds.cc:85] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 3
I20260709 12:15:01.678354 10123 pending_rounds.cc:107] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:15:01.635918 12483 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.678687 10123 raft_consensus.cc:2889] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:01.638911 12559 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.541108 12473 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:01.679188 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 183112us
I20260709 12:15:01.682723 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.683477 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.684458 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.687053 10046 raft_consensus.cc:2410] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:01.687647 10128 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:01.687979 10702 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:01.688962 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:01.693231 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.644301 12487 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:01.686285 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.704368 10121 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:01.705482 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.711129 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.711869 10121 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:01.654693 12607 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:01.713910 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:01.725186 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.679628 12548 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:01.675848 12529 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:01.556965 12384 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.723384 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.726217 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:15:01.728128 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 235832us
I20260709 12:15:01.731222 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.683954 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:01.735456 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.732878 10128 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:01.739246 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.709604 12564 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.716086 12552 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.708484 12608 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:01.731904 12587 consensus_meta.cc:287] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.000s
I20260709 12:15:01.739962 10123 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:01.756603 10124 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:01.726332 12575 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:01.727860 12374 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:01.759122 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:01.761741 10054 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:01.729199 12514 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.733880 12469 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:01.735764 12548 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.685941 12483 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:01.769429 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.775473 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:01.757519 12608 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.798754 10048 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:01.799748 10123 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:01.762171 12607 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:01.762454 12374 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:01.768500 12313 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:01.765055 12575 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.770359 12469 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.772449 12487 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:01.757701 12465 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.764165 12516 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.805131 12623 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:01.767974 12587 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:01.797382 10728 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:01.888558 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 657) took 2840 ms. Trace:
I20260709 12:15:01.879128 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:01.867974 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 178064us
I20260709 12:15:01.983194 10123 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:01.989814 10731 rpcz_store.cc:276] 0709 12:14:59.048196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.145519 (+ 97323us) service_pool.cc:224] Handling call
0709 12:14:59.179923 (+ 34404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:00.380350 (+1200427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.888292 (+1507942us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540029e0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:01.888496 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758982528}
W20260709 12:15:01.896946 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.023s	sys 0.026s
I20260709 12:15:01.985155 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:01.991537 10054 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
W20260709 12:15:01.984736 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:01.968760 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.514s (SENT) [suppressed 11 similar messages]
W20260709 12:15:01.942626 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 216447us
I20260709 12:15:01.993705 12529 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:01.991237 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.027s	sys 0.033s
I20260709 12:15:02.001523 12557 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:02.003841 12309 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.486s	user 0.007s	sys 0.003s
I20260709 12:15:02.004334 12384 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:01.998809 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:01.887272 12614 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:15:01.809311 10046 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:01.994325 12529 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:02.017443 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:02.001437 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 1.4416e+06us
I20260709 12:15:02.022805 10048 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:01.901916 10198 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:02.024397 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:01.888321 10155 heartbeater.cc:646] Failed to heartbeat to 127.8.178.254:37497 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.178.254:37497 timed out after 15.000s (SENT)
I20260709 12:15:01.993122 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:01.893486 12455 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.000s
W20260709 12:15:01.901677 12520 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.688s	user 0.000s	sys 0.008s
W20260709 12:15:01.886047 12612 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:15:01.885669 12606 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 12:15:01.885241 10730 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.003s
W20260709 12:15:01.886704 12616 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:15:01.894320 12578 consensus_meta.cc:287] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.000s
I20260709 12:15:01.804576 12608 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.802922 12607 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.019373 10046 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:01.980912 12344 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:01.842707 12552 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.980665 12575 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:01.992905 12469 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:01.883816 12547 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.883461 12483 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.899892 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 406) took 1514 ms. Trace:
I20260709 12:15:01.991947 12603 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:01.993376 12313 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.994874 12473 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.052515 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.089190 10201 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:15:02.049783 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56731.1us
I20260709 12:15:02.055279 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.084982 10046 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.090242 10046 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:02.057927 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63988.6us
I20260709 12:15:01.879271 12374 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.078811 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.052023 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.058804 12607 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:02.037037 12309 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.055284 12628 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:02.083686 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 114976us
I20260709 12:15:02.097819 10123 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:02.109457 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:02.085312 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 403) took 2150 ms (client timeout 1729 ms). Trace:
I20260709 12:15:02.086073 10737 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:15:02.040202 12520 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:02.075109 12499 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.861s	user 0.006s	sys 0.005s
I20260709 12:15:02.038595 12455 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.077201 10730 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:15:02.129442 10125 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:15:02.129817 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 560) took 1656 ms. Trace:
I20260709 12:15:02.130138 10733 rpcz_store.cc:276] 0709 12:15:00.473720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.183544 (+709824us) service_pool.cc:224] Handling call
0709 12:15:01.183845 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:01.211935 (+ 28090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:01.211965 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:01.212415 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:15:01.319213 (+106798us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:01.319250 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.118277 (+799027us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:02.118332 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.120129 (+  1797us) raft_consensus.cc:1685] finished
0709 12:15:02.120162 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.129747 (+  9585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1526,"raft.queue_time_us":10172,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4971,"spinlock_wait_cycles":60208896,"thread_start_us":100845,"threads_started":1,"wal-append.queue_time_us":285675}
I20260709 12:15:02.131582 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:02.131999 10733 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:02.091537 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.129333 10730 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 5
I20260709 12:15:02.137532 10730 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:15:02.137820 10730 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:02.138767 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.139390 10123 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:02.140218 10735 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:02.141470 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 100675us
W20260709 12:15:02.142172 10168 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.987s (SENT)
I20260709 12:15:02.142784 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:02.142130 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1152) took 1666 ms. Trace:
W20260709 12:15:02.143896 10168 leader_election.cc:336] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.998s (SENT)
I20260709 12:15:02.143457 10202 rpcz_store.cc:276] 0709 12:15:00.475285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.215542 (+740257us) service_pool.cc:224] Handling call
0709 12:15:01.223840 (+  8298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:01.224214 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:01.224242 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:01.227709 (+  3467us) log.cc:844] Serialized 52 byte log entry
0709 12:15:01.380229 (+152520us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:01.645530 (+265301us) log.cc:844] Serialized 14 byte log entry
0709 12:15:01.645864 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.645935 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.141880 (+495945us) raft_consensus.cc:1685] finished
0709 12:15:02.141906 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.142065 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24851,"prepare.queue_time_us":356205,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2237,"raft.queue_time_us":112741,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":17005,"thread_start_us":283888,"threads_started":2,"wal-append.queue_time_us":436802}
I20260709 12:15:02.075973 12552 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.119369 12628 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:02.106935 12473 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:15:02.015147 12623 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.141721 12374 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.056949 12578 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.111958 10737 pending_rounds.cc:85] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 7
I20260709 12:15:02.172739 10737 pending_rounds.cc:107] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:15:02.173026 10737 raft_consensus.cc:2889] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:02.112453 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.092700 12340 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:15:02.114012 12569 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:02.116074 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1666) took 1628 ms (client timeout 1563 ms). Trace:
I20260709 12:15:02.083376 10729 rpcz_store.cc:276] 0709 12:15:00.385214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.389730 (+  4516us) service_pool.cc:224] Handling call
0709 12:15:00.390012 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:01.211816 (+821804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.899626 (+687810us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54004b87d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:01.899820 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553234176}
I20260709 12:15:02.089375 12313 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:02.110883 10734 rpcz_store.cc:269] 0709 12:14:59.934488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.997589 (+ 63101us) service_pool.cc:224] Handling call
0709 12:15:02.085087 (+2087498us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400570dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.085243 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591596800}
I20260709 12:15:02.177302 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.048722 12487 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.124174 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:02.176528 10199 rpcz_store.cc:269] 0709 12:15:00.487889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.495643 (+  7754us) service_pool.cc:224] Handling call
0709 12:15:02.115775 (+1620132us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400203d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.115965 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237162240}
W20260709 12:15:02.124873 12600 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.961s	user 0.000s	sys 0.015s
I20260709 12:15:02.125942 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.152698 11728 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:02.152736 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62174.7us
I20260709 12:15:02.105907 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.183630 10198 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:02.183701 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.184062 11728 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:02.138659 12557 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.146787 12531 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:02.189680 12475 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.191751 10736 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:02.159245 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 559) took 1688 ms (client timeout 1670 ms). Trace:
I20260709 12:15:02.161543 12270 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:02.163992 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:02.100862 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:02.170780 10731 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:02.174091 10204 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:02.177942 10202 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
W20260709 12:15:02.169541 12617 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:15:02.200034 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 99286.9us
I20260709 12:15:02.182996 10733 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:02.200912 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:15:02.183868 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58018.5us
I20260709 12:15:02.203418 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.170662 12529 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:02.152607 12628 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:02.184821 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.194383 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.180220 12587 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:02.178534 12602 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.009s	sys 0.033s
I20260709 12:15:02.207572 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.201756 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:02.214155 11728 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:02.197479 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1664) took 1725 ms. Trace:
I20260709 12:15:02.208302 10198 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:02.208137 12557 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:02.214864 10200 rpcz_store.cc:276] 0709 12:15:00.471705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.215435 (+743730us) service_pool.cc:224] Handling call
0709 12:15:01.215758 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:01.273478 (+ 57720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:01.273507 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:01.273913 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:15:01.503204 (+229291us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:01.503244 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.191546 (+688302us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b54001040d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:02.191594 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.191640 (+    46us) raft_consensus.cc:1685] finished
0709 12:15:02.191653 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.197400 (+  5747us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2214,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":13826,"spinlock_wait_cycles":131941760,"thread_start_us":228935,"threads_started":1,"wal-append.queue_time_us":429689}
I20260709 12:15:02.211392 10199 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:02.218940 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.208760 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.193156 12344 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:02.223317 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.223930 10198 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:02.224032 10735 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:02.224269 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.225229 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.226228 10198 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:02.226730 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1154) took 1751 ms. Trace:
I20260709 12:15:02.226733 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.228757 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:02.219875 12339 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.936s	user 0.006s	sys 0.005s
I20260709 12:15:02.206719 12569 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:02.227375 10198 rpcz_store.cc:276] 0709 12:15:00.475781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.225662 (+1749881us) service_pool.cc:224] Handling call
0709 12:15:02.225932 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.226553 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.226690 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.228493 10734 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:02.232229 12309 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:02.233681 12635 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:15:02.234862 12571 consensus_meta.cc:287] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.005s
I20260709 12:15:02.234681 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.235140 12622 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:02.247514 12622 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:02.247646 12580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.005s	sys 0.020s
I20260709 12:15:02.247917 12622 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.235970 12346 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:02.236392 12531 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.248570 12346 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.191969 10728 raft_consensus.cc:2376] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7. Re-sending same reply.
W20260709 12:15:02.226531 12602 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.009s	sys 0.034s
I20260709 12:15:02.235548 12475 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.217963 12557 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.250903 12346 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.246356 10202 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:02.243345 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.250866 12475 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.252213 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1665) took 1772 ms. Trace:
I20260709 12:15:02.252646 10202 rpcz_store.cc:276] 0709 12:15:00.479751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.225995 (+1746244us) service_pool.cc:224] Handling call
0709 12:15:02.246193 (+ 20198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.251894 (+  5701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.252154 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.253459 12475 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.251235 12557 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.227120 12473 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:02.248654 12531 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.227660 12529 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:02.244654 10203 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:02.246863 10198 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:02.269368 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1155) took 1718 ms. Trace:
I20260709 12:15:02.269810 10198 rpcz_store.cc:276] 0709 12:15:00.550784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.246407 (+1695623us) service_pool.cc:224] Handling call
0709 12:15:02.246698 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.269096 (+ 22398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.269312 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.270781 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.271106 10198 pending_rounds.cc:85] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:15:02.271606 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:02.272037 10198 pending_rounds.cc:107] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:15:02.272326 10198 raft_consensus.cc:2889] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:02.257171 10049 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:15:02.257786 10046 pending_rounds.cc:85] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 3
I20260709 12:15:02.274248 11728 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:02.273921 10046 pending_rounds.cc:107] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:15:02.274551 10053 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:02.274952 10046 raft_consensus.cc:2889] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:02.248023 12580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.005s	sys 0.021s
I20260709 12:15:02.258843 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:02.196568 10732 rpcz_store.cc:269] 0709 12:15:00.471242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.638544 (+167302us) service_pool.cc:224] Handling call
0709 12:15:02.158993 (+1520449us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400612e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.159152 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126091136}
I20260709 12:15:02.261880 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.263924 10047 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:15:02.251300 10168 leader_election.cc:336] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 2.155s (SENT)
I20260709 12:15:02.255770 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.244380 12569 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.259896 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.281795 10052 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:02.278146 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:02.254853 12344 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:02.278615 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.247251 12455 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.286662 11728 raft_consensus.cc:2764] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:15:02.282621 10733 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:02.286135 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.260582 12473 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.278849 12521 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:02.289323 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 666) took 1020 ms. Trace:
I20260709 12:15:02.303310 10733 rpcz_store.cc:276] 0709 12:15:01.269305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.255522 (+986217us) service_pool.cc:224] Handling call
0709 12:15:02.289248 (+ 33726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.304937 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.305713 10055 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:15:02.289743 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 105458us
I20260709 12:15:02.286356 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.290851 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.291029 10734 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:15:02.272140 12340 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:02.269088 12613 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.306879 10053 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:15:02.282538 12510 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.095s	user 0.008s	sys 0.003s
I20260709 12:15:02.308386 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 407) took 1040 ms. Trace:
I20260709 12:15:02.246609 12523 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:15:02.314157 10734 rpcz_store.cc:276] 0709 12:15:01.267507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.271811 (+1004304us) service_pool.cc:224] Handling call
0709 12:15:02.290815 (+ 19004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.308116 (+ 17301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.308334 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.271859 12626 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.309499 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.310879 11728 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:02.246766 12642 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:15:02.287446 12569 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:02.288604 12641 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:15:02.261094 12571 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.317982 12387 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:02.302776 12625 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:02.310268 12473 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:02.330261 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:02.302948 12521 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:02.311092 12542 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:02.319963 12640 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:15:02.312654 12520 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.285470 12475 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:15:02.343842 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.344259 11728 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:02.346967 11728 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:02.347347 11728 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.347688 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.348510 12267 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:02.307890 12344 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:02.349596 12639 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:15:02.317992 12555 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:02.340791 12587 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 12:15:02.356603 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.357539 12587 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.331633 12625 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.358762 12625 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:02.360877 10047 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:02.361397 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.362107 10052 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:02.361850 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.362372 12623 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.362597 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:02.345584 12529 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.371767 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1663) took 1988 ms. Trace:
I20260709 12:15:02.372233 10201 rpcz_store.cc:276] 0709 12:15:00.383403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.383513 (+   110us) service_pool.cc:224] Handling call
0709 12:15:00.389472 (+  5959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.089638 (+1700166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.371489 (+281851us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540007dd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:02.371700 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908363136}
I20260709 12:15:02.373409 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.375824 12622 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.341897 12609 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:15:02.301301 12539 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:15:02.384624 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.356050  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:02.386336 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.387378 11728 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.387389 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.319772 12510 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.390383 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.391866 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 662) took 1124 ms. Trace:
I20260709 12:15:02.392252 10737 rpcz_store.cc:276] 0709 12:15:01.266985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.267185 (+   200us) service_pool.cc:224] Handling call
0709 12:15:02.085702 (+818517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.173477 (+ 87775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.391678 (+218201us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400570dd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.391808 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881646976}
W20260709 12:15:02.394579 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77012.5us
I20260709 12:15:02.346210 12387 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:02.395309 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:02.358044 12587 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.396519 10201 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:02.392949 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1153) took 1917 ms. Trace:
I20260709 12:15:02.397367 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.328493 12626 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.361941 12552 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.398583 11728 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.390841 12267 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:02.405210 10202 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:02.406757 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 383) took 1848 ms (client timeout 1641 ms). Trace:
I20260709 12:15:02.407027 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.387485 12622 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.374215 12469 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:02.414090 10203 rpcz_store.cc:269] 0709 12:15:00.557952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.158482 (+600530us) service_pool.cc:224] Handling call
0709 12:15:02.406560 (+1248078us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000627d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.406679 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496023296}
I20260709 12:15:02.390956 12613 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:02.418210 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:02.419205 10737 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:02.419414 11728 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:02.419806 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 676) took 1067 ms. Trace:
I20260709 12:15:02.420118 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.420162 10737 rpcz_store.cc:276] 0709 12:15:01.420791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.403292 (+982501us) service_pool.cc:224] Handling call
0709 12:15:02.418977 (+ 15685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.419609 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.419758 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:02.420845 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:02.421866 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.406339 12483 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:15:02.396941 12555 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:02.423520 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.424038 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.423961 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.426932 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.402072 12339 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:02.430610 10197 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:02.431152 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.432611 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.435526 10197 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:02.436599 10195 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:02.392535 12575 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.422890 12520 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:02.425014 12384 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:02.443701 12546 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.402379 12475 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:15:02.445463 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.401566 12523 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:15:02.458103 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1158) took 1099 ms. Trace:
I20260709 12:15:02.458272 12523 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:02.415241 12542 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:15:02.427184 12552 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:02.459254 12552 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.459653 12552 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:02.449983 12531 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.413156 12521 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.468393 12569 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.469401 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1159) took 1110 ms. Trace:
I20260709 12:15:02.468034 12313 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.471496 12587 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.472216 12313 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.472998 10204 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:02.472213 12607 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.475492 12571 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.475611 12469 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.476318 12607 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.469750 10198 rpcz_store.cc:276] 0709 12:15:01.359243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.270653 (+911410us) service_pool.cc:224] Handling call
0709 12:15:02.270923 (+   270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:02.321064 (+ 50141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:02.321097 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:02.331335 (+ 10238us) log.cc:844] Serialized 52 byte log entry
0709 12:15:02.411881 (+ 80546us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:02.411920 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.411985 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.469112 (+ 57127us) raft_consensus.cc:1685] finished
0709 12:15:02.469138 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.469341 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26193,"raft.queue_time_us":27257,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4706,"thread_start_us":59292,"threads_started":1,"wal-append.queue_time_us":114240}
I20260709 12:15:02.452280 12625 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.457397 12149 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.460434 10202 rpcz_store.cc:276] 0709 12:15:01.358420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.253769 (+895349us) service_pool.cc:224] Handling call
0709 12:15:02.254197 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.411793 (+157596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.457858 (+ 46065us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400314cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:02.458039 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346870144}
I20260709 12:15:02.466265 10197 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:02.430527 12339 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.468144 10732 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:02.467483 12384 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:02.455904 12615 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
I20260709 12:15:02.480070 10735 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:02.472947 12510 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:02.477236 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.458611 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 405) took 2077 ms. Trace:
I20260709 12:15:02.504463 12608 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.446161 12546 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.499284 12473 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.446218 12387 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.469810 12575 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.499502 12569 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.461354 12523 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:02.497949 12594 consensus_meta.cc:287] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.254s	user 0.008s	sys 0.003s
I20260709 12:15:02.507380 12339 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:02.523823 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.525134 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.524325 12555 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:15:02.527132 12546 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:02.524049 12520 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:15:02.528640 12654 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:15:02.529320 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1660) took 2146 ms (client timeout 1712 ms). Trace:
I20260709 12:15:02.529452 12608 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.507905 12557 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.531188 10729 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEARNER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:02.532320 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:02.533290 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1849) took 2071 ms. Trace:
I20260709 12:15:02.572759 10130 rpcz_store.cc:276] 0709 12:15:00.461594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.461787 (+   193us) service_pool.cc:224] Handling call
0709 12:15:00.478078 (+ 16291us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:00.480140 (+  2062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:00.480170 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:00.527039 (+ 46869us) log.cc:844] Serialized 78 byte log entry
0709 12:15:00.786466 (+259427us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:01.348149 (+561683us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.532182 (+1184033us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b18002b1a40. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:02.532506 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.532789 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.532921 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.533064 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.533107 (+    43us) raft_consensus.cc:1685] finished
0709 12:15:02.533120 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.533234 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288639,"prepare.queue_time_us":795171,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":2574,"raft.queue_time_us":1197075,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":37217,"spinlock_wait_cycles":11570432,"thread_start_us":409418,"threads_started":2,"wal-append.queue_time_us":711598}
W20260709 12:15:02.537812 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.480562 10733 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:02.540978 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:02.544013 12604 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:02.544260 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.545949 12400 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.527403 12625 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.527081 12473 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.589811 12384 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.592029 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 674) took 1273 ms. Trace:
I20260709 12:15:02.592449 10731 rpcz_store.cc:276] 0709 12:15:01.318750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.990985 (+672235us) service_pool.cc:224] Handling call
0709 12:15:02.591837 (+600852us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400731ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.591969 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340539776}
I20260709 12:15:02.554356 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:02.554966 11728 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:02.530346 10051 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:15:02.559310 10196 rpcz_store.cc:269] 0709 12:15:00.382618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.382830 (+   212us) service_pool.cc:224] Handling call
0709 12:15:02.529081 (+2146251us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.529204 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826886528}
I20260709 12:15:02.523823 10730 rpcz_store.cc:276] 0709 12:15:00.381154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.388297 (+  7143us) service_pool.cc:224] Handling call
0709 12:15:00.442365 (+ 54068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.138342 (+1695977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.458394 (+320052us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5400533250. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:02.458553 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113038592}
I20260709 12:15:02.551081 12607 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.555652 12469 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.556602 12575 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:02.553341 12594 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.400321 10199 rpcz_store.cc:276] 0709 12:15:00.475545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.225624 (+1750079us) service_pool.cc:224] Handling call
0709 12:15:02.245997 (+ 20373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.246188 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:02.269458 (+ 23270us) log.cc:844] Serialized 14 byte log entry
0709 12:15:02.392621 (+123163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:02.392677 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:02.392717 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.392783 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.392890 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53165,"prepare.queue_time_us":25273,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":48696,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2063,"thread_start_us":74156,"threads_started":1,"wal-append.queue_time_us":138236}
I20260709 12:15:02.715240 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:02.732949 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.785701 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:02.778666 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.602711 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:02.720988 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 673) took 1402 ms. Trace:
I20260709 12:15:02.813767 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:02.685477 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 133372us
I20260709 12:15:02.605850 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.721402 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 660) took 1455 ms. Trace:
W20260709 12:15:02.709210 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.717177 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:02.870076 10125 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:02.718905 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 174713us
I20260709 12:15:02.866875 10734 rpcz_store.cc:276] 0709 12:15:01.318362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.336825 (+1018463us) service_pool.cc:224] Handling call
0709 12:15:02.384570 (+ 47745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.395566 (+ 10996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:02.395587 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:02.399314 (+  3727us) log.cc:844] Serialized 26 byte log entry
0709 12:15:02.500696 (+101382us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:02.500734 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.500803 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.720752 (+219949us) raft_consensus.cc:1685] finished
0709 12:15:02.720774 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.720923 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5088,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7255,"thread_start_us":72656,"threads_started":1,"wal-append.queue_time_us":129742}
W20260709 12:15:02.866108 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:02.871834 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.738930 10130 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:15:02.737028 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.873533 10127 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:02.717921 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:02.720199 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.683974 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.874629 10735 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:02.685343 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 77892.1us
I20260709 12:15:02.605171 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.606316 10737 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:02.605516 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:02.877856 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 323558us
I20260709 12:15:02.868927 10736 rpcz_store.cc:276] 0709 12:15:01.266390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.266533 (+   143us) service_pool.cc:224] Handling call
0709 12:15:01.273049 (+  6516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.192248 (+919199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.721184 (+528936us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54005d2354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:02.721345 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112390528}
I20260709 12:15:02.603093 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:02.881042 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 67349.9us
I20260709 12:15:02.881791 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.883446 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.716874 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:02.875862 10198 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:02.865511 11728 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:02.888998 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:02.920315 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.888216 11728 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:02.887990 10202 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:02.895490 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:02.933032 10735 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:02.957470 10127 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:02.959826 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:02.822924 12628 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.003s
W20260709 12:15:02.925891 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55583us
I20260709 12:15:02.923941 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:02.887689 10124 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:02.960374 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:02.960953 10122 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:02.961427 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:02.994159 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.898895 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:02.684937 12604 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.962246 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.994982 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:02.995397 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71521.1us
I20260709 12:15:02.889619 12555 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:02.719029 12400 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:02.975428 12557 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:03.000373 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75169.5us
I20260709 12:15:03.001798 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.920667 12461 raft_consensus.cc:2764] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:15:02.986498 12657 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:15:02.982209 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.833343 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:02.685294 12603 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:02.986021 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.722620 10728 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 7. Ops: []
I20260709 12:15:02.731928 12624 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:03.024327 12624 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:02.890911 12575 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:02.884820 12562 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.027112 10734 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:02.889858 12473 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:02.716048 12578 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.028137 12575 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:02.996408 10124 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:03.029245 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.004602 10125 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:03.034476 12470 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.004751 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.036499 12339 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.037741 10203 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:03.037839 12624 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:03.009353 12459 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:15:02.976940 10127 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:02.978127 11728 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.006656 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:03.007414 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 108573us
I20260709 12:15:03.044981 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:02.958685 12546 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:15:02.958849 12516 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:15:03.000314 12569 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:03.051293 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44722.8us
I20260709 12:15:03.053407 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:03.055060 11728 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:02.709759 12580 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.280s
I20260709 12:15:02.979949 12608 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:03.021600 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.022540 12603 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.022856 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.023458 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.888373 12607 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.046144 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:02.888553 12469 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:03.048256 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 43571.7us
I20260709 12:15:03.008289 12587 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:02.985029 12646 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:15:03.017110 12557 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:03.014353 12400 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:03.012231 10130 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:03.096115 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:02.921969 12523 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.065336 12567 raft_consensus.cc:2764] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:15:03.056972 12524 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:03.057633 12555 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:03.061631 10128 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:03.057333 12461 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.086853 10129 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.110168 10123 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:03.104158 10729 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:15:03.018656 12628 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.013310 12491 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:15:03.058977 12569 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.105487 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:03.107647 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 105928us
I20260709 12:15:03.116360 12594 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.119055 12339 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:03.119551 12487 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:03.120503 12523 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:03.121592 12552 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.662s	user 0.004s	sys 0.004s
I20260709 12:15:03.121826 12469 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.122371 10128 pending_rounds.cc:85] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 1
I20260709 12:15:03.131369 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.136085 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 672) took 1829 ms. Trace:
I20260709 12:15:03.137799 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:03.138981 12660 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:03.140431 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:03.167774 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.102908 12587 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:03.142874 12400 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.144521 12603 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:03.108506 12461 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:03.145670 12270 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.937s	user 0.006s	sys 0.004s
I20260709 12:15:03.106909 12510 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.190865 12510 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.191308 12510 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.099014 12613 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:15:03.147178 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.152719 10129 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:03.197711 10729 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.198686 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.130110 12626 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:03.156481 10130 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.200136 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:03.200361 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.200659 10130 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.203038 12569 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.092865 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.141516 12521 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.208510 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:03.209668 10121 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:03.163475 10200 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:03.210346 10130 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:03.175761 12529 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.162910 10128 pending_rounds.cc:107] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:15:03.222806 10128 raft_consensus.cc:2889] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:03.169399 10195 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.170037 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:03.155157 12580 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:15:03.172314 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 118969us
I20260709 12:15:03.171216 12624 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:03.184460 12607 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.186234 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:03.182214 12461 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.188773 12628 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:03.168536 10732 rpcz_store.cc:276] 0709 12:15:01.306312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.319035 (+1012723us) service_pool.cc:224] Handling call
0709 12:15:02.352103 (+ 33068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.508699 (+156596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.135838 (+627139us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540046f354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:03.136020 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266380160}
I20260709 12:15:03.158974 12487 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:03.181201 12147 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:03.211045 10202 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:03.157346 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:03.218717 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 172633us
I20260709 12:15:03.162532 12557 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:15:03.224886 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:03.226331 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56357.9us
I20260709 12:15:03.226650 10203 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:03.187152 12604 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:03.211444 12149 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.001s
I20260709 12:15:03.176187 12552 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:03.268680 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43881.6us
I20260709 12:15:03.269375 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:03.253925 12626 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.263754 10195 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:03.258869 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.264678 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.266546 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:03.260902 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 103672us
I20260709 12:15:03.274734 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:03.275295 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.256430 12147 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:03.277029 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.282980 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.284886 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:03.289969 10736 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.290848 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.267658 12514 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.303220 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.267083 12607 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.288664 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:03.311425 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:03.273676 12626 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.274269 12604 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:03.331591 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.332270 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.332887 10054 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.332216 10053 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.330967 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.313971 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.330350 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:03.334280 10051 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.334221 10046 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.289595 12580 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.289705 12339 raft_consensus.cc:2764] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:15:03.335261 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.339826 10048 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.289526 12569 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:03.344492 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50360.6us
W20260709 12:15:03.345292 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.335964 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.346451 10050 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.303061 12387 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:03.338069 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.349510 10047 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:03.289983 12634 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:03.290082 12628 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:03.357746 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.358397 10125 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.360078 12524 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:03.360481 12524 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:03.361313 12524 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.264504 12587 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:03.368052 10122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1851) took 2896 ms (client timeout 1726 ms). Trace:
W20260709 12:15:03.368597 10122 rpcz_store.cc:269] 0709 12:15:00.471151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.471457 (+   306us) service_pool.cc:224] Handling call
0709 12:15:03.367764 (+2896307us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400243e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.367933 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4135321472}
I20260709 12:15:03.333596 12626 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.374413 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.375826 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.375993 12552 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.376458 10734 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:03.312666 12607 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.344038 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.377875 12607 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.305706 12578 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:15:03.378739 12491 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:03.379844 12491 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:03.380182 12491 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:03.380954 12491 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.382090 12491 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:03.382586 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71242.9us
I20260709 12:15:03.384277 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.386273 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.315335 12514 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.388041 12603 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.388469 12603 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.388799 12603 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.389951 12514 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:03.331905 12604 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.391623 12604 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:03.392233 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.393477 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.393971 10130 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.345410 12580 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.395002 12580 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.400207 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.400836 10055 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:15:03.347205 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.303583 12667 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.306082 12608 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:03.304296 12613 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.307178 12575 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:03.338701 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.355389 12267 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:03.377391 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.303444 12609 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:15:03.350384 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.336477 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.427137 10047 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:03.405984 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:03.408696 10053 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:03.430922 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:03.413290 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 146844us
I20260709 12:15:03.432266 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:03.414463 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70501.3us
I20260709 12:15:03.418892 10125 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:03.418545 10054 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:03.418046 10055 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:03.422894 10734 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.403617 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.436635 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:03.425833 12267 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.411980 12147 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.342720 11663 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:15:03.448726 10052 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:03.450011 10046 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:03.450524 10735 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.456557 10051 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:03.418299 12524 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:03.461231 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1248) took 1732 ms (client timeout 1628 ms). Trace:
W20260709 12:15:03.463891 10121 rpcz_store.cc:269] 0709 12:15:01.728736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.728848 (+   112us) service_pool.cc:224] Handling call
0709 12:15:03.461058 (+1732210us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400243954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.461161 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3395465984}
I20260709 12:15:03.448191 12555 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.468159 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.468506 12555 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:03.468923 12555 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.447914 12384 raft_consensus.cc:2764] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:15:03.452262 12465 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.475302 12465 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:03.475688 12465 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.478991 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.479791 10046 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.481244 12607 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.482820 12147 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.485790 12626 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.463096 12349 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:03.496018 10046 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:03.424018 12628 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:03.494671 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:03.516709 10051 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:15:03.422621 12547 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:03.487340 12669 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:15:03.466831 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:03.495255 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.518464 10121 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.452116 12483 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.442459 12387 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:03.487721 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.487048 11728 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:03.547132 11728 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:03.459870 12608 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:03.508539 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 73137.7us
I20260709 12:15:03.553553 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:03.490536 12575 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:03.510531 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.445132 12469 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:03.308864 12487 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.455400 12569 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:03.568670 10121 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
W20260709 12:15:03.535614 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.492787 10734 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:03.547204 10053 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:15:03.548866 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 82112.5us
I20260709 12:15:03.548075 11728 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.549957 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.507726 12676 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.612566 11728 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.612656 12676 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.613201 12676 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.426916 12613 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.616209 12613 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:03.515535 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 226915us
I20260709 12:15:03.620012 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.620996 12465 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.564496 12270 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.621992 12270 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.581420 12608 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.622160 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.623363 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.623874 10734 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:03.582767 12575 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.579932 12487 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.555598 12483 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.584807 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.568917 12569 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:03.587424 10203 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:03.635213 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 663) took 2366 ms. Trace:
I20260709 12:15:03.657370 10733 rpcz_store.cc:276] 0709 12:15:01.268609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.304183 (+1035574us) service_pool.cc:224] Handling call
0709 12:15:02.304544 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.577123 (+272579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.634934 (+1057811us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400450e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:03.635137 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404347136}
I20260709 12:15:03.640618 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.638559 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:03.659497 10128 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:03.659854 10735 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:03.590103 12529 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:03.592729 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:03.665231 10201 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:03.570996 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.605226 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.567236 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.621323 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.636654 10199 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:15:03.627291 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:03.667825 10053 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:03.511186 12677 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 12:15:03.631623 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:03.518316 12349 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:03.663597 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110106us
I20260709 12:15:03.628484 12270 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.666289 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:03.624643 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:03.676079 10734 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.667043 10048 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:03.668727 10127 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:03.644905 12470 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.670985 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:03.646003 12675 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:15:03.518481 12604 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.625592 12642 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.673036 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:03.689839 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:03.674679 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.565515 12628 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:03.692327 12628 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.679100 10130 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:03.641152 12607 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.680032 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:03.696658 12587 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:03.697188 12587 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.697695 12587 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.698707 12613 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:03.699282 12613 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.701293 12603 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.632306 12469 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.633354 12682 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.681700 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:03.642079 12626 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:03.685148 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.728565 10128 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:03.728730 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1246) took 2021 ms. Trace:
I20260709 12:15:03.685330 10733 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:03.729991 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1156) took 3071 ms. Trace:
I20260709 12:15:03.730376 10200 rpcz_store.cc:276] 0709 12:15:00.658569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.247873 (+1589304us) service_pool.cc:224] Handling call
0709 12:15:02.248153 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.211630 (+963477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.729749 (+518119us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002120d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:03.729932 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104602368}
I20260709 12:15:03.729140 10126 rpcz_store.cc:276] 0709 12:15:01.707694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.714688 (+  6994us) service_pool.cc:224] Handling call
0709 12:15:02.360918 (+646230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.571523 (+210605us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:02.571555 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:02.571596 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:02.571626 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:02.571704 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:03.728561 (+1156857us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54001d5450. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.728675 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210269,"raft.queue_time_us":229391,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":1438990720}
I20260709 12:15:03.727496 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 408) took 2370 ms. Trace:
I20260709 12:15:03.740770 10737 rpcz_store.cc:276] 0709 12:15:01.356782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.421083 (+1064301us) service_pool.cc:224] Handling call
0709 12:15:02.606139 (+185056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:02.876377 (+270238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.727219 (+850842us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400731ed0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.727420 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405581696}
I20260709 12:15:03.743685 10737 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:03.745105 12516 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:03.748169 10733 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:03.748482 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:03.749835 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.750531 10053 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.690912 10121 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:03.674008 12552 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:03.628600 12510 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.640214 12580 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.702282 12557 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:03.736951 12578 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:03.702742 12387 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.696650 10735 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:15:03.711177 12642 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.684640 12470 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.679373 11728 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:03.707271 12569 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.803864 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.708752 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:03.805089 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 96422.5us
I20260709 12:15:03.805456 10122 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:03.806384 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:03.709513 12587 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.711360 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.706642 10050 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:03.692234 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:03.713725 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.820502 10127 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:03.719853 10202 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:03.676415 12147 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:03.725348 10734 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:03.727427 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:03.761579 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:03.824872 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63389us
I20260709 12:15:03.824993 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:03.771740 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:03.703017 12680 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:15:03.783905 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:03.837112 10049 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:03.719465 12682 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:03.785393 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:03.788028 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.688601 12149 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:15:03.838661 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 677) took 1621 ms. Trace:
I20260709 12:15:03.684311 12672 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:03.839171 10731 rpcz_store.cc:276] 0709 12:15:02.217002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.593269 (+376267us) service_pool.cc:224] Handling call
0709 12:15:02.593648 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.107723 (+514075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.107754 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.108187 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.358555 (+250368us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b180021aa80. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:15:03.604415 (+245860us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:03.604456 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.838299 (+233843us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54003cd054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:03.838355 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:03.838403 (+    48us) raft_consensus.cc:1685] finished
0709 12:15:03.838417 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:03.838585 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1624,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":1589,"spinlock_wait_cycles":1245954176,"thread_start_us":245664,"threads_started":1,"wal-append.queue_time_us":627186}
I20260709 12:15:03.841511 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 413) took 1091 ms. Trace:
I20260709 12:15:03.799319 10053 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:03.812543 10055 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:15:03.843255 10048 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:15:03.843861 10055 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:03.728097 12469 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.838712 12682 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.845718 10730 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:03.848133 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 678) took 1630 ms. Trace:
I20260709 12:15:03.848477 10730 rpcz_store.cc:276] 0709 12:15:02.217284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.938585 (+721301us) service_pool.cc:224] Handling call
0709 12:15:03.845494 (+906909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.847328 (+  1834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.847960 (+   632us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54006491d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.848076 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932278144}
I20260709 12:15:03.848318 10046 pending_rounds.cc:85] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:15:03.850246 10046 pending_rounds.cc:107] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:15:03.850548 10046 raft_consensus.cc:2889] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:03.851106 10054 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 12:15:03.846949 10051 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:03.841946 10736 rpcz_store.cc:276] 0709 12:15:02.750532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.880110 (+129578us) service_pool.cc:224] Handling call
0709 12:15:03.841295 (+961185us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54006491d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:03.841447 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665695488}
I20260709 12:15:03.853686 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:03.799389 12552 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:03.856320 10199 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:03.799823 12557 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:03.814706 12465 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:03.823189 12147 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.813098 12578 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:03.855515 12533 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:03.857204 12514 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.848876 12569 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:03.896461 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.850188 12384 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.813624 12555 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.936177 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.855770 12673 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:15:03.895545 12147 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:03.869697 12149 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:03.940706 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.945817 10126 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:03.940852 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.941785 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:03.905701 12685 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:15:03.948446 10055 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:03.901469 12465 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:03.877082 12618 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:15:03.933681 12533 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:03.954681 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.955089 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 675) took 2636 ms. Trace:
I20260709 12:15:03.937538 12516 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:03.958280 11728 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.967409 11728 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.933945 12267 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:03.868216 12461 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.002s
I20260709 12:15:03.967597 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.970793 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:03.950033 12674 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:03.972400 10128 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.938009 12594 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:15:03.976724 11728 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.978650 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:03.959785 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.031s	sys 0.045s
W20260709 12:15:03.979396 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.031s	sys 0.045s
W20260709 12:15:03.979844 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 633602us
I20260709 12:15:03.979458 10121 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:03.984310 10126 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:03.986194 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:03.951913 12349 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:03.959435 12469 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:03.960654 12149 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:03.993103 10127 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:03.994357 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:03.997800 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.007264 10125 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:04.019198 10121 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:04.019924 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1872) took 1129 ms. Trace:
I20260709 12:15:04.020318 10121 rpcz_store.cc:276] 0709 12:15:02.890692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.016948 (+1126256us) service_pool.cc:224] Handling call
0709 12:15:04.019016 (+  2068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.019680 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.019868 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:04.040699 10121 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:03.973419 12674 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:04.041543 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1874) took 1047 ms. Trace:
I20260709 12:15:03.986645 12604 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.042230 10121 rpcz_store.cc:276] 0709 12:15:02.994268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.023090 (+1028822us) service_pool.cc:224] Handling call
0709 12:15:04.040374 (+ 17284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.041284 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.041483 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:04.044241 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:04.047992 10126 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:04.045567 10127 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [4.6-6.8]
I20260709 12:15:04.050246 10121 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:15:04.050686 10121 pending_rounds.cc:85] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 3
I20260709 12:15:04.050947 10121 pending_rounds.cc:107] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:15:04.051213 10121 raft_consensus.cc:2889] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:04.053041 10121 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:15:04.045306 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 393248us
I20260709 12:15:03.955271 12557 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.056798 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1873) took 1097 ms. Trace:
I20260709 12:15:04.062505 10127 rpcz_store.cc:276] 0709 12:15:02.959528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.019058 (+1059530us) service_pool.cc:224] Handling call
0709 12:15:04.045309 (+ 26251us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:04.056488 (+ 11179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.056738 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:04.054662 10128 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:04.054587 10121 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:03.953313 12552 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.060904 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:04.067219 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 377442us
I20260709 12:15:03.974203 12516 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.978016 12461 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:03.991437 12385 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:15:04.062784 12510 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:04.073585 10126 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:04.095094 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1875) took 1079 ms. Trace:
I20260709 12:15:04.095445 10126 rpcz_store.cc:276] 0709 12:15:03.015595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.048630 (+1033035us) service_pool.cc:224] Handling call
0709 12:15:04.073397 (+ 24767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.094820 (+ 21423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.095039 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:04.074975 10121 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:15:04.091621 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.991472 12578 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:03.966823 10728 rpcz_store.cc:276] 0709 12:15:01.319024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.376270 (+1057246us) service_pool.cc:224] Handling call
0709 12:15:02.376590 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.034218 (+657628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.954790 (+920572us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400646ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:03.955017 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795273088}
I20260709 12:15:04.126138 10121 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:15:04.111346 10129 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:04.073064 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:04.128592 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55592.4us
I20260709 12:15:04.071534 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:04.130447 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 58982.1us
I20260709 12:15:04.131440 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:04.131685 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:04.132355 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 307436us
I20260709 12:15:04.133617 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:04.079758 12642 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:04.094334 12670 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.745s	user 0.003s	sys 0.000s
I20260709 12:15:04.142234 10121 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:15:04.129374 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:04.092023 12587 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:04.147011 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:15:04.179423 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50154.3us
W20260709 12:15:04.183043 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48215.2us
W20260709 12:15:04.185125 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.188561 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:04.189592 10195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.009s
I20260709 12:15:04.137624 12628 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:04.192551 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.068452 12533 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.125533 12385 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:15:04.132792 12469 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:04.146145 12465 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:04.146023 12384 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:04.149612 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 287649us
I20260709 12:15:04.112597 12674 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.182389 12607 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:04.111632 12676 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:04.198110 12687 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:15:04.188561 12510 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.194928 12555 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:04.196225 10195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.009s
I20260709 12:15:04.178678 12470 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.133833 12149 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.149760 12686 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
W20260709 12:15:04.341946 10020 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.573s (SENT)
W20260709 12:15:04.372583 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.379648 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:04.378026 11663 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:04.381016 11663 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:04.381533 11663 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:04.198726 12628 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.201742 12642 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:04.236155 12575 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:15:04.354029 12691 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:15:04.354632 12346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.016s
I20260709 12:15:04.399554 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:04.399600 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.405596 10202 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:04.411331 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1862) took 1813 ms. Trace:
I20260709 12:15:04.411597 10731 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:04.412722 10734 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:15:04.355085 12711 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:04.354334 12384 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:04.344908 12523 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:04.414770 12676 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.370579 12465 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.416174 12470 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.373821 12510 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.417845 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.456343 10201 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:04.250593 12267 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:04.418941 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 237793us
I20260709 12:15:04.426700 10124 rpcz_store.cc:276] 0709 12:15:02.597650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.030151 (+432501us) service_pool.cc:224] Handling call
0709 12:15:03.030495 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:03.030917 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.030946 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:03.031537 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 12:15:03.154891 (+123354us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:03.154928 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.154988 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:03.948685 (+793697us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:04.388578 (+439893us) raft_consensus.cc:1685] finished
0709 12:15:04.388600 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.411264 (+ 22664us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4396,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":122,"spinlock_wait_cycles":50562816,"thread_start_us":122967,"threads_started":1,"wal-append.queue_time_us":237994}
W20260709 12:15:04.416086 12701 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:15:04.423658 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.008s
W20260709 12:15:04.510583 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.008s	sys 0.008s
W20260709 12:15:04.510882 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 661393us
I20260709 12:15:04.439774 11663 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.424407 12387 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:04.454779 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:04.416589 12575 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:04.422726 12642 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:04.486640 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:04.423672 12709 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 12:15:04.414644 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:04.502470 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:04.391834 12607 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:04.452098 12384 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:04.500483 12711 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:04.456311 12523 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:04.504927 12688 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
W20260709 12:15:04.505725 12690 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:15:04.506552 12689 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:15:04.456655 12710 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:04.509492 12704 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:15:04.425405 12346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.017s
W20260709 12:15:04.513487 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 59793.5us
I20260709 12:15:04.514925 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:04.394405 12628 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:04.519919 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 331403us
W20260709 12:15:04.529213 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.607692 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1175) took 1017 ms. Trace:
I20260709 12:15:04.432090 12686 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:04.610095 12686 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:04.610603 12686 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:04.554263 11663 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:04.614068 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.614243 11663 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:04.500272 12623 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:15:04.615623 12623 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:04.616040 12623 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:04.616457 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:04.616873 12623 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:04.511204 12270 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.823s	user 0.005s	sys 0.005s
I20260709 12:15:04.618680 12270 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:04.556375 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:04.558101 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.619872 10050 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:04.556660 12385 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:04.559019 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.620317 12385 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:04.559144 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 217235us
I20260709 12:15:04.620582 10204 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:04.511040 12516 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:04.516765 12555 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.551503 12461 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.621366 12555 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.565178 10052 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:04.598070 12694 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:15:04.622921 10201 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:15:04.623793 12555 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.565846 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:04.537102 12712 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:04.623911 12385 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.620101 10199 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:04.617383 12703 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:04.625600 12703 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.625980 12703 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:04.627256 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:04.627861 10127 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:04.628774 12270 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.629030 10124 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:04.625418 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:04.598279 12483 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.609740 12672 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:04.631290 12672 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:04.631034 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.630189 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1269) took 1171 ms. Trace:
I20260709 12:15:04.632113 12672 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.632912 10124 rpcz_store.cc:276] 0709 12:15:03.458296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.501993 (+1043697us) service_pool.cc:224] Handling call
0709 12:15:04.513199 (+ 11206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.629444 (+116245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.629982 (+   538us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001284d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:04.630138 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265978112}
I20260709 12:15:04.634024 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:04.635149 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.635288 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:04.625175 12385 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:04.637127 10702 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:04.624048 12678 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.233s	user 0.001s	sys 0.003s
I20260709 12:15:04.608718 10196 rpcz_store.cc:276] 0709 12:15:03.590566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.591892 (+  1326us) service_pool.cc:224] Handling call
0709 12:15:03.592150 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.592331 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:04.077325 (+484994us) log.cc:844] Serialized 14 byte log entry
0709 12:15:04.520162 (+442837us) log.cc:844] Serialized 14 byte log entry
0709 12:15:04.606855 (+ 86693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:04.606946 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:04.607074 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.607276 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.607558 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170543,"prepare.queue_time_us":850661,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":16588,"raft.queue_time_us":387240,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":60085504,"thread_start_us":845100,"threads_started":4}
I20260709 12:15:04.625397 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:04.678953 10201 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 5: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:04.628791 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:04.581825 12147 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.001s
I20260709 12:15:04.665431 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:04.618220 12623 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:04.569470 10728 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:04.640848 12667 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.638151 10124 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:04.677752 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:04.634722 12470 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:15:04.601620 12727 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:15:04.729621 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1173) took 1139 ms. Trace:
I20260709 12:15:04.729569 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1693) took 1342 ms. Trace:
I20260709 12:15:04.694123 10196 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:04.731489 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:04.789976 10198 rpcz_store.cc:276] 0709 12:15:03.589798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.590047 (+   249us) service_pool.cc:224] Handling call
0709 12:15:03.590358 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:03.590793 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.590823 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:03.591398 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 12:15:03.978119 (+386721us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:03.978163 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.978231 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.729399 (+751168us) raft_consensus.cc:1685] finished
0709 12:15:04.729419 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.729563 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13657,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":385916,"threads_started":1,"wal-append.queue_time_us":659729}
I20260709 12:15:04.633908 12609 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:04.796990 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:04.704118 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1176) took 1113 ms. Trace:
I20260709 12:15:04.803427 10050 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:04.804749 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:04.742858 10200 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:04.679323 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.734165 11728 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:04.736518 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1265) took 1279 ms (client timeout 1573 ms). Trace:
I20260709 12:15:04.742713 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:04.810540 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:04.797722 10197 rpcz_store.cc:276] 0709 12:15:03.590875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.590983 (+   108us) service_pool.cc:224] Handling call
0709 12:15:03.591277 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.591596 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.591622 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.592052 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.962533 (+370481us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:03.962571 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.962638 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.703889 (+741251us) raft_consensus.cc:1685] finished
0709 12:15:04.703908 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.704055 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12989,"raft.run_cpu_time_us":41,"raft.run_wall_time_us":41,"thread_start_us":370175,"threads_started":1,"wal-append.queue_time_us":609466}
W20260709 12:15:04.811784 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:04.740569 12491 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.318s	user 0.010s	sys 0.000s
I20260709 12:15:04.813402 12567 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:04.726013 12569 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.000s
I20260709 12:15:04.939401 10196 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:04.943245 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1871) took 2057 ms. Trace:
W20260709 12:15:04.817775 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 140091us
I20260709 12:15:04.792384 10047 rpcz_store.cc:276] 0709 12:15:03.387249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.443023 (+ 55774us) service_pool.cc:224] Handling call
0709 12:15:03.443374 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.448625 (+  5251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.448654 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.460453 (+ 11799us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.860133 (+399680us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:03.860173 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.860246 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.729360 (+869114us) raft_consensus.cc:1685] finished
0709 12:15:04.729380 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.729513 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4894,"raft.queue_time_us":8289,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3671,"thread_start_us":368675,"threads_started":1,"wal-append.queue_time_us":548881}
I20260709 12:15:04.944715 11728 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:04.945686 11728 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:04.945911 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:04.807101 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 211915us
I20260709 12:15:04.914343 10204 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
W20260709 12:15:04.947170 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 325660us
W20260709 12:15:04.944648 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 201966us
I20260709 12:15:04.946602 10047 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
W20260709 12:15:04.866685 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 353750us
I20260709 12:15:04.951809 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:04.952584 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:04.954473 10054 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:04.948838 10122 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:04.943698 10123 rpcz_store.cc:276] 0709 12:15:02.886246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.110979 (+224733us) service_pool.cc:224] Handling call
0709 12:15:03.122862 (+ 11883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.151135 (+ 28273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.151176 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.151586 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.329545 (+177959us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:03.329589 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.329674 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.623468 (+1293794us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:04.898935 (+275467us) raft_consensus.cc:1685] finished
0709 12:15:04.898962 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.943179 (+ 44217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33995,"raft.queue_time_us":34586,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8375,"spinlock_wait_cycles":50411904,"thread_start_us":173480,"threads_started":1,"wal-append.queue_time_us":235094}
W20260709 12:15:04.738039 12487 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.079s	user 0.007s	sys 0.001s
I20260709 12:15:04.960162 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.955729 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:04.962617 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:04.981490 10731 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:15:04.982079 10731 pending_rounds.cc:85] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 5
I20260709 12:15:04.982312 10731 pending_rounds.cc:107] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:15:04.747646 12523 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:04.726840 10729 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:15:04.730361 12679 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.353s	user 0.000s	sys 0.003s
W20260709 12:15:04.971441 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:04.814106 10125 rpcz_store.cc:269] 0709 12:15:03.457298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.640341 (+183043us) service_pool.cc:224] Handling call
0709 12:15:04.736324 (+1095983us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:04.736451 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705880320}
I20260709 12:15:05.006035 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:04.742928 12267 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.242s
I20260709 12:15:04.728858 12510 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.970472 12491 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.794932 12147 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.740720 12575 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:04.975890 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.700662 12672 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:04.796593 12609 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:04.975790 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.982563 10731 raft_consensus.cc:2889] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:04.704255 12714 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:15:04.943951 12521 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.718s	user 0.011s	sys 0.002s
I20260709 12:15:04.676069 12710 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.058069 10048 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:04.690232 12624 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:04.906653 12683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.008s	sys 0.014s
I20260709 12:15:04.746583 12580 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:04.985913 10203 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:04.810223 12667 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.727787 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 420) took 1529 ms. Trace:
I20260709 12:15:04.700121 12642 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.980654 12555 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:15:05.130158 12667 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.741856 12711 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:04.956604 12646 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.956208 12547 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:04.972882 11728 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:04.969250 12634 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:04.704914 12626 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.285s
I20260709 12:15:04.680719 12469 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:05.147248 12469 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:05.148154 12469 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.100196 12548 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.027791 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 60834.6us
W20260709 12:15:05.004527 12733 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:05.028018 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:04.724984 12384 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:04.993507 12578 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:05.036527 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:05.037783 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:05.039724 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 246774us
I20260709 12:15:05.177554 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:05.178968 10052 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:15:05.041082 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:05.043901 12720 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:05.045192 12739 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:05.200178 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 162447us
I20260709 12:15:04.712476 12607 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:05.028445 12682 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.182s	user 0.011s	sys 0.000s
I20260709 12:15:04.977559 12732 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:05.047912 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1271) took 1589 ms. Trace:
W20260709 12:15:05.048636 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.749993 12465 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.054287 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:05.051381 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 99095.2us
I20260709 12:15:05.060226 12609 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.062522 12514 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.064469 12613 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.067926 12147 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.022029 12726 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:15:05.071821 10054 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:05.057399 10130 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:05.035389 12491 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.090560 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:05.091416 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 294624us
I20260709 12:15:05.244297 10125 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:05.057713 12346 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:05.033627 12339 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:15:05.104686 10053 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:15:05.255847 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:05.065706 12686 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:05.088702 12683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.009s	sys 0.015s
I20260709 12:15:05.115851 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1978) took 1623 ms. Trace:
I20260709 12:15:05.396411 10049 rpcz_store.cc:276] 0709 12:15:03.492184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.837815 (+345631us) service_pool.cc:224] Handling call
0709 12:15:03.838167 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:04.193257 (+355090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:04.193288 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:04.216101 (+ 22813us) log.cc:844] Serialized 52 byte log entry
0709 12:15:04.475460 (+259359us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:04.475501 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.475580 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.115604 (+640024us) raft_consensus.cc:1685] finished
0709 12:15:05.115624 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.115782 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13939,"raft.queue_time_us":55800,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":19263,"thread_start_us":465306,"threads_started":2,"wal-append.queue_time_us":844362}
I20260709 12:15:05.398162 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:05.119565 12603 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.120704 12587 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:05.123219 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1983) took 1604 ms. Trace:
I20260709 12:15:05.328276 12552 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.228303 12682 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.325481 10728 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:05.025988 12703 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.136320 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1697) took 1428 ms. Trace:
I20260709 12:15:05.047401 12604 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:15:05.406838 12469 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:05.046363 12628 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.142838 12547 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.139138 12646 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.146519 12634 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:05.152418 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:05.171537 10123 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:05.172677 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.476529 10201 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:05.173118 10124 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
W20260709 12:15:05.477975 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.188802 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1179) took 1595 ms. Trace:
I20260709 12:15:05.177042 12706 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.189574 12580 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:05.190035 12149 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:05.190737 10126 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:05.191287 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1180) took 1563 ms. Trace:
I20260709 12:15:04.959409 12567 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.198065 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:05.488617 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 290613us
W20260709 12:15:05.200911 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 164444us
I20260709 12:15:05.490901 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:05.214524 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:05.147243 12626 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:05.216064 10128 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:05.496827 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1272) took 1985 ms. Trace:
I20260709 12:15:05.217585 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:05.497301 10199 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:05.222983 10127 rpcz_store.cc:276] 0709 12:15:03.458772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.691100 (+1232328us) service_pool.cc:224] Handling call
0709 12:15:04.691486 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:04.691875 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:04.691903 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:04.692380 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:15:04.812779 (+120399us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:04.812839 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.812935 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.047703 (+234768us) raft_consensus.cc:1685] finished
0709 12:15:05.047723 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.047859 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8531,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5320,"thread_start_us":82549,"threads_started":1,"wal-append.queue_time_us":271261}
I20260709 12:15:05.408735 12708 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:05.228307 10050 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:05.229950 11663 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:05.176235 12578 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.251302 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.241523 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:05.252367 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:05.221477 12483 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:05.215787 12751 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:05.174777 12385 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:15:05.256448 10204 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:05.176581 12548 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.251011 12346 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.239523 12738 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.334033 10736 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:05.348318 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.496062 12557 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:05.399049 10125 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:05.325707 12609 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:05.395656 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:05.400686 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:05.325944 12720 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:15:05.404372 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:05.124169 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1279) took 1417 ms. Trace:
I20260709 12:15:05.408064 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1172) took 1819 ms. Trace:
I20260709 12:15:05.124948 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 1987) took 1474 ms. Trace:
I20260709 12:15:05.406982 10048 rpcz_store.cc:276] 0709 12:15:03.519032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.844133 (+325101us) service_pool.cc:224] Handling call
0709 12:15:03.844442 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.058517 (+1214075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.122936 (+ 64419us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002774d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:05.123144 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790236928}
I20260709 12:15:05.412695 10046 rpcz_store.cc:276] 0709 12:15:03.708282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.847842 (+139560us) service_pool.cc:224] Handling call
0709 12:15:03.848149 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.851030 (+  2881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.851060 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.851487 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:15:04.195227 (+343740us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:04.195265 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.195349 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.136082 (+940733us) raft_consensus.cc:1685] finished
0709 12:15:05.136103 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.136251 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":343460,"threads_started":1,"wal-append.queue_time_us":659429}
I20260709 12:15:05.336397 12465 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.394202 12613 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:05.324877 12737 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.170s
W20260709 12:15:05.474295 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.539947 12547 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:05.541204 12750 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:15:05.540855 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.542740 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:05.478730 10202 rpcz_store.cc:276] 0709 12:15:03.593086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.821423 (+228337us) service_pool.cc:224] Handling call
0709 12:15:03.862338 (+ 40915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:04.431368 (+569030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.188537 (+757169us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54002634d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:05.188741 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248742784}
I20260709 12:15:05.544261 12465 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.544762 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.545856 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.406800 12587 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:05.414456 12608 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.546365 12465 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.546725 12608 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.484345 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1887) took 2356 ms. Trace:
I20260709 12:15:05.486644 10124 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:05.548347 10126 rpcz_store.cc:276] 0709 12:15:03.127511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.096170 (+968659us) service_pool.cc:224] Handling call
0709 12:15:05.190136 (+1093966us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:15:05.190354 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.484075 (+293721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.484288 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8727296}
I20260709 12:15:05.548913 10048 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:05.549049 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1274) took 1919 ms. Trace:
I20260709 12:15:05.484334 10203 rpcz_store.cc:276] 0709 12:15:03.628052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.684018 (+ 55966us) service_pool.cc:224] Handling call
0709 12:15:05.191074 (+1507056us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000ea1d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.191212 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681036032}
I20260709 12:15:05.550534 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.549763 10126 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:05.551488 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1278) took 1847 ms. Trace:
W20260709 12:15:05.493407 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 278953us
I20260709 12:15:05.546391 10202 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
W20260709 12:15:05.487774 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 335442us
I20260709 12:15:05.227409 10197 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:05.551779 10126 rpcz_store.cc:276] 0709 12:15:03.704265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.549347 (+1845082us) service_pool.cc:224] Handling call
0709 12:15:05.549619 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.551267 (+  1648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.551436 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.498874 10127 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:05.497181 10128 rpcz_store.cc:276] 0709 12:15:03.511590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.215490 (+1703900us) service_pool.cc:224] Handling call
0709 12:15:05.215857 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.496573 (+280716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.496763 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.500552 12642 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:15:05.556102 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:05.561662 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:05.562162 10197 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:05.506033 11728 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:05.508018 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 266571us
I20260709 12:15:05.472929 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 567) took 1097 ms. Trace:
I20260709 12:15:05.480098 12400 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.492144 12725 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:05.473407 12469 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.414764 12552 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.513676 12483 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.496441 12626 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.503532 12603 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:05.509223 12578 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:05.241084 12514 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.508687 12710 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:05.630159 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.524166 12738 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.513394 12339 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:05.532419 10195 rpcz_store.cc:276] 0709 12:15:03.588285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.588618 (+   333us) service_pool.cc:224] Handling call
0709 12:15:03.588929 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:03.589328 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:04.352888 (+763560us) log.cc:844] Serialized 14 byte log entry
0709 12:15:04.695782 (+342894us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:04.796889 (+101107us) log.cc:844] Serialized 52 byte log entry
0709 12:15:04.797317 (+   428us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:04.797457 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.797535 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.407841 (+610306us) raft_consensus.cc:1685] finished
0709 12:15:05.407862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.408007 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78026,"prepare.queue_time_us":755856,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":103758,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14797,"thread_start_us":949582,"threads_started":3,"wal-append.queue_time_us":285344}
I20260709 12:15:05.635964 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.517490 12744 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:05.526554 12384 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:05.539616 12746 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:15:05.503388 10200 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:05.551730 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:05.104089 10732 rpcz_store.cc:276] 0709 12:15:03.198019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.265070 (+ 67051us) service_pool.cc:224] Handling call
0709 12:15:03.330979 (+ 65909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:03.460141 (+129162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:03.463550 (+  3409us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:03.608380 (+144830us) log.cc:844] Serialized 26 byte log entry
0709 12:15:04.131423 (+523043us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:04.137804 (+  6381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:04.178086 (+ 40282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:04.727558 (+549472us) raft_consensus.cc:1685] finished
0709 12:15:04.727585 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:04.727726 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26321,"raft.queue_time_us":36511,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":31866,"thread_start_us":431948,"threads_started":1,"wal-append.queue_time_us":949014}
I20260709 12:15:05.543459 12646 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.638198 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:05.567157 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:05.639267 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 72184.3us
I20260709 12:15:05.586586 12567 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.573860 11663 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:05.587661 12552 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.528267 12580 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.496734 12706 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.572043 12682 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:05.564901 12387 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:05.583105 12400 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:05.584398 12754 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:15:05.585836 12469 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.472887 12575 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.543269 12628 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.543661 12613 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.659955 12706 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.655046 12683 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:15:05.661366 12613 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.507072 12708 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.557430 12557 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:05.662632 12557 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.663061 12557 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:05.587870 12757 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:15:05.565367 12703 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.627329 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 574) took 1194 ms. Trace:
I20260709 12:15:05.666878 10734 rpcz_store.cc:276] 0709 12:15:04.432730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.436648 (+  3918us) service_pool.cc:224] Handling call
0709 12:15:05.627082 (+1190434us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.627258 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075511040}
I20260709 12:15:05.651804 12469 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.640916 11728 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:05.550473 12587 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.667903 12469 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.668403 12587 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:05.670027 12469 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:05.671059 12761 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:15:05.618757 12725 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.632179 12491 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.567600 10728 rpcz_store.cc:276] 0709 12:15:04.374780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.378991 (+  4211us) service_pool.cc:224] Handling call
0709 12:15:05.417661 (+1038670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.657685 12575 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.640215 12339 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.647567 12624 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:05.630846 12147 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:15:05.691751 12725 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.648200 12580 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:05.684569 12628 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:05.631397 12346 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.696705 12674 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:05.675796 12744 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:15:05.702037 12624 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.707477 12628 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.722723 12708 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.719328 12628 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.724105 12628 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:05.725378 12738 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.672909 12626 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:05.720908 12755 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:15:05.722503 12575 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:05.743475 12624 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:05.740702 12623 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.000s
I20260709 12:15:05.744110 12667 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:05.776710 12667 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:05.777662 12667 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.747176 12686 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.752879 12608 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.753801 12682 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:05.780104 12682 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:05.780964 12682 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.757040 12548 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.778959 12667 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:05.767519 12580 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.768064 12626 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:05.734660 12752 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:15:05.782179 12682 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:05.808576 12634 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:05.811057 12634 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:05.534848 10046 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:05.537212 10123 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:05.625767 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 310) took 1017 ms. Trace:
W20260709 12:15:05.175468 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.857748 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1283) took 1058 ms. Trace:
I20260709 12:15:05.858661 10123 rpcz_store.cc:276] 0709 12:15:04.799511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.991628 (+192117us) service_pool.cc:224] Handling call
0709 12:15:05.857366 (+865738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.861812 10123 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 5
I20260709 12:15:05.862222 10123 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:15:05.625507 10121 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:15:05.862766 10123 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:05.549472 10124 rpcz_store.cc:276] 0709 12:15:03.629308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.486130 (+1856822us) service_pool.cc:224] Handling call
0709 12:15:05.486476 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.548777 (+ 62301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.548991 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:05.857897 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 366898us
I20260709 12:15:05.868269 10052 rpcz_store.cc:276] 0709 12:15:04.608152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.731210 (+123058us) service_pool.cc:224] Handling call
0709 12:15:05.625573 (+894363us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400131354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.625701 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855922048}
I20260709 12:15:05.532519 10055 rpcz_store.cc:276] 0709 12:15:03.651052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.845690 (+194638us) service_pool.cc:224] Handling call
0709 12:15:03.850134 (+  4444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:03.951216 (+101082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.124697 (+1173481us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54002a1554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:05.124886 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218253056}
I20260709 12:15:05.868906 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:05.532233 10122 rpcz_store.cc:276] 0709 12:15:03.706944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.941536 (+234592us) service_pool.cc:224] Handling call
0709 12:15:05.123992 (+1182456us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.124108 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304048512}
I20260709 12:15:05.875121 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:05.876454 10052 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:05.878304 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:05.866371 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.879420 10046 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:05.878275 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:05.883783 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:05.597007 10126 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:05.555052 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1890) took 1923 ms. Trace:
I20260709 12:15:05.559527 10128 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:15:05.624788 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1885) took 2497 ms (client timeout 1629 ms). Trace:
W20260709 12:15:05.885833 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 237109us
I20260709 12:15:05.886109 10195 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:05.651160 10204 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:15:05.529042 10196 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.034569 12587 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.035382 12587 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.037757 12587 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.029274 12708 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:06.038890 12516 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:15:06.039518 12708 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:06.040531 12557 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.041200 12708 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.045622 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 311) took 1397 ms. Trace:
I20260709 12:15:06.046141 10128 rpcz_store.cc:276] 0709 12:15:04.647644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.558863 (+911219us) service_pool.cc:224] Handling call
0709 12:15:05.559213 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:06.045091 (+485878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.045435 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:06.050483 10196 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:05.609370 10197 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:06.057386 10197 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:05.900213 11728 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:06.028446 10129 rpcz_store.cc:269] 0709 12:15:03.127002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.198398 (+ 71396us) service_pool.cc:224] Handling call
0709 12:15:05.624527 (+2426129us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400172d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.624708 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097070848}
I20260709 12:15:06.059072 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.060099 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1685) took 1551 ms. Trace:
I20260709 12:15:06.046625 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 310) took 1440 ms. Trace:
W20260709 12:15:06.028977 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 145467us
I20260709 12:15:06.061045 12725 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:05.901439 12147 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.908038 12346 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:05.908812 12483 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.063028 10126 rpcz_store.cc:276] 0709 12:15:04.606290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.554326 (+948036us) service_pool.cc:224] Handling call
0709 12:15:05.596606 (+ 42280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:06.021334 (+424728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.046456 (+ 25122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.908917 12459 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:06.063592 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.063491 10200 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:06.064654 10055 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:15:06.064225 12459 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.065580 12603 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:05.912460 12491 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.066985 12603 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.067219 12491 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.069576 12491 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.062879 12147 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.071425 12465 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.072160 12465 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.073171 12147 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.062879 12516 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:06.073846 12729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.041s	sys 0.099s
I20260709 12:15:06.060144 10054 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:05.913686 12339 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:06.074247 12729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.042s	sys 0.099s
I20260709 12:15:05.918066 12514 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:05.928511 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.928923 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1268) took 2470 ms. Trace:
I20260709 12:15:05.930855 12385 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:06.079484 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1682) took 1661 ms. Trace:
I20260709 12:15:05.822759 12578 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.097474 10728 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:15:06.076848 12339 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:06.060544 10201 rpcz_store.cc:276] 0709 12:15:04.508427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.681380 (+172953us) service_pool.cc:224] Handling call
0709 12:15:04.681679 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.476949 (+795270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.059589 (+582640us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54001040d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:06.059927 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827566848}
I20260709 12:15:05.857656 10049 raft_consensus.cc:2410] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:15:05.988798 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:06.028517 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.085736 10199 rpcz_store.cc:276] 0709 12:15:04.418318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.632669 (+214351us) service_pool.cc:224] Handling call
0709 12:15:04.632946 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.501734 (+868788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.078897 (+577163us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540007f154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:06.079259 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987364608}
I20260709 12:15:06.029247 12766 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:06.029505 12764 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:06.030155 12149 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:06.052409 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1891) took 2399 ms. Trace:
I20260709 12:15:06.074390 12465 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:05.888918 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1688) took 1379 ms. Trace:
W20260709 12:15:06.062546 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 764480us
I20260709 12:15:06.028738 10127 rpcz_store.cc:276] 0709 12:15:03.631229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.498234 (+1867005us) service_pool.cc:224] Handling call
0709 12:15:05.498559 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.554791 (+ 56232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.554996 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:05.829331 12604 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.136471 12604 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.083134 12682 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:15:06.087390 12628 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.080823 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 569) took 1690 ms. Trace:
I20260709 12:15:06.139591 10732 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:06.083554 10121 rpcz_store.cc:276] 0709 12:15:03.458079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.197798 (+739719us) service_pool.cc:224] Handling call
0709 12:15:05.625288 (+1427490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:05.863371 (+238083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.928487 (+ 65116us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400172d50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:05.928693 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3281578368}
I20260709 12:15:06.075302 12516 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:06.141276 12516 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:06.142453 12674 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.142781 12516 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.143258 12674 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:06.054509 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.126185 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.125393 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.126776 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.133718 10046 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:06.133143 12578 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:06.141644 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.082712 12459 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:06.153488 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 93296.5us
I20260709 12:15:06.139906 10736 rpcz_store.cc:276] 0709 12:15:04.390037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.390183 (+   146us) service_pool.cc:224] Handling call
0709 12:15:04.411077 (+ 20894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:05.518477 (+1107400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.080251 (+561774us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:06.080565 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122174336}
I20260709 12:15:06.157420 12766 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.159534 12628 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.119417 10125 rpcz_store.cc:276] 0709 12:15:03.653387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.521302 (+1867915us) service_pool.cc:224] Handling call
0709 12:15:05.521642 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:05.526163 (+  4521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:05.526194 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:05.534552 (+  8358us) log.cc:844] Serialized 52 byte log entry
0709 12:15:05.866249 (+331697us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:05.866349 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.866524 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:06.051931 (+185407us) raft_consensus.cc:1685] finished
0709 12:15:06.051950 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:06.052192 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4100,"raft.queue_time_us":6300,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7244,"thread_start_us":264998,"threads_started":1,"wal-append.queue_time_us":434546}
W20260709 12:15:06.162392 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.080789 12626 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:15:06.163553 12770 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.163712 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.164301 12770 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.164911 12594 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.165727 12594 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.166781 12770 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.168084 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:06.168310 12459 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:06.168910 10129 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:06.169268 12459 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:06.168095 12594 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:06.170574 10130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1267) took 2674 ms (client timeout 1909 ms). Trace:
I20260709 12:15:06.170460 12770 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:06.171013 10130 rpcz_store.cc:269] 0709 12:15:03.457849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.711036 (+253187us) service_pool.cc:224] Handling call
0709 12:15:06.094296 (+2383260us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001801d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:06.132089 (+ 37793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846805248}
I20260709 12:15:06.080017 12725 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:15:06.171695 12465 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:06.172158 12465 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:06.173225 12465 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:06.174865 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50574.6us
I20260709 12:15:06.177253 12149 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:06.178849 12149 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.181371 10126 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:06.183881 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.122530 10198 rpcz_store.cc:276] 0709 12:15:04.509247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.793132 (+283885us) service_pool.cc:224] Handling call
0709 12:15:04.793453 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:04.969108 (+175655us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:04.991595 (+ 22487us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.219677 (+228082us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.219858 (+   181us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:05.224401 (+  4543us) log.cc:844] Serialized 26 byte log entry
0709 12:15:05.224557 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:05.224843 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.225019 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.225096 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.724830 (+499734us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b1800293380. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a3522 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:05.734039 (+  9209us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:05.888209 (+154170us) raft_consensus.cc:1685] finished
0709 12:15:05.888254 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.888613 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178586,"prepare.queue_time_us":522708,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":3796,"raft.queue_time_us":204709,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":11517,"spinlock_wait_cycles":36777088,"thread_start_us":189919,"threads_started":1,"wal-append.queue_time_us":331461}
I20260709 12:15:06.154265 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.171399 12770 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.187086 12594 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:15:06.187139 12557 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:06.193233 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.162204 12628 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:06.204807 12776 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.206037 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.206542 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:06.208483 12607 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:06.210312 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1284) took 1410 ms. Trace:
I20260709 12:15:06.209977 12674 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.208580 10127 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:06.212644 11728 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:06.216907 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.213966 10123 rpcz_store.cc:276] 0709 12:15:04.799770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.860166 (+1060396us) service_pool.cc:224] Handling call
0709 12:15:05.861219 (+  1053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:05.863970 (+  2751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:05.864006 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:05.864761 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 12:15:06.083560 (+218799us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:06.083597 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.083661 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:06.210083 (+126422us) raft_consensus.cc:1685] finished
0709 12:15:06.210103 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:06.210255 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":218275,"threads_started":1,"wal-append.queue_time_us":322379}
W20260709 12:15:06.223839 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.222488 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:06.225673 10128 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:06.227438 12624 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:06.230587 11728 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.216512 12465 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:06.233882 10126 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:06.218263 12607 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:06.249297 10130 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:06.253098 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:06.254144 10046 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:06.258842 11728 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.262941 12775 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:06.263417 12400 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.231434 12776 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.274758 12674 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:06.275442 12674 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.276535 12674 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.277396 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.228068 12624 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:06.280333 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57113us
I20260709 12:15:06.283226 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.284159 10121 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:06.296105 12773 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:15:06.296540 12400 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:06.212003 12587 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 12:15:06.302590 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51800.2us
I20260709 12:15:06.303762 12604 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.305086 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.305606 12624 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.306731 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1710) took 1088 ms. Trace:
I20260709 12:15:06.307152 12624 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:06.297992 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.297991 10123 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:06.309190 10125 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:06.307145 10049 rpcz_store.cc:276] 0709 12:15:05.217945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.404123 (+186178us) service_pool.cc:224] Handling call
0709 12:15:06.306476 (+902353us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54002774d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:06.306645 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745459584}
I20260709 12:15:06.322726 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.324455 10046 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:06.263430 12775 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.333333 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.338774 10197 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:06.329887 10728 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:15:06.331007 12603 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:06.332547 12385 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.353511 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.356776 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.358590 12607 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.358736 12775 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.352499 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1192) took 1017 ms. Trace:
I20260709 12:15:06.344866 12459 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.338212 12776 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.346737 12628 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.369839 10054 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:06.365180 10195 rpcz_store.cc:276] 0709 12:15:05.335354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:05.635635 (+300281us) service_pool.cc:224] Handling call
0709 12:15:06.348303 (+712668us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54000e88d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:06.352457 (+  4154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572893440}
I20260709 12:15:06.366854 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.381037 12775 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.386549 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.386720 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:06.387897 12516 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:06.388567 12516 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:06.389029 12779 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:15:06.389513 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 83057.8us
I20260709 12:15:06.391085 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.351150 12594 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:15:06.392652 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.393677 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:06.394596 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.394778 10123 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:06.395193 12770 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.388312 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.351461 12766 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.392799 10055 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:06.387933 11728 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.367437 12603 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.411572 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:06.412438 10048 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:06.389912 12516 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.421726 10127 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:06.427415 10130 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:06.427574 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:06.371682 12385 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.430981 10121 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:06.430130 12646 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:15:06.414026 12628 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.441484 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.423105 10728 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:06.445737 12147 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:15:06.437965 12604 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:15:06.497777 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49938.3us
I20260709 12:15:06.442646 12594 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:15:06.517792 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87220.5us
I20260709 12:15:06.518710 10130 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:15:06.522586 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.522639 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:06.505682 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60659.2us
I20260709 12:15:06.522390 12547 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:15:06.525635 12781 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:15:06.526139 12547 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:06.527787 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 249105us
I20260709 12:15:06.526535 12547 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.520876 12594 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.528404 12557 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:06.550415 12547 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.555158 12557 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.553270 12555 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:15:06.552933 12785 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:15:06.554441 12385 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.555613 12547 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.557381 12557 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:06.557943 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:06.558344 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.539565 12769 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:06.558619 10734 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:06.559899 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.561064 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.562502 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.562681 12385 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.563623 12628 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.564177 10734 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:06.563737 12385 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.562505 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.565327 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.566444 12385 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.567378 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.567240 10737 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:06.568270 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 177280us
W20260709 12:15:06.569048 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.575709 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:06.577185 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.546940 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.567224 12459 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:06.591511 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46536.5us
I20260709 12:15:06.530921 12603 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.595201 12594 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.596666 12594 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:06.598058 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.571125 12555 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:06.605571 10737 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:06.605746 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.611526 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.607291 10049 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:06.620462 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:06.620795 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:06.621462 10195 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:06.621587 10204 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.623251 10203 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:06.625078 10197 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:06.629053 10734 raft_consensus.cc:2368] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:15:06.629987 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.586256 12459 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:06.613998 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5748534109998218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:15:06.631260 12459 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.632458 12385 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.633126 12385 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.635193 12385 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:06.635677 12385 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:06.632543 12459 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.637461 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.638259 10737 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:06.639457 10737 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:15:06.640688 10737 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:15:06.612983 12400 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:06.644878 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.646136 10048 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:06.648432 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 220576us
I20260709 12:15:06.647207 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.653438 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.580566 12604 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:15:06.610242 10728 raft_consensus.cc:2376] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6. Re-sending same reply.
I20260709 12:15:06.607286 12557 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:06.642850 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.655580 10204 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:06.657123 10123 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:15:06.662294 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 86687.9us
W20260709 12:15:06.665959 12784 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:15:06.669551 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.674553 10734 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:06.675539 10731 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:06.690780 12765 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.691327 12765 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:06.691727 12765 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.692116 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:06.696704 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.658560 12607 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:15:06.705938 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.709430 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.711195 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.715113 10200 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:06.715694 10200 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:06.716162 12778 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.588s	user 0.007s	sys 0.003s
I20260709 12:15:06.716740 10200 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.722777 12400 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:06.723424 12400 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.677202 12624 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:15:06.724481 12400 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.725402 10204 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:15:06.725946 12400 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.706198 12547 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:06.743449 12555 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.752241 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:06.760416 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 57139.9us
I20260709 12:15:06.771090 10197 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:06.772279 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.775988 10198 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:06.779250 12708 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.773533 10728 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:06.772032 12483 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.773456 12547 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:06.764714 12516 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.790831 10052 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:06.795243 10197 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:06.798709 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:06.790664 12624 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:15:06.800253 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.783751 12613 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.801084 12613 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.802093 10019 leader_election.cc:400] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:15:06.796373 11728 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:06.802843 12706 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:06.803432 12613 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.803052 12587 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:06.802860 11728 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.807379 11728 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:06.807065 12483 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.802404 10019 leader_election.cc:403] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:15:06.807632 12788 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:15:06.809799 12706 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:06.811025 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 131278us
I20260709 12:15:06.812179 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.812835 10729 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.770339 12725 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:15:06.815265 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.815939 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:06.815316 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77764.9us
I20260709 12:15:06.816622 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.823904 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.785329 12708 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:06.832890 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.809409 12483 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.840197 10053 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:06.841472 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.842005 10198 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:06.843201 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:06.829468 12674 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:06.831770 12769 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:15:06.846915 12770 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:06.847404 12770 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.847747 12770 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.853312 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.856612 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1195) took 1376 ms. Trace:
I20260709 12:15:06.831028 12578 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:15:06.857048 10202 rpcz_store.cc:276] 0709 12:15:05.477108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.053223 (+576115us) service_pool.cc:224] Handling call
0709 12:15:06.053886 (+   663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:06.131584 (+ 77698us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:06.207192 (+ 75608us) log.cc:844] Serialized 14 byte log entry
0709 12:15:06.342854 (+135662us) log.cc:844] Serialized 14 byte log entry
0709 12:15:06.344842 (+  1988us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:06.367272 (+ 22430us) log.cc:844] Serialized 26 byte log entry
0709 12:15:06.367446 (+   174us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:06.367483 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:06.367560 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:06.714844 (+347284us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b1800365b60. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:06.852781 (+137937us) raft_consensus.cc:1685] finished
0709 12:15:06.852807 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:06.852949 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94443,"prepare.queue_time_us":19408,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2602,"raft.queue_time_us":42759,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":24327,"spinlock_wait_cycles":9664256,"thread_start_us":135000,"threads_started":1,"wal-append.queue_time_us":195955}
I20260709 12:15:06.859167 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:06.859925 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 172436us
I20260709 12:15:06.861387 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.862249 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.870496 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:06.863214 12557 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:06.874881 12604 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:06.851158 12769 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:15:06.878716 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.881011 10053 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:06.881490 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.882819 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:06.893373 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67589.3us
I20260709 12:15:06.895361 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.892227 12604 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.896835 12578 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:06.893895 10202 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:06.900420 10735 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:06.883186 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:06.879191 12706 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:15:06.885457 12725 consensus_queue.cc:1243] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:15:06.911295 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:06.885366 12791 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:15:06.913728 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:06.891114 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.915102 10198 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:06.868634 12147 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:06.897105 12604 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.901329 10730 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.884300 10054 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:06.900594 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.896628 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.922886 10195 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:06.893177 12555 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:15:06.894995 12548 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:15:06.893262 12547 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.905838 12708 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:06.906587 10050 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:06.908670 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.909161 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.929808 10197 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:06.909401 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:06.910198 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.910391 10201 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:06.891881 12557 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:06.835579 12516 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.926404 12764 raft_consensus.cc:1064] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:15:06.927277 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.932301 10199 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:15:06.921860 12775 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:06.936451 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:06.919787 12147 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:06.935355 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43485.9us
I20260709 12:15:06.927037 12607 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:06.957208 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 46008.4us
I20260709 12:15:06.952550 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:06.953986 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:06.963404 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.945550 12708 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:06.952363 12147 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:06.948086 12806 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:06.964818 12385 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:06.966012 12769 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:15:06.984776  9952 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 265) took 20696 ms (client timeout 15000 ms). Trace:
I20260709 12:15:06.976405 12766 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:06.977705 12578 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:15:06.947144 12770 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.969249 12708 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.965193 12459 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:15:06.993052 10200 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:06.978246 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:06.982132 12624 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:06.985271  9952 rpcz_store.cc:269] 0709 12:14:46.288463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.288724 (+   261us) service_pool.cc:224] Handling call
0709 12:14:47.020162 (+731438us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6fa090 00007fc17e798f3a 00007fc18454ee9c 00007fc18464d04e 00007fc182b0e2a4 00007fc182b0e232 00007fc182b0e161 00007fc182b0e0dc 00007fc182b0d392 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:06.984557 (+19964395us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:59.984100 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:59.984759 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:59.984816 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:14:59.984834 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:59.985920 (+  1086us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:59.985997 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:59.986025 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:15:00.016071 (+ 30046us) tablet.cc:701] Row locks acquired
0709 12:15:00.016112 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:15:00.016293 (+   181us) write_op.cc:270] Start()
0709 12:15:00.016448 (+   155us) write_op.cc:276] Timestamp: P: 1783599300016226 usec, L: 0
0709 12:15:00.016463 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:15:00.017227 (+   764us) log.cc:844] Serialized 4422 byte log entry
0709 12:15:01.161154 (+1143927us) op_driver.cc:464] REPLICATION: finished
0709 12:15:02.127506 (+966352us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17b6860ac 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc1821c6ef0
0709 12:15:02.287671 (+160165us) write_op.cc:301] APPLY: starting
0709 12:15:02.301609 (+ 13938us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:02.366297 (+ 64688us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:02.366319 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:02.406128 (+ 39809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:02.406349 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:15:02.406397 (+    48us) write_op.cc:312] APPLY: finished
0709 12:15:02.466920 (+ 60523us) log.cc:844] Serialized 83 byte log entry
0709 12:15:02.523156 (+ 56236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:02.532745 (+  9589us) write_op.cc:454] Released schema lock
0709 12:15:02.532795 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:02.533156 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:02.533184 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20664,"reported_tablets":43,"spinlock_wait_cycles":81783552,"child_traces":[["op",{"apply.queue_time_us":1103826,"apply.run_cpu_time_us":13141,"apply.run_wall_time_us":252774,"num_ops":11,"prepare.queue_time_us":246469,"prepare.run_cpu_time_us":26915,"prepare.run_wall_time_us":539804,"raft.queue_time_us":252348,"raft.run_cpu_time_us":43256,"raft.run_wall_time_us":1089116,"replication_time_us":1144520,"spinlock_wait_cycles":54078848,"thread_start_us":1957000,"threads_started":5,"wal-append.queue_time_us":945703,"wal-append.run_cpu_time_us":19441,"wal-append.run_wall_time_us":2298273}]]}
I20260709 12:15:06.972273 12806 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:07.001119 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47238.4us
I20260709 12:15:07.001863 12385 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:07.007404 12385 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.007601 12147 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.009626 12147 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.010246 12547 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:07.010725 12547 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.011126 12547 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:07.016769 12604 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.018970 12764 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.019552 12483 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:07.020294 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.001717 12624 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.022573 12547 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.022992 12624 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:07.023824 10730 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:07.029623 10046 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:07.031837 10200 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:15:07.029713 12465 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:07.001757 12805 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:15:06.999598 12708 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:07.035670 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.037925 12147 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:07.036360 12587 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:07.042791 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.042255 12147 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:06.971997 12765 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.036288 10201 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:07.044852 12147 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.036525 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.045774 10195 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:15:07.046267 12765 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.035833 12604 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.038499 10731 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:07.046947 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.049093 12765 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:07.049407 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.050307 12775 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:07.042745 12587 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:07.051070 12809 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:15:07.051676 12587 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.050577 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.035439 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:07.053709 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.054836 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:07.052423 12775 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:07.056860 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.056998 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.056993 12765 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.057235 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.050681 12604 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:15:07.057859 10199 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:15:07.060946 10199 pending_rounds.cc:85] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:15:07.061266 10199 pending_rounds.cc:107] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:15:07.061489 10199 raft_consensus.cc:2889] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:07.058491 10202 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:07.062062 10204 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:07.023983 12806 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:07.063043 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 126679us
W20260709 12:15:07.063727 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.064478 10198 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:15:07.070819 10198 pending_rounds.cc:85] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:15:07.071102 10198 pending_rounds.cc:107] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:15:07.034315 12516 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.071344 10198 raft_consensus.cc:2889] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:07.071630 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:07.077134 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.063051 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:07.034775 12807 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:15:07.085178 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46215.8us
I20260709 12:15:07.095283 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:07.097077 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:07.094930 12804 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:15:07.097965 10731 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:07.062213 12459 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:07.084101 10019 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.861s (SENT) [suppressed 15 similar messages]
I20260709 12:15:07.100147 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.100179 12776 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:07.104918 10729 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:07.106671  9950 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 5, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.107643 12516 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:07.107930 12807 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:07.091109 12547 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.108850 10196 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:15:07.109676 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:07.110390 10046 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:07.129573 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.111647 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.116061 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.111210 10195 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:07.120087 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.125979 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.126179 12147 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:07.122545 12587 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:07.126806 10047 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:07.127115 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.127669 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.126649 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.118743 12776 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:07.111001 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.139663 10055 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:07.098340 12603 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.137780 10053 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:07.146202 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.130236  9950 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 6 to 9, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.112645 12459 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.132710 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:07.134464 10052 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:07.109614 12607 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.138306 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.138902 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.129953 10196 pending_rounds.cc:85] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 6
I20260709 12:15:07.160269 10196 pending_rounds.cc:107] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:15:07.160576 10196 raft_consensus.cc:2889] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:07.135236 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.138558 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.144655 10054 raft_consensus.cc:2410] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:07.150272 10049 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:15:07.150228 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66171us
I20260709 12:15:07.143786 12547 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:15:07.151989 12618 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.152846 12483 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:07.167496 12776 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.168771 12776 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:07.144060 12604 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:07.170740 12604 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.171087 12604 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:07.154364 12765 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:07.161659 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.162088 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:07.166898 12618 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.171103 10130 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:15:07.175256 10202 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:15:07.176123 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 43492.4us
I20260709 12:15:07.177621 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.178297 10054 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:07.183806 12708 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.187739 10050 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:07.188735 12708 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:07.195259 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 231876us
I20260709 12:15:07.199920 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:07.200850 10123 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:15:07.172962 12483 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:07.212142 10733 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:15:07.212271 10046 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:15:07.206710 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:07.208757 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 70306.3us
I20260709 12:15:07.159122 12674 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.158758 12578 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.158550 12459 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:07.213176 10049 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:07.220705 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.228338 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.229043 10130 raft_consensus.cc:2410] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:07.219429 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.163934 12548 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:07.207372  9950 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 5, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.195889 12765 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:07.225023 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.226141 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:07.195721 12547 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.230682 10200 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:07.226780 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.233724 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.237519 10130 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:15:07.234787 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:07.236778 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.236316 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.236644 10127 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:07.232947 11728 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:15:07.241343 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:07.162514 12147 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.244367 10123 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:07.245188 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:07.196651 12725 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:15:07.249699 10732 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:07.249148 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:07.201946 12516 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:15:07.242755  9950 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 5 to 6, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:07.226361 12776 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.257007 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.232088 12770 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:07.261931 10127 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:07.235416 12400 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.265981 10121 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:07.235355 12765 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.246062 12607 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.223455 12769 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:15:07.274712 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49733.8us
I20260709 12:15:07.275323 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.222955 12766 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:15:07.276785 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 56333.6us
I20260709 12:15:07.280767 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:07.316939 10051 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:15:07.317459 10051 pending_rounds.cc:85] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 2
I20260709 12:15:07.317718 10051 pending_rounds.cc:107] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:15:07.317997 10051 raft_consensus.cc:2889] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:07.274071 12725 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:07.318738  9950 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 2 to 7, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.320005 12725 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:07.320569 12725 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:07.322046 12793 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.321805 12624 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.319346 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:07.323397 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:07.322256 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 46811.5us
I20260709 12:15:07.320768  9950 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 8, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.227907 12674 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.273224 12765 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:07.343889 10127 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:07.351678 11728 consensus_queue.cc:1243] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:07.355001 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.355790 10121 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:07.359163 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 117865us
I20260709 12:15:07.361220 10204 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:07.371276 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:07.372053 10200 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:07.373740 10129 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:07.246157 12548 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:07.377331 10196 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:07.379228 10048 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:15:07.381575 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 58260.1us
I20260709 12:15:07.385179 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:07.376480 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 143735us
I20260709 12:15:07.333312 12706 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.260605 12547 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.274583 12775 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:15:07.353721 12578 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:07.409001 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.353236 12770 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:07.379140 12613 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:07.405189 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:07.379477 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.412034 12400 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.409755 10121 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:07.416208 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:07.423661 12516 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.423782 12817 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:15:07.425102 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.269665 12483 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.424834 12813 raft_consensus.cc:2764] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:15:07.425755 12816 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:15:07.321547 12725 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.437422 10127 raft_consensus.cc:2368] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:15:07.248931 12807 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:07.448596 12819 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:15:07.428560 10124 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:07.425940 12400 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.443799 12812 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.443635 12516 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.420451 12613 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:07.460062 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54947.6us
I20260709 12:15:07.419947 12607 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:15:07.442927 10200 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:15:07.456673 12557 consensus_meta.cc:287] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.005s
I20260709 12:15:07.445042 12706 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.511021 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.512989 10127 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:07.497390  9950 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 5 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:15:07.495821 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.499574 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.514218 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.461143 12770 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.445245 12578 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:15:07.511588 12813 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:07.557303 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:07.519419 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.562342 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:07.560782 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:07.502471 12483 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:07.559228 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:07.564899 10048 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:07.566128 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.563943 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:07.569458 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 294185us
I20260709 12:15:07.570936 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:07.559760 12822 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:15:07.516431 12823 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:07.570945 10124 raft_consensus.cc:2410] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:15:07.557015 12725 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:07.574257 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:07.578298 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.581198 10130 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:07.582840 10051 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:07.322688 12793 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.576506 12147 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.556110 12813 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.586140 12618 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.595392 12400 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.599491 12604 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.585700 12613 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.592360 12835 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:07.607565 12674 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:07.607174 12465 consensus_meta.cc:287] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 12:15:07.608968 12832 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.518460 12557 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.609867  9950 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.601442 10048 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:07.611608 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:07.614271 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.653477 10125 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:07.593624 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.654392 10121 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:07.573011 12770 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.504190 12812 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:07.516597 12706 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.639312 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:07.663021 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:07.665056 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.668485 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.615630 12604 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:07.620252 12516 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.594519 12624 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:07.618652 12835 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:07.603240 12813 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:07.594794 12548 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:07.618065 12793 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:07.609135 12823 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 12:15:07.842104 10197 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:15:07.747752 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 374328us
I20260709 12:15:07.651643 12465 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.661409 12832 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:07.718825 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:07.930729 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 351610us
I20260709 12:15:07.751415  9950 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 5, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:07.706709 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.493091 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:07.920599 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 309050us
I20260709 12:15:07.826843 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:08.490502 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:07.854791 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 244272us
I20260709 12:15:08.516664 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2011) took 1260 ms. Trace:
W20260709 12:15:08.513250 10127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.008s	sys 0.006s
W20260709 12:15:08.517215 10127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.008s	sys 0.007s
I20260709 12:15:07.856961 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:08.511724 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:08.121459 12604 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:08.260655 12483 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.000s
I20260709 12:15:08.526690 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:08.526778 12848 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:15:08.527832 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.526271 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:08.224642 12725 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.001s
I20260709 12:15:08.517089 10054 rpcz_store.cc:276] 0709 12:15:07.230773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.232090 (+  1317us) service_pool.cc:224] Handling call
0709 12:15:07.232388 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.688214 (+455826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.688242 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.688788 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.854512 (+165724us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:07.854930 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.855313 (+   383us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.490419 (+635106us) raft_consensus.cc:1685] finished
0709 12:15:08.490463 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.490631 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19961,"raft.queue_time_us":158981,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4484,"thread_start_us":585320,"threads_started":2,"wal-append.queue_time_us":771983}
I20260709 12:15:08.492630  9950 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 2 to 4, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 4 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:15:07.814999 12821 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.571s	user 0.003s	sys 0.000s
W20260709 12:15:08.456137 12806 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.357s	user 0.012s	sys 0.000s
W20260709 12:15:08.473172 12854 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:15:08.290568 12838 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.452741 12770 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.523123 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:07.841820 12776 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:08.295799 12847 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:15:08.298152 12765 consensus_meta.cc:287] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.905s	user 0.008s	sys 0.000s
I20260709 12:15:08.523602 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:07.778587 12826 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.530385 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:08.450106 12849 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 12:15:08.290247 12829 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 12:15:07.709609 12824 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:08.261060 12459 consensus_meta.cc:287] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.996s	user 0.007s	sys 0.003s
I20260709 12:15:08.484803 12850 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:07.781327 12587 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.566362 12587 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:08.566828 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2013) took 1321 ms. Trace:
I20260709 12:15:08.290148 12835 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.567082 12836 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:15:08.567250 10053 rpcz_store.cc:276] 0709 12:15:07.245219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.245410 (+   191us) service_pool.cc:224] Handling call
0709 12:15:07.263607 (+ 18197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.323817 (+ 60210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.323848 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.366654 (+ 42806us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.650220 (+283566us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:07.650267 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.650345 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.566575 (+916230us) raft_consensus.cc:1685] finished
0709 12:15:08.566594 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.566755 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11709,"raft.queue_time_us":140746,"spinlock_wait_cycles":2611072,"thread_start_us":236154,"threads_started":1,"wal-append.queue_time_us":261060}
I20260709 12:15:08.568104 12459 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.537230 12838 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.570649 12838 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:08.568524 12587 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:08.571668 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1909) took 1394 ms. Trace:
I20260709 12:15:08.562099 12765 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.572038 10126 rpcz_store.cc:276] 0709 12:15:07.177511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.177737 (+   226us) service_pool.cc:224] Handling call
0709 12:15:07.218868 (+ 41131us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:07.229334 (+ 10466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.229356 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:07.249628 (+ 20272us) log.cc:844] Serialized 52 byte log entry
0709 12:15:07.459875 (+210247us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:07.459931 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.459994 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.571429 (+1111435us) raft_consensus.cc:1685] finished
0709 12:15:08.571450 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.571610 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":934,"raft.queue_time_us":1326,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15529,"thread_start_us":130183,"threads_started":1,"wal-append.queue_time_us":243155}
I20260709 12:15:08.573901 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:08.570879 10128 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:08.574708 12850 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.575187 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.576493 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.577602 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.577872 12850 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:08.578501 10126 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:08.579741 10126 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:15:07.840340 12807 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.579845 12824 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.580112 10126 pending_rounds.cc:85] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:15:08.165367 12837 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:07.779210 10728 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:08.535923 10201 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:08.535262 12806 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.536839 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:07.811542 12557 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.532537 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:08.128883 12628 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.588390 12628 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.515774 12812 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:08.520826 12706 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.539680  9950 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 6 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:08.525861 12604 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.587601 10125 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:08.591248  9950 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 4, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 4 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:08.561615 12842 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:15:08.592240 12604 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:08.593120 12604 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:08.581076 10126 pending_rounds.cc:107] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:15:08.592228 10125 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:08.587637 10729 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:08.593338  9950 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 5, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:08.594300 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1914) took 1195 ms. Trace:
I20260709 12:15:08.593839 10126 raft_consensus.cc:2889] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:08.570171 12459 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.594901 12628 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:08.595182 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1913) took 1229 ms. Trace:
I20260709 12:15:08.561064 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:08.588752 12806 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.595520 12604 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:08.596438 12826 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.597867 12604 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.574132 12765 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.594660 10125 rpcz_store.cc:276] 0709 12:15:07.398956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.591578 (+1192622us) service_pool.cc:224] Handling call
0709 12:15:08.591910 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.594050 (+  2140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.594241 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:08.595582 10126 rpcz_store.cc:276] 0709 12:15:07.365546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.579117 (+1213571us) service_pool.cc:224] Handling call
0709 12:15:08.579417 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.594948 (+ 15531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.595130 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:08.603896 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 71434.8us
I20260709 12:15:08.604840 12812 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:08.605929 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 325) took 1396 ms. Trace:
I20260709 12:15:08.611699 10129 rpcz_store.cc:276] 0709 12:15:07.209384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.218899 (+  9515us) service_pool.cc:224] Handling call
0709 12:15:07.238771 (+ 19872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:07.374190 (+135419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.605704 (+1231514us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5400408154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:08.605874 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217617664}
I20260709 12:15:08.612557 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:08.615072 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:08.627488 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:08.564409 12770 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:08.590502 12824 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.629420 10129 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:15:08.630915 10125 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:08.627313  9950 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 5, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 5 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:08.632848 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1298) took 1116 ms. Trace:
I20260709 12:15:08.633204 10125 rpcz_store.cc:276] 0709 12:15:07.516673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.602501 (+1085828us) service_pool.cc:224] Handling call
0709 12:15:08.630739 (+ 28238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.632587 (+  1848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.632784 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:08.633716 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:08.542855 12776 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.598968 12826 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.609930 12842 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:08.634879 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1304) took 1019 ms. Trace:
I20260709 12:15:08.661473 10129 rpcz_store.cc:276] 0709 12:15:07.613548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.612617 (+999069us) service_pool.cc:224] Handling call
0709 12:15:08.629067 (+ 16450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.632385 (+  3318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.632644 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:08.629774 12557 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:08.663590  9950 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 2 to 7, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:08.634274 12807 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:08.675400 10125 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:15:08.678968 12861 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:15:08.682035 12837 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.682845 12837 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:15:08.683127 12857 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:08.684760 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2010) took 1476 ms. Trace:
I20260709 12:15:08.685122 10052 rpcz_store.cc:276] 0709 12:15:07.208240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.208404 (+   164us) service_pool.cc:224] Handling call
0709 12:15:07.231860 (+ 23456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.673909 (+442049us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:07.673944 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.853668 (+179724us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.442058 (+588390us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:08.442107 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.442186 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.684541 (+242355us) raft_consensus.cc:1685] finished
0709 12:15:08.684561 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.684704 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50524,"raft.queue_time_us":35215,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":56209,"thread_start_us":734951,"threads_started":2,"wal-append.queue_time_us":467556}
I20260709 12:15:08.687996 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 327) took 1165 ms. Trace:
I20260709 12:15:08.688371 10050 rpcz_store.cc:276] 0709 12:15:07.522173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.522874 (+   701us) service_pool.cc:224] Handling call
0709 12:15:07.566252 (+ 43378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.566546 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:07.566573 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.580922 (+ 14349us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.062885 (+481963us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:08.062932 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.063005 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.687790 (+624785us) raft_consensus.cc:1685] finished
0709 12:15:08.687807 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.687932 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42752,"thread_start_us":400933,"threads_started":1,"wal-append.queue_time_us":1047511}
I20260709 12:15:08.693372 12776 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.635962 12628 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:15:08.642715 12604 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.701871 12604 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.703925 12547 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:08.704348 12604 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:08.705286 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 71638.9us
I20260709 12:15:08.671972 12459 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.709120 12459 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.711397 12459 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.716566 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:08.636546 12385 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:08.733659  9950 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 5, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:08.718168 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 184302us
I20260709 12:15:08.702572 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 328) took 1470 ms. Trace:
I20260709 12:15:08.674261 12842 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:08.673998 12807 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:08.722869 10203 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:15:08.747790 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 221233us
I20260709 12:15:08.740049 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:08.674386 12770 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:15:08.756482 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:08.757115 10732 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:08.737161 10123 rpcz_store.cc:276] 0709 12:15:07.237356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.257414 (+ 20058us) service_pool.cc:224] Handling call
0709 12:15:07.257752 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:07.561578 (+303826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.561693 (+   115us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:07.577251 (+ 15558us) log.cc:844] Serialized 52 byte log entry
0709 12:15:07.982958 (+405707us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:07.983007 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.702130 (+719123us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000992d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:08.702181 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.702225 (+    44us) raft_consensus.cc:1685] finished
0709 12:15:08.702238 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:08.702506 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18552,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9204,"spinlock_wait_cycles":373753600,"thread_start_us":372144,"threads_started":2,"wal-append.queue_time_us":942878}
I20260709 12:15:08.751652  9950 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 4, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 4 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:08.762838  9950 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 4, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 4 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:08.763569 12832 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:08.748772 10731 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:08.764539 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:08.766011 10736 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:08.769765 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.770371 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:08.769474 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1227) took 1432 ms. Trace:
I20260709 12:15:08.778649 10201 rpcz_store.cc:276] 0709 12:15:07.336816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.337669 (+   853us) service_pool.cc:224] Handling call
0709 12:15:07.367279 (+ 29610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.587009 (+1219730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.757283 (+170274us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:08.769400 (+ 12117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686880640}
I20260709 12:15:08.774680 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:08.781405 10125 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:08.733059 12628 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:15:08.793946 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:08.795085 10123 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:15:08.751010 12807 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:08.773919 10129 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:08.926582  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:08.787968  9950 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } }
I20260709 12:15:08.756034 12557 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 12:15:08.801990 12604 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.009773 12604 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:09.012158 12604 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.012727 12604 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.013191 12604 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:08.983964  9950 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:08.986996 12867 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.986625 12842 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:08.988063 10129 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:15:09.055097 10125 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:08.995684 12459 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:09.002830 10732 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:09.059748 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1908) took 1847 ms. Trace:
I20260709 12:15:09.006507 12869 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:15:09.024776 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 359079us
I20260709 12:15:09.060182 10128 rpcz_store.cc:276] 0709 12:15:07.177198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.177664 (+   466us) service_pool.cc:224] Handling call
0709 12:15:09.024434 (+1846770us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:09.024607 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3087971072}
W20260709 12:15:09.107911 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.216537 10198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.018s
W20260709 12:15:09.273078 10198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.011s	sys 0.018s
I20260709 12:15:09.289114 11728 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.289906 11728 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:09.289098 10020 connection.cc:256] RPC call timeout handler was delayed by -1.5158469129999048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:15:09.294780 10020 connection.cc:256] RPC call timeout handler was delayed by -1.39704691299994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:15:09.295153 10020 connection.cc:256] RPC call timeout handler was delayed by -1.3853469129999212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:15:09.295439 10020 connection.cc:256] RPC call timeout handler was delayed by -1.3313469130000612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 12:15:09.295787 10020 connection.cc:256] RPC call timeout handler was delayed by -1.3250469130000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:15:09.296068 10020 connection.cc:256] RPC call timeout handler was delayed by -1.2503469129999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:15:09.296227 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.297073 10197 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:09.296437 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:09.227360 12839 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:09.298051 10195 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:09.296325 10020 connection.cc:256] RPC call timeout handler was delayed by -1.2467469129999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:15:09.298386 10199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.030s
I20260709 12:15:09.302649 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.298866 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.118417 12459 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:09.303468 10199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.002s	sys 0.030s
W20260709 12:15:09.303002 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.020s
I20260709 12:15:09.331123 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:09.335109 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.021s
I20260709 12:15:09.335340 10201 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:09.336427 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.311614 10202 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:15:09.303808 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.024s
I20260709 12:15:09.339026 11728 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.290650 12826 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.340209 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.011s	sys 0.025s
W20260709 12:15:09.340615 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 632724us
W20260709 12:15:09.335391 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 581483us
I20260709 12:15:09.342561 10168 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:09.349921 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.350945 10204 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:09.102873 12867 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.353008 11728 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:09.293033 12850 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.363070 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.382587 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:09.391016 10196 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:09.392042 10202 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:15:09.386679 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45358.5us
W20260709 12:15:09.401130 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.014s
W20260709 12:15:09.401520 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.014s
I20260709 12:15:09.401919 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:09.311914 12764 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.304190 12836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.027s
W20260709 12:15:09.408979 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 96314.2us
I20260709 12:15:09.418524 11728 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:15:09.420948 10126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.029s
W20260709 12:15:09.421891 10126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.008s	sys 0.030s
W20260709 12:15:09.393110 10701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.005s
W20260709 12:15:09.422827 10701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.005s
I20260709 12:15:09.330896 12628 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:15:09.400875 12876 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:09.427546 10732 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:09.351410 12770 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:15:09.463661 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.412329 12604 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.465003 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:09.438059 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.439251 10730 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:09.465240 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.466076 10733 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:15:09.467537 11728 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:09.465692 10731 raft_consensus.cc:2376] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7. Re-sending same reply.
I20260709 12:15:09.470074 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.338699 12839 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.414753 12850 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.416241 12764 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.491138 12548 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:09.491659 12548 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.403931 12826 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:09.492000 12548 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.493588 12826 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.433233 12879 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:15:09.500645 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:09.503576 12459 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.504184 12459 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.504690 12459 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:09.507192 12548 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.509348 12548 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:09.509928 12807 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.571s	user 0.003s	sys 0.004s
I20260709 12:15:09.474490 12604 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.514488 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 593) took 1825 ms. Trace:
I20260709 12:15:09.515905 11728 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:09.526697 10196 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:09.533353 11728 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:09.518878 12766 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:09.522547 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.523259 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.523667 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.535665 10195 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:09.523694 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:09.531906 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 61909.7us
I20260709 12:15:09.542196 10203 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:09.536767 10202 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:09.543728 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.544507 10202 raft_consensus.cc:2410] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:15:09.538002 10729 rpcz_store.cc:276] 0709 12:15:07.689057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.689205 (+   148us) service_pool.cc:224] Handling call
0709 12:15:07.689569 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.594184 (+904615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.514162 (+919978us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400159d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:09.514381 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064875904}
I20260709 12:15:09.548362 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:09.549059 10201 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:09.549681 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.550593 10196 raft_consensus.cc:2410] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:09.552002 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.491784 12764 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.500563 12879 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.553946 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:09.554246 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.503814 12867 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.552691 10203 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:09.567385 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.574038 10198 raft_consensus.cc:2410] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:09.568418 10202 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:09.575784 10202 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:15:09.524667 12826 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.597337 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 247678us
I20260709 12:15:09.568531 10195 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:09.599288 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:09.595682 12764 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:09.553313 12516 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.599643 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62119.9us
I20260709 12:15:09.596421 11728 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.577523 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:09.597460 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.471153 12876 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:09.569764 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 227338us
I20260709 12:15:09.608454 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:09.613088 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:09.597855 12872 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:09.566833 12886 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:09.510407 12807 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.618148 11728 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:09.617713 10020 leader_election.cc:400] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 4 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 4. Current term is 5.
I20260709 12:15:09.608948 12776 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.618902 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:09.571954 12604 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:09.725028 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 107457us
I20260709 12:15:09.725927 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:09.728652 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 105407us
I20260709 12:15:09.572156 12879 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.621119 12548 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.734241 11728 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:09.734714 11728 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.735038 11728 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:09.624480 12890 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.611263 12516 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:09.733541 12882 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:15:09.737417 12884 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:09.612206 12826 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.730037 12628 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:09.756172 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:09.773152 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 373638us
I20260709 12:15:09.774472 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:09.727823 12776 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:09.777171 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51340.1us
I20260709 12:15:09.752930 12806 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:09.782544 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.752120 12884 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:09.625139 12886 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.786062 12864 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:09.758046 12885 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:09.743667 12548 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:09.796393 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 295831us
I20260709 12:15:09.759442 12628 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:09.825601 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.834246 11728 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:09.847661 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.827831 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.850307 10729 raft_consensus.cc:2410] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:15:09.753201 12890 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:09.797577 12764 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:09.797760 12885 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.854323 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.863524 10737 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:09.865152 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 326) took 2614 ms. Trace:
I20260709 12:15:09.865628 10122 rpcz_store.cc:276] 0709 12:15:07.209640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.209754 (+   114us) service_pool.cc:224] Handling call
0709 12:15:07.242384 (+ 32630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.416205 (+173821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.416238 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.443899 (+ 27661us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.651295 (+207396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:07.651329 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.823652 (+2172323us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400173754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:09.823695 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:09.823738 (+    43us) raft_consensus.cc:1685] finished
0709 12:15:09.823749 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.824144 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12750,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":5577,"spinlock_wait_cycles":346632064,"thread_start_us":202320,"threads_started":1,"wal-append.queue_time_us":690412,"wal-append.run_cpu_time_us":13340,"wal-append.run_wall_time_us":1456598}
I20260709 12:15:09.867534 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.854631 12873 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:15:09.871351 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 443) took 2788 ms. Trace:
I20260709 12:15:09.871786 10728 rpcz_store.cc:276] 0709 12:15:07.083018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.085443 (+  2425us) service_pool.cc:224] Handling call
0709 12:15:07.105478 (+ 20035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.586734 (+1481256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.871067 (+1284333us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54006455d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:09.871258 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409542912}
W20260709 12:15:09.875294 12859 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.340s	user 0.000s	sys 0.017s
I20260709 12:15:09.875423 12764 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:09.877230 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.797971 12884 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.878118 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 330) took 2606 ms. Trace:
I20260709 12:15:09.883611 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.798913 12864 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.834949 12891 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:15:09.822535 12770 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:09.888701 10201 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:09.889751 12516 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:09.890659 12628 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.796809 12806 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.833827 12836 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:09.884027 10124 rpcz_store.cc:276] 0709 12:15:07.272163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.582933 (+310770us) service_pool.cc:224] Handling call
0709 12:15:07.593846 (+ 10913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.610937 (+ 17091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.610971 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.709160 (+ 98189us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.208265 (+499105us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:08.208310 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.208383 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:09.874725 (+1666342us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:09.877843 (+  3118us) raft_consensus.cc:1685] finished
0709 12:15:09.877864 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.878063 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16610,"raft.queue_time_us":16776,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":13274368,"thread_start_us":156450,"threads_started":1,"wal-append.queue_time_us":677639}
I20260709 12:15:09.905508 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:09.885520 12864 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:09.821938 12894 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 12:15:09.934329 10198 raft_consensus.cc:2410] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:09.883486 12885 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:09.936736 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 325233us
I20260709 12:15:09.941545 10730 raft_consensus.cc:1217] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-7.8]   Dedup: 5.7->[7.8-7.8]
I20260709 12:15:09.942090 10730 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: [4.6-7.8]
I20260709 12:15:09.938576 10203 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:09.936780 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:09.906296 12850 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.940882 12770 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:09.951908 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:09.948572 12826 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.931113 12516 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:15:09.957393 12873 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.981314 12886 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.951483 12839 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.957497 12901 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.980221 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:09.983492 10737 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:15:09.984081 12899 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:09.958845 12894 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:09.961045 12892 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:15:09.964363 12895 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:09.989610 12906 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:09.957690 12903 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:09.990518 12900 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:10.058535 12900 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:09.992714 12776 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.966343 12807 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:09.982354 12770 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.969864 12548 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:09.944839 12836 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:09.995577 12879 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:10.036540 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 273804us
I20260709 12:15:09.999054 10728 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:15:10.076131 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:10.054908 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:10.056375 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1300) took 2469 ms. Trace:
I20260709 12:15:10.013715 12894 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:10.035396 12887 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:10.075229 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:10.087610 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:10.035084 12876 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:10.098183 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.077112 10126 rpcz_store.cc:276] 0709 12:15:07.586769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.611757 (+1024988us) service_pool.cc:224] Handling call
0709 12:15:08.612099 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:08.626457 (+ 14358us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:08.749012 (+122555us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.763128 (+1014116us) log.cc:844] Serialized 14 byte log entry
0709 12:15:10.055709 (+292581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:10.055768 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:10.055938 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.056168 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.056309 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23916,"prepare.queue_time_us":588158,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3433,"raft.queue_time_us":379081,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":16771,"spinlock_wait_cycles":15169536,"thread_start_us":1380976,"threads_started":4,"wal-append.queue_time_us":838723}
I20260709 12:15:09.998953 12873 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:10.100363 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 300757us
I20260709 12:15:10.127840 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:10.122259 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 347872us
I20260709 12:15:10.189329 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:10.104111 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:10.122735 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 297210us
I20260709 12:15:10.193097 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:10.198388 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:10.070951 12842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.016s
W20260709 12:15:10.238302 10196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.047s	sys 0.051s
W20260709 12:15:10.238781 10196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.048s	sys 0.051s
W20260709 12:15:10.239830 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 135808us
I20260709 12:15:10.240696 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.187918 10737 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
W20260709 12:15:10.236203 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45857.7us
W20260709 12:15:10.236469 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48926.1us
I20260709 12:15:10.013324 12901 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:10.246873 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:10.250871 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:10.252355 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:10.238600 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.255893 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.256466 10195 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:10.257416 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.059440 12900 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.254208 10054 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:10.251731 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:10.266268 10128 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:10.121976 12879 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:10.269027 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:10.270013 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 77015us
I20260709 12:15:10.270447 12873 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:10.101985 12776 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:10.270798 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:10.272157 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.264724 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:10.246670 12842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.002s	sys 0.016s
I20260709 12:15:10.101589 12807 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:10.241667 12850 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:10.297559 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.298137 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.344609 10053 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:10.350157 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.271092 12776 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:10.299937 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:10.254941 12766 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.002s
I20260709 12:15:10.236405 12839 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.114123 12887 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:10.327955 12886 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:15:10.367659 12776 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:10.266788 10126 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:10.246312 12876 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:10.395018 12876 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:10.395603 12876 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:10.395831 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:10.245929 12578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.028s	sys 0.035s
I20260709 12:15:10.396095 12839 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:10.396634 12578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.028s	sys 0.036s
I20260709 12:15:10.314913 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:10.402756 10050 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.404867 12885 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.406134 10735 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:10.328326 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:10.406906 10737 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:10.357266 12894 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:10.329522 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:10.408517 12905 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 12:15:10.253438 12914 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:10.409240 12914 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:10.409677 12914 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:10.409936 12915 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:10.359905 12900 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:10.264715 12898 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:10.295702 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 237846us
I20260709 12:15:10.411166 12884 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:10.244827 12826 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:15:10.442251 12876 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:10.442925 12826 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:10.443908 12826 raft_consensus.cc:2764] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:15:10.444557 12826 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:10.444728 12876 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:10.445164 12898 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.445432 12876 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:10.273007 12904 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.448019 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.313359 12917 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:10.369437 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71980.4us
I20260709 12:15:10.416460 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.449205 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.114346 12903 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.301376 12806 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:10.416816 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:10.472648 10125 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:10.450891 10047 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:10.462870 10121 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:10.508922 10050 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:10.385200 12766 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.505350 12886 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:15:10.361439 12823 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:15:10.515738 12918 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.348040 12807 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.385483 12892 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:10.517922 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 423) took 1200 ms. Trace:
W20260709 12:15:10.518572 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 246445us
I20260709 12:15:10.572547 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.519601 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:10.560112 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 110989us
I20260709 12:15:10.574609 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.487382 12898 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:10.398279 12839 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:10.563344 12826 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:10.416860 12850 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:15:10.514763 12806 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.446008 12876 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.585904 10049 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:10.592038 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.569564 10197 rpcz_store.cc:276] 0709 12:15:09.317197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.317353 (+   156us) service_pool.cc:224] Handling call
0709 12:15:09.317748 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:09.318141 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:09.608029 (+289888us) log.cc:844] Serialized 14 byte log entry
0709 12:15:09.958563 (+350534us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:09.959106 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:15:09.960810 (+  1704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:09.960844 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.961447 (+   603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:10.517695 (+556248us) raft_consensus.cc:1685] finished
0709 12:15:10.517715 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.517855 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415184,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":53,"raft.queue_time_us":185502,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":19973,"thread_start_us":412544,"threads_started":2,"wal-append.queue_time_us":398961}
I20260709 12:15:10.607057 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.583590 12884 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:10.611868 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:10.560773 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 144378us
W20260709 12:15:10.612496 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 365696us
I20260709 12:15:10.585238 12149 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:10.589224 12894 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:10.625926 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:10.600795 12873 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:10.599305 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:10.640573 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.644847 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.613018 12613 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:10.666253 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.667501 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.668246 10054 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:10.514436 12903 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.620668 12879 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:10.670653 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1492694910000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 12:15:10.678198 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.678889 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:10.621289 12149 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:10.627489 12867 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:10.691884 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:10.695477 10203 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.695151 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:10.586555 12917 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:15:10.634653 12901 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:10.600461 12806 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.636513 12892 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:10.677891 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59078.4us
I20260709 12:15:10.695266 10052 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:10.713937 10125 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:10.699023 10055 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:10.775058 10051 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:15:10.772931 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77895.7us
I20260709 12:15:10.776388 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:10.736485 10046 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:10.681376 10728 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.778133 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:10.711233 12920 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:10.682327 12884 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:10.924593 10129 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:10.928532 10122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.001s	sys 0.005s
W20260709 12:15:10.712304 12853 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 2.211s	user 0.022s	sys 0.064s
I20260709 12:15:10.922699 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:10.770735 12149 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:10.933919 10730 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:15:10.708956 12883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.010s
I20260709 12:15:10.905118 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:15:10.710474 12860 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 2.196s	user 0.007s	sys 0.026s
W20260709 12:15:10.736698 12921 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:15:10.928877 10122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.001s	sys 0.005s
I20260709 12:15:10.928185 10733 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
W20260709 12:15:10.879228 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 86981.9us
I20260709 12:15:10.680791 12823 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:10.711181 12910 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:15:10.875844 12863 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 2.256s	user 0.017s	sys 0.039s
I20260709 12:15:10.708765 12928 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.708848 12911 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.613998 12887 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:10.953971 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.952790 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:10.708590 12916 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.709717 12912 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.712453 12941 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:10.713428 12836 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:10.924862 12867 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:10.967523 10196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.014s	sys 0.019s
W20260709 12:15:10.990159 10196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.014s	sys 0.019s
I20260709 12:15:10.777654 12339 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:10.712097 12826 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:10.945741 12883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.012s	sys 0.015s
I20260709 12:15:10.878824 12936 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:10.972023 12776 consensus_meta.cc:287] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.003s
I20260709 12:15:10.983002 10197 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:10.953791 12885 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:10.920843 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 144229us
I20260709 12:15:10.990335 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:10.979113 12807 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.011787 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:10.990857 12339 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:10.878674 12903 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.014508 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.015980 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:11.035207 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:11.035925 10126 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:10.980187 12823 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.037519 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 331) took 3674 ms. Trace:
I20260709 12:15:11.060218 10130 rpcz_store.cc:276] 0709 12:15:07.363195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.598258 (+235063us) service_pool.cc:224] Handling call
0709 12:15:07.600902 (+  2644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.612416 (+ 11514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.612445 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.612950 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:15:07.839468 (+226518us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:07.839509 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:07.839575 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:10.711476 (+2871901us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:11.030035 (+318559us) raft_consensus.cc:1685] finished
0709 12:15:11.030058 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.037448 (+  7390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9776,"raft.queue_time_us":10787,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":38256512,"thread_start_us":226136,"threads_started":1,"wal-append.queue_time_us":888053}
W20260709 12:15:11.014719 12920 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:15:11.037097 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:11.062341 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:10.992625 12836 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:11.057964 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:11.110726 10126 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.112540 12937 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:11.065733 10130 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
W20260709 12:15:11.111907 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74864.7us
I20260709 12:15:10.979540 12928 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:11.065181 12860 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:11.116739 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 329) took 3868 ms. Trace:
I20260709 12:15:11.116942 10130 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:11.031133 12339 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:11.037539 12839 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:11.013687 12776 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.121822 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1747) took 1042 ms. Trace:
I20260709 12:15:11.077301 12836 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.120126 10127 rpcz_store.cc:276] 0709 12:15:07.247892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.579567 (+331675us) service_pool.cc:224] Handling call
0709 12:15:07.579934 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:07.592717 (+ 12783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:07.592751 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:07.651237 (+ 58486us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.517694 (+866457us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:08.517773 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.517847 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:10.712412 (+2194565us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:11.083072 (+370660us) raft_consensus.cc:1685] finished
0709 12:15:11.083096 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.116676 (+ 33580us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13319,"raft.queue_time_us":27337,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"spinlock_wait_cycles":16733824,"thread_start_us":799543,"threads_started":1,"wal-append.queue_time_us":795658}
I20260709 12:15:11.136595 10195 rpcz_store.cc:276] 0709 12:15:10.079042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.408990 (+329948us) service_pool.cc:224] Handling call
0709 12:15:10.563032 (+154042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.604923 (+ 41891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.605046 (+   123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:10.606303 (+  1257us) log.cc:844] Serialized 26 byte log entry
0709 12:15:10.966961 (+360658us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:10.967002 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.967079 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.121621 (+154542us) raft_consensus.cc:1685] finished
0709 12:15:11.121643 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.121767 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10179,"raft.queue_time_us":46198,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":42295,"thread_start_us":287329,"threads_started":1,"wal-append.queue_time_us":424806}
W20260709 12:15:11.110605 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45443.1us
I20260709 12:15:11.033638 12876 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:11.134418 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 101469us
I20260709 12:15:11.037804 12938 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:15:10.995476 12941 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.149652 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:11.148751 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.033380 12904 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:15:11.121934 12898 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.159344 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.136014 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1737) took 1586 ms. Trace:
I20260709 12:15:10.993495 12867 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.113027 12937 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:11.168975 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:11.170266 10048 raft_consensus.cc:2410] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:15:11.172775 10019 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.167013 10196 rpcz_store.cc:276] 0709 12:15:09.549386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.561705 (+ 12319us) service_pool.cc:224] Handling call
0709 12:15:09.562050 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.562266 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:10.239181 (+676915us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.135567 (+896386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:11.135635 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:11.135692 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.135771 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.135934 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55156,"prepare.queue_time_us":198231,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":87099,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2660,"thread_start_us":1493197,"threads_started":3,"wal-append.queue_time_us":873460}
I20260709 12:15:11.175570 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.172477 12587 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.165959 12766 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:15:11.173808 12914 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.004s
I20260709 12:15:11.171489 12806 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.171382 12839 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:11.170572 12848 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:11.174387 12937 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:11.196197 12864 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.244s	user 0.009s	sys 0.002s
I20260709 12:15:11.182602 12613 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:11.196839 12925 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:11.235555 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 56689.6us
I20260709 12:15:11.196535 12766 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:11.241986 10020 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.014s
W20260709 12:15:11.243626 10020 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.015s
W20260709 12:15:11.244009 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 665588us
W20260709 12:15:11.245465 10020 leader_election.cc:336] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.158s (SENT)
I20260709 12:15:11.246062 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:11.235901 12933 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:15:11.231359 12839 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.193459 12587 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.232817 12848 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:11.241391 12613 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.243243 12925 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.246764 12766 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:11.209739 12940 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:15:11.267160 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.251664 12904 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:11.249378 12850 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.214915 12914 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.269024 10055 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
W20260709 12:15:11.267329 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 98385.6us
I20260709 12:15:11.276320 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:11.270087 12945 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:15:11.285709 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:11.286382 10128 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.271879 12891 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:11.274115 12947 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:15:11.255903 12839 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:11.241232 12864 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.279945 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2018) took 1032 ms. Trace:
I20260709 12:15:11.301944 10049 rpcz_store.cc:276] 0709 12:15:10.247762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.247920 (+   158us) service_pool.cc:224] Handling call
0709 12:15:10.268785 (+ 20865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:10.593700 (+324915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.279659 (+685959us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54002747d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:11.279877 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728831744}
I20260709 12:15:11.282557 12459 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.310963 12864 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.311849 12914 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.312551 12776 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.313513 10728 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:11.314651 12385 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:11.314988 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 338) took 1311 ms. Trace:
I20260709 12:15:11.315181 12899 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.315790 12385 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:11.315699 12899 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.316319 12385 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:11.316509 12941 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:11.315413 10124 rpcz_store.cc:276] 0709 12:15:10.003472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.003640 (+   168us) service_pool.cc:224] Handling call
0709 12:15:10.045052 (+ 41412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.060895 (+ 15843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.060929 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:10.080975 (+ 20046us) log.cc:844] Serialized 26 byte log entry
0709 12:15:10.583471 (+502496us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:10.583513 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.584220 (+   707us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.314781 (+730561us) raft_consensus.cc:1685] finished
0709 12:15:11.314802 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.314932 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12915,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4250,"thread_start_us":445200,"threads_started":1,"wal-append.queue_time_us":845101}
W20260709 12:15:11.288074 12948 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 12:15:11.273648 10020 connection.cc:256] RPC call timeout handler was delayed by -1.1793370230002438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
I20260709 12:15:11.288851 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.292691 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 340) took 1277 ms. Trace:
I20260709 12:15:11.324365 10121 rpcz_store.cc:276] 0709 12:15:10.015013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.015144 (+   131us) service_pool.cc:224] Handling call
0709 12:15:11.292517 (+1277373us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400244d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:11.292628 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452569472}
I20260709 12:15:11.259663 12848 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:11.262898 12613 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:11.306708 12923 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:11.307530 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.330727 10052 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
W20260709 12:15:11.308969 12900 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.897s	user 0.002s	sys 0.006s
I20260709 12:15:11.317669 12823 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:11.262745 12934 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:15:11.265069 12925 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:11.283241 12836 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.326094 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:11.329255 10124 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:11.293687 12891 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:11.337644 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.345512 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:11.331995 12923 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:11.343333 12868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.351s	user 0.027s	sys 0.034s
I20260709 12:15:11.347617 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.350629 10052 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:11.349435 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.353556 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.351753 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.338862 12904 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.358560 10052 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:11.358342 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.359496 10055 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.348922 12807 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:15:11.360071 12868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.373s	user 0.028s	sys 0.035s
I20260709 12:15:11.374743 10126 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:11.374878 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:11.353274 12923 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:11.377525 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.380232 10128 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:11.381583 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 429) took 1481 ms. Trace:
I20260709 12:15:11.382091 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:11.380065 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:11.381980 10199 rpcz_store.cc:276] 0709 12:15:09.900064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.900969 (+   905us) service_pool.cc:224] Handling call
0709 12:15:09.930473 (+ 29504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.095037 (+164564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.095069 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:10.122514 (+ 27445us) log.cc:844] Serialized 26 byte log entry
0709 12:15:10.561640 (+439126us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:10.561683 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.561758 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.381286 (+819528us) raft_consensus.cc:1685] finished
0709 12:15:11.381307 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.381521 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5144,"raft.queue_time_us":19812,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4266,"thread_start_us":425382,"threads_started":2,"wal-append.queue_time_us":720968}
I20260709 12:15:11.375533 12928 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:11.357270 12903 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:15:11.390534 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:11.376912 12867 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.390579 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:11.393499 10128 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:11.393561 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50602.9us
I20260709 12:15:11.395443 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.369401 12624 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:15:11.383553 12807 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:11.398166 10195 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:15:11.398056 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.387255 12823 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:11.406646 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.410534 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.417495 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.377189 12149 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.389622 12964 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:15:11.423344 10198 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:15:11.424645 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.425462 10198 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:11.422032 12964 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:11.430217 12613 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.432456 12613 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.363551 12904 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.378630 12385 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.438268 12850 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:11.439497 12925 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.440167 12967 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:11.441087 10055 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:11.444589 12904 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.456274 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2024) took 1139 ms. Trace:
W20260709 12:15:11.456576 10019 leader_election.cc:336] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.861s (SENT)
I20260709 12:15:11.457860 10203 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
W20260709 12:15:11.459280 12894 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.002s
I20260709 12:15:11.418529 12823 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:11.461647 12766 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.417241 12891 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.455749 12937 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.465438 12925 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.466750 12923 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.456902 10046 rpcz_store.cc:276] 0709 12:15:10.309928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.310072 (+   144us) service_pool.cc:224] Handling call
0709 12:15:11.448628 (+1138556us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54003d0254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:11.448763 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886487424}
I20260709 12:15:11.470870 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.473308 12899 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.476317 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:11.481091 12890 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.483858 12149 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:11.448218 12962 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:15:11.535885 12766 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.536414 12891 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.538199 12937 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.553967 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:11.554410 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 78181.8us
W20260709 12:15:11.565163 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 108611us
I20260709 12:15:11.484658 12967 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:11.606004 12624 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:11.495914 12868 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:11.645510 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.646309 10046 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:11.535912 12923 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:11.564251 12385 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:11.688768 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.563773 12899 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.689519 10046 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:11.528097 12339 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.533880 12823 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.693033 12964 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:11.638837 12925 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:15:11.703272 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.705382 12964 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:11.711609 10046 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:11.715587 12964 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:11.718997 12967 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.668989 12149 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:11.719506 12964 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.724464 12964 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:11.725811 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.727115 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.727789 10196 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:11.729031 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.730398 10199 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:11.731632 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.732335 10046 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:11.667860 12766 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:15:11.555131 12807 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.646845 12903 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:15:11.738519 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.743498 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.745064 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:11.746567 10046 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:11.749038 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:11.751585 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.764146 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.754169 12516 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:11.757871 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.650309 12624 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.736764 12149 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.766862 12894 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:11.745465 12613 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:15:11.804905 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.671164 12868 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.745672 12839 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:11.787335 12516 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.818601 12839 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:11.818702 12516 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.810660 12547 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.819671 12547 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.801858 12890 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:11.821537 10046 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:15:11.821376 12890 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:11.813426 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.822818 10054 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:11.789306 12812 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:11.804895 12894 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:11.816830 12149 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.815112 12624 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:11.765714 12923 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:15:11.830981 10199 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:11.832309 12812 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.850518 12894 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.860872 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.763551 12848 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:11.864316 12149 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:11.870810 12547 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.875059 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:11.860913 12812 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:11.881778 10054 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:11.886971 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:11.892786 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:11.893595 10054 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:11.883106 12923 consensus_queue.cc:1243] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:15:11.886171 12149 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:11.885726 12339 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:11.893373 12624 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:11.915328 12973 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:15:11.899026 12940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.067s	sys 0.118s
W20260709 12:15:11.921986 12826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.015s
I20260709 12:15:11.927747 10054 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:11.921715 12624 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:11.935971 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:11.930720 12940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.068s	sys 0.119s
W20260709 12:15:11.932756 12826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.012s	sys 0.015s
I20260709 12:15:11.932439 12890 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:11.942193 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:11.942889 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1926) took 1555 ms. Trace:
I20260709 12:15:11.943274 10121 rpcz_store.cc:276] 0709 12:15:10.387278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.325519 (+938241us) service_pool.cc:224] Handling call
0709 12:15:11.334342 (+  8823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:11.339646 (+  5304us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:11.339679 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:11.345991 (+  6312us) log.cc:844] Serialized 26 byte log entry
0709 12:15:11.738942 (+392951us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:11.738986 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.739810 (+   824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:11.942693 (+202883us) raft_consensus.cc:1685] finished
0709 12:15:11.942711 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.942827 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2389,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":1806,"thread_start_us":362645,"threads_started":1,"wal-append.queue_time_us":450751}
I20260709 12:15:11.945640 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:11.937422 12942 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.964s	user 0.008s	sys 0.006s
I20260709 12:15:11.964951 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:11.934659 12918 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.055s	sys 0.143s
I20260709 12:15:11.939427 12339 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:11.949424 12624 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:12.031005 12978 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:15:12.032135 10126 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:12.032191 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 428) took 2593 ms. Trace:
I20260709 12:15:11.945124 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:12.013008 12976 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:15:12.015878 12930 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.044s	user 0.003s	sys 0.006s
I20260709 12:15:11.937638 12149 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.009114 10121 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:12.030848 10094 connection.cc:256] RPC call timeout handler was delayed by -1.0912530929999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 12:15:12.054863 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.033144 10204 rpcz_store.cc:276] 0709 12:15:09.439125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.439243 (+   118us) service_pool.cc:224] Handling call
0709 12:15:09.439559 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:09.573690 (+134131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:09.573723 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:09.606082 (+ 32359us) log.cc:844] Serialized 26 byte log entry
0709 12:15:10.008030 (+401948us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:10.008077 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.031742 (+2023665us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000e92d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:12.031793 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.031849 (+    56us) raft_consensus.cc:1685] finished
0709 12:15:12.031862 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.032107 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22727,"raft.queue_time_us":45258,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":4976,"spinlock_wait_cycles":255286016,"thread_start_us":280425,"threads_started":1,"wal-append.queue_time_us":641854,"wal-append.run_cpu_time_us":8047,"wal-append.run_wall_time_us":1731634}
W20260709 12:15:12.010881 12918 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.055s	sys 0.144s
I20260709 12:15:12.039676 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.040170 12890 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.043450 12923 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.083866 12923 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:12.085903 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 329) took 4524 ms (client timeout 1756 ms). Trace:
I20260709 12:15:12.038856 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:12.086822 10047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2022) took 1837 ms (client timeout 1984 ms). Trace:
I20260709 12:15:12.065161 12890 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.053836 12868 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.063512 12891 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.061976 12547 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.074688 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.086212 12923 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:12.077064 12975 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:15:12.103674 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:12.084242 11728 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.053296 12339 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:12.087224 10047 rpcz_store.cc:269] 0709 12:15:10.248907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.249075 (+   168us) service_pool.cc:224] Handling call
0709 12:15:12.086664 (+1837589us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400110154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.086768 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309938432}
W20260709 12:15:12.088718 10048 rpcz_store.cc:269] 0709 12:15:07.561497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.662740 (+101243us) service_pool.cc:224] Handling call
0709 12:15:12.085667 (+4422927us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b54002a1f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.085802 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8063824768}
I20260709 12:15:12.098592 10054 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:12.075726 12894 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:12.063760 12848 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.107507 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.107793 10121 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:12.107789 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:12.111249 10053 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:12.111939 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.115134 10048 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:12.116127 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.116710 10048 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:12.116966 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:12.111967 10047 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:12.104657 12547 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.143772 12547 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.144380 12547 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:12.146247 12890 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.146965 12890 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:12.158187 12604 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.160265 12971 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:12.160764 12971 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:12.161665 12971 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:12.181241 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.038s (SENT) [suppressed 16 similar messages]
I20260709 12:15:12.181998 10199 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.162846 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:12.166684 12984 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:15:12.167737 12926 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.245s	user 0.005s	sys 0.003s
I20260709 12:15:12.168661 12928 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:12.170845 12871 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:12.171332 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.213346 10046 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:12.214339 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.172472 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 598) took 2338 ms. Trace:
I20260709 12:15:12.172113 12812 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.174332 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.175282 12339 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.183323 12923 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:12.190596 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.211962 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:12.099602 12891 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.217890 10049 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:12.215185 10735 rpcz_store.cc:276] 0709 12:15:09.833747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.854817 (+ 21070us) service_pool.cc:224] Handling call
0709 12:15:12.172240 (+2317423us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54004ba354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.172387 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236849920}
I20260709 12:15:12.186066 10121 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:12.223820 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.227073 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:12.228631 10195 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:12.218505 12871 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.242038 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.210721 12928 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:12.231242 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.253106 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.243834 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.253713 10049 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:12.254491 10121 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:12.244813 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.255533 10054 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:12.256884 10046 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:15:12.257097 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 202321us
I20260709 12:15:12.252864 10053 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:12.257577 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.223055 12923 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:12.230276 12848 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:12.258725 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.263679 10046 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:15:12.264019 10052 raft_consensus.cc:2410] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:12.259331 10121 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:12.266145 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.255059 12871 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.269788 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.270658 10049 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:12.267522 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 430) took 2367 ms. Trace:
I20260709 12:15:12.273468 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.268175 10055 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:15:12.265882 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.275017 10055 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:12.275200 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.251700 10199 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:12.275574 10121 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:12.278615 10046 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:12.272579 10201 rpcz_store.cc:276] 0709 12:15:09.900422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.904446 (+  4024us) service_pool.cc:224] Handling call
0709 12:15:09.940218 (+ 35772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.940443 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:09.959535 (+ 19092us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.078959 (+2119424us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18003ea220. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a 00007fc17e79aa2a
0709 12:15:12.264599 (+185640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.264646 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:12.264689 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.264746 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.267471 (+  2725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4062,"prepare.queue_time_us":19045,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2833,"raft.queue_time_us":86,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3651,"spinlock_wait_cycles":3594496,"thread_start_us":185403,"threads_started":1}
I20260709 12:15:12.279829 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.280501 10121 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:12.280781 10052 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:15:12.262775 12923 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.277144 12604 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:12.284863 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 103646us
I20260709 12:15:12.285241 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.287426 10049 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:15:12.287606 10121 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:12.268924 12848 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:12.282299 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:12.289539 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 250663us
I20260709 12:15:12.326932 12764 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.333601 12764 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.336023 12764 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.338940 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1920) took 2010 ms. Trace:
I20260709 12:15:12.339426 10125 rpcz_store.cc:276] 0709 12:15:10.329064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.567286 (+238222us) service_pool.cc:224] Handling call
0709 12:15:10.593919 (+ 26633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:10.773594 (+179675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.338647 (+1565053us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:12.338865 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275410304}
W20260709 12:15:12.340529 12985 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:15:12.288552 12385 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:12.341188 12385 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.341954 12949 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:12.342576 12949 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.343271 12385 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.344511 12949 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.346983 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.333041 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.348429 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:12.284371 12890 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:12.298789 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.299371 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.351694 10121 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:12.338975 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:12.350648 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 68426.4us
I20260709 12:15:12.359980 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:12.358073 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.361198 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.362555 10121 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:12.372428 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:12.375002 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.375128 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.375798 10729 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:12.342583 12987 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:15:12.288355 12624 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:12.383452 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.288666 12823 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:12.288619 12903 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.391655 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.391901 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.392467 10729 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:12.392822 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.350684 12967 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.340749 12812 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.386803 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.286764 12604 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.390898 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.327890 12725 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:12.383553 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.351810 12890 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.371464 12547 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:12.375452 12770 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.409376 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:12.410269 10737 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.408612 10125 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:12.410727 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:12.412962 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:12.419034 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:12.426038 10729 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:12.430636 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:12.433141 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:12.429348 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.376852 12837 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:15:12.440243 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.441046 10732 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:12.442305 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.444813 10121 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:12.393826 12894 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.409483 12604 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.451145 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.456044 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.463637 10125 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:12.454617 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 98669.5us
I20260709 12:15:12.464550 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.465981 10121 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:12.426513 12949 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:12.474172 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:12.329432 12928 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.426729 12890 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.424717 12547 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.425979 12628 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:12.466989 12548 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:12.477909 10729 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:12.439291 12812 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:12.463080 12516 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:12.483937 12964 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:12.484390 12547 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:12.505956 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 142716us
I20260709 12:15:12.409330 12903 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.487237 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1937) took 1114 ms. Trace:
I20260709 12:15:12.512534 10126 rpcz_store.cc:276] 0709 12:15:11.372435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.384709 (+ 12274us) service_pool.cc:224] Handling call
0709 12:15:12.487056 (+1102347us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400243e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.487165 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471747072}
I20260709 12:15:12.489455 12587 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.492776 12892 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:12.493614 10124 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:12.493728 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 340) took 1179 ms. Trace:
I20260709 12:15:12.472502 12891 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.419224 12725 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.485515 12548 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:12.495270 12928 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:12.498289 12868 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.529824 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 330) took 1274 ms. Trace:
I20260709 12:15:12.395224 12624 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.453789 12896 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:12.439559 12834 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:12.502874 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 128124us
I20260709 12:15:12.536451 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.479628 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.509057 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.402074 12967 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.510738 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.491369 12935 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:12.509908 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.487694 12949 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.516307 10053 rpcz_store.cc:276] 0709 12:15:11.313877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.263395 (+949518us) service_pool.cc:224] Handling call
0709 12:15:12.272839 (+  9444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.273051 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:12.384944 (+111893us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.492888 (+107944us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.493137 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.493205 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:12.493274 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.493376 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.493652 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10367,"prepare.queue_time_us":75994,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":501,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":175,"spinlock_wait_cycles":26496,"thread_start_us":195890,"threads_started":2}
I20260709 12:15:12.453882 12848 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.518473 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.425839 12770 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.545038 10737 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
W20260709 12:15:12.522037 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.525821 10049 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:15:12.530812 10047 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:12.535789 12868 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.552345 12868 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:12.543269 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1918) took 2275 ms (client timeout 2095 ms). Trace:
I20260709 12:15:12.552994 12871 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:12.553490 10129 rpcz_store.cc:269] 0709 12:15:10.267988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.268770 (+   782us) service_pool.cc:224] Handling call
0709 12:15:12.543062 (+2274292us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54003d1154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.543185 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506085248}
I20260709 12:15:12.554663 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.555154 12725 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.531909 10051 rpcz_store.cc:276] 0709 12:15:11.255033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.255175 (+   142us) service_pool.cc:224] Handling call
0709 12:15:11.264092 (+  8917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:11.802092 (+538000us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b180039aea0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc17e788060 00007fc17e788bfb 00007fc17e79364b
0709 12:15:11.802229 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:11.802252 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:11.806087 (+  3835us) log.cc:844] Serialized 52 byte log entry
0709 12:15:12.110085 (+303998us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:12.110122 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.110187 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.516930 (+406743us) raft_consensus.cc:1685] finished
0709 12:15:12.516950 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.529744 (+ 12794us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31828,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8085,"spinlock_wait_cycles":9509760,"thread_start_us":332276,"threads_started":2,"wal-append.queue_time_us":440861}
I20260709 12:15:12.556445 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:12.544837 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.399658 12823 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.547034 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.530318 12891 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:12.559329 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.557070 10125 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:12.557359 10049 pending_rounds.cc:85] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 7
I20260709 12:15:12.561299 10049 pending_rounds.cc:107] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:15:12.561625 10049 raft_consensus.cc:2889] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:12.549023 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.519843 10054 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:12.562760 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 337) took 1249 ms. Trace:
I20260709 12:15:12.563162 10054 rpcz_store.cc:276] 0709 12:15:11.312959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.262598 (+949639us) service_pool.cc:224] Handling call
0709 12:15:12.519401 (+256803us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:15:12.519632 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.562467 (+ 42835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.562695 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321792}
I20260709 12:15:12.562830 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:12.541088 12896 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:12.545475 12949 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:12.569278 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.572567 10126 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:12.543336 12935 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:12.546115 12812 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:12.545463 12892 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.572860 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.574450 12996 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:12.582123 10125 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:15:12.568274 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62995.4us
I20260709 12:15:12.563750 12891 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.585572 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:12.589979 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.607589 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.571941 12896 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:12.572155 12938 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:12.613547 10126 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:12.607798 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:12.614356 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.584968 12996 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.570500 12725 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.668738 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.670776 10125 raft_consensus.cc:2410] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:15:12.676748 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 129784us
W20260709 12:15:12.678180 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.592377 12891 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:12.589368 12812 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:12.694223 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.740103 10126 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:12.607685 12895 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:12.732465 12986 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.487s	user 0.001s	sys 0.002s
I20260709 12:15:12.586649 12892 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.676913 12628 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:12.627246 13004 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:12.737761 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 129050us
I20260709 12:15:12.626618 12938 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.563627 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:15:12.626188 12996 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:12.759037 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.768057 10055 raft_consensus.cc:606] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:12.768538 10055 raft_consensus.cc:614] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:12.678153 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:12.766974 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.769565 10126 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:15:12.685987 12725 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.772490 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 337) took 3164 ms. Trace:
I20260709 12:15:12.772264 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.755019 12895 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.755951 12894 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.594295 12548 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.765149 12578 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:12.763115 12867 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:12.774178 10123 rpcz_store.cc:276] 0709 12:15:09.607715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.607969 (+   254us) service_pool.cc:224] Handling call
0709 12:15:09.615412 (+  7443us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:09.728003 (+112591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:09.728036 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:09.735320 (+  7284us) log.cc:844] Serialized 78 byte log entry
0709 12:15:10.014459 (+279139us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:10.068499 (+ 54040us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.501013 (+2432514us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b1800318e80. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:12.501217 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.762342 (+261125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.762449 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.772251 (+  9802us) raft_consensus.cc:1685] finished
0709 12:15:12.772273 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.772431 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2296413,"prepare.queue_time_us":54264,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":214109,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":97974,"spinlock_wait_cycles":2582272,"thread_start_us":513979,"threads_started":3,"wal-append.queue_time_us":637867,"wal-append.run_cpu_time_us":2478,"wal-append.run_wall_time_us":1002514}
I20260709 12:15:12.813525 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.816727 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.775540 12628 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:12.823148 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.825963 10125 raft_consensus.cc:2376] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7. Re-sending same reply.
I20260709 12:15:12.826970 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.827692 10125 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:12.828502 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.829156 10125 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:12.829511 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1313) took 1021 ms. Trace:
I20260709 12:15:12.829800 10125 rpcz_store.cc:276] 0709 12:15:11.808237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.828276 (+1020039us) service_pool.cc:224] Handling call
0709 12:15:12.829457 (+  1181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.831137 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1265) took 1011 ms. Trace:
I20260709 12:15:12.831676 12938 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.832360 12871 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.833338 12628 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.737061 12935 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.777776 12903 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.831514 10199 rpcz_store.cc:276] 0709 12:15:11.819421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.861738 (+ 42317us) service_pool.cc:224] Handling call
0709 12:15:12.830989 (+969251us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400312ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.831082 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687804800}
I20260709 12:15:12.837509 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:12.837879 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:12.839339 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:12.840129 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:12.843986 13022 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:12.816237 12578 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:12.845196 12892 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:12.822938 13018 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:12.835554  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 12:15:12.854878 12923 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 12:15:12.847973 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:12.850862 13007 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:15:12.851866 13011 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:15:12.852964 12823 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.856464 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:12.874866 10125 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:12.779516 13021 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:15:12.836058 12624 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:12.847288 12812 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.811731 12894 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.874670 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:12.883503 10200 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:12.872390 12578 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:12.878043 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1317) took 1068 ms. Trace:
I20260709 12:15:12.899091 10125 rpcz_store.cc:276] 0709 12:15:11.809141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.856191 (+1047050us) service_pool.cc:224] Handling call
0709 12:15:12.877976 (+ 21785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.770373 13010 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:15:12.872313  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:12.866490 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1323) took 1056 ms. Trace:
I20260709 12:15:12.822686 12867 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.873136 12548 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:12.889781 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 302219us
I20260709 12:15:12.872718 12770 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:12.901413 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 223312us
I20260709 12:15:12.873082 12892 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.902051 10126 rpcz_store.cc:276] 0709 12:15:11.827411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.815172 (+987761us) service_pool.cc:224] Handling call
0709 12:15:12.866401 (+ 51229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:12.904031 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:12.904695 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 129914us
I20260709 12:15:12.878583 13022 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:12.917903 12994 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.516s	user 0.000s	sys 0.003s
I20260709 12:15:12.922691 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1264) took 1105 ms. Trace:
I20260709 12:15:12.923207 10198 rpcz_store.cc:276] 0709 12:15:11.817720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.937677 (+119957us) service_pool.cc:224] Handling call
0709 12:15:12.922378 (+984701us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54000627d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.922605 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200897920}
W20260709 12:15:12.933048 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1249) took 1537 ms (client timeout 1551 ms). Trace:
W20260709 12:15:12.933562 10203 rpcz_store.cc:269] 0709 12:15:11.395978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.396098 (+   120us) service_pool.cc:224] Handling call
0709 12:15:12.932764 (+1536666us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b540003b454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.932926 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115903360}
W20260709 12:15:12.939230 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.887472 13018 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:12.898566 13019 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:12.942365 10124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1936) took 1599 ms (client timeout 1918 ms). Trace:
I20260709 12:15:12.879269 12923 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:12.954488 10124 rpcz_store.cc:269] 0709 12:15:11.343060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.355735 (+ 12675us) service_pool.cc:224] Handling call
0709 12:15:12.942131 (+1586396us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001e3f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:12.942292 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562312576}
I20260709 12:15:12.945967 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:12.880728 12896 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.944501 10196 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:12.944016 13007 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:15:12.966179 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.972241 10734 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:12.948730 13022 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:12.962412 12960 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.988929 10048 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:15:12.989187 12725 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:12.989895 10199 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:12.960417 12890 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:12.979300 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:13.001731 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.003407 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.004106 10055 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:13.005285 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.006390 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:12.943274 12892 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:12.958248 13026 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:12.986935 10124 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:15:12.946671 12885 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:15:13.010051 10121 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:13.012864 10047 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:13.021607 10047 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:13.022773 10198 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:12.958461 13019 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.024374 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.025058 10054 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:12.981654 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68616.9us
I20260709 12:15:13.025959 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.019836 10124 pending_rounds.cc:85] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 5
I20260709 12:15:13.027642 10124 pending_rounds.cc:107] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:15:13.027911 10124 raft_consensus.cc:2889] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:13.024667 13025 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:12.995276 13022 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:13.036609 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 344) took 2470 ms. Trace:
I20260709 12:15:13.037041 10124 rpcz_store.cc:276] 0709 12:15:10.566802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.971057 (+2404255us) service_pool.cc:224] Handling call
0709 12:15:12.984235 (+ 13178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.036345 (+ 52110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.036545 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:13.021661 12890 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.053782  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:13.014806 12977 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:13.022820 13026 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.997035 12516 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:15:12.957459 13018 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.067235 10124 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:13.076216 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:13.021775 12949 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.079711 12949 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:13.081254 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 135369us
W20260709 12:15:13.082093 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 130993us
I20260709 12:15:13.084760 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 345) took 2421 ms. Trace:
I20260709 12:15:13.084821 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.085386 10124 rpcz_store.cc:276] 0709 12:15:10.663738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.064258 (+2400520us) service_pool.cc:224] Handling call
0709 12:15:13.064559 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.084488 (+ 19929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.084695 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:13.090118 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.095192 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.095783 10199 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:13.097540 10020 leader_election.cc:336] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.508s (SENT)
W20260709 12:15:13.098564 10020 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.527s (SENT)
I20260709 12:15:13.098963 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:12.988997 12960 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.103379 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:13.105211 10020 leader_election.cc:336] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.597s (SENT)
I20260709 12:15:13.103977 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.105741 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.101199 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:13.106391 10732 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.107635 10200 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 8. Ops: []
I20260709 12:15:13.067059 13026 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:13.086795 12892 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.121728 12807 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:15:13.123018 10199 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:13.131494 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:13.140540 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.141573 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.087103 13036 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:13.096963 12904 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:15:13.119956 12894 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:13.096060 13035 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:15:13.149864 13024 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:13.151607 12892 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:13.154313 12890 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:13.175870 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.194527 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:13.195842 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.196749 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.201719 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.183475 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.203083 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.203421 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.203706 10195 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:13.204166 10199 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:13.204698 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.205068 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.206018 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 342) took 2640 ms. Trace:
I20260709 12:15:13.206440 10125 rpcz_store.cc:276] 0709 12:15:10.565635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.904936 (+2339301us) service_pool.cc:224] Handling call
0709 12:15:12.905298 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.914404 (+  9106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.914468 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.946773 (+ 32305us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.048457 (+101684us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:13.048515 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.048601 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.205766 (+157165us) raft_consensus.cc:1685] finished
0709 12:15:13.205791 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.205951 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":11533,"thread_start_us":28347,"threads_started":1,"wal-append.queue_time_us":243055}
I20260709 12:15:13.208316 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:13.209100 10125 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:13.186698 10200 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:13.197052 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.182250 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2035) took 1454 ms. Trace:
I20260709 12:15:13.214488 10052 rpcz_store.cc:276] 0709 12:15:11.727734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.281499 (+553765us) service_pool.cc:224] Handling call
0709 12:15:12.289376 (+  7877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:12.292162 (+  2786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.292198 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:12.339224 (+ 47026us) log.cc:844] Serialized 26 byte log entry
0709 12:15:12.920711 (+581487us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b180032cbc0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:15:13.104006 (+183295us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:13.104044 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.104108 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.181931 (+ 77823us) raft_consensus.cc:1685] finished
0709 12:15:13.181952 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.182183 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31023,"raft.queue_time_us":2515,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":35705,"spinlock_wait_cycles":19035904,"thread_start_us":183103,"threads_started":1,"wal-append.queue_time_us":840983}
I20260709 12:15:13.218806 10195 raft_consensus.cc:2410] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:13.221047 12918 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:13.225168 10732 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:13.162513 12923 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:13.160192 12896 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.230779 13022 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:13.192919 13033 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:15:13.173117 13024 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:13.237095 12891 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.004s
I20260709 12:15:13.237520 12891 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.224710 12890 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:13.159696 13021 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:15:13.179441 12892 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:13.228466 12516 consensus_queue.cc:1243] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:13.228605 13041 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:13.255690 13018 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.261222 12764 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:13.317111 12764 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:13.318277 12764 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.226706 13039 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:13.284971 13022 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:13.320711 13039 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.240154 13024 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.241218 12890 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:13.321017 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 321837us
W20260709 12:15:13.325474 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.327201 10732 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:13.327558 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.238648 12996 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:13.331591 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 226383us
W20260709 12:15:13.365922 10020 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.639s (SENT)
I20260709 12:15:13.366392 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.369246 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:13.371410 10020 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.668s (SENT)
W20260709 12:15:13.372417 10020 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.707s (SENT)
W20260709 12:15:13.332149 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 135175us
I20260709 12:15:13.240953 12895 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.245482 12892 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:13.383203 12578 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.385751 10201 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:13.256927 12604 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.000s
I20260709 12:15:13.386597 12604 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.387291 12891 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.334071 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.388265 10195 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:13.362074 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.389213 10055 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
W20260709 12:15:13.242849 12547 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.724s	user 0.003s	sys 0.008s
I20260709 12:15:13.363118 10047 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:13.335393 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.320508 13019 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.379973 10736 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:13.390708 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.393339 10729 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.378289 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.384732 12964 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:13.388664 12604 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.393675 10199 raft_consensus.cc:2410] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:13.382189 12895 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.257804 12960 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.246699 13047 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:13.334476 13040 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.403290 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.405406 10124 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:13.390753 12547 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.364491 12516 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:13.411618 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.411701 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:13.414166 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.415216 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1746) took 2759 ms. Trace:
I20260709 12:15:13.365361 13039 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:13.377743 13041 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:13.418262 10050 rpcz_store.cc:276] 0709 12:15:10.646319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.696748 (+ 50429us) service_pool.cc:224] Handling call
0709 12:15:12.087713 (+1390965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.087893 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.087917 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.087955 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:12.087985 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.088037 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.405042 (+1317005us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400110150. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:13.405151 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085154688}
I20260709 12:15:13.426071 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:13.415251 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.427676 10199 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:13.428026 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.422374 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:13.401165 12624 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:13.432101 10129 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:13.439324 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.454241 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.487573 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.490689 10200 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:15:13.397516 13018 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:15:13.423903 12977 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:13.494522 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.495147 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.496783 10195 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:13.428740 12895 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.415364 13027 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:13.500231 13027 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.501029 12895 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:13.503708 12988 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.078s	user 0.005s	sys 0.001s
I20260709 12:15:13.495791 12624 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.505054 12977 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:13.508819 12624 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:13.510862 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.510772 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.488909 13035 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:13.511536 10200 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:13.429493 13053 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:13.431062 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.493752 13047 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.432341 12964 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.429739 12770 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:15:13.545056 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.545943 10050 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:13.546237 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.417910 13040 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.429488 12516 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.486567 13015 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:13.513490 13035 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.565724 10047 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:13.569449 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.572767 10050 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:13.569741 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 138749us
I20260709 12:15:13.543417 12895 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:13.574115 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.430788 13041 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:13.577419 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.564570 12960 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:13.584805 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65858.4us
I20260709 12:15:13.589224 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.574489 13035 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.581738 13053 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:13.598851 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.599289 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:13.599501 10050 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:13.605273 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.561240 13047 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.602850 10047 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:13.660084 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.661085 10204 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:13.668462 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1326) took 1813 ms (client timeout 2140 ms). Trace:
W20260709 12:15:13.668927 10129 rpcz_store.cc:269] 0709 12:15:11.854664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.555600 (+700936us) service_pool.cc:224] Handling call
0709 12:15:13.668267 (+1112667us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400244d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:13.668403 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001794304}
I20260709 12:15:13.609658 12996 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:13.673084 13057 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:15:13.675321 13054 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:15:13.675515 13058 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:15:13.681005 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:13.681222 12867 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:13.682659 13026 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 12:15:13.683569 13026 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.692590 13026 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.683060 13047 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.674155 12547 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.701120 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.694819 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.701833 10200 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:13.702196 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:13.721356 10123 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:13.715706 12516 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:13.724530 12881 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.298s	user 0.005s	sys 0.003s
W20260709 12:15:13.725001 13009 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.102s	user 0.003s	sys 0.000s
I20260709 12:15:13.727830 10053 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:13.701849 10204 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:13.734405 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.708636 13024 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.742128 13024 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.726627 13026 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:13.743227 13026 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.714995 13039 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.746366 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:13.748162 13012 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.981s	user 0.005s	sys 0.007s
I20260709 12:15:13.748893 13026 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.748118 13039 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.705924 12918 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:13.755039 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 463) took 1364 ms. Trace:
I20260709 12:15:13.758890 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.755517 10730 rpcz_store.cc:276] 0709 12:15:12.390864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.391095 (+   231us) service_pool.cc:224] Handling call
0709 12:15:12.391437 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:12.397575 (+  6138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.397609 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:12.398266 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 12:15:12.482697 (+ 84431us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:12.482736 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.482802 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:13.747611 (+1264809us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:13.750735 (+  3124us) raft_consensus.cc:1685] finished
0709 12:15:13.750756 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.754962 (+  4206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5703,"raft.queue_time_us":8166,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7738,"spinlock_wait_cycles":6750080,"thread_start_us":30266,"threads_started":1,"wal-append.queue_time_us":259546}
I20260709 12:15:13.729333 13027 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.763625 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.767226 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:13.764225 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.768637 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.769913 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.770816 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.774281 12547 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:13.774711 12547 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.775081 12547 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.778703 13026 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:13.779181 13026 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.779524 13026 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:13.781775 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 354) took 1645 ms (client timeout 2078 ms). Trace:
I20260709 12:15:13.759435 12964 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:13.782187 10121 rpcz_store.cc:269] 0709 12:15:12.139060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.584871 (+445811us) service_pool.cc:224] Handling call
0709 12:15:13.781558 (+1196687us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400173c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:13.781715 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868076416}
I20260709 12:15:13.783526 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:13.784756 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:13.793102 10096 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55236 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
I20260709 12:15:13.794687 13006 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:13.795922 13010 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:13.796177 12764 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:13.796289 13010 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:13.797325 13010 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.799953 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.800565 10049 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.801129 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.802340 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.802888 10055 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:13.805656 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.807204 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.807966 12967 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.808131 10055 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.810611 10049 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:13.693984 12892 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.852027 12892 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:13.785456 10121 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:13.818749 12935 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.818933 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.787801 13026 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.820194 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:13.894634 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 74499.2us
I20260709 12:15:13.823493 10055 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:13.824543 13040 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.836678 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1762) took 1771 ms. Trace:
I20260709 12:15:13.895547 10046 rpcz_store.cc:276] 0709 12:15:12.065488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.479671 (+414183us) service_pool.cc:224] Handling call
0709 12:15:12.479981 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.528291 (+ 48310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:12.528326 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.528373 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:12.528404 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.836389 (+1307985us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b5400320d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:13.836459 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:13.836608 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110633344}
I20260709 12:15:13.896917 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:13.897207 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.840142 10129 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:13.840883 13021 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.841430 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.900053 10048 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:13.900162 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.842962 12890 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.862872 13035 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.852699 13039 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:13.868777 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.869248 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:13.871143 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 715) took 1542 ms. Trace:
I20260709 12:15:13.871691 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 441) took 1030 ms. Trace:
I20260709 12:15:13.873224 13010 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.878801 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.879559 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.907317 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:13.880286 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.908766 13040 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:13.910281 13035 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.910688 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.911041 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.910600 10735 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEARNER]: Advancing to term 11
I20260709 12:15:13.907302 10196 rpcz_store.cc:276] 0709 12:15:12.840961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.841072 (+   111us) service_pool.cc:224] Handling call
0709 12:15:12.944285 (+103213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.967709 (+ 23424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.871512 (+903803us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54000627d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:13.871637 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204502272}
I20260709 12:15:13.914778 13026 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.915540 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.894848 13004 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.917192 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.917074 13004 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:13.883030 10123 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:13.860845 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 437) took 1022 ms. Trace:
I20260709 12:15:13.917619 13042 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:13.901415 12339 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.898941 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.918601 10201 rpcz_store.cc:276] 0709 12:15:12.838206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.838336 (+   130us) service_pool.cc:224] Handling call
0709 12:15:12.847603 (+  9267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.386190 (+538587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.860576 (+474386us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002648d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:13.860779 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237176576}
I20260709 12:15:13.903941 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:13.907243 10734 rpcz_store.cc:276] 0709 12:15:12.328661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.328813 (+   152us) service_pool.cc:224] Handling call
0709 12:15:12.336847 (+  8034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.972712 (+635865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.870901 (+898189us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540015a754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:13.871081 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460813696}
I20260709 12:15:13.911456 10733 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:13.911067 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.922454 10737 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.923583 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:13.905850 10046 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:13.911407 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:13.919603 13042 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:13.930171 10729 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:13.924365 10735 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:15:13.924477 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 55804.1us
I20260709 12:15:13.926697 13006 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:13.920382 12339 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:13.924760 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:13.928120 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.929396 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:13.934355 10734 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:13.939720 10201 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:13.942368 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:13.919107 13004 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:13.945856 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:13.947961 10201 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:13.922561 12604 raft_consensus.cc:2764] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:15:13.940907 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.927304 12972 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:13.954931 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.956629 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.957851 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.958865 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.960464 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.961980 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.962731 10204 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:13.937587 12385 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:13.972743 10197 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:13.964744 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:13.976114 10203 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:13.942412 12624 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:13.941776 13026 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.944468 13006 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:13.984151 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:13.936801 12339 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:13.984843 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:13.982564 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.793470 10096 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55236 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:13.941641 13039 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:13.985635 10201 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:13.988323 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:13.979935 10737 raft_consensus.cc:2410] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:15:14.002919 10728 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:13.950546 13040 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.004165 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:14.006582 10046 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.937739 12896 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:15:13.937999 12928 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:15:14.009735 10203 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:13.972609 12385 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:13.972326 13019 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:13.921285 13021 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:13.980541 13004 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:14.021276 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.024454 10096 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54462 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 362)
I20260709 12:15:14.016584 13040 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.017221 12385 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.004930 13026 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.008857 12339 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:15:14.032122 10096 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54462 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.039649 10046 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:14.040937 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:14.041067 10096 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54462 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.016929 12896 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:15:14.077740 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 209726us
I20260709 12:15:14.087131 12848 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:14.087837 12848 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.090289 12848 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.031478 12972 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:14.101926 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:14.109395 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:14.110061 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.061132 13035 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:14.073176 12149 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.125069 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:14.126144 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 339) took 4112 ms. Trace:
I20260709 12:15:14.105165 12339 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:14.131412 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:14.118189 12964 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:14.115075 12890 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.124070 12928 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:15:14.152055 10020 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.529s (SENT)
I20260709 12:15:14.152592 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:14.152711 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.126238 12993 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:14.130247 13038 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:14.042723 13039 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.059152 13006 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.128609 13035 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:14.134646 12339 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.140743 12807 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.058923 10096 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55236 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.133080 13064 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.122599 12149 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.144027 12928 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.135226 12964 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.115536 12972 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.167407 12613 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:15:14.184322 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 247237us
I20260709 12:15:14.180400 10096 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55236 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.198873 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.195183 10096 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54462 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.187059 13024 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:14.225189 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 236912us
I20260709 12:15:14.222657 10096 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54462 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362)
I20260709 12:15:14.230341 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:14.237983 10020 leader_election.cc:336] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.751s (SENT)
I20260709 12:15:14.238512 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.245671 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:14.270778 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 320516us
I20260709 12:15:14.272598 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.244608 13026 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.269249 12613 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:14.240329 12928 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.244037 13035 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.126505 10122 rpcz_store.cc:276] 0709 12:15:10.013933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.014092 (+   159us) service_pool.cc:224] Handling call
0709 12:15:10.055720 (+ 41628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:10.055945 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:10.318842 (+262897us) log.cc:844] Serialized 14 byte log entry
0709 12:15:13.918170 (+3599328us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18002b1c80. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:13.918378 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.125820 (+207442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.125874 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:14.125915 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.125973 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.126088 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2978268,"prepare.queue_time_us":5472005,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2791,"raft.queue_time_us":6853,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":8838,"spinlock_wait_cycles":5300992,"thread_start_us":1076528,"threads_started":3,"wal-append.queue_time_us":673904,"wal-append.run_cpu_time_us":2236,"wal-append.run_wall_time_us":1338954}
W20260709 12:15:14.288929 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 90147.8us
I20260709 12:15:14.351516 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.333732 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1928) took 3946 ms. Trace:
I20260709 12:15:14.288434 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 343) took 3722 ms. Trace:
I20260709 12:15:14.359580 10126 rpcz_store.cc:276] 0709 12:15:10.566206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:12.912741 (+2346535us) service_pool.cc:224] Handling call
0709 12:15:12.953218 (+ 40477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:12.953436 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.138980 (+1185544us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.288074 (+149094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.288144 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.288186 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.288251 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.288370 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":995687,"prepare.queue_time_us":1054262,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1655,"raft.queue_time_us":1129,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3296,"thread_start_us":338098,"threads_started":2}
W20260709 12:15:14.288941 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157586us
I20260709 12:15:14.402212 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.401491 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:14.335177 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62647.4us
I20260709 12:15:14.406643 10122 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:14.409186 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1929) took 3248 ms. Trace:
I20260709 12:15:14.293138 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1923) took 3927 ms. Trace:
I20260709 12:15:14.413305 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:14.307034 13072 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:15:14.330816 13077 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:15:14.425079 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.345082 13082 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.410518 10127 rpcz_store.cc:276] 0709 12:15:10.365364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.145205 (+779841us) service_pool.cc:224] Handling call
0709 12:15:11.154718 (+  9513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:11.155210 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:11.155301 (+    91us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:11.158753 (+  3452us) log.cc:844] Serialized 52 byte log entry
0709 12:15:11.239715 (+ 80962us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:14.126729 (+2887014us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.289224 (+162495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.289303 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.292289 (+  2986us) raft_consensus.cc:1685] finished
0709 12:15:14.292301 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.293074 (+   773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2715312,"prepare.queue_time_us":2708450,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":2879,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":9425,"thread_start_us":382493,"threads_started":3,"wal-append.queue_time_us":394365,"wal-append.run_cpu_time_us":9402,"wal-append.run_wall_time_us":1374986}
I20260709 12:15:14.440802 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:14.441565 10126 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.437234 10735 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [9.10-10.11]
W20260709 12:15:14.438599 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.448580 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:14.449357 10122 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:14.341379 13021 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.338958 12928 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:14.444777 12764 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:15:14.408093 12149 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.469769 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.405819 13085 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:15:14.473912 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 121513us
I20260709 12:15:14.474076 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:14.482499 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.442704 12967 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.434947 12770 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:15:14.469228 12547 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.001s
W20260709 12:15:14.499868 10020 leader_election.cc:336] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.551s (SENT)
I20260709 12:15:14.467796 13084 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:14.407871 13036 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:15:14.501098 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1360) took 1072 ms. Trace:
I20260709 12:15:14.501173 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.507644 10122 rpcz_store.cc:276] 0709 12:15:13.428985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.449990 (+1021005us) service_pool.cc:224] Handling call
0709 12:15:14.501036 (+ 51046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.507879 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:14.448977 13092 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:14.503084 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.464052 13089 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:15:14.506876 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 101897us
I20260709 12:15:14.436112 12848 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:15:14.511991 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.514245 13093 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:15:14.515750 13093 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:14.516433 13093 consensus_queue.cc:1243] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:14.494071 12972 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.522400 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.529542 10126 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:14.530006 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1347) took 1109 ms. Trace:
I20260709 12:15:14.522575 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1351) took 1101 ms. Trace:
I20260709 12:15:14.530252 10126 rpcz_store.cc:276] 0709 12:15:13.420256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.405962 (+985706us) service_pool.cc:224] Handling call
0709 12:15:14.529960 (+123998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.530763 10127 rpcz_store.cc:276] 0709 12:15:13.421291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.473081 (+1051790us) service_pool.cc:224] Handling call
0709 12:15:14.522510 (+ 49429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.531369 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.532096 10126 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:14.535282 10049 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:14.511791 12770 consensus_queue.cc:1243] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:14.536229 10122 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:14.536733 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1352) took 1115 ms. Trace:
I20260709 12:15:14.537040 10122 rpcz_store.cc:276] 0709 12:15:13.421521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.508656 (+1087135us) service_pool.cc:224] Handling call
0709 12:15:14.536670 (+ 28014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.538611 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1353) took 1116 ms. Trace:
I20260709 12:15:14.537952 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:14.542006 13086 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:15:14.547049 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:14.548915 13096 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:14.539011 10126 rpcz_store.cc:276] 0709 12:15:13.421748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.531076 (+1109328us) service_pool.cc:224] Handling call
0709 12:15:14.538485 (+  7409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.550511 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:14.511138 13089 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:14.551097 10126 raft_consensus.cc:2376] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8. Re-sending same reply.
I20260709 12:15:14.552130 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.552867 10126 raft_consensus.cc:2393] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:14.553553 10122 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:14.554011 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1361) took 1122 ms. Trace:
I20260709 12:15:14.554281 10122 rpcz_store.cc:276] 0709 12:15:13.431237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.537680 (+1106443us) service_pool.cc:224] Handling call
0709 12:15:14.553945 (+ 16265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.558036 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.558282 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.558758 10126 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:14.559408 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:14.559731 12385 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 12:15:14.560184 12385 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.559238 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1364) took 1065 ms. Trace:
I20260709 12:15:14.561589 10126 rpcz_store.cc:276] 0709 12:15:13.493479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.557733 (+1064254us) service_pool.cc:224] Handling call
0709 12:15:14.559184 (+  1451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.562621 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.563181 10126 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:14.565112 10122 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.566921 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:14.584857 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.585881 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1349) took 1165 ms. Trace:
W20260709 12:15:14.586781 10020 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.613s (SENT)
I20260709 12:15:14.587294 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.588595 12764 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:14.589371 12764 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.589814 12764 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.356915 10128 rpcz_store.cc:276] 0709 12:15:10.387746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.416065 (+1028319us) service_pool.cc:224] Handling call
0709 12:15:11.426758 (+ 10693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.426981 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:14.196936 (+2769955us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.333212 (+136276us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.333383 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.333427 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:14.333475 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.333541 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.333667 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2518605,"prepare.queue_time_us":2537651,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":12077,"raft.queue_time_us":5020,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8894,"thread_start_us":371389,"threads_started":2}
I20260709 12:15:14.592005 12764 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:14.592931 13090 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:15:14.561254 10198 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:14.595081 13089 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.595871 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.586222 10121 rpcz_store.cc:276] 0709 12:15:13.420719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.584490 (+1163771us) service_pool.cc:224] Handling call
0709 12:15:14.585811 (+  1321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.597576 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.598255 10121 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:14.599020 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.599439 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.600057 10127 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:15:14.600176 12624 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.002s
I20260709 12:15:14.600528 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1346) took 1180 ms. Trace:
I20260709 12:15:14.600585 12624 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.600894 10127 rpcz_store.cc:276] 0709 12:15:13.420030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.531451 (+1111421us) service_pool.cc:224] Handling call
0709 12:15:14.600473 (+ 69022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.601802 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.599647 10121 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:14.602825 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1355) took 1180 ms. Trace:
I20260709 12:15:14.602299 10127 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:14.603137 10121 rpcz_store.cc:276] 0709 12:15:13.422194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.598781 (+1176587us) service_pool.cc:224] Handling call
0709 12:15:14.602772 (+  3991us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:14.604035 10020 leader_election.cc:336] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.038s (SENT)
I20260709 12:15:14.604493 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.605580 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.606532 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1365) took 1027 ms. Trace:
I20260709 12:15:14.285622  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.606906 10121 rpcz_store.cc:276] 0709 12:15:13.578739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.603806 (+1025067us) service_pool.cc:224] Handling call
0709 12:15:14.606476 (+  2670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.606797 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:14.608891 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:14.599236 13088 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:15:14.612566 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.613169 10126 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:14.509479 12547 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.614319 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.616262 10127 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:14.513387 13084 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.522212 13092 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.617702 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1366) took 1036 ms. Trace:
W20260709 12:15:14.619259 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 109611us
I20260709 12:15:14.634483 10121 rpcz_store.cc:276] 0709 12:15:13.581696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.607617 (+1025921us) service_pool.cc:224] Handling call
0709 12:15:14.617646 (+ 10029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.635592 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.628263 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1343) took 1209 ms. Trace:
W20260709 12:15:14.629040 10020 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.052s (SENT)
I20260709 12:15:14.636691 10127 rpcz_store.cc:276] 0709 12:15:13.419171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.603825 (+1184654us) service_pool.cc:224] Handling call
0709 12:15:14.628170 (+ 24345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.636986 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.637923 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:14.638690 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1359) took 1213 ms. Trace:
I20260709 12:15:14.638967 10126 rpcz_store.cc:276] 0709 12:15:13.425277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.637704 (+1212427us) service_pool.cc:224] Handling call
0709 12:15:14.638637 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.639372 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.620662 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:14.641340 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:14.606263 12972 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:14.641908 10048 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.639773 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.642963 10126 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:14.614326 12989 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 2.214s	user 0.000s	sys 0.005s
W20260709 12:15:14.643647 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 144195us
I20260709 12:15:14.636550 13097 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:14.648178 10128 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:14.615917 13024 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.649360 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.649863 10126 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:15:14.650190 10200 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:14.650396 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1931) took 3487 ms. Trace:
I20260709 12:15:14.650731 10126 rpcz_store.cc:276] 0709 12:15:11.163363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.649430 (+3486067us) service_pool.cc:224] Handling call
0709 12:15:14.649685 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.650201 (+   516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.650352 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.651502 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.652000 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.652681 10127 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:14.652560 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.648941 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:14.654917 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1358) took 1231 ms. Trace:
I20260709 12:15:14.655325 10127 rpcz_store.cc:276] 0709 12:15:13.423859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.637403 (+1213544us) service_pool.cc:224] Handling call
0709 12:15:14.654843 (+ 17440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40832}
I20260709 12:15:14.659893 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2051) took 1645 ms. Trace:
I20260709 12:15:14.660276 10053 rpcz_store.cc:276] 0709 12:15:13.014471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.022369 (+  7898us) service_pool.cc:224] Handling call
0709 12:15:13.024024 (+  1655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.728629 (+704605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.659656 (+931027us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54003d0254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:14.659841 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614625536}
I20260709 12:15:14.661545 10048 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:14.642702 12624 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:15:14.666885 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.669740 13084 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.671669 12547 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.650775 12764 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:14.674659 10020 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.078s (SENT)
I20260709 12:15:14.647903 13097 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.677150 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.677887 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:14.677524 13097 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.679378 13097 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.680239 13041 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.682762 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.683470 10122 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:14.684702 10122 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:14.685308 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1934) took 3376 ms. Trace:
I20260709 12:15:14.685616 10122 rpcz_store.cc:276] 0709 12:15:11.308928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.684239 (+3375311us) service_pool.cc:224] Handling call
0709 12:15:14.684524 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.685082 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.685252 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.681262 10200 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:14.688395 10127 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:14.692431 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1933) took 3391 ms. Trace:
I20260709 12:15:14.692809 10127 rpcz_store.cc:276] 0709 12:15:11.301292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.658617 (+3357325us) service_pool.cc:224] Handling call
0709 12:15:14.688202 (+ 29585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.692149 (+  3947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.692365 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.656756 13100 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.695941 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:14.697597 10053 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:14.699041 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.663524 12624 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.701375 13089 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.702628 13092 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.762794 12885 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:14.763238 12885 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:14.764079 12885 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.765270 12885 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.706101 12971 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:14.709760 12868 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:15:14.710304 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:14.712705 13074 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.422s	user 0.001s	sys 0.001s
I20260709 12:15:14.663077 13099 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:14.715466 12385 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:14.718683 12935 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.001s
I20260709 12:15:14.773463 10050 raft_consensus.cc:2410] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:14.775497 12764 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.719563 10053 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:14.775988 12764 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.720734 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.777415 12964 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:14.721544 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:14.781224 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.722776 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.766800 12868 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:14.723088 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.722362 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:14.724038 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:14.762250 13089 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:14.727676 12972 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:14.783612 10735 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:14.783636 13099 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.784991 12972 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:14.785396 12972 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:14.783877 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1922) took 4434 ms. Trace:
I20260709 12:15:14.786711 10130 rpcz_store.cc:276] 0709 12:15:10.349259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.148495 (+799236us) service_pool.cc:224] Handling call
0709 12:15:11.162987 (+ 14492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:11.195398 (+ 32411us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:13.933485 (+2738087us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.168642 (+235157us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:14.184478 (+ 15836us) log.cc:844] Serialized 52 byte log entry
0709 12:15:14.184637 (+   159us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:14.184667 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.712113 (+527446us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:14.745183 (+ 33070us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54001d6d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:14.745239 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.783664 (+ 38425us) raft_consensus.cc:1685] finished
0709 12:15:14.783683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.783812 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2725570,"prepare.queue_time_us":2752535,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":4869,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":11629,"spinlock_wait_cycles":78863488,"thread_start_us":234376,"threads_started":1,"wal-append.queue_time_us":307200}
I20260709 12:15:14.786240 12972 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.789960 12624 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.790827 10054 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:14.791034 12624 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:14.793885 10054 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:14.798123 13083 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.506s	user 0.003s	sys 0.000s
I20260709 12:15:14.799546 13082 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:14.801331 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1356) took 1378 ms (client timeout 1551 ms). Trace:
W20260709 12:15:14.801745 10129 rpcz_store.cc:269] 0709 12:15:13.422412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.680732 (+258320us) service_pool.cc:224] Handling call
0709 12:15:14.801162 (+1120430us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400172d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:14.801270 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364264832}
I20260709 12:15:14.804073 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2062) took 1002 ms. Trace:
W20260709 12:15:14.805536 13073 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.519s	user 0.000s	sys 0.000s
I20260709 12:15:14.790222 12972 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:14.809134 13071 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.627s	user 0.000s	sys 0.002s
I20260709 12:15:14.804476 10049 rpcz_store.cc:276] 0709 12:15:13.801556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.811334 (+  9778us) service_pool.cc:224] Handling call
0709 12:15:14.803894 (+992560us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400276ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:14.803998 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420044544}
W20260709 12:15:14.731993 13087 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.002s
I20260709 12:15:14.731546 13042 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.732535 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:14.733078 13055 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:14.733726 13004 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:14.736347 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:14.823087 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87112.4us
W20260709 12:15:14.823549 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 176119us
I20260709 12:15:14.824293 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.824689 12964 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:14.825160 12964 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:14.738514 12339 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.741271 10121 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:15:14.825536 12587 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.409569 10125 rpcz_store.cc:276] 0709 12:15:11.160812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.209839 (+2049027us) service_pool.cc:224] Handling call
0709 12:15:13.210148 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.223309 (+ 13161us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:14.162192 (+938883us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.408648 (+246456us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.408826 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.408873 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:14.408925 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.408992 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.409126 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":746457,"prepare.queue_time_us":801366,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":5976,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":29739,"spinlock_wait_cycles":17133952,"thread_start_us":417732,"threads_started":2}
W20260709 12:15:14.741137 10124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 357) took 1671 ms (client timeout 1838 ms). Trace:
I20260709 12:15:14.826231 12587 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:14.826493 10124 rpcz_store.cc:269] 0709 12:15:13.070226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.100099 (+ 29873us) service_pool.cc:224] Handling call
0709 12:15:14.740929 (+1640830us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400172854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:14.741081 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658256128}
I20260709 12:15:14.827561 10125 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:15:14.826107 12339 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.828166 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1322) took 3018 ms. Trace:
I20260709 12:15:14.732993 10127 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:15:14.829097 12587 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.829442 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1938) took 3366 ms. Trace:
I20260709 12:15:14.703480 13100 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.825560 12964 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:14.825646 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.765852 12578 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:14.834702 12587 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:14.730674 13065 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:14.811542 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:14.835469 10123 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:15:14.836001 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1350) took 1415 ms (client timeout 1632 ms). Trace:
W20260709 12:15:14.836344 10123 rpcz_store.cc:269] 0709 12:15:13.421070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.811278 (+1390208us) service_pool.cc:224] Handling call
0709 12:15:14.835931 (+ 24653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.812351 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 360) took 1449 ms. Trace:
I20260709 12:15:14.828512 10125 rpcz_store.cc:276] 0709 12:15:11.810225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.826948 (+3016723us) service_pool.cc:224] Handling call
0709 12:15:14.827305 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:14.827915 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.828115 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.829811 10127 rpcz_store.cc:276] 0709 12:15:11.463492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.732400 (+3268908us) service_pool.cc:224] Handling call
0709 12:15:14.732761 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.829151 (+ 96390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.829388 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.812144 10054 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.840961 10054 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.842027 10125 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:14.843652 10127 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:14.844305 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1943) took 2627 ms. Trace:
I20260709 12:15:14.844614 10127 rpcz_store.cc:276] 0709 12:15:12.217084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.843188 (+2626104us) service_pool.cc:224] Handling call
0709 12:15:14.843497 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.844069 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.844252 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.826542 12904 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:14.845757 12904 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.846205 12904 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.835132 12587 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.846966 12587 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:14.847410 10051 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
W20260709 12:15:14.851275 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 118817us
I20260709 12:15:14.845728 10127 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:14.851739 10054 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:14.786203 13099 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:14.852370 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2053) took 1836 ms. Trace:
I20260709 12:15:14.851311 13055 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:14.851382 13052 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.853201 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1946) took 2465 ms. Trace:
I20260709 12:15:14.831758 13100 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:14.771646 12896 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.782716 12868 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:14.852303 13046 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:15:14.853808 10127 rpcz_store.cc:276] 0709 12:15:12.388222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.845281 (+2457059us) service_pool.cc:224] Handling call
0709 12:15:14.845578 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.851991 (+  6413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.853148 (+  1157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.852823 10054 rpcz_store.cc:276] 0709 12:15:13.015823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.030443 (+ 14620us) service_pool.cc:224] Handling call
0709 12:15:13.063246 (+ 32803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.790739 (+1727493us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54000e2020. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:14.852115 (+ 61376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.852312 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419998592}
I20260709 12:15:14.855690 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 353) took 2747 ms. Trace:
I20260709 12:15:14.837136 10047 rpcz_store.cc:276] 0709 12:15:13.362981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.652741 (+289760us) service_pool.cc:224] Handling call
0709 12:15:13.694867 (+ 42126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:13.870739 (+175872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:13.870769 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:13.871279 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.070648 (+199369us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.070687 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.070752 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.808575 (+737823us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:14.812070 (+  3495us) raft_consensus.cc:1685] finished
0709 12:15:14.812090 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.812289 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175493,"raft.queue_time_us":176619,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":26303232,"thread_start_us":199020,"threads_started":1,"wal-append.queue_time_us":274184}
I20260709 12:15:14.859633 10125 rpcz_store.cc:276] 0709 12:15:12.111018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.841521 (+2730503us) service_pool.cc:224] Handling call
0709 12:15:14.841848 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.842522 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.855624 (+ 13102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.860179 12896 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.860806 10127 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:14.861044 10125 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:14.861209 10195 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
I20260709 12:15:14.863462 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 359) took 1791 ms. Trace:
I20260709 12:15:14.863567 10123 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:14.864295 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1941) took 2820 ms. Trace:
I20260709 12:15:14.864620 10123 rpcz_store.cc:276] 0709 12:15:12.044163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.841430 (+2797267us) service_pool.cc:224] Handling call
0709 12:15:14.863411 (+ 21981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.864050 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.864244 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.825278 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:14.851965 12993 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.852852 13042 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:14.871009 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 356) took 2444 ms. Trace:
I20260709 12:15:14.852999 13055 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:14.872588 10127 rpcz_store.cc:276] 0709 12:15:12.426414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.860312 (+2433898us) service_pool.cc:224] Handling call
0709 12:15:14.860648 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.870699 (+ 10051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.870945 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:14.885496 10020 leader_election.cc:336] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.940s (SENT)
W20260709 12:15:14.893411 10020 leader_election.cc:336] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.528s (SENT)
I20260709 12:15:14.893922 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.895808 12935 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.866511 10125 rpcz_store.cc:276] 0709 12:15:13.072454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.860490 (+1788036us) service_pool.cc:224] Handling call
0709 12:15:14.860757 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.863200 (+  2443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.863406 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:14.866266 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.906018 13099 raft_consensus.cc:2764] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:15:14.907712 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.908906 13099 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:14.909488 13099 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.911056 13099 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:14.918370 12339 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:14.920212 12339 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.922825 12339 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:14.862361 12896 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:14.932073 13055 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.933389 13055 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:14.909358 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.946264 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.946717 10123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:15:14.946949 12339 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:14.858366 13052 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:14.948832 10203 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:14.929052 12868 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:14.931044 13106 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:15:14.966820 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:14.970611 12624 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:14.960516 12339 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:14.974767 12896 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:14.982211 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:14.979838 12624 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.998792 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:14.997975 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 350) took 3649 ms. Trace:
I20260709 12:15:15.001176 10122 rpcz_store.cc:276] 0709 12:15:11.349089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.686725 (+3337636us) service_pool.cc:224] Handling call
0709 12:15:14.687050 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.687251 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.814049 (+126798us) log.cc:844] Serialized 14 byte log entry
0709 12:15:14.994386 (+180337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:14.994464 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:14.997712 (+  3248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.997792 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.997913 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126472,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":306,"thread_start_us":179989,"threads_started":1}
I20260709 12:15:15.005839 10122 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:14.991997 13104 raft_consensus.cc:2764] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:15:14.996624 12624 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:15.010742 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.002888 13082 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.014859 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 360) took 1839 ms. Trace:
I20260709 12:15:15.014038 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:15.010149 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 168473us
I20260709 12:15:15.024866 10122 rpcz_store.cc:276] 0709 12:15:13.175676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.005363 (+1829687us) service_pool.cc:224] Handling call
0709 12:15:15.005671 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.014592 (+  8921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.014798 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.026063 12972 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:15.029645 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.032676 10122 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:15:15.033262 12339 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.035429 12964 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.036547 13104 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:15.037213 12587 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:15.037988 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.038180 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:15.038959 13104 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:15.039336 13104 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:15.039675 13104 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:15.037626 12964 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.047962 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 361) took 1871 ms. Trace:
I20260709 12:15:15.050537 10122 rpcz_store.cc:276] 0709 12:15:13.176405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.032111 (+1855706us) service_pool.cc:224] Handling call
0709 12:15:15.032446 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.047662 (+ 15216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.047898 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.049705 13104 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.002676 12896 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:15:15.054999 12896 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:15.055377 12896 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:15.055441 13039 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.055629 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:15.056226 13039 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.056726 10728 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:15:15.056396 12896 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.049288 12587 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.059828 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1338) took 3128 ms. Trace:
I20260709 12:15:15.060252 12896 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.060707 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:15.060225 10124 rpcz_store.cc:276] 0709 12:15:11.931816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.827418 (+2895602us) service_pool.cc:224] Handling call
0709 12:15:14.827700 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.828079 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:14.828107 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.828583 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.980639 (+152056us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:14.983961 (+  3322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.984056 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.059591 (+ 75535us) raft_consensus.cc:1685] finished
0709 12:15:15.059612 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.059743 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1972,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":151688,"threads_started":1,"wal-append.queue_time_us":185088}
I20260709 12:15:15.064035 10124 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:15:15.065286 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:15.067932 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1345) took 1648 ms. Trace:
I20260709 12:15:15.068624 10124 rpcz_store.cc:276] 0709 12:15:13.419796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.063547 (+1643751us) service_pool.cc:224] Handling call
0709 12:15:15.063827 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.067655 (+  3828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.067870 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.069070 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.084273 12903 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:15.086277 10020 leader_election.cc:336] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.140s (SENT)
I20260709 12:15:15.086825 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.093441 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1362) took 1607 ms. Trace:
I20260709 12:15:15.094039 12904 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.080643 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 351) took 3604 ms. Trace:
I20260709 12:15:15.097766 10130 rpcz_store.cc:276] 0709 12:15:11.476015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.788550 (+3312535us) service_pool.cc:224] Handling call
0709 12:15:14.788895 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.789084 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.981698 (+192614us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.080120 (+ 98422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.080197 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:15.080260 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.080367 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.080558 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51682,"prepare.queue_time_us":62805,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":109,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":226972,"threads_started":2}
W20260709 12:15:15.112399 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.138419 13104 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:15.139071 10129 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:15.060125 13039 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:15.093987 10127 rpcz_store.cc:276] 0709 12:15:13.485923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.092624 (+1606701us) service_pool.cc:224] Handling call
0709 12:15:15.092932 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.093109 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.093133 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.093172 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:15.093200 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.093250 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.093356 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.163311 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 364) took 1227 ms. Trace:
I20260709 12:15:15.059253 12624 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.142482 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.143436 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 365) took 1207 ms. Trace:
W20260709 12:15:15.149657 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.184484 10048 rpcz_store.cc:276] 0709 12:15:13.936235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.664969 (+728734us) service_pool.cc:224] Handling call
0709 12:15:14.665295 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.665513 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.993217 (+327704us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.143060 (+149843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.143121 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:15.143163 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.143236 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.143373 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7690,"prepare.queue_time_us":355255,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":46932,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3758,"thread_start_us":429569,"threads_started":2}
I20260709 12:15:15.150967 10123 raft_consensus.cc:606] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.151124 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1312) took 3343 ms. Trace:
I20260709 12:15:15.186324 10129 rpcz_store.cc:276] 0709 12:15:11.807946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.802669 (+2994723us) service_pool.cc:224] Handling call
0709 12:15:14.802975 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.138884 (+335909us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b540011d620. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:15.150814 (+ 11930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.151066 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98923776}
I20260709 12:15:15.163811 10046 rpcz_store.cc:276] 0709 12:15:13.936039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.663407 (+727368us) service_pool.cc:224] Handling call
0709 12:15:14.691109 (+ 27702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.691326 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:14.982591 (+291265us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.162807 (+180216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.162864 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:15.162911 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.162990 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.163192 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12031,"prepare.queue_time_us":339890,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":456431,"threads_started":2}
I20260709 12:15:15.106055 10124 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:15:15.163614 10126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.027s
W20260709 12:15:15.170193 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.188163 10126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.017s	sys 0.027s
I20260709 12:15:15.182891 10130 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:15.188913 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 349) took 4006 ms. Trace:
I20260709 12:15:15.191330 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1348) took 1770 ms. Trace:
I20260709 12:15:15.191787 10124 rpcz_store.cc:276] 0709 12:15:13.420493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.069936 (+1649443us) service_pool.cc:224] Handling call
0709 12:15:15.070214 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.187511 (+117297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.191266 (+  3755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:15.151651 13046 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:15.218950 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 172704us
I20260709 12:15:15.218532 13100 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:15.237811 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.245119 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:15.226315 12904 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.249702 12928 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:15.250260 12928 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:15.250681 12928 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:15.261945 13093 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:15:15.285326 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.285771 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59182.7us
I20260709 12:15:15.273451 13099 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:15:15.277609 13082 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:15:15.299795 13121 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:15:15.301355 13082 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:15.301826 13082 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:15.302680 13082 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.304023 13082 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:15.315452 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.285066 12928 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.318815 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:15.319792 13109 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 12:15:15.322686 13042 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.334587 13089 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:15.335148 13089 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:15.324692 12885 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:15:15.337145 13089 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.341643 10197 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:15:15.341959 10020 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.747s (SENT)
I20260709 12:15:15.347656 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:15.360780 13081 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.088s	user 0.003s	sys 0.000s
I20260709 12:15:15.348995 12885 consensus_queue.cc:1243] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:15.364686 10204 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:15.366530 13125 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 12:15:15.384151 12928 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:15.384891 13052 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:15.389257 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.391511 12764 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.394126 12547 raft_consensus.cc:1064] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
W20260709 12:15:15.394634 12547 raft_consensus.cc:1068] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Unable to promote non-voter 4b3390fbbe574de7bf154b5a6cc35677: Service unavailable: leader transfer in progress
I20260709 12:15:15.394853 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.395714 13135 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:15.396153 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.189252 10126 rpcz_store.cc:276] 0709 12:15:11.183073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.651699 (+3468626us) service_pool.cc:224] Handling call
0709 12:15:14.652016 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.652204 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.662645 (+ 10441us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.188601 (+525956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.188657 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:15.188697 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.188760 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.188862 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5773,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1673,"raft.queue_time_us":851,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":19044,"spinlock_wait_cycles":70656,"thread_start_us":525662,"threads_started":1}
I20260709 12:15:15.386119 13093 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:15.398797 13093 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:15.399719 13093 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.400995 13093 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:15.357697 13089 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:15.406672 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:15.407028 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 83725.5us
I20260709 12:15:15.408651 10124 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:15.410144 10129 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:15.410530 10127 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:15.413532 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.415337 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.423085 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.424867 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.422654 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.447897 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.416203 12547 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:15.448625 12547 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.450870 12547 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.414933 13026 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.451500 13026 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.453482 13026 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.454141 12885 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.414672 12868 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:15.454891 12868 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:15.455246 12868 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.456110 12868 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.457252 12868 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:15.458593 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.425287 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.459334 10130 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
W20260709 12:15:15.461156 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54542.2us
I20260709 12:15:15.422274 13004 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:15.465564 10128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 1950) took 1674 ms (client timeout 2029 ms). Trace:
I20260709 12:15:15.424263 13024 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:15.470268 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.468107 10128 rpcz_store.cc:269] 0709 12:15:13.791054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.595574 (+804520us) service_pool.cc:224] Handling call
0709 12:15:15.465376 (+869802us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b5400173754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:15.465502 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118853888}
I20260709 12:15:15.470700 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.471702 10129 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:15.473361 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61441us
I20260709 12:15:15.471772 10127 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:15.472829 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.479038 10130 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
W20260709 12:15:15.480786 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55994.1us
I20260709 12:15:15.472975 13026 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:15.484334 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:15.487002 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.488380 10734 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:15.490665 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.472316 13004 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.498662 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:15.501645 10130 raft_consensus.cc:1217] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-7.8]   Dedup: 5.7->[7.8-7.8]
I20260709 12:15:15.502097 10130 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:15:15.474319 13024 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.505213 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:15.487289 12547 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:15.489846 13026 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:15.508917 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1771) took 2095 ms. Trace:
I20260709 12:15:15.512004 13025 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.513155 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.513665 10050 rpcz_store.cc:276] 0709 12:15:13.413699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.605039 (+191340us) service_pool.cc:224] Handling call
0709 12:15:15.508725 (+1903686us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002756d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:15.508862 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684562688}
I20260709 12:15:15.515478 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.518633 10130 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:15.522959 10125 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:15.510005 12547 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.534765 12547 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.537479 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 371) took 1600 ms. Trace:
I20260709 12:15:15.508509 13039 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:15.538829 13039 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:15.540032 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.539732 13039 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.534310 12885 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:15.541010 12725 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:15.541857 12725 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:15.542191 12725 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:15.542194 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 446194us
I20260709 12:15:15.543205 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.544333 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.543706 12725 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.544767 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:15.545430 10195 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:15.546988 10050 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:15:15.547381 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 205446us
I20260709 12:15:15.547040 12971 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:15.548378 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.548965 10048 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:15.549991 13065 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:15.550464 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.550763 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.551191 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.551507 10046 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:15.552538 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.553045 10123 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:15.554271 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.508479 12890 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:15.555313 12890 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:15.555503 10051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2048) took 2545 ms (client timeout 1503 ms). Trace:
W20260709 12:15:15.555867 10051 rpcz_store.cc:269] 0709 12:15:13.009922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.010950 (+  1028us) service_pool.cc:224] Handling call
0709 12:15:15.555299 (+2544349us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003f98d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:15.555413 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4185615104}
I20260709 12:15:15.556182 12890 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.557281 12890 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.558606 12971 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.559490 13136 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:15.560562 12971 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:15.561429 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:15.561730 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:15.561883 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.562408 10195 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:15.562608 13004 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:15.563184 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:15.563351 10127 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:15.533578 13064 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:15.559690 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.571246 10126 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:15.563740 10198 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:15.531745 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.564577 10201 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.545034 10124 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:15.562160 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:15.550365 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.573633 10204 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:15.572603 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.531036 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.576303 10130 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.584335 10129 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:15.585701 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.592860 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:15.596865 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 104349us
I20260709 12:15:15.597390 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.598089 10055 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:15.537876 10052 rpcz_store.cc:276] 0709 12:15:13.937500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.735588 (+798088us) service_pool.cc:224] Handling call
0709 12:15:14.735842 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.736019 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:14.970933 (+234914us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.152702 (+181769us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.369118 (+216416us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180014e5a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:15.536964 (+167846us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b180014e5a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:15.537119 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:15.537175 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:15.537218 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.537288 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.537419 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197450,"prepare.queue_time_us":333635,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":73,"raft.queue_time_us":404025,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"spinlock_wait_cycles":10884736,"thread_start_us":410554,"threads_started":2,"wal-append.queue_time_us":251950}
I20260709 12:15:15.599216 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:15.596704 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.600792 10049 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:15.607345 10054 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:15.604987 10019 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:15.607918 10019 leader_election.cc:403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:15:15.608129 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.606503 10123 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:15.607146 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:15.606834 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.545430 12904 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:15.605926 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.616655 10048 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:15.622923 10053 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:15.583705 13064 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.591992 13111 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.586652 13082 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.642510 13149 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:15:15.643458 13148 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:15.644862 13148 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:15.645694 13148 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:15.646041 13148 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.637032 12928 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.646935 12928 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.649209 12928 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:15.627748 12904 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.651871 12904 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.652182 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1342) took 2233 ms. Trace:
I20260709 12:15:15.652182 13135 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:15.612614 13065 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:15.590619 12725 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.652592 10122 rpcz_store.cc:276] 0709 12:15:13.418939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.051459 (+1632520us) service_pool.cc:224] Handling call
0709 12:15:15.051806 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.069516 (+ 17710us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:15.151296 (+ 81780us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.464483 (+313187us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18003a2340. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a 00007fc17e79aa2a
0709 12:15:15.497405 (+ 32922us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.506931 (+  9526us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.507093 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:15.508023 (+   930us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.511927 (+  3904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.512012 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:15.651913 (+139901us) raft_consensus.cc:1685] finished
0709 12:15:15.651938 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:15.652085 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5226,"prepare.queue_time_us":81757,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":1802,"raft.queue_time_us":7754,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":4338,"spinlock_wait_cycles":10459520,"thread_start_us":32657,"threads_started":1,"wal-append.queue_time_us":408538}
I20260709 12:15:15.627688 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.655257 13024 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:15.655133 12885 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:15.656486 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.657074 12885 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:15.657851 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.653748 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:15.658879 13064 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.629565 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.660166 10052 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:15.603205 12903 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.661495 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.662716 12972 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:15.663136 12972 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:15.663498 12972 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.591775 12964 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.666320 13100 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:15.667011 10046 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:15:15.667920 13082 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.668412 12885 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:15.653734 13065 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:15.669490 13065 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:15.668387 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1932) took 4501 ms. Trace:
I20260709 12:15:15.670817 10121 rpcz_store.cc:276] 0709 12:15:11.167054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:14.651236 (+3484182us) service_pool.cc:224] Handling call
0709 12:15:14.741044 (+ 89808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.826058 (+ 85014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.668196 (+842138us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b5400172850. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:15.668329 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205767040}
I20260709 12:15:15.621791 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.672374 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.620695 10201 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:15.653319 13135 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.658917 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.676656 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.633605 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.679790 10050 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:15.636375 10049 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:15.687994 10734 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:15.690155 10734 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:15.691506 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.692133 10123 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:15.618260 10055 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:15.696031 10055 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:15.697135 10130 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:15.693238 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.660137 13064 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.706019 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:15.707818 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:15.693266 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.709547 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:15.710568 10054 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:15:15.670382 12885 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.716627 10052 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:15.720338 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:15.726925 12885 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.693763 13149 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:15.709033 13004 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:15.737234 12928 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:15:15.741287 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 269377us
I20260709 12:15:15.742944 10052 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:15.745326 10052 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 5. Current term is 6. Ops: []
W20260709 12:15:15.754124 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.758968 10129 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:15:15.769132 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.772518 13042 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:15.773276 10047 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:15:15.775092 13095 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:15.775599 13095 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:15.728086 13148 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.776465 13148 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:15.778501 13136 consensus_queue.cc:1175] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 12:15:15.779956 13096 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.780468 13096 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:15.783183 12547 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.784786 12624 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:15.785372 12547 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:15.787190 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.787125 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.787930 10051 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:15.788386 10128 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:15.789559 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:15.790069 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.740262 13089 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:15.790740 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.794181 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.794579 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:15.793406 10125 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:15.799451 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:15.804013 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.806576 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.807931 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:15.838059 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.803340 13089 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.794822 12547 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:15:15.900050 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 293371us
I20260709 12:15:15.901994 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.903702 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:15.876685 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:15.907665 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.908730 10055 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:15.909683 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.910847 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:15.911736 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:15.788964 12725 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:15.809321 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.794384 13096 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:15.883651 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.884497 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:15.885689 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:15.837460 13138 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:15:15.732271 13027 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:15:15.893635 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 85771.3us
I20260709 12:15:15.893635 10047 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:15.775281 12868 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:15:15.925503 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:15.926262 10054 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:15.879715 13004 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:15.879969 13024 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:15.938048 10052 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:15:15.776573 13095 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:15.930704 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 326250us
I20260709 12:15:15.932204 10054 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:15:15.885295 12964 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.901113 13039 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:15.935607 13145 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.924469 10051 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:15.941531 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:15.930039 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 174567us
I20260709 12:15:15.943559 10054 pending_rounds.cc:85] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 10
I20260709 12:15:15.976920 10054 pending_rounds.cc:107] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:15:15.977231 10054 raft_consensus.cc:2889] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:15.899080 13089 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:15.945868 13096 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:15:15.943205 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:15.945372 10201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:15:15.982560 10201 raft_consensus.cc:606] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:15.942140 10053 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:15.938465 10052 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:15:15.931021 12725 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.928131 13046 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:15.940196 12587 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:15.989147 10203 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:15:15.989575 10203 pending_rounds.cc:85] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:15:15.989802 10203 pending_rounds.cc:107] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:15:15.990036 10203 raft_consensus.cc:2889] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:15.943876 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:15.946165 13006 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.974169 12868 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:15.986606 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43481.4us
I20260709 12:15:15.993831 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:15.976372 12928 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:15.955842 12964 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:15.985061 13150 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:15:16.000619 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 94924.4us
I20260709 12:15:15.983403 12971 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:15.983409 10052 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.7
I20260709 12:15:16.005172 10052 raft_consensus.cc:2917] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Aborting config change with OpId 10.7: Aborted: Op aborted by new leader
I20260709 12:15:16.005591 10052 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:16.002573 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 58757.5us
I20260709 12:15:15.981832 13082 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:16.008332 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:15.994007 13025 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:16.033636 10047 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:16.009195 12928 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:16.061079 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.957749 13145 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:15.976940 12624 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:15:16.075439 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:16.074494 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 66230.8us
I20260709 12:15:15.985719 13100 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:15:16.077560 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 72134us
I20260709 12:15:16.076653 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:16.006635 13039 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:15.980667 12904 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.077508 13052 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:16.083686 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:16.085363 13159 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:15:16.088773 13160 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:15:16.090106 13164 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:15:16.091852 12725 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.093516 12903 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:16.094784 12964 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.095791 13046 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:16.100512 13046 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.100564 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.101562 10735 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:15:16.134184 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57589.5us
W20260709 12:15:16.097728 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 129383us
I20260709 12:15:16.077124 13027 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.999954 12868 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:16.223675 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.233049 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.233920 10203 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:16.170471 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:16.235539 10203 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:16.236307 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65919.1us
I20260709 12:15:16.240332 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.241310 10197 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:15:16.166024 13157 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:15:16.104975 13046 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:16.099406 13052 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.249459 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:16.253949 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:16.254750 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 167530us
I20260709 12:15:16.256724 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.171206 12964 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:16.268405 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.270037 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.271634 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.272986 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.292550 10735 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:15:16.298781 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49402.2us
I20260709 12:15:16.249698 12725 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:16.310035 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:16.266608 13052 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:16.312983 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:16.313490 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.171013 13042 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.109s
W20260709 12:15:16.307157 12885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.020s
I20260709 12:15:16.328980 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:16.307982 13096 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:16.246275 13027 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:16.331918 13064 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
W20260709 12:15:16.332595 12885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.021s
I20260709 12:15:16.325235 13162 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:16.304874 12903 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:15:16.307801 13082 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:15:16.314719 12624 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:15:16.339690 13169 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:16.276196 12928 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:16.383136 13166 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:15:16.385260 13145 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:16.386849 13161 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:15:16.362020 13162 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.392256 13162 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:16.393776 13148 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.002s
W20260709 12:15:16.397060 13065 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.001s
I20260709 12:15:16.345657 13165 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:15:16.487761 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 408175us
W20260709 12:15:16.489075 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 236968us
W20260709 12:15:16.510087 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 180995us
I20260709 12:15:16.516517 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1373) took 1004 ms. Trace:
I20260709 12:15:16.520169 10122 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
W20260709 12:15:16.524068 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.524308 10129 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:16.532938 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:16.533704 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.544631 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.555378  9951 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 6, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:16.366675 12725 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:16.557945 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:16.617754 13039 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:16.618670 13172 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:16.619508 13039 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.563047 12904 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.569017 12885 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.623411 12885 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.617836 12725 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:16.624437 12725 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:16.445752 12964 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:16.571291 12868 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.572548 12578 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.576138 12764 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.633019 12764 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.618541 10124 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:16.576558 12972 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.913s	user 0.012s	sys 0.008s
I20260709 12:15:16.581933 12928 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:16.586201 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:16.587203 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 592324us
I20260709 12:15:16.588634 12547 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:16.431672 13164 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:16.660104 13098 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:16.660526 13135 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.592018 13027 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.369418 13169 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.603598 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:16.430241 13065 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.608461 13186 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.616689 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:16.617445 13187 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.559242 12587 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.622236 13018 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.626085 12885 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.627907 10733 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:16.632135 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:16.631846 12578 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.637142 12928 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.637941 12764 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.639132 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:16.639165 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53426.5us
I20260709 12:15:16.599355 10128 rpcz_store.cc:276] 0709 12:15:15.512273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.512388 (+   115us) service_pool.cc:224] Handling call
0709 12:15:16.515877 (+1003489us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400232b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:16.516208 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625824000}
I20260709 12:15:16.643383 12547 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.639458 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.639533 12972 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.637974 12964 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.639169 13006 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:16.639402 12890 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:15:16.653724 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:16.654332 13145 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:16.591087 13096 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:16.662704 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:16.794052 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 131529us
I20260709 12:15:16.794667 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 733) took 1276 ms. Trace:
I20260709 12:15:16.795055 10737 rpcz_store.cc:276] 0709 12:15:15.484318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.484459 (+   141us) service_pool.cc:224] Handling call
0709 12:15:15.485145 (+   686us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:15.713312 (+228167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.713346 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:15.713906 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:15:15.930679 (+216773us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:15.950036 (+ 19357us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.951105 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.951206 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.691375 (+740169us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b1800095ec0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:16.728845 (+ 37470us) raft_consensus.cc:1685] finished
0709 12:15:16.742710 (+ 13865us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.760201 (+ 17491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3086,"prepare.queue_time_us":18158,"prepare.run_cpu_time_us":2000,"prepare.run_wall_time_us":10343,"raft.queue_time_us":32450,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":2252,"spinlock_wait_cycles":8984960,"thread_start_us":410445,"threads_started":2,"wal-append.queue_time_us":238914}
W20260709 12:15:16.678853 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.679438 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.800904 13052 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.794000 13096 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.803210 13052 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.803937 13052 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:16.680998 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:16.617640 13183 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:15:16.682091 10200 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:16.687139 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:16.694782 13098 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:16.809437 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 177499us
I20260709 12:15:16.809867 13098 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:16.697283 13177 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
I20260709 12:15:16.707988 13111 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.709075 13135 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:16.717083 13046 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.721189 12725 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.811105 13179 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:16.810822 13184 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:16.811946 13179 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.813393 12725 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.732913 13100 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.765406 13018 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:16.766657 13027 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.814494 13100 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.815968 13179 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.816773 13100 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:16.814474 13184 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:16.819533 13184 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:16.820766 13184 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.810791 13192 raft_consensus.cc:2764] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:15:16.824158 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 376) took 1154 ms. Trace:
I20260709 12:15:16.824384 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.826663 13197 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.827368 13197 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.828843 13111 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.829803 13197 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.831105 13111 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:16.768452 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 151936us
I20260709 12:15:16.766703 12587 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.834412 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:16.835721 12587 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.782799 12578 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.783390 13065 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.836035 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:16.787886 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:16.837019 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49331.8us
I20260709 12:15:16.837400 13095 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:16.837705 13027 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:16.838514 13017 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:16.838835 13024 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:16.839002 13017 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:16.839421 13024 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:16.840283 13017 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.840606 13024 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.841712 13017 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:16.837884 13100 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:16.779655 13186 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:16.789590 13089 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.005s
I20260709 12:15:16.789798 12972 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.790493 10048 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 5.
I20260709 12:15:16.792598 12547 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.798766 12904 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:16.799383 10050 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:16.799611 13185 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.800032 13025 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.799985 10124 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:16.800503 13004 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.797726 13187 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.818730 13145 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.833611 13018 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:16.781118 13169 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:16.800841 10121 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:16.842960 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 162154us
I20260709 12:15:16.837698 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:16.844563 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:16.834178 10125 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:16.842381 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:16.798342 10020 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:16.848523 10122 rpcz_store.cc:276] 0709 12:15:15.669693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.669875 (+   182us) service_pool.cc:224] Handling call
0709 12:15:16.519221 (+849346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:16.623542 (+104321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.823931 (+200389us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400232b50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:16.824085 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952131328}
I20260709 12:15:16.816144 13046 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.844933 13186 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:16.836896 12928 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:16.860494 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.872624 10202 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:16.858840 12904 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:16.878067 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:16.893929 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:16.893249 10732 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:16.886061 12904 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:16.923290 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:16.925268 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:16.889086 13004 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.928606 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2078) took 1370 ms. Trace:
I20260709 12:15:16.929100 10048 rpcz_store.cc:276] 0709 12:15:15.557968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.658698 (+100730us) service_pool.cc:224] Handling call
0709 12:15:16.928339 (+1269641us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400274cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:16.928522 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552860416}
I20260709 12:15:16.930861 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:16.932014 13082 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:16.934963 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2072) took 1378 ms. Trace:
I20260709 12:15:16.935374 10050 rpcz_store.cc:276] 0709 12:15:15.556663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.690095 (+133432us) service_pool.cc:224] Handling call
0709 12:15:15.703856 (+ 13761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:16.870155 (+1166299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.934673 (+ 64518us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:16.934885 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508194176}
W20260709 12:15:16.923821 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 86305.2us
I20260709 12:15:16.896143 13018 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:16.930125 13004 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:16.943150 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50983.3us
I20260709 12:15:16.858664 13089 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.953840 10737 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:16.900637 12587 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:16.968608 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 124209us
I20260709 12:15:16.873309 13185 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:16.973824 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:16.975307 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:16.942832 12547 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:16.875938 13025 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:16.970392 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:16.960888 13039 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.978658 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:16.981722 12578 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:16.982026 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:16.982867 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:16.984157 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:16.984804 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 186689us
I20260709 12:15:16.986935 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:16.981526 13026 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:16.998311 10734 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:17.008246 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:17.015018 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.015336 13089 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:17.016659 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54249.9us
I20260709 12:15:17.019908 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:16.990451 13026 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.998039 13184 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.023831 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:17.025293 13025 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:17.026825 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 76663.3us
I20260709 12:15:17.027245 13042 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.027741 13042 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.028182 13042 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.029337 13006 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:17.029795 13006 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:17.030148 13006 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.030623 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.032436 13039 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.034744 13039 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.006335 12547 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.035547 13145 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.036868 12547 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.019379 13186 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.038451 13185 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:16.993073 12587 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.040927 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.041649 10200 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.027801 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:17.052439 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.064702 10200 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:17.066164 10195 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 5.
W20260709 12:15:17.067031 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60146.3us
I20260709 12:15:17.022040 13082 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.023216 13026 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.071012 13167 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:17.071432 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:17.073030 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54054.7us
I20260709 12:15:17.073606 13082 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.062849 12964 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.077795 13025 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:17.038791 13186 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:17.083541 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.085381 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.090948 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.091213 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:17.091881 10200 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:17.093377 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:17.095525 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67849.7us
I20260709 12:15:17.096748 13167 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.090143 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.099555 13167 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.104444 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.105237 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:17.107347 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.108304 10051 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:17.111317 13089 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.111960 13089 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.114087 13089 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.083482 13186 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:17.115298 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62944us
I20260709 12:15:17.117465 13183 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.118027 13183 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:17.118378 13183 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.119048 13148 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.119473 13148 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:17.119822 13148 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.121229 10048 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.122874 13098 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:17.123281 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:17.123553 13098 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.125146 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.125757 13098 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.126745 13093 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:17.126286 13098 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:17.092758 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.127189 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.087288 13004 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:17.128008 10732 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:17.082413 13082 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.128829 13098 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:17.129747 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.130617 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:17.131379 13098 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:17.131982 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:17.119755 13006 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.138717 13025 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:17.139456 13025 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.139762 13025 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:17.134632 13027 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.135247 12972 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:17.128269 13004 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:17.140645 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.140444 13169 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.158854 13181 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:17.159338 13181 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:17.159982 13169 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.127142 13093 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.160852 13093 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:17.160365 13181 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.126549 13145 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.119757 12725 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.141346 13185 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.139858 13183 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.145377 12904 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.128690 10734 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.193377 12904 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.127703 10047 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
W20260709 12:15:17.134687 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 63396.1us
I20260709 12:15:17.140200 13025 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.163070 10048 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:17.114581 12587 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.164029 13145 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.181849 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.185241 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:17.186627 10051 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:17.188071 13183 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.188287 12547 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:17.189496 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:17.179894 13006 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.190524 13004 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.157027 13027 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.198375 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.180027 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:17.206274 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:17.167636 12972 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:17.177688 13187 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.217551 12547 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.218712 10053 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:17.219825 12547 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.214769 13027 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.226811 10734 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:17.209570 13145 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:17.228230 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48281.1us
I20260709 12:15:17.204258 12725 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:17.235847 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110751us
I20260709 12:15:17.233716 13006 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.253919 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.249187 10020 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6.
I20260709 12:15:17.254617 10195 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.251057 13194 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.257035 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:17.241163 13046 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.278409 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.278582 13046 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:17.278759 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.240633 13181 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.279449 10737 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:17.280047 10728 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.247223 13006 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.278317 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.237289 13183 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.302204 10728 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:17.321446 10195 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:17.329996 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:17.314201 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.287467 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.302207 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.340785 10201 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:17.340440 10202 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:17.279141 13046 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:17.337849 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 161404us
I20260709 12:15:17.249995 13148 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:17.301985 13206 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:17.314881 12971 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.345604 13095 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.329720 13006 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:17.348451 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.348708 13197 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:17.353024 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 113242us
I20260709 12:15:17.258642 12578 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.280944 13194 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.283547 13004 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.293035 12725 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.362602 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:17.367069 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 83906.7us
I20260709 12:15:17.287381 13210 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:17.296015 13186 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.277603 13202 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.205s
I20260709 12:15:17.295463 13042 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.365552 13095 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.365801 13197 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:17.389647 10200 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:17.389151 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.375398 13194 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.387954 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.386889 13167 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.387835 13148 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:17.390874 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 109844us
I20260709 12:15:17.346872 13026 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.376231 12964 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:17.393069 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.366537 13183 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.315383 12972 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:17.442219 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 252770us
W20260709 12:15:17.442854 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50327.5us
I20260709 12:15:17.443643 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:17.442020 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 58046.8us
W20260709 12:15:17.444813 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51816.8us
I20260709 12:15:17.379667 13196 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:17.395754 13187 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:17.452682 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 64794.4us
I20260709 12:15:17.378121 12971 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.454497 13198 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.455108 13198 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.455597 12971 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.462742 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:17.468468 13197 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.470011 13197 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.474905 13093 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.475579 13082 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.443440 13004 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.450589 12587 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.480086 13198 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.474157 13006 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.381664 12578 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.485589 13027 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.487370 13042 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.489012 12890 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:17.490813 12971 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.491271 13184 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.498811 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.513113 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.448475 13215 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 12:15:17.605605 12928 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:17.619504 12928 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.621724 12928 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.605767 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.532930 13187 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:17.606815 13093 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.607079 12964 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:17.625283 12964 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.626236 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.611893 13006 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.610103 10737 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:17.611935 12578 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.450842 13142 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.613514 13027 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.627761 13142 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.614037 12971 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.629853 13142 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.464883 13052 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:17.630585 13052 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:17.631155 12971 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.631480 13052 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.632369 13145 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.632766 12964 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:17.605326 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 161759us
I20260709 12:15:17.614281 13184 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.599954 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.625566 10200 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:15:17.615002 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 165210us
I20260709 12:15:17.590631 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.440621 13210 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.605839 13217 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:17.513981 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.515753 13095 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.524055 13183 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.613811 12890 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:17.599043 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 148940us
I20260709 12:15:17.635152 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:17.635934 10735 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:15:17.650969 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 60413.3us
I20260709 12:15:17.657115 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.689196 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.752211 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.618713 12587 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:17.615177 13100 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:17.659596 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:17.758237 10196 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:17.676694 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.637698 13065 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:17.635108 13185 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:17.688911 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.692376 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.661000 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.769165 10200 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:17.690845 13213 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.677521 13216 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:15:17.689388 13210 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.700073 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:17.660467 12964 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:17.674619 12890 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.659886 13006 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.683929 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:17.654708 13167 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:15:17.770769 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 111267us
I20260709 12:15:17.695202 13082 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.789594 13065 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:17.791896 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 99641.2us
I20260709 12:15:17.792279 13065 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.792367 13026 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.793418 13213 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.624259 13187 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.763649 10203 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:17.777911 10734 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:17.782469 10737 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.787436 12971 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.787612 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:17.768710 13185 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.781500 12964 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.788197 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:17.763742 13042 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:15:17.639307 13194 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.660725 13027 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 12:15:17.781801 13006 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:17.768011 13025 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.001s
I20260709 12:15:17.697753 13046 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.660089 13039 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:15:17.789579 13167 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:17.776299 13217 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.799088 10196 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:17.813912 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.808738 12964 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:17.815268 13042 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:17.793342 13169 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:17.819933 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:17.825692 10125 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.823395 10124 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:17.799587 13004 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.797839 13145 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:17.668005 12904 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:15:17.832065 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.816150 13100 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:17.821872 13006 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.819059 13186 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.821463 13217 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.823691 13042 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:17.824498 13184 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.816120 12971 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:17.827668 13169 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:17.849776 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.844669 13215 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.850353 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:17.883931 10053 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.852813 13004 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:17.859396 10050 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:17.853194 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.889818 10123 raft_consensus.cc:2376] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9. Re-sending same reply.
I20260709 12:15:17.890859 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:17.891683 10123 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 5: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:17.892599 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.893280 10123 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:17.860589 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:17.893980 10052 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.861270 13046 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:17.862160 13210 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.862993 13042 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.857672 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.858009 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.863031 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.820700 13025 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:17.866784 13186 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.867377 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.844251 13217 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.885111 10125 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:17.842024 12885 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:17.870702 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.903415 10130 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
W20260709 12:15:17.856665 13181 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 12:15:17.902758 10128 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:17.909092 10054 raft_consensus.cc:2410] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:15:17.911012 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:17.914230 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:17.910451 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:17.922372 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 86603us
I20260709 12:15:17.946599 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.922173 10124 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:17.964000 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:17.926872 10121 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:17.957929 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:17.926848 10047 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:17.972661 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:17.974409 13226 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:15:17.984105 10123 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.987993 12971 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:17.908722 12885 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.990690 12885 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.994305 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:17.996259 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 85917us
I20260709 12:15:17.997758 10052 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:17.958137 13042 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:18.005663 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:18.004283 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:17.922577 13215 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.011147 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.011754 10733 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:18.011791 13215 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.016081 13229 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:15:18.019402 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.020553 13082 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:18.022698 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.032703 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.034624 12587 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.035356 10735 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:18.042687 13194 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.043931 13229 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:18.044091 13025 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:18.044581 13229 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:18.045553 13229 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.046818 13229 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:18.057027 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 386) took 1004 ms. Trace:
I20260709 12:15:18.057466 10048 rpcz_store.cc:276] 0709 12:15:17.052763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.052901 (+   138us) service_pool.cc:224] Handling call
0709 12:15:17.083764 (+ 30863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:17.196760 (+112996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:18.045660 (+848900us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540012ff54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:18.056936 (+ 11276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85880064}
I20260709 12:15:18.058969 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:17.945820 13210 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.060520 13096 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:18.060961 13096 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:18.061365 13096 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:17.953593 13186 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:18.062865 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 600203us
I20260709 12:15:18.063808 13186 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:18.064482 10124 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:18.067103 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.067804 10124 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.068082 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.068621 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.068746 10199 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:18.069252 10201 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:18.070340 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.071154 10197 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:18.072100 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.073150 13185 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.073614 10204 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:17.996650 13181 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.068545 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.083482 10124 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:15:17.909440 13004 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.050164 10737 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:18.007453 12971 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:18.081892 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:18.087327 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:18.081293  9950 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 285) took 19676 ms (client timeout 15000 ms). Trace:
I20260709 12:15:18.087620 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.078087 10123 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:18.093451 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.094048 10123 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.102957 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:18.061404 13214 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.612s	user 0.002s	sys 0.000s
I20260709 12:15:18.112951 10053 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:18.016633 13213 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:18.106765 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.107276 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.106885 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:17.915576 13167 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.116492 10202 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:18.081557  9951 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 6, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.061404 13210 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.125367 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.093606 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:18.114848 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:18.119050 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 121204us
I20260709 12:15:17.971979 13169 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.121296 10201 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.110772 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.124251 10129 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.090696 12971 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.118853 10198 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:18.127079 10735 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:18.107527 13089 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.087764 13181 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.128772 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:18.035284 12587 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.132993 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.134527 10199 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:18.135437 13017 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.128753 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:18.091511  9950 rpcz_store.cc:269] 0709 12:14:58.471308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.706573 (+235265us) service_pool.cc:224] Handling call
0709 12:15:18.081050 (+19374477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:10.107278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:10.613542 (+506264us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:10.635399 (+ 21857us) write_op.cc:435] Acquired schema lock
0709 12:15:10.638318 (+  2919us) tablet.cc:662] Decoding operations
0709 12:15:11.244183 (+605865us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:11.256709 (+ 12526us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:11.261014 (+  4305us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:15:11.281241 (+ 20227us) tablet.cc:701] Row locks acquired
0709 12:15:11.281285 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:15:11.281469 (+   184us) write_op.cc:270] Start()
0709 12:15:11.281620 (+   151us) write_op.cc:276] Timestamp: P: 1783599311281401 usec, L: 0
0709 12:15:11.281637 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:15:11.295978 (+ 14341us) log.cc:844] Serialized 7851 byte log entry
0709 12:15:12.569139 (+1273161us) op_driver.cc:464] REPLICATION: finished
0709 12:15:12.884901 (+315762us) write_op.cc:301] APPLY: starting
0709 12:15:12.885046 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:12.885473 (+   427us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:12.885614 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:13.259317 (+373703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:13.259677 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:15:13.259724 (+    47us) write_op.cc:312] APPLY: finished
0709 12:15:13.260217 (+   493us) log.cc:844] Serialized 139 byte log entry
0709 12:15:13.260427 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:13.260616 (+   189us) write_op.cc:454] Released schema lock
0709 12:15:13.260688 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:13.261095 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:13.261127 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52883,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":281541,"apply.run_cpu_time_us":7919,"apply.run_wall_time_us":383676,"num_ops":20,"prepare.queue_time_us":539989,"prepare.run_cpu_time_us":43974,"prepare.run_wall_time_us":1720662,"raft.queue_time_us":444551,"raft.run_cpu_time_us":14739,"raft.run_wall_time_us":233298,"replication_time_us":1261851,"spinlock_wait_cycles":66304,"thread_start_us":1110371,"threads_started":4,"wal-append.queue_time_us":548637,"wal-append.run_cpu_time_us":35714,"wal-append.run_wall_time_us":2378866}]]}
I20260709 12:15:18.134438 13184 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:18.155601  9951 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 10, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 10 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.161239 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.195657 10121 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.116171 13052 raft_consensus.cc:2764] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:18.138268 12971 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.177383 10129 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:15:18.187178 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 58446.5us
W20260709 12:15:18.190935 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62746.3us
W20260709 12:15:18.194483 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.194834 10733 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:18.200819 10123 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:15:18.173491 13214 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:15:18.201045 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.204779 10735 raft_consensus.cc:2368] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9.
I20260709 12:15:18.197276 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.205539 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.207973 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.208827 10053 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.173710 13039 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:18.197589 13202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.011s	sys 0.002s
I20260709 12:15:18.211766 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.207365 10126 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:18.214684 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.189095 13089 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:18.194693 12904 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:18.218395 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:18.220849 10052 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.218791 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:18.224419 10126 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.225378 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.162309 12885 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.232088 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:18.217218 13202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.011s	sys 0.003s
I20260709 12:15:18.230844 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.206146 13017 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:18.232698 10046 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:18.236474 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.245054 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.245711 10732 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:18.228439 12972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.015s	sys 0.008s
I20260709 12:15:18.232895 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.247351 10198 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:18.221493 13210 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.250231 10126 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.222918 12904 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.255570  9951 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 5, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 5 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:15:18.250697 12972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.016s	sys 0.008s
I20260709 12:15:18.263707 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:18.265388 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.259792 12904 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.293800 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.295399  9951 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.289412 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.235502 13025 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.250569 13024 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.224888 12547 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:15:18.227649 13194 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:15:18.260632 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.305809 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.302677 12587 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.303870 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.304638 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.236080 13039 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.300695 10735 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:18.307863 13165 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:18.307816 10732 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:18.312673 10128 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:18.310220 13006 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.265954 13224 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:18.332680 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 389) took 1173 ms. Trace:
I20260709 12:15:18.312955 10126 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.326262 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:18.326475 13237 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:15:18.264185 13197 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:15:18.326851 13089 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.328195 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.329579 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.330164 13017 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.311638 13025 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.305253 13222 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.335146 10052 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:15:18.336300 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 72692.7us
I20260709 12:15:18.344689 10124 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:18.345183 10054 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:18.345388 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:18.353907 10732 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:15:18.345764 10047 raft_consensus.cc:2410] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:18.346338 10125 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.345991  9951 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:18.297474 13185 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:18.356999 13220 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:18.357620 13220 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.358460 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.359303 10047 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:15:18.359709 13220 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:18.323325 12578 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:18.360563 12578 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.360958 12578 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.361450 10054 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:18.369123 10201 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:18.373216 13025 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.332894 13242 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:18.374264 13242 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:18.375224 13242 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:18.378527 13238 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 12:15:18.380545 13181 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.332772 13224 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.383615 13224 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.348474 10046 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:18.338023 10055 rpcz_store.cc:276] 0709 12:15:17.158931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.159783 (+   852us) service_pool.cc:224] Handling call
0709 12:15:17.160210 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:17.160726 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:17.161046 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:15:17.235039 (+ 73993us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:17.341297 (+106258us) log.cc:844] Serialized 52 byte log entry
0709 12:15:17.341456 (+   159us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:17.341487 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:17.341551 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:17.350008 (+  8457us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18002d9a60. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:18.060794 (+710786us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:18.332453 (+271659us) raft_consensus.cc:1685] finished
0709 12:15:18.332476 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:18.332620 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3848,"prepare.queue_time_us":659,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":4045,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":47521,"spinlock_wait_cycles":12348416,"thread_start_us":70338,"threads_started":1,"wal-append.queue_time_us":216494}
I20260709 12:15:18.264394 13210 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:18.337798 12890 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260709 12:15:18.323017 13165 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.359210 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.410840 10048 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:18.355456 10702 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.324508 13221 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:15:18.418040 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62684us
I20260709 12:15:18.419479 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:18.414484 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71414.5us
I20260709 12:15:18.332121 13004 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.315054 13024 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.423666 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:18.423928 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:18.424817  9951 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.427536 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.428211 10128 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:18.435972 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:18.403482 13186 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.440037 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:18.441028 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.441248 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:18.438643 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:18.444532 10121 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:18.446028 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.416193 13165 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:18.446903 10052 raft_consensus.cc:2410] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:18.443249 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:18.450876 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.451009 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:18.451687 10046 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.409659 13222 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:18.425853 13198 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.451640 10122 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:18.808113  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:18.847486 13185 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.847630 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.847967 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.848084 13185 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.849187  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:18.805845 13018 raft_consensus.cc:1064] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:15:18.849157 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.851043 13185 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:18.851823 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.810945 12885 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.741374 10046 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
W20260709 12:15:18.734591 12964 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.030s
I20260709 12:15:18.853706 12964 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.855789 12964 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.796016 13025 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:18.853617 13198 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:18.856457 13025 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.857306 13198 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.858615 13025 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:18.743311 10125 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:18.809584 10128 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:18.815805 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.859463 10126 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.859927 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.860558 10125 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:18.861356 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.818213 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:18.820796 12904 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.005s
I20260709 12:15:18.821171 13229 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:18.821707 13006 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.792594 13187 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:18.738524 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 297314us
I20260709 12:15:18.447685 12972 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:18.792104 13184 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:18.452591 12587 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:18.421886 12890 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.822957 10121 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:18.494392 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:18.747220 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 232831us
I20260709 12:15:18.482789 13186 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.446844 13221 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:18.887486 13240 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.562s	user 0.000s	sys 0.012s
I20260709 12:15:18.551278  9951 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:18.506039 13244 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:15:18.545657 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 121814us
I20260709 12:15:18.796057 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:18.453734 13004 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:15:18.912355 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.915187 10128 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:18.892537 12587 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:18.790669 13230 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:18.827912 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.736788 12578 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.835150 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.744426 13024 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.839115 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.802260 13210 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.795437 13039 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:18.738824 10050 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 12:15:18.923851 10050 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:18.806104 13222 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.924058 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:18.924862 10199 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:18.925086 13148 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:18.925506 13148 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.925679 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.843648 13194 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:18.845870 13096 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.004s
I20260709 12:15:18.926891 13194 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.926946 13096 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.929051 13194 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:18.844377 13224 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:18.929214 13096 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:18.804910 13042 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260709 12:15:18.927662 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.929656 13224 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:18.799002 13217 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.004s
I20260709 12:15:18.919910 12587 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:18.852454 10122 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:18.930541 13210 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.931120 13210 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.931494 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.875885 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.931761 13224 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.883502 10202 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:15:18.932704 10734 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:18.898262 10204 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:18.891507  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:18.886489 13252 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.059s	user 0.004s	sys 0.000s
W20260709 12:15:18.886318 13250 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.090s	user 0.005s	sys 0.000s
W20260709 12:15:18.895773 13248 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.007s
I20260709 12:15:18.931504 12890 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.447206 13046 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:18.888185 13243 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.472s	user 0.005s	sys 0.007s
I20260709 12:15:18.879662 13229 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.935745 13229 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:18.939653 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.940456 10130 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.941355 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.941885 10130 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.901054 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.901234 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.930613 13217 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.904414 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.944511 13217 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.945132 13217 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:18.905779 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.946141 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.906587 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.908061 10198 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:15:18.947001 10124 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.908351 13186 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:18.908427 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.908983 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.950372 10123 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:18.949052 10733 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:18.910889 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:18.915699 10126 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
W20260709 12:15:18.748703 12971 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.006s
W20260709 12:15:18.916261 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120317us
I20260709 12:15:18.917236 10127 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:18.917855 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:18.951916 10129 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.884210 12904 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:18.921330 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:18.922189 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 83169.7us
I20260709 12:15:18.921942  9951 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.742513 13165 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.925875 13148 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:18.852425 13018 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.957846 12971 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.965654 12971 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:18.966310 10202 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:18.966730 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.967952 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.968686 10055 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:18.968947 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.969439 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.896054 13187 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:18.886622 13251 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.057s	user 0.004s	sys 0.000s
I20260709 12:15:18.885485 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:18.935290 13210 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:18.948957 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.953882 10052 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:18.899834 13184 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:18.917773 12972 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.961920 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.955659  9951 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 3, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 3 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.979703 10129 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:18.988395 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:18.982893 10055 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:18.934455 13230 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:18.988408 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:18.989787 10047 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:18.990839 10049 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:18.947906 13217 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:18.991662 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:19.005757 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 88193.6us
I20260709 12:15:18.993064 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.000875 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.000828 10201 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.002620 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.003199 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.003258 10052 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:19.008162 10053 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.004451 10049 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:19.005466 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.010370 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.011013 10195 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:19.010896 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:19.013553 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.014392 13181 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:19.015791 10127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1386) took 1166 ms (client timeout 1501 ms). Trace:
I20260709 12:15:19.002463 13089 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:15:19.016235 10127 rpcz_store.cc:269] 0709 12:15:17.849752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.862644 (+ 12892us) service_pool.cc:224] Handling call
0709 12:15:19.015603 (+1152959us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400230d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:19.015715 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313405824}
I20260709 12:15:18.983310 13004 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.024387 10094 leader_election.cc:400] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9.
I20260709 12:15:19.018769 10129 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:19.024748 10094 leader_election.cc:403] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:19.021113 10122 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:19.024869 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:18.983636 12578 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.016697 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:18.999082 13046 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.028172 10094 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.023597 13185 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:15:19.030630 13165 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.033591 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.034194 10195 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.018090 13042 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.038630 13024 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9.
I20260709 12:15:19.042822 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.043424 13230 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.006170 13229 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.045590 10048 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:15:19.047397 10054 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:19.048563 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.051331 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.055016 10195 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:19.058015 10128 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:19.005649 12964 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:15:19.049135 10054 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:19.071659 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46876.8us
I20260709 12:15:19.049767  9951 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:19.073110 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 45032.2us
I20260709 12:15:19.064175 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:19.072403 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.074947 10053 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:19.077190 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
W20260709 12:15:19.027068 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47978.7us
I20260709 12:15:19.070603 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.084360 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.093618 10201 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:19.096967 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.046263 13229 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.047611 13184 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:19.102559 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.102631 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.107434 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:19.107684 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.106942 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.107945 10130 raft_consensus.cc:2368] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:19.108649 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.109225 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.109552 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.110108 10195 raft_consensus.cc:2410] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:19.103533 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.106667 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.072479 13046 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:19.112941 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:19.113957 10199 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 6: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:19.115733 10197 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:19.107465  9951 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 6, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 6 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:19.116472 10130 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:19.110110 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 224705us
I20260709 12:15:19.096509 12890 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:19.098300 12578 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.120535 10737 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:15:19.082918 13024 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:19.101222 13242 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.017364 13217 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.109395 13247 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:19.100440 13096 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:19.099378 13224 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:19.125326 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.134690 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.134927 10123 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:19.163734 10054 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.120029 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:19.135825 10130 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:19.140622 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.164328 10130 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:19.146260 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.108839 13169 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:19.151765 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 137015us
I20260709 12:15:19.112608 13186 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:19.098050 13006 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:15:19.101307 13039 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:15:19.130491 12890 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.145605 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.119858 12972 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:15:19.182178 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48905.2us
W20260709 12:15:19.182775 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57525.7us
I20260709 12:15:19.210999 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.167176 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.180148  9951 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 5, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 5 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:19.182642 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.175689 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.212703 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.212916 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.213320 10203 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.167505 10130 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.216547 10130 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.151305 13004 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.134502 13024 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.212133 13266 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:19.180266 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.180379 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:19.144958 13096 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.163406 12578 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:19.204128 13221 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.222132 10053 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:19.168892 13247 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:19.139846 13184 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:15:19.205474 12890 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.174794 13186 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:19.242333 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:15:19.242825 10130 pending_rounds.cc:85] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 6
W20260709 12:15:19.221848 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54753us
I20260709 12:15:19.200986 13169 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:19.229908 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.129652 13148 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.207973 13167 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:19.224541 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48954.3us
I20260709 12:15:19.205926 12972 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:19.221328 13024 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.222867 13042 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:19.228364 13096 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.283931 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.243180 10130 pending_rounds.cc:107] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:15:19.299800 10130 raft_consensus.cc:2889] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:19.299938 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59170.5us
I20260709 12:15:19.228994 13242 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.203686 13261 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:15:19.300303 10130 pending_rounds.cc:107] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:15:19.302773 10130 raft_consensus.cc:2889] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:19.237252 12904 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.311156 10728 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8.
I20260709 12:15:19.312680 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.230661 13215 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:15:19.281652 13082 raft_consensus.cc:2764] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:15:19.323196 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.325090 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.327607 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.229504 13004 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.283831 13167 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.330662 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.321130 13221 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.305071 13262 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:19.239171 13046 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.328586 13187 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.321391 13006 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.348847 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:19.355262 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.360208 10729 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.360349 10046 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:19.303154 13042 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.349931 13039 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.365983 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.366812 10046 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:19.367388 13082 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:19.367691 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.368319 10046 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:19.368762 13082 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:19.369158 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.369699 12587 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.328460 13213 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.341837 13167 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.370291 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:19.391395 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 103132us
W20260709 12:15:19.407917 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.424036 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:19.431802 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 106769us
I20260709 12:15:19.435477 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.436276 10053 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.361675 13262 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:19.439456 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.375049 13148 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.337980 12578 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.448365 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.449390 10053 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:19.344713 13169 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.354904 13270 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:15:19.451854 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:19.450870 13257 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 12:15:19.451388 13258 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:15:19.357312 13186 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.447445 13039 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.361246 12972 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:19.456296 13264 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:15:19.454737 13221 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.454097 13006 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:15:19.377962 13247 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.476441 10737 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:15:19.463862 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 136310us
I20260709 12:15:19.489427 12972 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:19.453226 13242 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:15:19.494654 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.492830 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.497253 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:19.502569 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.505038 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.483202 13186 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.508618 13006 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.510232 13270 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:19.510617 13270 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.510720 12587 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:19.511423 13267 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:15:19.512562 13004 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.513100 13004 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:19.503664 13213 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.515793 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.516104 13276 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:19.497201 13169 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.502815 13221 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.520262 10197 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:19.523082 10729 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:19.523703 10735 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:19.526549 10203 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
W20260709 12:15:19.514619 13263 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:15:19.522804 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.517845 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:19.530647 13269 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:15:19.519837 13270 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.534117 10053 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:19.538836 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.515077 13275 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:19.542040 13275 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:19.542608 13268 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:15:19.521256 13039 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.543046 13275 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.543471 13039 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.545495 13039 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.504160 13262 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.529801 13042 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.536474 13082 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:19.546187 13165 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:19.571081 13165 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.571552 13165 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.574550 13082 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:19.575846 13096 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.576683 13082 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.576884 13266 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:19.577064 10198 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:19.527504 13024 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.579208 13096 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.586585 13082 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.587579 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 642) took 1296 ms. Trace:
I20260709 12:15:19.587996 10734 rpcz_store.cc:276] 0709 12:15:18.290889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.291026 (+   137us) service_pool.cc:224] Handling call
0709 12:15:19.587336 (+1296310us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400600254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:19.587492 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424316800}
I20260709 12:15:19.577350 13266 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:19.630611 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 92464us
I20260709 12:15:19.660962 10052 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:19.680279 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 459647us
I20260709 12:15:19.685899 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:19.682569 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.686949 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.688882 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:19.665035 12964 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.683179 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.683640 12587 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:19.684072 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 473140us
I20260709 12:15:19.689752 10049 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:19.682912 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.700752 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.717772 12578 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.718446 12578 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:19.721011 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 203300us
I20260709 12:15:19.721856 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.722740 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.702046 13262 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.704689 13278 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.744585 10169 leader_election.cc:400] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:19.691298 13181 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.726526 13186 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:19.755213 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:19.755541 13186 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:19.756181 10054 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:19.756450 13186 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.757058 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.759083 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.759716 10051 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.725049 13270 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.768294 13270 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.770324 13278 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:19.748612 12904 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.771438 13278 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.773142 13167 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.774712 10046 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:19.751005 13275 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.775638 13275 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:19.719693 12587 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.750710 13247 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:15:19.777745 12578 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.777859 12587 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:19.780560 13265 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.600s	user 0.004s	sys 0.000s
I20260709 12:15:19.775827 12890 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.750257 10169 leader_election.cc:403] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:15:19.774942 13024 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.784250 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:19.790596 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:19.792575 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.793269 10202 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:19.793490 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49071.3us
I20260709 12:15:19.795076 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:19.795993 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:19.793951 13262 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:19.691852 13266 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.799609 13266 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.800117 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.800673 10199 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:19.801729 10199 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:19.802040 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:19.802590 13292 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:19.803058 13167 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.794299 12904 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:15:19.805092 10128 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:19.808862 13302 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:19.809424 13302 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:19.810403 12890 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:19.810250 13302 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.809024 10201 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:19.815441 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.825306 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.778116 13165 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.833186 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.833841 10054 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:19.843809 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.844965 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.846024 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.836913 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.847321 10125 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.823868 13230 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:19.850987 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.851331 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.853117 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.855000 10129 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:19.856563 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.857234 10126 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:19.857820 10054 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:19.857997 13185 raft_consensus.cc:2764] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:15:19.858285 13275 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.858889 13185 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.860541 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.861331 13276 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:19.861728 13276 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:19.862074 13276 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.828184 13169 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:15:19.835517 13292 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:15:19.863131 13169 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:19.863487 13169 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:19.864260 13169 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.865324 13169 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:19.866627 13303 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.867354 13230 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:19.835698 13270 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.869168 10124 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:19.869494 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.872750 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.873757 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.873837 10202 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:19.874290 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.872169 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.875090 10129 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:19.875995 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:19.876904 10127 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:19.875468 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:19.878659 12964 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.878947 13185 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:19.879364 13185 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.879721 13185 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.882571 12890 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:19.882946 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:19.883140 12890 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:19.883626 13165 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:19.884229 13165 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:19.884030 12890 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:19.884693 13165 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:19.861974 13300 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.888188 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.896142 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.897658 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.902705 13082 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.904026 13261 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:19.901307 12904 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:19.905646 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.905401 12904 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.885721 13262 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.912426 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.902601 10125 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:19.902204 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.915326 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.875842 13303 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.902294 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:19.914108 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:19.918157 10051 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.917115 13215 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.917141 13096 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:19.885520 13165 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:19.919914 12964 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:19.920378 13284 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.921077 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:19.921577 13278 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.975816 12964 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:19.924176 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:19.916349 13292 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:19.917452 13082 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:15:19.956020 13222 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.960625 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:19.893667 13302 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 12:15:19.968781 13307 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 12:15:19.868300 13230 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:19.974534 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 53533.4us
W20260709 12:15:20.012616 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52101.7us
I20260709 12:15:19.994102 10051 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:19.991081 10094 leader_election.cc:400] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8.
I20260709 12:15:20.025104 13229 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:20.025657 13229 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:20.018708 10094 leader_election.cc:403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:20.034296 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2098) took 1089 ms. Trace:
I20260709 12:15:20.034745 10052 rpcz_store.cc:276] 0709 12:15:18.944589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.015460 (+ 70871us) service_pool.cc:224] Handling call
0709 12:15:19.015762 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.661464 (+645702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.034036 (+372572us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002a0b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:20.034226 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483349888}
I20260709 12:15:20.035177 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:20.036199 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2091) took 1115 ms. Trace:
I20260709 12:15:20.036556 10048 rpcz_store.cc:276] 0709 12:15:18.920864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.921020 (+   156us) service_pool.cc:224] Handling call
0709 12:15:18.950030 (+ 29010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:19.045969 (+ 95939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.035964 (+989995us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b5400087354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:20.036141 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219253504}
I20260709 12:15:20.037482 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:20.039126 13025 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:20.038996 13017 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:20.039490 13025 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:20.039686 13277 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:20.040500 13017 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:20.041020 13017 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:20.042281 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1999) took 1137 ms. Trace:
I20260709 12:15:20.042938 12578 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:20.043339 12578 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:20.043708 12578 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.044433 13025 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.045608 13025 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.042658 10128 rpcz_store.cc:276] 0709 12:15:18.905082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.097154 (+192072us) service_pool.cc:224] Handling call
0709 12:15:19.097534 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.805464 (+707930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.042060 (+236596us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400210054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:20.042221 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626850176}
I20260709 12:15:20.047588 13229 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.048900 13229 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:20.071295 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54212.7us
I20260709 12:15:20.016707 13301 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:20.041855 13017 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.084741 10047 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:15:20.087596 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 96718.6us
I20260709 12:15:20.090821 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.091821 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.094858 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:19.990684 13024 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.976969 13276 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.116932 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:20.117662 10129 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:20.118532 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:20.118916 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:20.099304 10735 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:20.097952 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:20.123337 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:20.078838 13275 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:20.129642 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.118543 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.128788 13277 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:20.018893 13222 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.141647 10129 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.142647 10124 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:15:20.143590 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 220923us
I20260709 12:15:20.096673 13217 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:20.125767 13213 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:19.976814 12964 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.167689 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 1991) took 1300 ms. Trace:
I20260709 12:15:20.131302 13221 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:20.171478 10128 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:20.170324 10129 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:20.168170 10122 rpcz_store.cc:276] 0709 12:15:18.867700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.027576 (+159876us) service_pool.cc:224] Handling call
0709 12:15:19.051782 (+ 24206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:19.083462 (+ 31680us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:19.083497 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:19.113745 (+ 30248us) log.cc:844] Serialized 26 byte log entry
0709 12:15:19.442718 (+328973us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:19.442758 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.157335 (+714577us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54003d1154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:20.157380 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:20.157420 (+    40us) raft_consensus.cc:1685] finished
0709 12:15:20.157428 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:20.167610 (+ 10182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15343,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3330,"spinlock_wait_cycles":71956736,"thread_start_us":280538,"threads_started":1,"wal-append.queue_time_us":345449}
I20260709 12:15:20.140545 13275 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:20.143567 13277 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.188661 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.204380 10127 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:20.205978 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:20.210913 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 276328us
I20260709 12:15:20.211262 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:20.219817 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 129377us
I20260709 12:15:20.167309 13089 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:20.192080 13309 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:15:20.233312 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:20.203229 13277 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:20.210745 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:20.233498 13042 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.212792 13261 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:20.169497 13217 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.261677 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:20.266212 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:20.231281 13089 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:20.231945 13292 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:20.203109 13215 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:15:20.191198 13221 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.286698 13273 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:15:20.295426 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.285714 13198 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:20.327025 13198 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:20.328027 13198 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.272631 13194 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:15:20.332284 13089 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.335192 10198 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:20.237358 13316 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:15:20.274855 10128 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:20.353464 10199 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:20.353770 10734 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:20.361250 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:20.317945 13185 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.270663 13042 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.424160 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:20.433996 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:20.285517 13292 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.440515 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.357010 13089 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:20.445796 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.454867 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.438534 13262 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.352815 13194 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 12:15:20.468061 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 254527us
I20260709 12:15:20.444049 12587 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:20.448604 13261 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:20.482754 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:20.487736 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 266648us
I20260709 12:15:20.449721 13259 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:20.492503 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.511466 13300 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:15:20.511935 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.498796 13167 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:20.484754 13229 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:20.481902 13276 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:20.481503 13339 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.554870 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:20.559160 10123 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:15:20.560271 10054 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:20.564762 10053 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:20.476011 13262 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.589092 10122 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:20.598654 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 363119us
I20260709 12:15:20.517478 13222 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:20.594924 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.593366 10047 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:20.595767 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:20.596091 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:20.595033 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:20.621203 10052 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:20.614956 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:20.626310 10048 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:20.500716 13261 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.655457 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.656179 10122 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:20.671437 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:20.588538 13284 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:15:20.646747 13186 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:20.709004 13186 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:15:20.709800 12904 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:20.710532 13333 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:15:20.711535 13186 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:20.713732 13042 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:20.660989 13217 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:20.718528 10201 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:20.751226 10199 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:20.753466 10735 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:20.719170 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:20.762281 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:20.718348 12578 consensus_meta.cc:287] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.000s
I20260709 12:15:20.722208 13185 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:20.770153 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:20.777889 10198 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:20.779004 13230 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:20.754062 13332 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:15:20.708153 13221 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:20.769124 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:20.718780 13194 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.770699 12972 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:15:20.770259 13024 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.004s
I20260709 12:15:20.805233 10728 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:20.720646 13261 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:20.747869 13198 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:20.770623 13348 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 12:15:20.914311 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 424589us
I20260709 12:15:20.908948 10052 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:20.915624 10123 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:20.923542 10122 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:20.866336 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 97295.7us
I20260709 12:15:20.854225 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:20.925318 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:20.827304 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:20.914407 13300 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:20.941869 10122 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:20.944317 12587 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.944070 13300 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.944814 12587 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:20.945616 10055 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:20.945406 12971 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:15:20.945142 13277 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.001s
W20260709 12:15:20.848287 13169 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.983s	user 0.005s	sys 0.008s
W20260709 12:15:20.847404 13213 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 12:15:20.948078 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:20.899281 13017 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:20.910118 13325 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 12:15:20.922091 13024 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:20.950565 13277 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.950928 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1421) took 1036 ms. Trace:
I20260709 12:15:20.969620 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:20.970415 10053 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:20.946288 13300 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:20.907434 13229 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.826553 13339 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:20.949966 10123 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:20.958956 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:20.976926 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:20.977602 10123 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:20.979341 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:20.843879 13262 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:20.979862 10728 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:20.979940 10123 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:20.952931 12890 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:20.951445 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:20.973026 10093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.010s	sys 0.010s
I20260709 12:15:20.967660 10125 rpcz_store.cc:276] 0709 12:15:19.914118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.932303 (+ 18185us) service_pool.cc:224] Handling call
0709 12:15:19.932868 (+   565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:19.943096 (+ 10228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:19.983050 (+ 39954us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.423606 (+440556us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:20.451940 (+ 28334us) log.cc:844] Serialized 52 byte log entry
0709 12:15:20.452614 (+   674us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:20.452758 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.453026 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:20.950659 (+497633us) raft_consensus.cc:1685] finished
0709 12:15:20.950736 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:20.950873 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9635,"prepare.queue_time_us":24971,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4900,"raft.queue_time_us":84172,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4545,"thread_start_us":348673,"threads_started":2,"wal-append.queue_time_us":904134}
I20260709 12:15:20.807035 13292 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:20.985098 10054 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:20.979948 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:20.960366 13213 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8.
I20260709 12:15:20.986701 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:20.970516 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:20.961244 13330 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:20.989252 10093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.010s
I20260709 12:15:20.804011 12578 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.930331 13194 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.014726 10123 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:21.015787 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:21.016989 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:21.017640 10050 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:20.983127 13336 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.998390 10125 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:20.988265 13354 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:20.992628 10730 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:21.009414 10729 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:21.008940 10122 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
W20260709 12:15:21.026949 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.989955 13300 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:21.014034 10126 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
W20260709 12:15:20.991639 12964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.014s
I20260709 12:15:21.014726 10053 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:21.013412 10127 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:20.992044 12587 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:20.938630 13198 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.970736 13259 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:15:21.017740 13215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.000s	sys 0.015s
W20260709 12:15:21.031589 12964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.014s
I20260709 12:15:20.990373 13229 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:20.968572 13017 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.037885 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:20.999630 13262 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:15:21.039394 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.036407 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.042996 13327 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:21.044157 13198 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.040792 13215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.016s
I20260709 12:15:21.041601 10123 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:15:21.091691 10196 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:21.051364 10121 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:21.063550 12578 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.063977 12964 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.065207 13194 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.065578 13342 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:21.034557 13300 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.066962 13017 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:21.028528 13336 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.065133 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:21.107900 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:21.042125 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.109247 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:21.072650 13229 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:21.047590 13018 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:15:21.076911 13277 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.051676 13354 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:15:21.085268 13334 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.085563 13315 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.085327 13276 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.014766 13185 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:15:21.104491 13342 consensus_queue.cc:1243] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:15:21.123958 13338 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:21.124424 13338 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:21.124784 13338 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:21.120733 13334 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.126108 13300 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:21.128561 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1419) took 1284 ms. Trace:
I20260709 12:15:21.128759 13276 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.127235 13334 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:21.111317 13221 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:21.105300 12964 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.130326 10130 rpcz_store.cc:276] 0709 12:15:19.844442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.869945 (+ 25503us) service_pool.cc:224] Handling call
0709 12:15:19.870181 (+   236us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:19.885025 (+ 14844us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:19.885335 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.027116 (+141781us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800286b40. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6712a6 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1
0709 12:15:20.028457 (+  1341us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800286b40. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:20.236320 (+207863us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.452695 (+216375us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:20.456809 (+  4114us) log.cc:844] Serialized 52 byte log entry
0709 12:15:20.456949 (+   140us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:20.457213 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.457602 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.898595 (+440993us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b1800286b40. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:20.898787 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.898878 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.128366 (+229488us) raft_consensus.cc:1685] finished
0709 12:15:21.128384 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.128504 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":447204,"prepare.queue_time_us":54475,"prepare.run_cpu_time_us":206,"prepare.run_wall_time_us":3809,"raft.queue_time_us":635221,"raft.run_cpu_time_us":577,"raft.run_wall_time_us":30211,"spinlock_wait_cycles":44703232,"thread_start_us":545625,"threads_started":2,"wal-append.queue_time_us":967969}
I20260709 12:15:21.131500 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.171681 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 413) took 1084 ms. Trace:
I20260709 12:15:21.192430 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:21.197440 10130 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:21.198060 10198 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:21.195014 10126 rpcz_store.cc:276] 0709 12:15:20.087768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.090537 (+  2769us) service_pool.cc:224] Handling call
0709 12:15:21.171488 (+1080951us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400244d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:21.171620 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071813376}
I20260709 12:15:21.123063 13330 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:21.199210 10049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.043s
W20260709 12:15:21.202102 10049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.043s
W20260709 12:15:21.200881 10129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.017s	sys 0.008s
W20260709 12:15:21.171440 13357 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.227s	user 0.000s	sys 0.003s
W20260709 12:15:21.203878 10129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.018s	sys 0.009s
I20260709 12:15:21.207409 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:21.212867 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.223179 10197 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:21.223577 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:21.202559 13300 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:21.197743 13184 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:15:21.224285 10735 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:21.197394 13273 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:15:21.233525 10200 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:21.233968 10200 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:21.250276 10201 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
W20260709 12:15:21.251029 10124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.021s	sys 0.007s
W20260709 12:15:21.251636 10124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.022s	sys 0.007s
I20260709 12:15:21.257392 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:21.263383 10046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.011s	sys 0.045s
W20260709 12:15:21.263933 10046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.011s	sys 0.045s
I20260709 12:15:21.242787 10200 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.265720 10200 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:21.268044 10735 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:21.272749 10197 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:15:21.123016 13315 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.248677 13330 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.299728 10197 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:21.239979 13300 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.299014 13167 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:21.347149 10198 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:15:21.366871 10198 pending_rounds.cc:85] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:15:21.367194 10198 pending_rounds.cc:107] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:15:21.367458 10198 raft_consensus.cc:2889] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.376081 10200 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:15:21.376564 10200 pending_rounds.cc:85] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 3
I20260709 12:15:21.376793 10200 pending_rounds.cc:107] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:15:21.377032 10200 raft_consensus.cc:2889] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:21.299064 13276 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:21.300912 13165 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:21.409173 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.411139 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.378368 13167 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:21.326380 12972 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:15:21.431500 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.458302 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 771) took 1147 ms. Trace:
I20260709 12:15:21.458817 10729 rpcz_store.cc:276] 0709 12:15:20.333774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.351091 (+ 17317us) service_pool.cc:224] Handling call
0709 12:15:20.408953 (+ 57862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:21.025783 (+616830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.458024 (+432241us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b540012d4d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:21.458229 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356819840}
W20260709 12:15:21.459453 13369 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:15:21.461228 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:21.463758 13300 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.461221 13364 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:21.469868 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:21.471480 10198 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:21.474761 13024 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.475170 13347 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.553s	user 0.002s	sys 0.000s
I20260709 12:15:21.475296 13024 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.301149 13330 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.429520 13167 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:21.480068 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.411970 13165 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.477624 13242 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.509860 10204 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
W20260709 12:15:21.520112 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.479254 12964 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.430682 13338 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.554596 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:21.556396 13315 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:21.557524 10737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.017s	sys 0.016s
W20260709 12:15:21.560988 10737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.018s	sys 0.017s
W20260709 12:15:21.560272 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.003s	sys 0.022s
W20260709 12:15:21.562297 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.022s
W20260709 12:15:21.562666 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 928035us
W20260709 12:15:21.579360 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.021s
W20260709 12:15:21.579860 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.007s	sys 0.021s
W20260709 12:15:21.580209 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 596289us
I20260709 12:15:21.587397 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:21.626641 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:21.627411 10126 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
W20260709 12:15:21.634809 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 71498.7us
W20260709 12:15:21.636816 10051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.021s	sys 0.040s
W20260709 12:15:21.637331 10051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.021s	sys 0.041s
I20260709 12:15:21.638027 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2124) took 1076 ms. Trace:
I20260709 12:15:21.639541 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:21.620822 12578 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:21.525455 13242 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.624977 12890 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.689894 10702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.523s (SENT) [suppressed 33 similar messages]
W20260709 12:15:21.691766 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55840.5us
I20260709 12:15:21.558878 13277 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:15:21.692884 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:21.636792 13024 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.708257 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.012s	sys 0.079s
W20260709 12:15:21.712013 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.012s	sys 0.081s
W20260709 12:15:21.714143 10055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.004s	sys 0.057s
W20260709 12:15:21.715499 10055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.004s	sys 0.057s
I20260709 12:15:21.550276 13275 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:21.675971 13089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.005s	sys 0.028s
I20260709 12:15:21.671653 13367 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:21.721690 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:21.722277 10128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.028s	sys 0.039s
I20260709 12:15:21.712319 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:21.726750 10126 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:21.728688 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:21.729285 10130 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
W20260709 12:15:21.730033 10128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.029s	sys 0.039s
I20260709 12:15:21.736626 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:21.699712 13372 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:21.730638 13089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.005s	sys 0.028s
I20260709 12:15:21.720577 13096 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:21.720834 12964 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.712409 12578 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:21.750579 13373 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:15:21.750968 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.702766 12890 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:21.773036 10123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.005s	sys 0.009s
I20260709 12:15:21.756772 13230 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.760363 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1423) took 1620 ms. Trace:
W20260709 12:15:21.773545 10123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.009s
I20260709 12:15:21.760672 13275 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:21.703092 13276 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:15:21.765550 10730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.011s
W20260709 12:15:21.770506 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.753038 13329 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.983s	user 0.006s	sys 0.007s
W20260709 12:15:21.770915 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.012s	sys 0.024s
I20260709 12:15:21.772863 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.753659 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 426) took 1459 ms. Trace:
I20260709 12:15:21.778694 10129 rpcz_store.cc:276] 0709 12:15:20.140148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.172982 (+ 32834us) service_pool.cc:224] Handling call
0709 12:15:20.177533 (+  4551us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:20.205054 (+ 27521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.205082 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:20.224049 (+ 18967us) log.cc:844] Serialized 52 byte log entry
0709 12:15:21.205522 (+981473us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:21.224489 (+ 18967us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.224715 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.224792 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.760134 (+535342us) raft_consensus.cc:1685] finished
0709 12:15:21.760155 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.760299 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29029,"prepare.queue_time_us":18756,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":36255,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12406,"thread_start_us":933891,"threads_started":1,"wal-append.queue_time_us":1487240}
W20260709 12:15:21.785344 10730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.002s	sys 0.012s
I20260709 12:15:21.762001 13339 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:21.784528 10124 rpcz_store.cc:276] 0709 12:15:20.294089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.294240 (+   151us) service_pool.cc:224] Handling call
0709 12:15:20.294612 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.453392 (+158780us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:20.490088 (+ 36696us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.252538 (+762450us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.265567 (+ 13029us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.278519 (+ 12952us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.278679 (+   160us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:21.278714 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.278784 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.473789 (+195005us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800388cc0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc18266458f 00007fc17b6a3571 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd
0709 12:15:21.753429 (+279640us) raft_consensus.cc:1685] finished
0709 12:15:21.753452 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.753599 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29177,"prepare.queue_time_us":21054,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":12599,"raft.queue_time_us":38411,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13688,"spinlock_wait_cycles":38659584,"thread_start_us":855927,"threads_started":2,"wal-append.queue_time_us":1235912}
I20260709 12:15:21.760869 12904 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.787029 10195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.011s	sys 0.004s
W20260709 12:15:21.792052 10195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.004s
I20260709 12:15:21.792225 13336 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.787405 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.013s	sys 0.024s
I20260709 12:15:21.763219 13096 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:21.795511 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 1.07812e+06us
I20260709 12:15:21.780201 12971 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.781463 13165 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.782817 13373 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:21.770946 12964 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:21.811468 13375 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:15:21.749699 13372 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.814561 12587 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:21.807757 13330 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:21.786056 13230 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.825006 10048 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:21.800897 13339 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:21.838049 10202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.029s
I20260709 12:15:21.809634 12971 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.826418 13247 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:21.827013 13242 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:21.848627 10196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.006s	sys 0.010s
W20260709 12:15:21.849030 10196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.010s
I20260709 12:15:21.828414 12890 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:21.803957 13096 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:21.863940 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.033s	sys 0.025s
I20260709 12:15:21.765286 13089 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 12:15:21.787519 13261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.027s
I20260709 12:15:21.737200 13367 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.825775 12964 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.838640 10202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.014s	sys 0.029s
I20260709 12:15:21.838141 12587 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.842475 13230 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.846674 10728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.006s	sys 0.010s
W20260709 12:15:21.897389 10728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.006s	sys 0.010s
I20260709 12:15:21.804396 12904 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.829038 12578 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:21.897977 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 499) took 1810 ms. Trace:
W20260709 12:15:21.864526 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.034s	sys 0.025s
W20260709 12:15:21.876538 10733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.009s	sys 0.012s
I20260709 12:15:21.835742 13338 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:21.898789 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 627157us
I20260709 12:15:21.907616 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.908484 10198 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:21.909461 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.910094 10198 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:21.840318 13247 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:21.898509 10049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.012s	sys 0.008s
W20260709 12:15:21.925318 10049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.008s
W20260709 12:15:21.856720 13302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.011s
I20260709 12:15:21.898473 10203 rpcz_store.cc:276] 0709 12:15:20.053629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.053762 (+   133us) service_pool.cc:224] Handling call
0709 12:15:20.076271 (+ 22509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.077415 (+  1144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.077455 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:20.085960 (+  8505us) log.cc:844] Serialized 26 byte log entry
0709 12:15:20.236609 (+150649us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:20.236647 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.236721 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:21.752559 (+1515838us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:21.840866 (+ 88307us) raft_consensus.cc:1685] finished
0709 12:15:21.840888 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.864159 (+ 23271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5886,"raft.queue_time_us":72638,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6700,"spinlock_wait_cycles":2596096,"thread_start_us":82615,"threads_started":1,"wal-append.queue_time_us":634874}
W20260709 12:15:21.865991 13261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.010s	sys 0.027s
W20260709 12:15:21.899049 10733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.013s
I20260709 12:15:21.855306 13024 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:21.900477 10201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.005s
W20260709 12:15:21.956799 10201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.017s	sys 0.006s
I20260709 12:15:21.823091 13373 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.896766 13185 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:21.925457 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:21.969033 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:22.034004 10054 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:21.969882 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:21.961681 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.036193 10203 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 12:15:21.927973 13302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.011s
I20260709 12:15:22.006718 13024 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.023679 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:22.026512 10197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.020s
W20260709 12:15:22.048321 10197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.020s
I20260709 12:15:21.955514 13338 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:22.030468 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:22.047721 10048 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
W20260709 12:15:22.030732 13184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.009s	sys 0.018s
I20260709 12:15:22.153218 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:22.042042 13089 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.208675 10130 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:15:22.151458 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 91397.9us
W20260709 12:15:22.155269 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 97119.3us
I20260709 12:15:22.214486 10124 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:22.023780 13229 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:22.219297 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1432) took 1257 ms. Trace:
I20260709 12:15:22.227950 10123 rpcz_store.cc:276] 0709 12:15:20.962349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.092246 (+129897us) service_pool.cc:224] Handling call
0709 12:15:21.092577 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.102153 (+  9576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.102190 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.106963 (+  4773us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.773923 (+666960us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:21.773962 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.774027 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.219085 (+445058us) raft_consensus.cc:1685] finished
0709 12:15:22.219117 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.219236 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7947,"raft.queue_time_us":8970,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3925,"thread_start_us":624153,"threads_started":1,"wal-append.queue_time_us":843266}
I20260709 12:15:22.232035 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:22.151489 13230 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:22.214251 13184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.018s	sys 0.018s
I20260709 12:15:22.208169 13355 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.048640 13185 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.265846 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:22.265846 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:22.021867 13247 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.269038 10126 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:22.269145 10130 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:22.270117 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:22.270759 10126 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:22.266929 12904 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.275067 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:22.279335 10702 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.025s	sys 0.038s
I20260709 12:15:22.236249 13378 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:22.281638 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.019s	sys 0.044s
W20260709 12:15:22.283813 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.044s
W20260709 12:15:22.279747 10702 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.025s	sys 0.038s
W20260709 12:15:22.284751 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 594972us
W20260709 12:15:22.282864 10200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.017s	sys 0.046s
W20260709 12:15:22.285738 10200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.046s
I20260709 12:15:22.152663 13338 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.224066 13089 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.287520 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:22.291375 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:22.245666 13230 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:22.283756 13275 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
W20260709 12:15:22.293227 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.047s
W20260709 12:15:22.293597 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.005s	sys 0.047s
I20260709 12:15:22.293895 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:22.296684 10021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.031s	sys 0.033s
I20260709 12:15:22.312856 10124 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
W20260709 12:15:22.326211 10021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.032s	sys 0.033s
I20260709 12:15:22.282869 13339 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.326531 10123 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:22.314495 10130 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:22.328366 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:22.419508 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.030s
I20260709 12:15:22.329589 10046 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:15:22.328035 10053 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:15:22.273818 13355 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.330469 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:22.332728 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.295656 13224 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:22.287636 13378 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.292090 13372 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:22.420661 10053 pending_rounds.cc:85] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 3
I20260709 12:15:22.450255 10053 pending_rounds.cc:107] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 12:15:22.440145 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 111870us
I20260709 12:15:22.450714 10053 raft_consensus.cc:2889] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:22.367223 13386 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:15:22.327452 13377 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.367624 13379 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 12:15:22.326758 12904 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.288585 12971 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.294476 13230 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:22.333664 13184 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.351069 13387 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:15:22.445067 10204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.020s	sys 0.026s
W20260709 12:15:22.475723 10204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.020s	sys 0.026s
W20260709 12:15:22.420657 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.030s
W20260709 12:15:22.440119 10050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.341s	user 0.037s	sys 0.057s
W20260709 12:15:22.476994 10050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.037s	sys 0.057s
I20260709 12:15:22.452432 13224 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:22.421563 13096 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 12:15:22.336241 13273 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:15:22.449184 10048 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:22.357656 13167 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.003s
W20260709 12:15:22.332305 13391 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:15:22.344029 13395 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:15:22.360877 13324 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:22.507627 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 509) took 1306 ms. Trace:
I20260709 12:15:22.507965 13324 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:22.508939 13324 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:21.638401 10051 rpcz_store.cc:276] 0709 12:15:20.561272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.562948 (+  1676us) service_pool.cc:224] Handling call
0709 12:15:20.563232 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:20.563420 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:20.966548 (+403128us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.637698 (+671150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:21.637751 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:21.637798 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.637862 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.637971 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50100,"prepare.queue_time_us":287759,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":101,"thread_start_us":999268,"threads_started":2}
I20260709 12:15:22.511435 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:22.510197 13324 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:22.516408 13355 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.462401 13377 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.519321 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2014) took 1963 ms. Trace:
I20260709 12:15:22.519730 10128 rpcz_store.cc:276] 0709 12:15:20.555944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.879572 (+323628us) service_pool.cc:224] Handling call
0709 12:15:20.879986 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.948613 (+ 68627us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:20.973379 (+ 24766us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.849318 (+875939us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.849820 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.849957 (+   137us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:21.849990 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.850071 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.519091 (+669020us) raft_consensus.cc:1685] finished
0709 12:15:22.519116 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.519258 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186897,"prepare.queue_time_us":24852,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":192579,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":25232,"thread_start_us":703527,"threads_started":1,"wal-append.queue_time_us":899447}
W20260709 12:15:22.521270 13383 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:15:22.508019 10734 rpcz_store.cc:276] 0709 12:15:21.201362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.201514 (+   152us) service_pool.cc:224] Handling call
0709 12:15:21.201856 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.202217 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:21.223214 (+ 20997us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.727793 (+504579us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.750817 (+ 23024us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.754175 (+  3358us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:21.754214 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.754281 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.507391 (+753110us) raft_consensus.cc:1685] finished
0709 12:15:22.507415 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.507553 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20820,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":5795,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":8882,"thread_start_us":494455,"threads_started":1,"wal-append.queue_time_us":689594}
W20260709 12:15:22.460922 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.180s	sys 0.263s
W20260709 12:15:22.522727 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.181s	sys 0.263s
I20260709 12:15:22.523018 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 656) took 1425 ms. Trace:
I20260709 12:15:22.523379 10730 rpcz_store.cc:276] 0709 12:15:21.097246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.097540 (+   294us) service_pool.cc:224] Handling call
0709 12:15:21.098095 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.098488 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.098515 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.107251 (+  8736us) log.cc:844] Serialized 564 byte log entry
0709 12:15:21.785741 (+678490us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:21.785781 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.785845 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.522797 (+736952us) raft_consensus.cc:1685] finished
0709 12:15:22.522815 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.522961 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":668204,"threads_started":1,"wal-append.queue_time_us":923667}
I20260709 12:15:22.524943 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:22.459991 10127 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:15:22.440095 13381 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 12:15:22.526551 13338 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.527321 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1854) took 1578 ms. Trace:
I20260709 12:15:22.527733 10055 rpcz_store.cc:276] 0709 12:15:20.948955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.949074 (+   119us) service_pool.cc:224] Handling call
0709 12:15:20.949590 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:20.958356 (+  8766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:20.958385 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:20.971279 (+ 12894us) log.cc:844] Serialized 564 byte log entry
0709 12:15:21.717194 (+745915us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:21.717240 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.717317 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.527113 (+809796us) raft_consensus.cc:1685] finished
0709 12:15:22.527133 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.527259 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":745621,"threads_started":1,"wal-append.queue_time_us":955656}
I20260709 12:15:22.528721 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 511) took 1021 ms. Trace:
I20260709 12:15:22.529245 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.529505 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1365) took 1780 ms. Trace:
W20260709 12:15:22.462539 10093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.029s	sys 0.017s
W20260709 12:15:22.461509 10122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.017s	sys 0.030s
I20260709 12:15:22.365628 13089 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:22.530150 10093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.029s	sys 0.017s
I20260709 12:15:22.295375 13247 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:22.362869 12587 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.529067 10200 rpcz_store.cc:276] 0709 12:15:21.506949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.507516 (+   567us) service_pool.cc:224] Handling call
0709 12:15:21.508306 (+   790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.508699 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.508729 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.664264 (+155535us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.286538 (+622274us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:22.286592 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.286667 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.528508 (+241841us) raft_consensus.cc:1685] finished
0709 12:15:22.528529 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.528665 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14269,"thread_start_us":566141,"threads_started":1,"wal-append.queue_time_us":835254}
I20260709 12:15:22.455617 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.538889 10046 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:22.459486 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:22.476990 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 676027us
I20260709 12:15:22.478169 13024 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.481144 13399 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:15:22.474889 12971 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:15:22.499987 13273 consensus_queue.cc:1243] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:15:22.492090 13389 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:22.561843 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.518275 13378 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:22.493440 13396 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:15:22.494997 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 513) took 1238 ms. Trace:
I20260709 12:15:22.496740 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.479161 13184 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.505089 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1379) took 1269 ms. Trace:
I20260709 12:15:22.505311 13167 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.557772 13403 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:22.459678 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 417) took 2365 ms (client timeout 1523 ms). Trace:
I20260709 12:15:22.366192 13367 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:22.530563 10122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.017s	sys 0.030s
I20260709 12:15:22.530877 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:22.530249 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.297677 13302 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.533583 10051 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:22.481261 13224 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:22.536929 10048 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:22.590624 10054 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:22.609407 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.610112 10048 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:22.529897 10199 rpcz_store.cc:276] 0709 12:15:20.749060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.756404 (+  7344us) service_pool.cc:224] Handling call
0709 12:15:20.756778 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:22.327092 (+1570314us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:22.327120 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:22.327164 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:22.327199 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.529284 (+202085us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540003cad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:22.529329 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.529442 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29331,"raft.queue_time_us":29553,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4121,"spinlock_wait_cycles":3543024896}
I20260709 12:15:22.491906 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1372) took 1397 ms. Trace:
I20260709 12:15:22.520998 13377 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.559072 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.564888 12587 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:22.465811 12904 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:22.563570 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 104158us
I20260709 12:15:22.500321 13185 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.530364 13276 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:22.579334 13390 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:22.565531 10733 rpcz_store.cc:276] 0709 12:15:21.256159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.256299 (+   140us) service_pool.cc:224] Handling call
0709 12:15:21.256681 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.263871 (+  7190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.263900 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.264395 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.968164 (+703769us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:21.968206 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.968271 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.494759 (+526488us) raft_consensus.cc:1685] finished
0709 12:15:22.494783 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.494937 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6782,"raft.queue_time_us":10004,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2926,"thread_start_us":653608,"threads_started":1,"wal-append.queue_time_us":1119348}
I20260709 12:15:22.573632 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.624650 10200 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:22.625746 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.626928 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.628012 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.574728 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.628892 10734 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:22.575481 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.576035 13336 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.522202 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 504) took 1219 ms. Trace:
I20260709 12:15:22.541292 13372 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:22.573194 10202 rpcz_store.cc:276] 0709 12:15:21.235357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.235473 (+   116us) service_pool.cc:224] Handling call
0709 12:15:21.235809 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.236178 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.236205 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.236750 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.865043 (+628293us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:21.865087 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.865163 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.504858 (+639695us) raft_consensus.cc:1685] finished
0709 12:15:22.504877 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.505028 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1356,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9196,"thread_start_us":583141,"threads_started":1,"wal-append.queue_time_us":970898}
I20260709 12:15:22.499307 13096 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:22.541792 13393 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.580600 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.541954 13338 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:22.582823 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.589999 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.611191 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:22.580428 10121 rpcz_store.cc:269] 0709 12:15:20.088906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.091768 (+  2862us) service_pool.cc:224] Handling call
0709 12:15:22.453914 (+2362146us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54003a0554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:22.454042 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035349888}
I20260709 12:15:22.616014 10055 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:22.637851 10199 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:22.492822 13385 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:15:22.654726 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.656036 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 657) took 1528 ms. Trace:
I20260709 12:15:22.656387 10728 rpcz_store.cc:276] 0709 12:15:21.128055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.128181 (+   126us) service_pool.cc:224] Handling call
0709 12:15:21.128490 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.128836 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.128864 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.129328 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.897831 (+768503us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:21.897871 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.897940 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.655845 (+757905us) raft_consensus.cc:1685] finished
0709 12:15:22.655865 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.655977 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5561,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13722,"thread_start_us":768100,"threads_started":1,"wal-append.queue_time_us":1143101}
I20260709 12:15:22.657909 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.610245 13378 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.610875 10195 rpcz_store.cc:276] 0709 12:15:21.094648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.094765 (+   117us) service_pool.cc:224] Handling call
0709 12:15:21.104604 (+  9839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.104946 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.104971 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.110932 (+  5961us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.792420 (+681488us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:21.792459 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.792527 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.491632 (+699105us) raft_consensus.cc:1685] finished
0709 12:15:22.491659 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.491843 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9214,"thread_start_us":628500,"threads_started":1,"wal-append.queue_time_us":934176}
I20260709 12:15:22.619830 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 436) took 1038 ms. Trace:
I20260709 12:15:22.557071 13089 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:15:22.622040 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:22.565826 10047 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:22.665611 10047 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:22.666879 10047 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:15:22.667412 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:22.667938 10735 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:22.668016 10047 pending_rounds.cc:85] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 2
I20260709 12:15:22.668321 10047 pending_rounds.cc:107] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:15:22.668553 10047 raft_consensus.cc:2889] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:22.634086 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.609931 13339 raft_consensus.cc:2764] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:15:22.638968 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.581221 13355 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.601050 13024 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.641587 13167 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.682998 13261 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:22.643810 12904 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.619156 13302 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.646735 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.632499 13354 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:22.690784 10048 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:22.647267 13393 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.695539 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.647701 13184 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.637862 13276 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.648308 13338 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.632579 10197 rpcz_store.cc:276] 0709 12:15:21.302895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.303948 (+  1053us) service_pool.cc:224] Handling call
0709 12:15:21.304230 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.330760 (+ 26530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.343340 (+ 12580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.377696 (+ 34356us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.048758 (+671062us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:22.048797 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.048865 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.521996 (+473131us) raft_consensus.cc:1685] finished
0709 12:15:22.522013 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.522147 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16750,"thread_start_us":629284,"threads_started":1,"wal-append.queue_time_us":1079553}
I20260709 12:15:22.649260 13336 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.650398 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.651450 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:22.632128 12587 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.646622 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 434) took 1677 ms. Trace:
I20260709 12:15:22.712998 10127 rpcz_store.cc:276] 0709 12:15:20.969529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.174766 (+205237us) service_pool.cc:224] Handling call
0709 12:15:22.454134 (+1279368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:22.525705 (+ 71571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.646402 (+120697us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003a0550. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:22.646564 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941544192}
I20260709 12:15:22.654712 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 425) took 1631 ms. Trace:
I20260709 12:15:22.663760 13367 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:15:22.566505 13275 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:15:22.661650 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.670653 10122 rpcz_store.cc:276] 0709 12:15:21.581403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.581569 (+   166us) service_pool.cc:224] Handling call
0709 12:15:21.634296 (+ 52727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:21.634530 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:21.674662 (+ 40132us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.842630 (+167968us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b1800388a20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:22.345848 (+503218us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4800240258. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:22.619400 (+273552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:22.619458 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:22.619503 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.619566 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.619679 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13138,"prepare.queue_time_us":51071,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":174517,"raft.run_cpu_time_us":2507,"raft.run_wall_time_us":483289,"spinlock_wait_cycles":88939136,"thread_start_us":769094,"threads_started":1}
I20260709 12:15:22.674217 10200 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
W20260709 12:15:22.675611 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53671us
I20260709 12:15:22.674988 13355 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.681329 13407 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:22.686219 13024 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:22.689088 13392 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:15:22.646136 13230 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.658638 13185 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:22.662863 13406 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.664776 13229 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:22.612802 13403 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.711480 10735 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:22.592789 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1377) took 1413 ms. Trace:
I20260709 12:15:22.700866 13354 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.658505 13390 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.719305 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:22.756983 10196 rpcz_store.cc:276] 0709 12:15:21.179089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.179216 (+   127us) service_pool.cc:224] Handling call
0709 12:15:21.179591 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.179825 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.179865 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.180420 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:15:21.856950 (+676530us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:21.856995 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.857065 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.592549 (+735484us) raft_consensus.cc:1685] finished
0709 12:15:22.592571 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.592722 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":668558,"threads_started":1,"wal-append.queue_time_us":1117528}
I20260709 12:15:22.761963 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:22.675465 13378 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.713989 10050 rpcz_store.cc:276] 0709 12:15:21.022945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.025916 (+  2971us) service_pool.cc:224] Handling call
0709 12:15:21.034332 (+  8416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.034932 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.034962 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.035406 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.477381 (+1441975us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:22.477418 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.477496 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.654497 (+177001us) raft_consensus.cc:1685] finished
0709 12:15:22.654522 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.654654 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2077,"raft.queue_time_us":948,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5126,"thread_start_us":1378369,"threads_started":1,"wal-append.queue_time_us":1574080}
I20260709 12:15:22.758766 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:22.764797 12904 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:22.765323 12904 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:22.766183 12904 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.770999 10046 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:22.770159 12971 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:22.721197 13368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.013s	sys 0.021s
I20260709 12:15:22.726199 13184 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:15:22.771214 13261 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:22.779976 13167 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.756830 13185 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.761340 13229 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.759303 13406 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.788905 13261 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:22.784174 13368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.013s	sys 0.022s
W20260709 12:15:22.806278 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 475404us
I20260709 12:15:22.814941 13261 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:22.835548 13371 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:22.802014 13224 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.805078 13167 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:22.849681 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 318844us
W20260709 12:15:22.848377 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 270027us
I20260709 12:15:22.823591 13096 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:22.853206 13247 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:22.856031 13410 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:22.838979 13371 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:22.896181 10734 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:22.889329 13184 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:22.902786 13184 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.902873 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.903813 10048 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:22.904596 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.904904 13184 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.847091 13316 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:22.860940 13338 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.905535 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:22.863690 13276 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.906401 13276 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:22.906765 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.906996 13276 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.906628 13316 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.828009 13273 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:15:22.906370 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:22.910909 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49558.3us
W20260709 12:15:22.888419 13408 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:15:22.918467 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.919217 10050 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:22.901829 13336 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.926867 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:22.900013 13096 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:22.924374 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:22.931565 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:22.933984 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:22.939440 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:22.908560 13247 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:15:22.923142 13302 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.916530 13338 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:15:22.941984 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 104579us
I20260709 12:15:22.914978 13399 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:15:22.925114 13420 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:22.921684 13024 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.963037 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:22.925418 13355 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:22.967319 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:22.967478 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:22.936901 13336 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:15:22.968875 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55702.7us
I20260709 12:15:22.937484 13373 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:22.944299 13407 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:22.973596 13324 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:22.983774 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 515) took 1167 ms. Trace:
I20260709 12:15:22.935930 13096 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:22.927922 13371 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:23.874992 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 516) took 1225 ms. Trace:
I20260709 12:15:23.284165 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:23.272004 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:23.277102 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 309889us
I20260709 12:15:23.283844 10055 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:23.390108 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2132) took 1093 ms. Trace:
W20260709 12:15:23.568126 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 129336us
I20260709 12:15:23.360136 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:23.286754 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:23.306453 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:23.294203 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:23.884532 10051 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:23.887864 10200 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:23.886168 10052 rpcz_store.cc:276] 0709 12:15:22.296285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.296403 (+   118us) service_pool.cc:224] Handling call
0709 12:15:22.296668 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:22.296847 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:22.787867 (+491020us) log.cc:844] Serialized 14 byte log entry
0709 12:15:23.389379 (+601512us) log.cc:844] Serialized 14 byte log entry
0709 12:15:23.389675 (+   296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:23.389719 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:23.389763 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:23.389919 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.390047 (+   128us) inbound_call.cc:177] Queueing success response
0709 12:15:23.446292 (+ 56245us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4800080358. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:23.697919 (+251627us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
Metrics: {"prepare.queue_time_us":62723,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":38075,"raft.run_cpu_time_us":2872,"raft.run_wall_time_us":479803,"spinlock_wait_cycles":167609344,"thread_start_us":1056496,"threads_started":3,"wal-append.queue_time_us":199582}
I20260709 12:15:23.330488 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:23.893360 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 475391us
I20260709 12:15:23.894899 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:23.874527 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:22.961010 13052 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:22.961598 13390 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:23.890882 10199 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:23.881211 10204 rpcz_store.cc:276] 0709 12:15:21.816867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.817020 (+   153us) service_pool.cc:224] Handling call
0709 12:15:21.817357 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:21.817712 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:21.817740 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:21.827339 (+  9599us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.476208 (+648869us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:22.476247 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.476312 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.983541 (+507229us) raft_consensus.cc:1685] finished
0709 12:15:22.983561 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.983712 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12498,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":648467,"threads_started":1,"wal-append.queue_time_us":832057}
I20260709 12:15:23.883311 10729 rpcz_store.cc:276] 0709 12:15:22.649534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.669315 (+ 19781us) service_pool.cc:224] Handling call
0709 12:15:22.679442 (+ 10127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.679857 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:22.901342 (+221485us) log.cc:844] Serialized 14 byte log entry
0709 12:15:23.195863 (+294521us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:23.430230 (+234367us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b2c00012878. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:23.430697 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:15:23.430860 (+   163us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:23.430896 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:23.430978 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:23.874687 (+443709us) raft_consensus.cc:1685] finished
0709 12:15:23.874781 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.874931 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281160,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":5020,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":37400,"spinlock_wait_cycles":207208320,"thread_start_us":480252,"threads_started":2,"wal-append.queue_time_us":447714}
I20260709 12:15:23.124897 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:23.381134 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2125) took 2819 ms. Trace:
I20260709 12:15:22.960752 13354 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:23.132807 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 144813us
I20260709 12:15:22.966857 13410 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:23.697309 12587 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:23.881666 13407 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:22.984855 13224 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:23.419495 13404 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:23.984513 13407 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:23.983930 13410 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:23.280488 13424 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.309s	user 0.003s	sys 0.000s
I20260709 12:15:23.355868 13400 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.727638 13339 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:23.698593 13426 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.711s	user 0.000s	sys 0.003s
W20260709 12:15:23.426096 13415 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:15:23.987727 13339 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:23.605839 13412 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.665s	user 0.002s	sys 0.000s
I20260709 12:15:22.984966 13167 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:23.192440 12972 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.986716 13410 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:23.699097 13185 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:23.516647 13261 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.004s
W20260709 12:15:23.979337 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 93850.4us
I20260709 12:15:23.146514 12578 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:23.427294 13409 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:24.009387 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:22.971892 13275 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:23.990084 12972 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:23.238996 13378 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:23.139505 13316 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:22.985304 13229 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:23.376072 13419 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:23.280889 13230 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:24.002280 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 107556us
I20260709 12:15:22.987174 13373 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.985903 13431 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:23.577775 13380 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:23.243412 12971 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:23.268736 13372 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:24.009657 13409 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:23.987193 13400 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.005404 13185 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.054095 13403 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:23.275207 13393 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:23.146212 13406 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:23.094799 13276 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:23.308646 13405 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:23.082924 13300 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:23.547256 12964 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:24.012135 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:23.980656 13371 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:24.016522 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1861) took 1555 ms. Trace:
I20260709 12:15:22.967964 13430 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 1.040s
W20260709 12:15:24.012301 13277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.018s	sys 0.011s
I20260709 12:15:23.121943 13420 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:24.104914 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:24.101244 13277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.019s	sys 0.011s
I20260709 12:15:24.106750 13449 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:15:24.083925 13419 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.071286 10198 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
W20260709 12:15:24.082257 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 196882us
I20260709 12:15:24.082484 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:23.977325 10049 rpcz_store.cc:276] 0709 12:15:20.561558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:20.563564 (+  2006us) service_pool.cc:224] Handling call
0709 12:15:20.563824 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:20.690619 (+126795us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:21.207497 (+516878us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.928768 (+721271us) log.cc:844] Serialized 14 byte log entry
0709 12:15:21.968555 (+ 39787us) log.cc:844] Serialized 14 byte log entry
0709 12:15:22.019480 (+ 50925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:22.019545 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:22.019595 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.679792 (+660197us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18003ce7a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a3522 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:23.147407 (+467615us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b18003ce7a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:23.380835 (+233428us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400130454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:23.380887 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:23.381065 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46534,"prepare.queue_time_us":939818,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2006,"raft.queue_time_us":52106,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":17496,"spinlock_wait_cycles":361247104,"thread_start_us":1213143,"threads_started":2,"wal-append.queue_time_us":1073666,"wal-append.run_cpu_time_us":2962,"wal-append.run_wall_time_us":1356149}
I20260709 12:15:24.096390 13185 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.007336 13354 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:24.007087 13221 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:23.981220 13052 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.004657 13339 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.098538 13405 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:22.974393 13336 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.027874 13215 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:24.003643 13261 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.011176 13435 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:24.080902 13275 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:24.083690 13373 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:24.098841 10046 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:24.085424 13316 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:24.088342 13372 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:24.099999 10055 rpcz_store.cc:276] 0709 12:15:22.460921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:22.639870 (+178949us) service_pool.cc:224] Handling call
0709 12:15:23.283673 (+643803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:23.886761 (+603088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:24.016323 (+129562us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400110150. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:24.016463 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479951744}
I20260709 12:15:24.086772 13380 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.083801 13355 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:15:24.003058 12578 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.101595 12964 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.158718 12578 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:24.159530 12964 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.112143 13367 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:24.160296 13367 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:24.160692 13367 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:24.102551 13300 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.123101 13052 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.123397 13261 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:24.123878 12972 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.116542 13221 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.120826 13336 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:24.109699 13420 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.116432 13354 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.192126 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:24.192816 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:24.193373 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:24.194819 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 834734us
I20260709 12:15:24.196825 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.218506 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:24.218923 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.219655 10733 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:24.219983 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
W20260709 12:15:24.210005 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 149302us
I20260709 12:15:24.107612 13409 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.146282 13275 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.151170 13316 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.191984 13221 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:24.226176 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.197578 10199 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:24.229790 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.239079 10203 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:24.192442 13433 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:24.229465 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.230088 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.240064 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:24.240550 10195 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:24.149983 13435 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.193984 13449 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:24.240012 10196 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:24.243731 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.216903 12972 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:24.194123 13276 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:24.251783 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 140154us
I20260709 12:15:24.252619 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:24.253793 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:24.254832 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.246917 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.256780 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.258744 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:24.218393 13324 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:24.226933 13400 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:24.263200 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 146716us
I20260709 12:15:24.262036 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.282604 10195 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:24.238365 13409 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:24.288123 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:24.286175 12904 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:24.291227 12904 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.294540 13393 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:24.297592 13393 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:24.297937 13393 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:24.298507 13431 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:24.299067 13431 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:24.298702 13393 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.299870 13393 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:24.308372 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 89996.5us
I20260709 12:15:24.233696 13215 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:24.294225 12904 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.330138 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:24.330322 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:24.331714 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.332602 10737 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:15:24.332232 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.334702 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:24.277281 13420 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.278327 13405 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.336272 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.339826 10730 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:24.268559 13452 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:24.337893 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.346418 10197 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:24.324136 13456 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:24.235339 13372 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.350065 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.341619 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.344686 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:24.352237 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.259797 12972 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.307487 13262 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:24.339653 12904 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:24.260980 13407 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.285463 13276 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:24.363390 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 283808us
I20260709 12:15:24.346764 13400 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:24.339303 13185 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.373298 10121 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:24.256620 13433 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.376843 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:24.260761 13449 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.383951 10130 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:15:24.393410 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.396294 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.344367 13224 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:15:24.344216 13165 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:15:24.409030 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:24.409621 10121 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:24.413425 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.381589 13419 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.401918 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.401232 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:24.421697 10121 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:24.372534 12904 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:24.424175 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 80326.4us
I20260709 12:15:24.425910 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.382752 13400 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:24.299889 13431 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:24.406069 13185 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:24.430996 10121 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:24.431612 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:24.409761 12964 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:24.382197 13453 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:15:24.462365 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.464564 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.465783 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.466408 10049 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:24.460940 13380 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.467406 13096 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.460505 13467 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:24.410149 13420 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:15:24.469684 13420 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:24.470009 13420 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:24.470657 13470 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:24.471205 13470 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:24.471566 13470 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:24.349404 13452 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.474843 10055 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:24.475164 10049 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:15:24.478044 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.478381 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.478740 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:24.479030 10049 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:24.433495 13300 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.430303 13089 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:24.405506 13464 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:15:24.407889 13324 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.425127 13215 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:24.652096 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.591269 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:24.430655 12904 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:24.823324 10202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.014s
W20260709 12:15:24.871589 10202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.015s
I20260709 12:15:24.443218 13400 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.448096 13185 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.432665 13405 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:25.003808 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 269299us
I20260709 12:15:24.591890 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.964157 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:24.479307 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.965375 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.529603 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:24.681555 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 428983us
I20260709 12:15:24.977761 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:24.868743 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.034873 10127 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:25.034925 10054 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:24.576872 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:24.823711 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 484912us
I20260709 12:15:25.037011 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:25.035172 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.039000 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.039216 10130 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:25.039714 10052 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:25.038307 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.041018 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:25.013744 10201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.002s	sys 0.014s
W20260709 12:15:25.042944 10201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.003s	sys 0.014s
I20260709 12:15:25.044361 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:24.710743 13261 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:25.015254 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 685220us
I20260709 12:15:25.059219 13261 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.059690 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:25.061376 13261 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.054286 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:25.034319 10047 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:24.455318 13354 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:25.062664 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:25.063246 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:24.591564 13367 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.063807 13354 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:25.064199 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:25.065155 13367 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.066164 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:25.065181 13354 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:25.067970 13354 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:25.068316 13354 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:25.069092 13354 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.070219 13354 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:24.710983 13052 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:25.071036 13052 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.073064 13052 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:25.073767 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.074406 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.073076 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.074748 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.074443 10734 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:25.073773 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.075846 10737 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:25.076227 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.076287 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:25.077775 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.078315 10735 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:15:24.470877 13463 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:15:24.464715 13460 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:24.982868 13373 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.830s	user 0.006s	sys 0.003s
W20260709 12:15:24.982868 13404 consensus_meta.cc:287] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.998s	user 0.010s	sys 0.000s
W20260709 12:15:25.078208 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1848) took 1705 ms (client timeout 1640 ms). Trace:
W20260709 12:15:25.086117 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.529362 13380 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.824122 13467 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.474874 12964 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:24.981720 13449 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:24.463522 13410 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:24.823571 13448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.010s
I20260709 12:15:25.146894 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:23.233844  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:24.862591 13390 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.608304 13430 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.098291 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2148) took 1684 ms. Trace:
I20260709 12:15:25.032276 13185 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:24.982461 13393 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.001s
I20260709 12:15:24.575555 13275 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.956344 13469 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.853196 13407 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.850737 13435 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.099674 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 531) took 1084 ms. Trace:
W20260709 12:15:25.079663 13336 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.001s
W20260709 12:15:25.108639 10198 rpcz_store.cc:269] 0709 12:15:23.286318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.286494 (+   176us) service_pool.cc:224] Handling call
0709 12:15:24.991326 (+1704832us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:24.991467 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424470272}
I20260709 12:15:24.854974 13452 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:24.831700 13276 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:25.099301 13481 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:15:25.089776 13339 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.001s	sys 0.011s
I20260709 12:15:24.956583 13089 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.093520 13316 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:25.150209 10051 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 2 to 8, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:24.470865 13420 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:25.384193 13221 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.001s
I20260709 12:15:25.214823 10200 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:25.280864 10129 raft_consensus.cc:1217] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-9.9]   Dedup: 5.7->[7.8-9.9]
I20260709 12:15:25.416477 10129 pending_rounds.cc:85] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:15:25.416733 10129 pending_rounds.cc:107] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:15:25.417385 10129 raft_consensus.cc:2889] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:25.231096 10125 raft_consensus.cc:2368] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:25.324613 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.423422 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.280907 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.080927 13487 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:25.143406 13448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.008s	sys 0.020s
I20260709 12:15:25.281303 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.407347 13390 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.384173 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.408275 13430 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:25.408249 13339 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.003s	sys 0.016s
I20260709 12:15:25.408959 10195 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:25.392513 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:25.409512 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:25.116775 13404 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:25.452214 10124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.016s	sys 0.018s
W20260709 12:15:25.452714 10124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.017s	sys 0.018s
I20260709 12:15:25.114183 12587 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.116552 13373 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.102085 12972 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.123730 13380 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.125396 13467 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.447283 13420 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:25.412254 13336 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.409915 10204 rpcz_store.cc:276] 0709 12:15:24.015661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.017574 (+  1913us) service_pool.cc:224] Handling call
0709 12:15:24.017917 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.154105 (+136188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:24.302537 (+148432us) log.cc:844] Serialized 14 byte log entry
0709 12:15:24.682907 (+380370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:24.682965 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:24.683009 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.099456 (+416447us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000636d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:25.099507 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.099620 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243241,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":405458,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":15530,"spinlock_wait_cycles":312669568,"thread_start_us":497075,"threads_started":2,"wal-append.queue_time_us":882403}
I20260709 12:15:25.222538 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.446967 13354 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:25.127269 10126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.001s	sys 0.010s
W20260709 12:15:25.619493 10126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.004s	sys 0.012s
I20260709 12:15:25.425604 10730 raft_consensus.cc:2410] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:15:25.415108 10046 rpcz_store.cc:276] 0709 12:15:23.414355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.414534 (+   179us) service_pool.cc:224] Handling call
0709 12:15:23.874608 (+460074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.125236 (+250628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.098058 (+972822us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002f9c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:25.098233 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515047424}
I20260709 12:15:25.434527 10121 raft_consensus.cc:2376] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8. Re-sending same reply.
I20260709 12:15:25.434623 10130 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:25.433916 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 380392us
I20260709 12:15:25.459712 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.393420 13433 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:25.627888 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:25.545225 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:25.628526 10204 pending_rounds.cc:85] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 9
W20260709 12:15:25.581918 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 522267us
I20260709 12:15:25.581898 10733 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:25.421205 13259 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:25.628597 10053 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:25.413933 13453 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:25.101613 12578 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.942s	user 0.006s	sys 0.003s
I20260709 12:15:25.655371 12578 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.657680 12578 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:25.659277 13485 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 12:15:25.660153 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:25.662707 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:25.664851 10729 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:15:24.993268 13024 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 2 to 8, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:25.596421 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2030) took 1246 ms. Trace:
I20260709 12:15:25.451794 13018 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.684455 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:25.114398 13261 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.610919 10196 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:25.628906 10204 pending_rounds.cc:107] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:15:25.691841 10204 raft_consensus.cc:2889] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:25.555634 13435 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.641547 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2038) took 1230 ms. Trace:
I20260709 12:15:25.699608 10126 rpcz_store.cc:276] 0709 12:15:24.410742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.410873 (+   131us) service_pool.cc:224] Handling call
0709 12:15:24.411146 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.411333 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:24.604145 (+192812us) log.cc:844] Serialized 14 byte log entry
0709 12:15:25.641208 (+1037063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:25.641265 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:25.641314 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.641378 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.641491 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27394,"prepare.queue_time_us":608306,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5670,"raft.queue_time_us":44967,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1207932,"threads_started":2}
I20260709 12:15:25.701807 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.707749 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.709353 10055 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:25.651453 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:25.652884 13259 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.666749 10125 rpcz_store.cc:276] 0709 12:15:24.349708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.349823 (+   115us) service_pool.cc:224] Handling call
0709 12:15:25.596194 (+1246371us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000997d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:25.596355 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024215936}
I20260709 12:15:25.640829 13354 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.681452 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.682217 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:25.745215 13454 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:25.587021 12587 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.747224 10732 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 2 to 8, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:25.705250 13018 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.753355 10702 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:25.720542 13409 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.392s	user 0.006s	sys 0.004s
I20260709 12:15:25.760103 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.795141 10126 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:15:25.768996 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:25.428275 13221 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.771593 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.411154 13469 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.680812 13453 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:25.790871 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:25.793701 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.796583 10130 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:15:25.796872 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.834800 10123 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:25.708025 13435 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.703243 13261 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:25.823254 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:25.786023 13470 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.314s	user 0.010s	sys 0.000s
I20260709 12:15:25.845706 10046 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:25.792100 13279 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:25.869436 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78645.1us
W20260709 12:15:25.848042 13405 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 12:15:25.919149 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.868371 10125 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:25.930022 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.934307 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:25.935158 10126 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:25.832861 13410 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:25.835942 13409 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.938704 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:25.916345 13499 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:15:25.946996 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:25.919950 13431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.023s	sys 0.029s
I20260709 12:15:25.947881 10121 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:25.867662 13491 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.918843 13498 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:25.962268 10130 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:25.934646 13470 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:25.967046 13507 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:15:25.967300 10121 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:25.968325 13336 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:25.968559 13453 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.969005 13469 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.940706 13405 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:25.969674 13504 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:15:25.970489 13501 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:15:25.970713 13221 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:25.971390 13373 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:25.940312 13390 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:25.974458 13502 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:15:25.975687 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 536) took 1445 ms. Trace:
I20260709 12:15:25.976488 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2029) took 1628 ms. Trace:
I20260709 12:15:25.976862 10128 rpcz_store.cc:276] 0709 12:15:24.348556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.348680 (+   124us) service_pool.cc:224] Handling call
0709 12:15:24.348980 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:24.448807 (+ 99827us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:24.744072 (+295265us) log.cc:844] Serialized 14 byte log entry
0709 12:15:25.664519 (+920447us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b1800388900. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:25.664704 (+   185us) log.cc:844] Serialized 14 byte log entry
0709 12:15:25.685511 (+ 20807us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:25.709915 (+ 24404us) log.cc:844] Serialized 26 byte log entry
0709 12:15:25.710063 (+   148us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:25.710098 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.710167 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:25.976293 (+266126us) raft_consensus.cc:1685] finished
0709 12:15:25.976313 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.976434 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":561511,"prepare.queue_time_us":1179839,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":55,"raft.queue_time_us":376279,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":21918,"spinlock_wait_cycles":87441024,"thread_start_us":724839,"threads_started":3,"wal-append.queue_time_us":1089400}
I20260709 12:15:25.976078 10197 rpcz_store.cc:276] 0709 12:15:24.530365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.530532 (+   167us) service_pool.cc:224] Handling call
0709 12:15:24.530853 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:24.531065 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:24.531090 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:24.869850 (+338760us) log.cc:844] Serialized 26 byte log entry
0709 12:15:25.220415 (+350565us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:25.220461 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.220535 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:25.975465 (+754930us) raft_consensus.cc:1685] finished
0709 12:15:25.975485 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.975618 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":257092,"threads_started":1,"wal-append.queue_time_us":902783}
I20260709 12:15:25.932371 12964 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:25.958149 13431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.023s	sys 0.029s
I20260709 12:15:25.990612 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1418) took 1396 ms. Trace:
I20260709 12:15:25.958644 13409 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.000828 10197 rpcz_store.cc:276] 0709 12:15:24.597765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.989669 (+1391904us) service_pool.cc:224] Handling call
0709 12:15:25.990009 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.990206 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.990234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:25.990284 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:25.990320 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.990403 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:25.990553 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:25.967381 13496 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:15:26.142586 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2033) took 1765 ms. Trace:
I20260709 12:15:26.143898 10124 rpcz_store.cc:276] 0709 12:15:24.376853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.377005 (+   152us) service_pool.cc:224] Handling call
0709 12:15:24.377352 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.377593 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:24.648494 (+270901us) log.cc:844] Serialized 14 byte log entry
0709 12:15:25.704250 (+1055756us) log.cc:844] Serialized 14 byte log entry
0709 12:15:25.937922 (+233672us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.120018 (+182096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.120070 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:26.120121 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.120181 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.142482 (+ 22301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282789,"prepare.queue_time_us":711693,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":895,"raft.queue_time_us":424572,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":50445,"spinlock_wait_cycles":7004032,"thread_start_us":1460254,"threads_started":4,"wal-append.queue_time_us":1295650}
I20260709 12:15:26.147300 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.010157 13380 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.156057 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:26.154528 10094 connection.cc:256] RPC call timeout handler was delayed by -1.1886575039998206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 12:15:26.162976 13508 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:15:26.164489 13505 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:26.165139 13505 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.167147 13517 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.167701 13517 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.168582 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.170091 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.171337 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.172559 13453 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:26.172951 13453 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:26.173305 13453 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:26.174073 12904 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.209s	user 0.003s	sys 0.004s
I20260709 12:15:25.988498 13491 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.177670 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:26.177282 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:26.182309 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:26.199944 10124 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:26.179612 13469 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:26.201028 13469 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.201900 13430 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.203045 13469 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.203593 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:26.204856 13390 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:26.205312 13390 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:26.205710 13390 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:26.205888 13509 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:15:26.206964 13506 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:15:26.207170 13339 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:26.208120 13339 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:26.208451 13339 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:26.209187 13339 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:26.211120 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.211721 10052 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:26.213367 13390 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.194206 13221 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:26.214737 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 447) took 1066 ms. Trace:
I20260709 12:15:26.215158 10129 rpcz_store.cc:276] 0709 12:15:25.148016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.148135 (+   119us) service_pool.cc:224] Handling call
0709 12:15:25.280692 (+132557us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:25.438371 (+157679us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:25.438405 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:25.439120 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 12:15:25.792663 (+353543us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:25.792703 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.792802 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.214498 (+421696us) raft_consensus.cc:1685] finished
0709 12:15:26.214527 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.214676 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56702,"raft.queue_time_us":47479,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":113001,"thread_start_us":208084,"threads_started":1,"wal-append.queue_time_us":574275}
I20260709 12:15:26.216281 13491 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.175513 13467 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.176368 13018 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.157157 13354 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.217628 13089 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.219117 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1397) took 2015 ms. Trace:
I20260709 12:15:26.219547 10196 rpcz_store.cc:276] 0709 12:15:24.203878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.254584 (+ 50706us) service_pool.cc:224] Handling call
0709 12:15:26.218892 (+1964308us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:26.219050 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3093261184}
I20260709 12:15:26.216143 13390 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:26.220891 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1405) took 1759 ms (client timeout 2210 ms). Trace:
W20260709 12:15:26.221297 10195 rpcz_store.cc:269] 0709 12:15:24.461991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.462119 (+   128us) service_pool.cc:224] Handling call
0709 12:15:26.220706 (+1758587us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54000eabd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:26.220826 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170315136}
I20260709 12:15:26.176055 13435 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:26.239070 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:26.294021 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.343755 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.245428 10735 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:26.237057 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:26.204923 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:26.362022 10052 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:26.204775 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.356567 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.373843 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:26.190994 13420 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
W20260709 12:15:26.174319 13185 consensus_meta.cc:287] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.742s	user 0.003s	sys 0.002s
W20260709 12:15:26.363006 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 158151us
I20260709 12:15:26.375595 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:26.175117 13371 consensus_meta.cc:287] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 2.073s	user 0.010s	sys 0.002s
W20260709 12:15:26.271104 13400 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.192s	user 0.010s	sys 0.001s
W20260709 12:15:26.268326 13367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.013s	sys 0.020s
I20260709 12:15:26.210330 13339 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:26.174638 13336 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:26.379338 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.179523 13410 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.396870 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.179368 13490 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:26.382932 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:26.398964 10124 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:26.189622 13409 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.344331 13261 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.403158 10046 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:26.364040 13390 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:26.396467 13367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.013s	sys 0.031s
I20260709 12:15:26.406277 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:26.426959 10129 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:26.383765 13181 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:15:26.376929 13165 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:26.238888 12904 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.419883 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.401975 13336 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:26.422729 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:26.408375 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:26.394271 13185 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.455216 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.375664 13221 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.417003 13018 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.431855 13261 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:15:26.435539 10199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1408) took 1844 ms (client timeout 1592 ms). Trace:
W20260709 12:15:26.467216 10199 rpcz_store.cc:269] 0709 12:15:24.591483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.963859 (+372376us) service_pool.cc:224] Handling call
0709 12:15:26.435314 (+1471455us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54000ea6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:26.435456 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287063424}
I20260709 12:15:26.436349 12587 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.439276 13454 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:26.441026 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.473424 10127 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
W20260709 12:15:26.441834 13519 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:15:26.402456 13400 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.447889 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1415) took 1854 ms. Trace:
I20260709 12:15:26.478047 10204 rpcz_store.cc:276] 0709 12:15:24.593295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.628001 (+1034706us) service_pool.cc:224] Handling call
0709 12:15:25.628346 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.692486 (+ 64140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.692521 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:25.692959 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.049565 (+356606us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:26.049599 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.049672 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.447652 (+397980us) raft_consensus.cc:1685] finished
0709 12:15:26.447677 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.447826 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":304611,"threads_started":1,"wal-append.queue_time_us":671024}
I20260709 12:15:26.405046 13410 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.480810 10127 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: [8.6-9.7]
W20260709 12:15:26.481276 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 856832us
I20260709 12:15:26.484119 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:26.485031 10129 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:26.405803 13490 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:26.428457 13024 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
W20260709 12:15:26.461438 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 284636us
I20260709 12:15:26.462296 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.469394 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.487583 10130 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:26.429462 13419 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:26.471268 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.441845 10046 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:26.472450 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.493872 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.455286 13336 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:26.481817 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1412) took 1889 ms. Trace:
I20260709 12:15:26.434068 13449 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:15:26.465822 13165 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:26.494122 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.494982 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.476272 13454 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:26.470585 13407 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.534924 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.528390 10050 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:26.494567 10198 rpcz_store.cc:276] 0709 12:15:24.592570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.410397 (+817827us) service_pool.cc:224] Handling call
0709 12:15:25.410688 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.410876 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:25.411407 (+   531us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.481491 (+1070084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.481543 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:26.481583 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.481647 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.481762 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":813499,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"thread_start_us":256243,"threads_started":1,"wal-append.queue_time_us":370767}
I20260709 12:15:26.532014 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.530515 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.535679 10046 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:26.541405 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.542269 10051 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:26.543175 10047 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:15:26.543081 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59039.2us
I20260709 12:15:26.475404 13018 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.565529 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:26.542276 10054 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:26.531188 13419 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.568627 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:26.608660 10129 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:26.610157 10129 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:15:26.568823 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 161954us
W20260709 12:15:26.616014 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:26.619392 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.623723 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.624444 10195 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:26.627923 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.628197 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.628878 10204 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 4.
I20260709 12:15:26.630378 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.631472 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:26.632881 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 64352.9us
I20260709 12:15:26.631786 10196 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:26.635205 10204 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:26.565688 13316 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:26.636893 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:26.638981 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.635103 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.641297 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.643890 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.607702 13371 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.535490 13503 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:15:26.538388 13453 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.617347 13324 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.650266 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.650976 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:26.546691 13407 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.679612 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.711925 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:26.702085 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:26.720103 10197 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:26.721226 10196 raft_consensus.cc:2410] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:26.634276 13420 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:26.678789 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:26.544849 10047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38950
I20260709 12:15:26.618535 13406 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:26.637073 13404 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:26.653216 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:26.697103 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 435) took 1232 ms. Trace:
I20260709 12:15:26.632202 13449 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:26.740954 10195 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:26.651198 13276 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:26.740985 10050 rpcz_store.cc:276] 0709 12:15:25.464396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.620793 (+156397us) service_pool.cc:224] Handling call
0709 12:15:26.696875 (+1076082us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540019e454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:26.697037 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938900736}
I20260709 12:15:26.700596 13316 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:26.639240 13416 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:15:26.738930 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.731921 10047 raft_consensus.cc:606] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:15:26.746963 10047 raft_consensus.cc:614] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:26.752671 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71287us
W20260709 12:15:26.752700 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.756000 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:26.756858 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78138.6us
I20260709 12:15:26.732553 13390 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:26.680624 13371 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.645804 13165 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.743554 13276 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.769891 10199 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:15:26.770819 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.771435 10197 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:26.748355 13316 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:26.777895 10169 leader_election.cc:400] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:26.778904 10169 leader_election.cc:403] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:26.730263 13324 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.778198 10195 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:26.753614 12904 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.781030 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:26.784466 10204 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:15:26.781080 10199 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:15:26.761082 13390 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:26.755048 13185 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.780619 13316 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:26.762908 13406 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:26.768936 13465 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:26.773978 13276 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:26.753058 13449 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:26.790284 13526 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:15:26.795107 13018 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:26.795794 13532 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:15:26.794340 13336 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.796181 13419 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:26.782232 13493 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.183s	user 0.000s	sys 0.003s
W20260709 12:15:26.782651 13529 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:15:26.796347 13528 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:15:26.778151 13410 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.781611 13420 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:26.780614 13490 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.788609 13447 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:26.780040 13400 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.801558 13371 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.781821 13096 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:15:26.802544 13407 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.798406 13465 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:26.825961 13465 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:26.804163 13406 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:26.805298 13221 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.782799 13324 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.789333 13390 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:26.798127 13535 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:15:26.812672 13453 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.830629 13454 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.813755 13336 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:26.814414 13449 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.821751 13420 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:26.838485 13454 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:26.840656 13489 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.419s	user 0.000s	sys 0.005s
W20260709 12:15:26.841614 13530 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:15:26.843798 13465 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.845499 13465 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:26.887318 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.889607 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.887318 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.891696 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.892818 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.893522 10046 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:26.895414 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.896324 10047 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:26.899210 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.902022 10047 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:26.907334 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.908735 10047 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
W20260709 12:15:26.909550 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 193195us
I20260709 12:15:26.916931 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.916986 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:26.917802 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:26.920629 13560 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:26.922082 13560 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:26.922480 13560 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:26.923753 13560 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:26.924701 10046 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:26.924919 13560 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:26.918067 10052 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:26.799659 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:26.832861 13316 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.932422 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:26.935353 13324 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:26.935786 13324 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:26.936170 13324 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:26.928220 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 457) took 1467 ms. Trace:
I20260709 12:15:26.939124 10121 rpcz_store.cc:276] 0709 12:15:25.460577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.968117 (+507540us) service_pool.cc:224] Handling call
0709 12:15:25.968435 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.968770 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.968799 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:25.969316 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:15:26.267197 (+297881us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:26.271637 (+  4440us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.405550 (+133913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.405621 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.801022 (+395401us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4800240258. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:26.927408 (+126386us) raft_consensus.cc:1685] finished
0709 12:15:26.927556 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.927884 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133542,"prepare.queue_time_us":4001,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":134640,"raft.run_cpu_time_us":2958,"raft.run_wall_time_us":389374,"spinlock_wait_cycles":3027840,"thread_start_us":297471,"threads_started":1,"wal-append.queue_time_us":522509}
I20260709 12:15:26.929090 10130 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:26.929979 13096 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:26.788789 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:26.942667 13096 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:26.837898 13420 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:26.837369 13447 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
W20260709 12:15:26.931308 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 192756us
I20260709 12:15:26.942247 13390 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:26.950956 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:26.951902 13316 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:26.952921 13096 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:26.954716 10201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.008s
I20260709 12:15:26.969673 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:26.969340 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1874) took 1932 ms. Trace:
W20260709 12:15:26.972543 10201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.008s
W20260709 12:15:26.981400 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 61412.5us
I20260709 12:15:26.990139 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.991852 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:26.992267 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2026) took 2645 ms. Trace:
I20260709 12:15:26.993144 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:26.994928 13406 raft_consensus.cc:2764] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:15:26.970913 13540 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:15:26.996842 13540 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:26.997283 13540 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:26.989048 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:15:26.971527 10049 rpcz_store.cc:276] 0709 12:15:25.037204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.037337 (+   133us) service_pool.cc:224] Handling call
0709 12:15:25.037699 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.062170 (+ 24471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.062198 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:25.062665 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:15:25.449766 (+387101us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:25.449908 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.968378 (+1518470us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54003fa7d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:26.968519 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.968629 (+   110us) raft_consensus.cc:1685] finished
0709 12:15:26.968650 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:26.969092 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8439,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":55524096,"thread_start_us":386214,"threads_started":1,"wal-append.queue_time_us":692727}
I20260709 12:15:27.002473 13540 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.003647 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 528) took 2993 ms. Trace:
I20260709 12:15:27.004330 13540 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:27.006574 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.004107 10202 rpcz_store.cc:276] 0709 12:15:24.009575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.010522 (+   947us) service_pool.cc:224] Handling call
0709 12:15:24.010778 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.113652 (+102874us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:24.241069 (+127417us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.421717 (+2180648us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800475fc0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:26.611254 (+189537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.611309 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:26.611354 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.003049 (+391695us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000ea1d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:27.003116 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.003400 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313355,"prepare.queue_time_us":225876,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1575796,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5332,"spinlock_wait_cycles":272025216,"thread_start_us":944188,"threads_started":3,"wal-append.queue_time_us":838210,"wal-append.run_cpu_time_us":1002,"wal-append.run_wall_time_us":1001037}
I20260709 12:15:27.007983 13550 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:27.008524 13550 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:27.008798 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:27.005369 13185 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:27.010677 13185 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.008986 13550 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.014941 13165 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:15:27.015482 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 64798.7us
I20260709 12:15:27.016543 13420 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.019318 13420 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.024267 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1409) took 2432 ms. Trace:
I20260709 12:15:27.024798 10203 rpcz_store.cc:276] 0709 12:15:24.591785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.067026 (+475241us) service_pool.cc:224] Handling call
0709 12:15:25.076641 (+  9615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:26.535004 (+1458363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.535033 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.535089 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:26.535120 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.023716 (+488596us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000627d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:27.023787 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.024065 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160241,"raft.queue_time_us":146590,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":20279,"spinlock_wait_cycles":3020680576}
W20260709 12:15:27.032999 10702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.677s (SENT) [suppressed 23 similar messages]
I20260709 12:15:27.038473 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.040220 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.040742 13324 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.041608 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:26.992628 10123 rpcz_store.cc:276] 0709 12:15:24.347161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.347263 (+   102us) service_pool.cc:224] Handling call
0709 12:15:24.347521 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.867988 (+1520467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.991786 (+1123798us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400173754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:26.992091 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420017536}
I20260709 12:15:27.057745 10121 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:27.051560 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 776) took 1980 ms. Trace:
W20260709 12:15:27.092566 13511 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.938s	user 0.003s	sys 0.004s
I20260709 12:15:27.095968 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1456) took 1137 ms. Trace:
I20260709 12:15:27.005426 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 533) took 2681 ms. Trace:
I20260709 12:15:27.096364 13276 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.097177 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.102604  9952 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.103652 13185 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.106554 10195 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:27.091950 13259 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.009536 13390 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.109278 10130 rpcz_store.cc:276] 0709 12:15:25.959063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.488159 (+529096us) service_pool.cc:224] Handling call
0709 12:15:26.488436 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:26.942226 (+453790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.095645 (+153419us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001e3a54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:27.095880 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012240768}
I20260709 12:15:27.047339 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 452) took 1765 ms. Trace:
I20260709 12:15:27.049458 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.111342 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 433) took 1681 ms. Trace:
W20260709 12:15:27.130756 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 64069.8us
I20260709 12:15:27.048570 13096 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.133682 10203 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:27.134253 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:27.135434 13517 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.109526 10733 rpcz_store.cc:276] 0709 12:15:25.071404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.071547 (+   143us) service_pool.cc:224] Handling call
0709 12:15:25.071813 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.629747 (+557934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.035917 (+1406170us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400646ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:27.051332 (+ 15415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924483456}
I20260709 12:15:27.120891 13505 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.127725 10122 rpcz_store.cc:276] 0709 12:15:25.281395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.420105 (+138710us) service_pool.cc:224] Handling call
0709 12:15:25.420414 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.847441 (+427027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.847474 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:25.847531 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:25.847563 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.990328 (+1142765us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54001d5954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:26.990406 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.047171 (+ 56765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981564800}
I20260709 12:15:27.047982 13432 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:15:27.144001 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 735502us
I20260709 12:15:27.145462 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1455) took 1215 ms. Trace:
I20260709 12:15:27.043958 13470 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:27.111368 13550 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.149969 10124 rpcz_store.cc:276] 0709 12:15:25.929546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.487830 (+558284us) service_pool.cc:224] Handling call
0709 12:15:26.488143 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:26.488361 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:26.545210 (+ 56849us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.144631 (+599421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.144741 (+   110us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:27.144880 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.145005 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.145258 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":548781,"prepare.queue_time_us":130237,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":106716,"threads_started":1,"wal-append.queue_time_us":198807}
I20260709 12:15:27.164974 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 454) took 1774 ms. Trace:
I20260709 12:15:27.129083 10048 rpcz_store.cc:276] 0709 12:15:25.430044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.430246 (+   202us) service_pool.cc:224] Handling call
0709 12:15:25.430566 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.433171 (+  2605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.433200 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:25.454845 (+ 21645us) log.cc:844] Serialized 26 byte log entry
0709 12:15:25.784411 (+329566us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:25.784454 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:25.784520 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:26.800544 (+1016024us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b4800080358. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:27.091953 (+291409us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b2400171908. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e209d 00007fc17e31410e 00007fc17e32b88c 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221
0709 12:15:27.110896 (+ 18943us) raft_consensus.cc:1685] finished
0709 12:15:27.110921 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.111150 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2224,"raft.queue_time_us":2710,"raft.run_cpu_time_us":7257,"raft.run_wall_time_us":1353643,"spinlock_wait_cycles":79640832,"thread_start_us":190121,"threads_started":1,"wal-append.queue_time_us":605075}
W20260709 12:15:27.171422 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 201963us
I20260709 12:15:27.169838 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.158141 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:27.177971 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.180025 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.181006 13259 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.181813 13259 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.183346 10195 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:27.185051 13259 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.186972 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.149788 13432 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:27.109536 10201 rpcz_store.cc:276] 0709 12:15:24.324204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.324866 (+   662us) service_pool.cc:224] Handling call
0709 12:15:24.342360 (+ 17494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:24.342607 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:24.398863 (+ 56256us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.718022 (+2319159us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:27.004833 (+286811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.004945 (+   112us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:27.005087 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.005208 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.005371 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1538938,"prepare.queue_time_us":188093,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":1415538,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9897,"spinlock_wait_cycles":29732096,"thread_start_us":1250778,"threads_started":3,"wal-append.queue_time_us":1029067}
I20260709 12:15:27.197238 13537 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:27.197682 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 148430us
I20260709 12:15:27.159423 13276 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:27.199030 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 166197us
I20260709 12:15:27.161672 13018 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.193215 13324 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:27.201483 13537 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:27.197892 13498 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:27.169024 10125 rpcz_store.cc:276] 0709 12:15:25.390695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.940428 (+549733us) service_pool.cc:224] Handling call
0709 12:15:25.940722 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:26.149706 (+208984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:26.149735 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:26.155779 (+  6044us) log.cc:844] Serialized 52 byte log entry
0709 12:15:26.486692 (+330913us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:26.539388 (+ 52696us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.146368 (+606980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.150772 (+  4404us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.156483 (+  5711us) raft_consensus.cc:1685] finished
0709 12:15:27.156514 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.164780 (+  8266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":606373,"prepare.queue_time_us":58141,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":13617,"raft.queue_time_us":650699,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":208,"thread_start_us":424594,"threads_started":2,"wal-append.queue_time_us":384805}
I20260709 12:15:27.222960 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 458) took 1628 ms. Trace:
I20260709 12:15:27.223526 10128 rpcz_store.cc:276] 0709 12:15:25.594210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.979598 (+385388us) service_pool.cc:224] Handling call
0709 12:15:25.979911 (+   313us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:25.980295 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:25.980322 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:26.115888 (+135566us) log.cc:844] Serialized 78 byte log entry
0709 12:15:26.410840 (+294952us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:26.431377 (+ 20537us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.841125 (+409748us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:26.998261 (+157136us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800356f80. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:27.133939 (+135678us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.222291 (+ 88352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.222444 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.222525 (+    81us) raft_consensus.cc:1685] finished
0709 12:15:27.222555 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.222769 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96365,"prepare.queue_time_us":23736,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1869,"raft.queue_time_us":729731,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":1088,"spinlock_wait_cycles":36332160,"thread_start_us":254347,"threads_started":1,"wal-append.queue_time_us":469402}
W20260709 12:15:27.226953 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 84351.1us
I20260709 12:15:27.226568 13430 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:27.228147 13430 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.231315 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.232396 10203 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:15:27.232978 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:27.235857 13215 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:27.236387 13215 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:27.237516 13215 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.218847 10123 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:27.240661 13546 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.455s	user 0.004s	sys 0.000s
I20260709 12:15:27.241585 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.249567 13498 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.252632 10195 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:27.253127 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 455) took 1839 ms. Trace:
I20260709 12:15:27.253422 13432 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.274531 10122 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:15:27.274956 13432 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:27.260272 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45550.4us
I20260709 12:15:27.277666 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.278914 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1414) took 2685 ms. Trace:
I20260709 12:15:27.279055 13406 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.262373 10052 raft_consensus.cc:606] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.279665 13279 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:27.279603 10052 raft_consensus.cc:614] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:27.282011 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:27.245816 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:27.235870 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.216120 13537 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.264403 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:15:27.266077 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52431.6us
I20260709 12:15:27.267391 10203 raft_consensus.cc:2410] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:27.270677 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:27.271003 10020 connection.cc:256] RPC call timeout handler was delayed by -1.4214707680000629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33740000000000003s for a response
I20260709 12:15:27.272898 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.259754 13165 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.274371 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.270529 13498 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:27.279364 10200 rpcz_store.cc:276] 0709 12:15:24.593043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.425907 (+832864us) service_pool.cc:224] Handling call
0709 12:15:25.426153 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.426348 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:25.453695 (+ 27347us) log.cc:844] Serialized 14 byte log entry
0709 12:15:27.149980 (+1696285us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18003756a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a 00007fc17e79aa2a
0709 12:15:27.210876 (+ 60896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.215816 (+  4940us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:27.264208 (+ 48392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.278568 (+ 14360us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.278757 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27070,"prepare.run_cpu_time_us":8962,"prepare.run_wall_time_us":118400,"raft.queue_time_us":935,"spinlock_wait_cycles":10266368,"thread_start_us":50967,"threads_started":1,"wal-append.queue_time_us":1829635}
I20260709 12:15:27.303370 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.303579 13498 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:27.303403 13165 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.305075 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.305552 13372 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.306042 10200 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
W20260709 12:15:27.307010 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71285.4us
I20260709 12:15:27.308266 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.309159 13221 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.312064 13165 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.313843 13554 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:27.314847 13536 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:27.316936 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.279865 13406 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.329743 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:15:27.318102 13550 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:27.318728 10020 connection.cc:256] RPC call timeout handler was delayed by -1.3370820640000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:15:27.324827 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:27.326678 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.267199 10126 rpcz_store.cc:276] 0709 12:15:25.414002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:25.941175 (+527173us) service_pool.cc:224] Handling call
0709 12:15:25.941412 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:25.941586 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:25.944306 (+  2720us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.995355 (+1051049us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b1800268a80. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a 00007fc17e79aa2a
0709 12:15:27.249483 (+254128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:27.252560 (+  3077us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:27.252659 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.252756 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.252937 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38579,"prepare.queue_time_us":1403,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":42003,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":112,"spinlock_wait_cycles":8319744,"thread_start_us":202661,"threads_started":1,"wal-append.queue_time_us":1324095}
I20260709 12:15:27.308116 13430 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.335707  9952 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.337453 13453 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:27.341565 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.342470 10195 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:27.343417 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.344606 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:27.341461 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.347905 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:27.338183 13453 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.326203 13554 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:27.327944 13536 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:27.368741 13536 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.368634  9952 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.370365  9952 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 7, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.372884 13486 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.373440 13486 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.357204 10204 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:27.355564 13517 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.376830 13517 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.379098 13517 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:27.362709 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89999.3us
I20260709 12:15:27.382256 10204 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:27.382764 13372 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:27.384713 10204 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:27.363135 13453 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.347762 10052 raft_consensus.cc:606] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.388588  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:27.364089 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.366962 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.373698 13554 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.392241 13554 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.368072 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.393674 10203 raft_consensus.cc:2410] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:27.354930 13430 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:27.394507 13430 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.394965 13430 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.396363 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.371997  9952 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 6, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:27.396019 13486 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.406713 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:27.407837 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43902.9us
I20260709 12:15:27.408108 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:27.409125 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:27.409785 10198 pending_rounds.cc:85] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:15:27.410096 10198 pending_rounds.cc:107] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:15:27.410436 10198 raft_consensus.cc:2889] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:27.410611 13453 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:27.411413 13453 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:27.411924 13453 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:27.412257 13540 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:27.412693 13540 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.413003 13540 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.412961 13453 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.390100 13406 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:27.392261  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:27.417017  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:27.419868 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:27.421022 13476 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:27.421473 13476 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.421949 13476 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.422343  9952 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 6 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.423249 10195 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:27.423823 13316 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:27.424983  9952 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 3 to 8, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 8 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:27.426810 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 149303us
I20260709 12:15:27.427961 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.428488 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:27.429548 13486 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:27.429600 13498 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:27.430454 13275 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:27.431871 13275 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:27.432263 13275 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:27.433003 13279 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:27.433347 13275 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.434862 13275 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:27.436602 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 107615us
I20260709 12:15:27.438685 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:27.439528 13390 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:27.439958 13390 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:27.440383 13390 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.441716 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.443706 10197 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.425778 13316 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.421408 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.450840 13517 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.451581 13517 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.451946 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.453874 13517 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.430377 13486 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:27.455899 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.455608 13486 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.456575 10050 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:27.461586 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.466565 13336 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.448587 13316 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.484175 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.484768 10129 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:27.485224 13262 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.485997 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.490288 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.491113 13165 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:27.491854 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 70557us
W20260709 12:15:27.492787  9951 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 272) took 21261 ms (client timeout 15000 ms). Trace:
I20260709 12:15:27.493849 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:27.494763 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.495354 13165 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:27.496445 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.497051 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.498610 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.499249 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.495448 10123 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.427038 13537 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.505487 13336 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:27.505935 13336 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.506307 13336 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:27.509017 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.506033 10122 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:27.517493 10121 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:27.520223 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.517846 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.523782 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.523808 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.525573 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.526342 10126 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:27.528331 13536 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.536046 10201 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:27.531888 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.522714 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.537142 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.550802 10130 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.552827 10046 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:27.549085 10128 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:27.549136 10125 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:27.553777 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70249.7us
I20260709 12:15:27.516074 13517 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:15:27.550372 13536 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.570573 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.571049 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.572856 13372 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.576954 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.577857 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.578708 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.579336 13537 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:27.579598 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.580420 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.571921 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.580682 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.545861 13221 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.584304 10197 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:27.584622 10732 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:27.585158 10735 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:27.592649 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55596us
I20260709 12:15:27.590783 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.594669 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.594833 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.595745 13517 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:27.596606 13517 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:27.597232 13018 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:27.596998 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 85056.1us
I20260709 12:15:27.602538 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.606159 10123 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:27.601456  9952 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 4 to 7, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:27.607563 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 255232us
I20260709 12:15:27.596940 13517 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:27.616298 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:27.617703 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:27.493146  9951 rpcz_store.cc:269] 0709 12:15:06.278987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:06.279238 (+   251us) service_pool.cc:224] Handling call
0709 12:15:06.381518 (+102280us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54001f0090. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66c640 00007fc184543846 00007fc18464d90e 00007fc182b0e2a4 00007fc182b0e232 00007fc182b0e161 00007fc182b0e0dc 00007fc182b0d392 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:27.492525 (+21111007us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:19.551294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:19.552072 (+   778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:19.552134 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:15:19.552154 (+    20us) tablet.cc:662] Decoding operations
0709 12:15:19.553452 (+  1298us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:19.553538 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:19.553568 (+    30us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:15:19.702524 (+148956us) tablet.cc:701] Row locks acquired
0709 12:15:19.717303 (+ 14779us) write_op.cc:260] PREPARE: finished
0709 12:15:19.717500 (+   197us) write_op.cc:270] Start()
0709 12:15:19.717671 (+   171us) write_op.cc:276] Timestamp: P: 1783599319717417 usec, L: 0
0709 12:15:19.717693 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:19.718523 (+   830us) log.cc:844] Serialized 5294 byte log entry
0709 12:15:20.624560 (+906037us) op_driver.cc:464] REPLICATION: finished
0709 12:15:21.695525 (+1070965us) write_op.cc:301] APPLY: starting
0709 12:15:21.708925 (+ 13400us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:21.762565 (+ 53640us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:21.786682 (+ 24117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:22.038465 (+251783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:22.038817 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:15:22.038866 (+    49us) write_op.cc:312] APPLY: finished
0709 12:15:22.039277 (+   411us) log.cc:844] Serialized 95 byte log entry
0709 12:15:22.820696 (+781419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:22.834597 (+ 13901us) write_op.cc:454] Released schema lock
0709 12:15:22.834677 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:22.862837 (+ 28160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:22.888707 (+ 25870us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1719277,"reported_tablets":41,"spinlock_wait_cycles":25523072,"child_traces":[["op",{"apply.queue_time_us":945952,"apply.run_cpu_time_us":44503,"apply.run_wall_time_us":1201968,"num_ops":13,"prepare.queue_time_us":190113,"prepare.run_cpu_time_us":21989,"prepare.run_wall_time_us":286980,"raft.queue_time_us":307955,"raft.run_cpu_time_us":50614,"raft.run_wall_time_us":601535,"replication_time_us":871325,"spinlock_wait_cycles":7040,"thread_start_us":1480837,"threads_started":5,"wal-append.queue_time_us":979665,"wal-append.run_cpu_time_us":21450,"wal-append.run_wall_time_us":2548525}]]}
I20260709 12:15:27.625142 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1452) took 1965 ms. Trace:
I20260709 12:15:27.625576 10127 rpcz_store.cc:276] 0709 12:15:25.652131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.488429 (+836298us) service_pool.cc:224] Handling call
0709 12:15:26.533241 (+ 44812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:27.146620 (+613379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:27.146672 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:27.191170 (+ 44498us) log.cc:844] Serialized 26 byte log entry
0709 12:15:27.245723 (+ 54553us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:27.245767 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.249647 (+  3880us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:27.615209 (+365562us) raft_consensus.cc:1685] finished
0709 12:15:27.615229 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.617305 (+  2076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612709,"raft.queue_time_us":628981,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":51948,"threads_started":1,"wal-append.queue_time_us":361091}
I20260709 12:15:27.627081 10051 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:27.630542 10055 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.631646 13540 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.634011 13540 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:27.588250 13430 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.636015 13430 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.637216 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.629709 13390 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.640722 10733 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.641016 10737 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:27.644917 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77838.7us
I20260709 12:15:27.637284 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.643927 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:27.643013  9952 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 2 to 8, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 8 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:27.649250 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56051us
I20260709 12:15:27.649678 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.650027 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.650274 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.652638 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.653054 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:27.655457 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:27.656028 10201 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:27.659318 10729 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:27.661764 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.663491 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.664285 13406 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.664942 13406 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.665558 13406 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:27.646451 13372 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:27.669976 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:27.670717 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:27.673015 10020 connection.cc:256] RPC call timeout handler was delayed by -1.237629964000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:15:27.673782 10020 connection.cc:256] RPC call timeout handler was delayed by -1.1503299639998659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 12:15:27.673647 13336 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:27.674185 10020 connection.cc:256] RPC call timeout handler was delayed by -1.0495299639999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23270000000000002s for a response
I20260709 12:15:27.675726 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.672394 13390 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.676862 13537 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:27.676783 13476 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.678894 10127 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:27.678996 13390 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:27.680440 13215 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:27.680831 13215 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:27.681627 13540 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:27.682128 13540 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:27.682606 13540 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:27.687820 10126 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:27.688392 10733 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:27.690310 10735 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:27.695381 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.696801  9952 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.703691 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:27.704650 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.704365 13477 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:15:27.637612 13018 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:15:27.681607 13215 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.710389 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:27.714995 10020 leader_election.cc:336] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.502s (SENT)
I20260709 12:15:27.744702 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.714751 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.712261 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:27.745379  9952 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:27.752401 10055 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
W20260709 12:15:27.765867 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55544us
I20260709 12:15:27.694614 13316 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.749819 13165 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:27.765802  9952 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:27.789505 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:27.771504 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56547.8us
W20260709 12:15:27.771973 10001 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1c0050fa6eee4a0183cbe41a3f72c62b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:15:27.790647 10020 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.545s (SENT)
I20260709 12:15:27.772367 13181 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:27.773752 13215 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.774930 13476 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.775076 13262 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:27.777952 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63303.5us
W20260709 12:15:27.778729 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66697.6us
I20260709 12:15:27.861268 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.778647 13406 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:27.785032 13275 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:15:27.790772 10001 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:15:27.772903 13221 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:27.792032 10201 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
W20260709 12:15:27.760381 13096 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.613s	user 0.003s	sys 0.007s
I20260709 12:15:27.794866 13560 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:27.814220 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:27.814960 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53316.4us
I20260709 12:15:27.816686 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.818282 13390 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:27.830796 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.868363 10046 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:27.864071 10001 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:15:27.831586 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.832259 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.830222 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.833346 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.711418 13185 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:15:27.834216 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.835000 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.838626 13181 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.839936 10200 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:27.720175 13517 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:27.842919 13336 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.759804 13372 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:15:27.846205 13573 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
W20260709 12:15:27.849988 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55814.6us
I20260709 12:15:27.855573 10130 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:27.849725 13540 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.815410 13477 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:15:27.871562 10202 raft_consensus.cc:2410] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:15:27.869519 10052 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:27.873854 13215 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.873306 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.890022 10127 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:27.874372 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:27.860781 13262 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:27.883881 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:27.895618 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.887883 10051 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:27.891707 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.897534 10126 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:27.900667 10129 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:27.901098 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:27.903344 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 1863) took 1096 ms. Trace:
I20260709 12:15:27.903775 10202 rpcz_store.cc:276] 0709 12:15:26.806567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.008299 (+201732us) service_pool.cc:224] Handling call
0709 12:15:27.903134 (+894835us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54000e97d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:27.903287 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979611520}
I20260709 12:15:27.873440 13390 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:27.901284 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:27.905922 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.906415 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:27.892021 13550 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.919071 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.913295 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.907537 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.916386 10052 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:27.898399 13490 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.927026 13181 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:27.939004 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.940886 10049 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:15:27.930629 10048 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:27.941407 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:27.942319 10129 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:15:27.945171 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:27.917850 13537 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:27.957266 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.911067 13554 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 12:15:27.968044 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 177418us
W20260709 12:15:27.969014 10020 leader_election.cc:336] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.592s (SENT)
W20260709 12:15:27.974328 10020 leader_election.cc:336] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.699s (SENT)
I20260709 12:15:27.977010 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:27.936179 13215 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:27.979614 10020 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.754s (SENT)
I20260709 12:15:27.940840 13431 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:27.986829 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.989467 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:27.992228 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.992347 13390 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:27.996482 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.997619 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.998308 10125 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:27.998819 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.999919 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.001013 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.001933 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.002774 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.003335 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.003818 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.004956 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.005898 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.006805 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.007194 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.008005 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.008260 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.009296 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.004076 10122 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:28.009940 10130 raft_consensus.cc:2410] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:15:27.999248 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.010690 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.011682 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:27.989846 13590 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:28.015084 13410 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:28.015559 13410 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.016037 13410 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:28.021322 10129 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:27.936430 13550 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:28.006381 10126 raft_consensus.cc:2376] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7. Re-sending same reply.
I20260709 12:15:28.038287 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.038905 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:28.040105 10123 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:15:28.043321 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53935.6us
W20260709 12:15:28.042060 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 258388us
I20260709 12:15:28.046408 10055 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:28.045516 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:28.055717 10049 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:15:28.036276 13453 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.030354 13431 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:28.059813 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:28.060913 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81348.6us
W20260709 12:15:28.062585 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 173030us
I20260709 12:15:27.981405 13490 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:15:28.064553 10020 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.812s (SENT)
I20260709 12:15:28.063361 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.073002 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:28.067831 13372 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:28.056981 13316 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.083249 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:28.063683 13185 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:28.080837 13372 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:28.086748 13185 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:28.086903 13372 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:28.087302 13185 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:28.087836 10020 leader_election.cc:336] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.832s (SENT)
I20260709 12:15:28.056845 13476 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:15:28.124361 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53857.6us
I20260709 12:15:28.125221 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:28.127485 10020 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.955s (SENT)
I20260709 12:15:28.127972 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:28.127121 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 170909us
I20260709 12:15:28.121068 13096 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:28.071065 13336 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:15:28.140129 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:28.127368 13540 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.128973 13486 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:28.144620 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 81328.1us
I20260709 12:15:28.144701 10054 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:28.149080 10020 leader_election.cc:336] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.014s (SENT)
I20260709 12:15:28.149562 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.149704 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.150328 10052 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:28.154690 13589 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:28.155511 13589 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.156502 13589 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.158527 13165 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:28.158735 13431 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.159123 13165 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.160909 13372 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.161314 13165 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:28.163548 13316 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:28.164139 13316 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.164942 13316 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.166750 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.166980 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:28.167547 13490 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:28.168325 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.168969 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.158340 10052 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:28.172627 10124 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:28.174991 13372 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:28.175932 13583 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 12:15:28.177839 13578 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:15:28.141902 13560 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:28.184213 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.185045 10051 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:28.146730 13486 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.195317 10049 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:28.203217 13595 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:28.206751 13536 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:28.207396 13536 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:28.207834 13536 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:28.215413 13517 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:28.216785 13372 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:28.217423 13372 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.219857 13262 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.221163 13262 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:28.224993 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.225663 10121 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:28.230624 13406 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:28.231027 13406 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.217502 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:28.277724 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.372187 10198 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:28.185793 13096 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:28.198817 13486 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.231160 13550 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.371266 13540 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:28.404640 13595 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.421548 13595 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:28.435353 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 290886us
W20260709 12:15:28.482537 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 314278us
I20260709 12:15:28.483511 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:28.485677 13589 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.486776 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:28.494405 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 276952us
I20260709 12:15:28.495335 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.489755 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1853) took 1412 ms. Trace:
I20260709 12:15:28.483739 13595 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:28.426255 13453 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:28.510985 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.511251 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.438941 13406 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.496119 10196 rpcz_store.cc:276] 0709 12:15:26.768202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.771752 (+  3550us) service_pool.cc:224] Handling call
0709 12:15:27.274693 (+502941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:27.275456 (+   763us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:27.275485 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:27.337435 (+ 61950us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b2c00107318. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:27.337919 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:15:27.757690 (+419771us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:27.757739 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.757820 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:28.177097 (+419277us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:28.178808 (+  1711us) raft_consensus.cc:1685] finished
0709 12:15:28.178835 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:28.180370 (+  1535us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54002634d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:28.180505 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23230,"raft.queue_time_us":10568,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":10584,"spinlock_wait_cycles":1240864768,"thread_start_us":411947,"threads_started":1,"wal-append.queue_time_us":554255}
I20260709 12:15:28.524065 13589 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:28.507805 13410 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.531589 13410 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:28.515306 13096 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:28.543313 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:28.543537 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.544164 10200 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.544883 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:28.548363 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.544269 10202 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:28.552120 10200 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:28.556854 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.557752 10195 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:28.558547 10202 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:28.572405 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61206.1us
I20260709 12:15:28.575255 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:28.585042 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:28.571228 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43653.5us
I20260709 12:15:28.592768 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.624053 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:28.557220 13589 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.628151 10198 raft_consensus.cc:2376] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10. Re-sending same reply.
I20260709 12:15:28.583590 13470 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:28.591784 13406 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.641567 13540 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.589066 13185 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.651800 10051 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:28.620934 13372 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:28.654130 13372 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:28.606886 13096 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:15:28.625432 13605 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:15:28.657348 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 82197.1us
W20260709 12:15:28.631768 13601 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:15:28.632305 13604 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:15:28.675078 13595 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:28.676383 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:28.677222 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:28.677166 13390 raft_consensus.cc:993] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:15:28.679754 10049 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:28.681396 10734 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:28.686370 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.689126 10201 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:28.689512 10051 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:28.690171 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62705.6us
I20260709 12:15:28.691475 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.681133 13605 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.692576 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.696467 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.696549 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.698601 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.703467 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:28.688253 13608 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.711017 13470 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:28.711692 13605 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.731138 10054 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:28.733253 13595 raft_consensus.cc:1081] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:15:28.734283 13595 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.724151 13589 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.711632 13470 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.748329 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.750002 10050 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:28.752401 13486 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.754253 13607 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:28.754913 10197 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:28.730048 13608 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.715561 13536 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.748097 13610 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:15:28.771804 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68456.8us
I20260709 12:15:28.766688 13096 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:28.764454 13607 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:28.777406 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88560.9us
I20260709 12:15:28.780851 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.782763 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:28.783450 10053 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.802129 10199 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:28.807507 13582 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.840s	user 0.025s	sys 0.051s
I20260709 12:15:28.812875 10053 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:28.827576 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:28.828455 10020 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.232s (SENT)
I20260709 12:15:28.828941 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.830284 13612 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:28.835728 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:28.835978 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.838315 10203 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:28.850363 10048 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:28.855319 10053 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:28.856582 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.830193 13608 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.868064 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:28.869889 10055 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:28.792596 13470 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.837218 13181 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.837699 13096 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:28.796917 13607 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.875851 13615 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:28.877357 13605 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:28.878930 13316 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.879907 13608 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.880239 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:28.900764 13608 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:28.881978 13614 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:15:28.894750 13628 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:28.902925 13608 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.899801 13316 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.904985 13316 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.905994 13486 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:28.906662 13536 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:28.907356 13605 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.922971 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.924424 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.925263 10124 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:28.873018 13610 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:28.893371 13262 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.004s
I20260709 12:15:28.908299 13615 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:28.926699 13432 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:15:28.932392 13615 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.932900 13631 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:28.934962 13610 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:28.938076 13605 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:28.939397 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.939996 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.946898 10121 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:28.941751 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 874343us
I20260709 12:15:28.930781 13628 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:15:28.943164 13629 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:28.956084 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.957957 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:28.959708 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:28.947835 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:28.963007 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.969972 10129 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:28.971240 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:28.971885 10201 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:28.973946 10125 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:28.892699 13181 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:28.976063 10204 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:28.873700 13096 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:28.983500 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56461us
I20260709 12:15:28.990887 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:28.997659 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:28.999440 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:28.989277 13612 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:28.976425 13595 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:15:29.027009 13181 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:29.059523 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59123.8us
W20260709 12:15:29.076193 10020 leader_election.cc:336] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 2.672s (SENT)
I20260709 12:15:29.076683 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:29.077204 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79624.7us
I20260709 12:15:29.010675 13635 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:15:29.084131 10121 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:29.084684 13642 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:29.085170 13626 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:15:29.085389 13643 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:29.091529 13631 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.092622 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.093254 10732 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:29.094746 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48563.8us
I20260709 12:15:29.087843 13642 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.081938 13640 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:29.099417 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.100942 10737 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:29.098686 13642 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.089020 13643 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:29.107321 13595 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.100925 13640 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:29.110518 13646 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:29.126753 13646 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.127734 13646 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.129102 13646 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:29.129410 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 484) took 1076 ms. Trace:
W20260709 12:15:29.114956 13584 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.149s	user 0.033s	sys 0.039s
I20260709 12:15:29.129832 10126 rpcz_store.cc:276] 0709 12:15:28.052554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:28.053238 (+   684us) service_pool.cc:224] Handling call
0709 12:15:28.053509 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:28.053695 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:28.063041 (+  9346us) log.cc:844] Serialized 14 byte log entry
0709 12:15:28.068225 (+  5184us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.128879 (+1060654us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b18003a1f20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:29.129063 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:29.129115 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:29.129163 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.129229 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:29.129349 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7914,"prepare.queue_time_us":70111,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3758,"raft.queue_time_us":1134,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4242,"spinlock_wait_cycles":16490240}
W20260709 12:15:29.132922 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 1.07159e+06us
I20260709 12:15:29.133991 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.134938 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.139014 13476 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.139740 13476 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:29.140128 13476 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.126072 13640 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.140955 13476 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:29.142952 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.144567 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1492) took 1148 ms. Trace:
I20260709 12:15:29.145370 13336 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:29.145838 13336 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.139669 13651 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:15:29.146878 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 479) took 1258 ms. Trace:
I20260709 12:15:29.144942 10122 rpcz_store.cc:276] 0709 12:15:27.996206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:28.011447 (+ 15241us) service_pool.cc:224] Handling call
0709 12:15:28.011806 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:28.041407 (+ 29601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:28.041439 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:28.057333 (+ 15894us) log.cc:844] Serialized 52 byte log entry
0709 12:15:28.136895 (+ 79562us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:28.143539 (+  6644us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.144076 (+1000537us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.144265 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.144337 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:29.144376 (+    39us) raft_consensus.cc:1685] finished
0709 12:15:29.144387 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:29.144512 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1035103,"prepare.queue_time_us":9611,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":29105,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4578,"spinlock_wait_cycles":13696,"thread_start_us":54532,"threads_started":1,"wal-append.queue_time_us":94419}
I20260709 12:15:29.147274 10128 rpcz_store.cc:276] 0709 12:15:27.888695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.888839 (+   144us) service_pool.cc:224] Handling call
0709 12:15:27.889163 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:27.908964 (+ 19801us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:27.950511 (+ 41547us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.146572 (+1196061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:29.146620 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:29.146659 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.146717 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:29.146818 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1026354,"prepare.queue_time_us":41532,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":158186,"threads_started":1,"wal-append.queue_time_us":450455}
I20260709 12:15:29.149147 13476 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:29.152571 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 204805us
I20260709 12:15:29.153265 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:29.154000 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 480) took 1221 ms. Trace:
I20260709 12:15:29.154295 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:29.156908 13215 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:29.154628 13410 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.154349 10127 rpcz_store.cc:276] 0709 12:15:27.932781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:27.933259 (+   478us) service_pool.cc:224] Handling call
0709 12:15:27.946248 (+ 12989us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:27.983357 (+ 37109us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:28.138104 (+154747us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.150885 (+1012781us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:29.151522 (+   637us) log.cc:844] Serialized 78 byte log entry
0709 12:15:29.151685 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:29.151885 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 12:15:29.152053 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.152121 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:29.153809 (+  1688us) raft_consensus.cc:1685] finished
0709 12:15:29.153824 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:29.153950 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627952,"prepare.queue_time_us":44978,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":619473,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":4638,"thread_start_us":511324,"threads_started":2,"wal-append.queue_time_us":337119}
I20260709 12:15:29.155651 13490 raft_consensus.cc:2764] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:15:29.162683 13486 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.132822 13643 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.164777 13643 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:29.165205 10168 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.165889 13610 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.166445 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.166361 13610 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.166859 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.167459 10121 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:29.168625 13610 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.169267 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.138782 13018 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.169853 10130 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.170524 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.171069 10734 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:29.172027 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.172184 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.172904 13372 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:29.173134 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.174315 10127 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:15:29.174199 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.176235 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.179708 10052 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:29.177870 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:29.184782 10732 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:29.185322 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.186187 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:29.211508 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57279us
I20260709 12:15:29.212455 10130 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:29.214890 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 137015us
I20260709 12:15:29.217068 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.185950 10129 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:29.218137 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:29.105273 13612 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.223891 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.220392 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.224154 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.221276 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:29.154321 13595 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:29.225379 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.229908 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.183452 13372 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.229965 10046 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:29.238584 13623 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.239454 13537 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:29.239632 13560 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:29.240362 13537 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:29.240331 13560 consensus_queue.cc:1243] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:29.241205 13641 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:29.241556 13641 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.242437 13641 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.230988 13221 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:29.243659 13641 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:29.244737 13221 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.245133 13221 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.220470 13610 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:29.232774 13390 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.247783 13390 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.231436 13608 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:29.241408 13629 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:29.255611 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.220604 13490 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:29.220747 13018 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:29.223277 13406 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:29.260053 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.261744 10046 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:29.261951 10199 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:29.261024 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.266361 10128 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:29.256318 10049 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:29.163234 13486 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:29.239372 13602 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.676s	user 0.005s	sys 0.013s
I20260709 12:15:29.227918 13595 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.235502 13372 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.272235 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.279803 10203 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:29.257027 13390 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.226511 13517 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:15:29.256639 13537 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.264720 13453 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:29.294657 13624 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:15:29.262643 13610 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:29.261479 13018 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:29.297888 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 124563us
I20260709 12:15:29.263535 13608 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:29.302450 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 78362.7us
I20260709 12:15:29.303771 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.276295 13635 consensus_queue.cc:1243] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:29.267441 13096 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:29.313789 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89134.1us
I20260709 12:15:29.297984 13406 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.274399 13410 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:15:29.327046 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.270092 13642 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.258174 13336 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.316100 13390 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:15:29.340389 13658 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:29.340926 13586 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.374s	user 0.005s	sys 0.011s
I20260709 12:15:29.337482 13406 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.342536 13486 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.315974 13018 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:29.358489 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.361117 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.350454 10128 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:29.351636 13621 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.355150 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.359570 10195 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:29.315841 13536 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:29.317416 13517 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:29.362042 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.363091 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.325951 13616 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:29.364912 10737 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:29.365300 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.316324 13625 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:15:29.348706 13658 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.373976 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:29.375415 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:29.336999 13096 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.373768 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:29.389042 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:29.390456 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:29.391722 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:29.370610 13536 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.371405 13616 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.317402 13612 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:29.404918 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 86932.3us
I20260709 12:15:29.388346 13490 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.410051 10199 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:29.372932 13633 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:15:29.401433 13536 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:29.420221 10199 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:15:29.424726 13657 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:29.427768 13410 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.439076 13490 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.406317 13616 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:29.443753 13640 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.363281 13595 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.365818 13608 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.448043 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.454473 10199 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:29.456631 13658 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.458148 13658 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:29.405086 13610 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.465442 13406 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.386780 13621 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.468327 13621 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.469818 13595 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.474140 10204 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:29.373215 13537 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.478338 13537 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.479303 13607 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.482057 10046 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:29.488380 13185 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.476750 10196 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:29.477432 13603 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.951s	user 0.004s	sys 0.005s
I20260709 12:15:29.491577 13476 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.493036 13476 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.493383 13640 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:29.491827 13609 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.759s	user 0.004s	sys 0.000s
I20260709 12:15:29.496671 13476 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:29.498247 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50281.3us
I20260709 12:15:29.499295 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.499708 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.500555 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.500891 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:29.501569 10055 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:29.502295 13652 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:29.502714 13652 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:29.503057 13652 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:29.503789 13653 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.409348 13659 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:15:29.494253 10734 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:29.513885 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:29.515662 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 154631us
I20260709 12:15:29.516782 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:29.524879 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.444415 13221 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.498572 13185 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.550858 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.546229 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.551738 10129 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:29.554417 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.554723 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.561124 13517 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.561683 13517 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.561930 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.548885 13640 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:29.563308 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.563385 13640 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:29.561195 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44503.9us
I20260709 12:15:29.542850 13659 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.564807 13659 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.565198 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.565478 13640 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.566042 13640 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.567106 13659 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.567418 13410 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.563709 13517 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.566859 10094 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:29.569593 13221 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.570281 13221 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.571712 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.572309 10126 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:29.577298 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.576748 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.578640 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.579970 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.543289 13390 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.585585 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.583065 10129 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:29.564159 10125 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 7: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:29.587939 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.588654 10123 raft_consensus.cc:2368] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8.
W20260709 12:15:29.588505 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88010.4us
I20260709 12:15:29.590689 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.590981 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:29.591574 10737 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:29.591809 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.593384 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.594096 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.596020 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.592464 10126 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:29.600092 10048 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:29.603951 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.594969 13662 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.613016 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.613816 10130 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:29.613911 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.614674 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.614861 10126 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:29.617627 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.598977 13221 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.618867 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:29.619463 10197 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:29.618191 10126 raft_consensus.cc:2376] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9. Re-sending same reply.
I20260709 12:15:29.619812 13372 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.622136 10199 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:29.623034 10126 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:29.626159 10126 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:29.629762 10126 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:29.628371 13372 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:29.630795 13659 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.631471 13642 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.632292 10126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:15:29.633013 10126 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.633404 10126 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.641884 10126 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.648468 10126 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.661195 13616 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.663605 13616 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.593394 13490 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:29.557598 13185 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.667469 10126 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:29.668776 13185 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.668952 13096 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.668743 10126 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:29.683916 10197 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:15:29.686089 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.685644 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:29.688917 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 99200.8us
I20260709 12:15:29.689896 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.690217 10052 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:29.690697 10130 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:29.689625 13659 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:29.708084 13659 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.708990 13659 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.709285 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.710140 10126 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:29.706115 13631 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.711002 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.710927 13631 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.606199 13410 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:15:29.713109 13631 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.599375 13517 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:15:29.714172 13517 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:29.714533 13517 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:29.715446 13517 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.718717 10735 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:29.720592 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:29.724498 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.725598 10053 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:29.726017 10053 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.727087 10732 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:15:29.727375 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.727692 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.728248 10735 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:29.688997 13646 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 12:15:29.718329 13517 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:29.730862 10053 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:29.739223 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 146001us
I20260709 12:15:29.740648 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.742328 10053 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:29.741199 10129 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:29.752725 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:29.733492 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 182695us
I20260709 12:15:29.734674 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.769649 10126 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:29.733353 13595 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:29.778640 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88837.2us
I20260709 12:15:29.779497 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.740366 13631 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.774863 13431 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.794709 13431 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.795368 13646 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.796581 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.696146 13652 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.797029 13431 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.778641 13215 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.797856 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.799350 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:29.741526 13185 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:15:29.800594 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.801162 10049 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:29.801963 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:29.799292 13621 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.802851 13621 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.803519 13646 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.788178 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:29.804347 10197 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.805476 10049 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:29.812085 10735 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:29.814107 10204 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:29.816372 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:29.777374 13608 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:15:29.842448 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:29.844770 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46982.8us
I20260709 12:15:29.819726 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.807240 13550 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.845608 10126 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:29.802132 13536 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.785612 13643 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:15:29.811233 13621 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.821702 10197 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
W20260709 12:15:29.814960 13628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.005s	sys 0.010s
I20260709 12:15:29.858479 10053 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:29.806298 13631 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.859264 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.864809 10049 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 6.
I20260709 12:15:29.862517 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:29.867156 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.825533 13410 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.843118 13275 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:29.860006 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.861707 13536 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:29.863684 10197 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:29.841562 13616 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:29.868083 10053 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:29.876294 10733 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:29.878181 10728 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:29.862872 13628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.005s	sys 0.010s
W20260709 12:15:29.871023 13649 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:15:29.849261 13630 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:15:29.882942 13550 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:29.892079 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.884363 13616 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:29.922994 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:29.924757 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:29.925395 10053 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:29.925493 13679 raft_consensus.cc:2764] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:15:29.908265 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51399us
I20260709 12:15:29.911228 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:29.915426 13631 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.881942 13410 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:29.916220 13550 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:29.918570 13613 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:29.919535 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.921046 13595 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.922088 13652 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:29.928040 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.933717 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.938025 10126 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:29.934770 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.939512 10130 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:29.940374 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:29.940922 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:29.941686 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:29.898855 13585 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.848s	user 0.004s	sys 0.014s
I20260709 12:15:29.931800 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.942380 10130 raft_consensus.cc:2410] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:15:29.949903 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.950019 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:29.950686 10123 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.937222 13608 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:29.946230 13550 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:29.946486 13390 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:29.947002 13613 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:29.947891 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:29.954747 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.957706 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:29.958552 13642 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:29.964542 10126 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:29.966445 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:29.991988 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:29.948007 13659 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:29.989311 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.004980 10733 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:30.018587 13659 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:30.026343 13641 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:30.030336 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:29.999753 13018 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 12:15:30.006946 13630 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:29.967299 13316 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:29.999382 13185 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.923036 13616 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:30.040434 13683 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:30.009886 13647 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:30.065263 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 107670us
I20260709 12:15:30.194370 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:30.195484 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.195866 10729 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:30.077726 10123 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:30.094362 10731 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:30.098464 13676 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:15:30.092024 13621 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:15:30.119194 13670 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.556s	user 0.004s	sys 0.000s
I20260709 12:15:30.139134 13470 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.142593 13628 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:30.143437 13453 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:30.147619 13540 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.156461 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:30.158012 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:30.206712 10052 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:30.207509 10052 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:30.174619 13664 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.152035 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.172250 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:30.183714 10047 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:30.183079 10728 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:30.196605 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.171241 13590 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:30.171200 13620 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.215866 10052 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.226950 10201 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:30.168026 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:30.209638 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.177865 13630 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.213917 10198 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:30.214231 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62306us
I20260709 12:15:30.193848 13647 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:30.246634 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.210989 13628 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:30.238548 10052 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.211205 13453 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:30.221199 13556 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:30.184266 13018 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:30.292887 13687 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:15:30.293046 13336 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.294749 13659 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.238518 13490 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.302065 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.223882 13641 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:30.303517 10731 raft_consensus.cc:2376] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9. Re-sending same reply.
W20260709 12:15:30.323350 13684 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:15:30.334064 13613 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.337301 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.338018 10731 raft_consensus.cc:2376] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12. Re-sending same reply.
I20260709 12:15:30.337895 13628 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.239375 13620 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.344751 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1450) took 1782 ms. Trace:
W20260709 12:15:30.354620 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 158089us
I20260709 12:15:30.353955 10200 rpcz_store.cc:276] 0709 12:15:28.561938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:28.954386 (+392448us) service_pool.cc:224] Handling call
0709 12:15:28.955020 (+   634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:28.972566 (+ 17546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:28.972594 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:29.688112 (+715518us) spinlock_profiling.cc:243] Waited 906 us on lock 0x7b2c00107318. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:29.704225 (+ 16113us) log.cc:844] Serialized 26 byte log entry
0709 12:15:29.824763 (+120538us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:29.824802 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:29.825717 (+   915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:30.344477 (+518760us) raft_consensus.cc:1685] finished
0709 12:15:30.344495 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:30.344696 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084736,"thread_start_us":113845,"threads_started":1,"wal-append.queue_time_us":176572}
I20260709 12:15:30.346683 13018 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.278789 13647 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.348485 10128 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:30.238364 13630 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:30.351964 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62301us
I20260709 12:15:30.352636 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.355629 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.356945 10728 raft_consensus.cc:2376] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12. Re-sending same reply.
I20260709 12:15:30.357312 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.215423 13540 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.223032 13664 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.224143 13470 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.237603 13590 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:30.376223 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.377240 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.373636 10198 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:30.376493 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:30.377336 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.382812 13664 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:30.388238 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 373538us
I20260709 12:15:30.389062 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.390785 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.391794 10728 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:30.360685 13653 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:30.394970 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:30.398445 13550 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:30.400790 10122 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:15:30.401257 10122 pending_rounds.cc:85] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 6
I20260709 12:15:30.401473 10122 pending_rounds.cc:107] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:15:30.401690 10122 raft_consensus.cc:2889] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:30.415946 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 494) took 1050 ms. Trace:
I20260709 12:15:30.416445 10128 rpcz_store.cc:276] 0709 12:15:29.365419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.365719 (+   300us) service_pool.cc:224] Handling call
0709 12:15:29.384907 (+ 19188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:30.356196 (+971289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.415620 (+ 59424us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400409054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:30.415862 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215551360}
I20260709 12:15:30.429317 10052 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:30.441583 13410 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.368364 13556 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:30.461712 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66830.3us
W20260709 12:15:30.461469 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 64509.3us
I20260709 12:15:30.569927 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:30.388322 13628 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:30.379824 13390 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.422583 13673 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:30.360005 13490 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:30.489249 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 91652.9us
I20260709 12:15:30.584152 10020 leader_election.cc:400] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8.
I20260709 12:15:30.584563 10020 leader_election.cc:403] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:30.481971 13646 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:30.465552 13641 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.447448 13631 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:15:30.504562 10735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.074s	sys 0.172s
W20260709 12:15:30.590613 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.074s	sys 0.173s
I20260709 12:15:30.502105 13653 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.597399 13653 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.599634 13653 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.513628 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.600643 10047 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:30.514320 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:30.515618 13453 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.604409 13453 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:30.533623 13550 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:30.535501 13470 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.536612 13620 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.537614 13590 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:30.542060 10046 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:30.607599 10046 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:30.608386 10046 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.609323 10046 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.543642 13540 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:30.555285 13610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.010s
W20260709 12:15:30.610718 13610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.000s	sys 0.010s
I20260709 12:15:30.565151 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:30.611449 13181 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:15:30.611759 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46703.8us
I20260709 12:15:30.612501 13181 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:30.612843 13181 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:30.613782 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.613620 13181 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.568068 13018 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:30.588572 13646 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:30.615152 13646 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.569247 13556 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:30.616812 13556 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:30.622282 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 233287us
I20260709 12:15:30.623286 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:30.624784 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.626035 13185 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:30.627657 13185 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:30.628017 13185 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.628408 13185 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.632597 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.633311 13621 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:30.634714 13621 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:30.635031 13621 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.635339 13621 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.637362 13647 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.638481 10737 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:15:30.643327 13490 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.643535 10198 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:30.644608 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.645169 13590 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.645644 13590 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.648000 10052 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:30.594079 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:30.651216 10728 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:30.594617 13642 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8.
I20260709 12:15:30.594276 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:30.582243 13649 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:30.587019 13673 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.663928 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:30.664693 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70508.4us
W20260709 12:15:30.665227 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 436549us
I20260709 12:15:30.677140 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:30.677563 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 103189us
I20260709 12:15:30.678315 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.679140 10051 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:30.679996 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.681046 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.681690 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:30.682545 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:30.688362 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:30.676417 13673 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.690739 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.691357 10048 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:30.692646 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.693249 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:30.672721 13664 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:30.678018 13653 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:30.726773 13653 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:30.727675 13653 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.731509 10052 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:30.670388 13275 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:30.706583 13453 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:30.707028 13490 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.706317 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:30.708168 13646 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:30.589983 13390 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.719414 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2085) took 1554 ms. Trace:
I20260709 12:15:30.696063 13181 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:30.690338 13686 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:15:29.145473  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.724391 13590 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:30.697942 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:30.726131 13664 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.680657 13410 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:30.763037 10046 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:30.765457 10122 rpcz_store.cc:276] 0709 12:15:29.164670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.164803 (+   133us) service_pool.cc:224] Handling call
0709 12:15:29.165128 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:30.402076 (+1236948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.719156 (+317080us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:30.719344 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840737152}
I20260709 12:15:30.720634 13612 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:30.769861 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 63652.9us
I20260709 12:15:30.809185 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:30.647186 13641 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.811245 10053 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:30.680518 13018 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:15:30.756572 13645 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:30.760867 13275 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.760237 13550 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.762848 13674 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.803105 13649 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:30.812695 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 114814us
W20260709 12:15:30.812700 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 187969us
I20260709 12:15:30.698196 13630 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.858925 13390 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:30.859412 13630 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:30.860107 13540 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:30.861021 13540 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:30.861326 13540 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:30.798713 13664 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:30.862583 13612 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:30.863155 13612 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:30.863632 13646 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:30.864538 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.864135 13612 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.808207 13410 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.865322 13410 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.865995 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.866852 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.867676 10200 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:30.869688 13556 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.762882 13453 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.871889 13556 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:30.856693 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.857391 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:30.880717 10737 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:30.818701 13698 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.882517 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:30.888835 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 816) took 1073 ms. Trace:
I20260709 12:15:30.891175 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:30.892268  9952 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 174) took 21027 ms (client timeout 15000 ms). Trace:
I20260709 12:15:30.894884 10730 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:30.814970 13695 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:30.767107 13490 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.899376 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.889271 10735 rpcz_store.cc:276] 0709 12:15:29.815915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:29.816815 (+   900us) service_pool.cc:224] Handling call
0709 12:15:29.842491 (+ 25676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:29.858548 (+ 16057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:29.858579 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:29.878869 (+ 20290us) log.cc:844] Serialized 26 byte log entry
0709 12:15:30.596998 (+718129us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:30.597040 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.597113 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:30.888605 (+291492us) raft_consensus.cc:1685] finished
0709 12:15:30.888626 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:30.888773 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15667,"raft.queue_time_us":20295,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8146,"thread_start_us":690391,"threads_started":1,"wal-append.queue_time_us":733668}
I20260709 12:15:30.902704 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:30.844298 13708 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.816885 13645 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:30.921754 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:30.887274 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.929322 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:30.935551 10051 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:30.851511 13096 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:30.932358 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:30.941498 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:30.941954 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.890897 13390 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:30.938071 10195 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:30.938393 10734 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:30.929968 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.871948 13453 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:30.933732 10731 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:30.840718 13605 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:15:30.938982 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.939294 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:30.940189 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:30.946264 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.937590 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:30.923243 13616 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:30.931241 13677 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:15:30.892675  9952 rpcz_store.cc:269] 0709 12:15:09.864914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.865080 (+   166us) service_pool.cc:224] Handling call
0709 12:15:30.892185 (+21027105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:28.503012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:28.529356 (+ 26344us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:28.529409 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:15:28.529427 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:28.530533 (+  1106us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:28.530616 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:28.530643 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:15:28.531700 (+  1057us) tablet.cc:701] Row locks acquired
0709 12:15:28.531744 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:15:28.531926 (+   182us) write_op.cc:270] Start()
0709 12:15:28.532067 (+   141us) write_op.cc:276] Timestamp: P: 1783599328531860 usec, L: 0
0709 12:15:28.532086 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:15:28.681142 (+149056us) log.cc:844] Serialized 4746 byte log entry
0709 12:15:29.012919 (+331777us) op_driver.cc:464] REPLICATION: finished
0709 12:15:29.080271 (+ 67352us) write_op.cc:301] APPLY: starting
0709 12:15:29.080401 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:29.080700 (+   299us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:29.080848 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:29.156432 (+ 75584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:29.156725 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:15:29.156776 (+    51us) write_op.cc:312] APPLY: finished
0709 12:15:29.157122 (+   346us) log.cc:844] Serialized 89 byte log entry
0709 12:15:29.157312 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.157439 (+   127us) write_op.cc:454] Released schema lock
0709 12:15:29.157510 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:30.137560 (+980050us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78be28 00007fc1821c6581 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901 00007fc1821c9b2d 0000000000388634 0000000000388479
0709 12:15:30.137790 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:30.137819 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":823056,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":67023,"apply.run_cpu_time_us":4074,"apply.run_wall_time_us":77608,"num_ops":12,"prepare.queue_time_us":292267,"prepare.run_cpu_time_us":20562,"prepare.run_wall_time_us":1657426,"raft.queue_time_us":95552,"raft.run_cpu_time_us":43640,"raft.run_wall_time_us":75141,"replication_time_us":477711,"spinlock_wait_cycles":100605312,"thread_start_us":405516,"threads_started":4,"wal-append.queue_time_us":91355,"wal-append.run_cpu_time_us":27358,"wal-append.run_wall_time_us":1381374}]]}
W20260709 12:15:30.944720 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 266494us
W20260709 12:15:30.955060 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:30.862120 13540 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.855470 13550 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.922859 13470 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.896842 13215 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:15:30.879648 13674 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.929807 13018 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:30.978188 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:30.967370 13536 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:30.973383 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43496.1us
I20260709 12:15:30.978206 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:30.940030 13716 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:30.975250 13616 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.999275 13616 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.003194 10122 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:15:31.009537 13703 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:15:30.988660 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.980567 10051 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:30.946527 13713 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:30.986027 13649 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.011619 13713 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.989923 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:30.932873 13556 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:15:30.977097 13707 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:30.971746 13693 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:30.992779 13645 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.990767 13536 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:30.992782 13700 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:15:30.997685 13608 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:31.033434 13711 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:31.033811 13536 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:30.997922 13540 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.034575 10198 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:30.974260 13096 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.038791 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.033852 13711 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:31.039320 13714 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.234s	user 0.001s	sys 0.001s
I20260709 12:15:31.039927 13711 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.041406 13711 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.985693 13018 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:31.042217 13018 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:31.043653 13674 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.044369 13550 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.044727 13674 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:31.045256 13674 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.046809 13645 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.042357 13621 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.022775 13716 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.026644 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.027019 13185 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.027566 10122 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:31.029048 13410 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:30.987358 13470 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.031275 13490 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.031684 13707 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:31.031527 13693 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.015600 13215 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:31.040046 13096 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:30.933005 13517 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:15:30.928965 13275 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:30.936705 13708 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.244536 13390 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.065822 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.275177 10129 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:31.067611 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.276355 10054 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:31.069180 10055 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:31.069808 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.230028 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.231792 10050 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:31.020714 13713 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:31.230015 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:31.109906 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 181566us
I20260709 12:15:31.233534 10203 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:31.233068 10124 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:31.283257 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.050208 13673 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:31.230306 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 252177us
I20260709 12:15:31.236613 10127 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:31.249363 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.257488 10126 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:31.267607 10728 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:31.235132 13608 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:31.245815 13536 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:31.308864 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 337628us
I20260709 12:15:31.291443 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.293709 10049 raft_consensus.cc:2410] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:31.251593 13664 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.258538 13215 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:31.294158 10200 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:31.296123 13674 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.297993 13641 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.297341 13708 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:31.298103 13616 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.292523 13720 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.299371 10123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:15:31.326313 10123 raft_consensus.cc:606] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.326723 10123 raft_consensus.cc:614] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:31.273029 13517 consensus_queue.cc:1243] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:31.261085 13696 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:31.289078 10201 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:15:31.309595 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 79798.7us
I20260709 12:15:31.255543 13647 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.335038 10121 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:15:31.312614 10199 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:31.311403 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.324074 13215 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:31.336411 13696 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:31.340314 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.344971 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.329481 13476 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:31.340646 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:31.343443 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.328429 13708 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.346500 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.347103 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.347572 13696 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.350818 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.359748 10732 raft_consensus.cc:2410] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:15:31.342084 13652 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:31.352298 10049 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:31.334353 13621 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:31.360797 13647 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:31.356318 13410 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.357354 13275 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.361619 13698 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.326153 13707 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.363075 10128 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:31.329720 13720 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.361328 13647 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.358268 13336 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:31.365891 13647 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.361640 13410 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:31.367496 13410 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:31.353365 13185 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:31.370762 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.369704 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.322755 13608 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.322933 13536 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:31.377861 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.386574 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.394021 13652 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:31.386111 13726 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.396375 13721 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:31.396780 13721 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:31.397553 13721 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.397945 13410 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.399019 13410 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:31.398944 13721 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:31.400942 13705 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.597s	user 0.003s	sys 0.000s
I20260709 12:15:31.402133 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1468) took 1240 ms. Trace:
I20260709 12:15:31.402498 10196 rpcz_store.cc:276] 0709 12:15:30.162269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.164032 (+  1763us) service_pool.cc:224] Handling call
0709 12:15:30.172081 (+  8049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:30.621013 (+448932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:30.621044 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:30.621494 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:15:30.811245 (+189751us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:30.811284 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.905143 (+ 93859us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54000e88d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:30.905189 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:31.391249 (+486060us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:31.401925 (+ 10676us) raft_consensus.cc:1685] finished
0709 12:15:31.401944 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:31.402076 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240965,"raft.queue_time_us":245830,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":508204672,"thread_start_us":189379,"threads_started":1,"wal-append.queue_time_us":182295}
I20260709 12:15:31.405514 13616 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:31.406479 13716 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.408253 13720 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.410259 13693 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.388773 13674 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:15:31.414212 13608 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:31.414927 13673 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.354732 13641 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:15:31.370294 13708 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.419276 13664 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.421515 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.422081 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:31.419328 13708 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.369243 13476 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.436329 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.438990 10129 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:31.436650 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.445945 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:31.446959 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 200433us
I20260709 12:15:31.449476 10123 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:31.449404 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.450135 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.453749 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.419953 13390 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:15:31.438584 13728 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:15:31.452912 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.451478 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.453423 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.455825 10122 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:31.453431 10128 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:31.460307 10121 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.460986 10125 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:31.454598 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.419832 13018 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.456585 13732 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:15:31.463351 13674 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:31.464169 13390 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:31.464622 13718 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:31.472031 13018 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.472277 13718 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:31.473390 13718 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.474819 13718 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:31.466234 13476 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.438337 13653 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.480054 13653 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:31.481129 13653 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.466671 13693 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:31.468008 13536 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:31.469048 13701 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.667s	user 0.000s	sys 0.002s
I20260709 12:15:31.489192 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.489974 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:31.496683 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.484790 13215 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:31.499507 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44971.1us
I20260709 12:15:31.501497 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.435388 13734 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.500517 13641 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:15:31.502540 13736 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:15:31.502660 13693 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:31.503573 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.512858 10121 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:31.510020 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.514256 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:31.519737 10203 raft_consensus.cc:2410] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:31.523598 13215 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.516541 13536 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.524468 13641 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:31.525243 13641 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:31.516764 13649 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:31.525871 13718 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:31.526221 13718 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:31.526928 13718 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.528283 13736 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:31.528677 13736 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:31.529079 13736 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.529471 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.530611 13693 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:31.531598 13096 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:31.532377 13096 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:31.532701 13721 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:31.535212 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.538347 10125 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:31.533470 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:31.541000 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:31.542687 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.525533 13641 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:31.543315 10125 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:31.549687 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:31.533089 13721 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:31.551682 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98844.5us
I20260709 12:15:31.556471 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.557179 10127 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.560356 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.533680 13476 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.562071 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.571856 10053 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:31.559515 13621 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:31.552153 13734 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.559505 13390 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.563952 13018 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:31.584338 13018 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:31.584666 13018 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:31.585289 13736 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.585440 13018 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.588101 10127 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:31.564769 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:31.461131 13708 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:15:31.595875 13706 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.566944 13275 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:31.568167 13550 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:31.568758 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.597859 13550 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.562013 13721 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:31.600628 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:31.604944 13470 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.577059 13621 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.606242 13621 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.570293 13641 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:31.571137 13724 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 12:15:31.610600 13018 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:31.611994 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.612776 10046 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:31.613538 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.572901 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.614737 10050 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:31.615594 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.616641 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.617596 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.618098 10050 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.564761 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.540439 13729 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:31.621706 10198 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:31.577692 10130 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:31.623157 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.624248 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.625211 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.625691 10130 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.577178 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.628779 10124 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:31.540393 13215 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.581481 10125 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:31.554041 13718 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:31.583410 13733 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:31.589666 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.633728 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:31.515568 13645 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:15:31.593271 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.588582 13736 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:31.590526 13490 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.540549 13646 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:15:31.595278 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.614511 13316 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:31.576187 13476 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.532697 13096 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:31.618739 10054 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:31.578716 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.675427 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:31.630784 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.631053 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.631670 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.635560 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.592126 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:31.636755 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.677762 10731 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:31.594602 13674 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:31.643437 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.679849 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:31.649137 10053 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:31.663264 13693 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:31.664214 13185 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:31.665604 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:31.669157 10198 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:31.670048 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
W20260709 12:15:31.672643 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.682569 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.650959 13664 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.700598 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.701467 10125 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.701614 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.703585 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.666445 13716 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:31.704109 10054 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:31.704564 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.707073 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:31.711083 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:31.712035 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.712627 10053 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.634733 13215 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.713531 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.651599 13275 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:15:31.671391 13708 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:15:31.671989 13490 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.699445 13734 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:31.666320 13720 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:31.699007 13695 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:31.718961 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:31.671113 13616 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:15:31.752592 10196 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:31.731029 13716 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.759411 13646 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:31.760051 13646 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.764492 10053 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:31.766943 10050 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:31.711938 13706 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.701745 13674 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:31.725374 13647 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:31.742820 13476 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.744482 13215 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.708611 13664 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.746145 13490 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.737155 10125 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:31.770843 10053 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:31.719107 13431 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:31.719955 13645 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.732149 13605 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:31.776602 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.782614 13646 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.762359 13695 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:31.784351 13664 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.749243 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:31.785287 13745 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:31.798890 10121 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
W20260709 12:15:31.798714 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 133178us
I20260709 12:15:31.798990 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:31.806762 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.807034 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.809649 13550 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.810029 10121 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:31.811635 10202 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:31.800921 13695 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:31.812304 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.814322 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:31.815469 13674 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.816617 13708 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:31.817008 13708 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.817330 13708 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.785571 13647 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.806681 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.821497 10054 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:31.824574 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:31.800146 13453 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:31.801362 13721 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.828315 10050 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:31.829380 13721 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:31.789908 13605 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:31.830417 13605 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:31.832479 13647 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:31.819412 13431 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:31.836411 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:31.836653 13431 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.824483 13645 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:31.827526 13608 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:31.850533 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:31.830286 13715 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.026s	user 0.000s	sys 0.005s
I20260709 12:15:31.781883 13018 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:15:31.860816 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 136653us
I20260709 12:15:31.865465 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:31.867075 13750 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.866469 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:31.845800 13608 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:31.871807 13185 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.877763 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.878402 10728 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:31.873123 13751 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.877035 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.881435 10728 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:31.899607 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:31.902096 10730 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:31.907335 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:31.908051 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2207) took 1278 ms. Trace:
I20260709 12:15:31.899471 13645 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.858847 13621 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:31.913600 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.908608 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:31.951561 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.953250 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.896402 13748 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.953926 10731 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:31.969430 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.969914 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:31.908455 10047 rpcz_store.cc:276] 0709 12:15:30.629503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.652603 (+ 23100us) service_pool.cc:224] Handling call
0709 12:15:30.676655 (+ 24052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:30.695168 (+ 18513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:30.695202 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:30.730279 (+ 35077us) log.cc:844] Serialized 26 byte log entry
0709 12:15:30.804554 (+ 74275us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:30.804596 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:30.804669 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:31.467218 (+662549us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:31.829916 (+362698us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b2400171878. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e209d 00007fc17e31410e 00007fc17e32b88c 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221
0709 12:15:31.907866 (+ 77950us) raft_consensus.cc:1685] finished
0709 12:15:31.907886 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:31.907998 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14854,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1906,"spinlock_wait_cycles":81527296,"thread_start_us":73874,"threads_started":1,"wal-append.queue_time_us":73707}
I20260709 12:15:31.971453 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:31.975431 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:31.899294 13185 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:31.972898 10728 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:31.979545 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.980170 10728 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:31.896076 13275 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:15:31.981468 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.986819 10730 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:31.961097 13710 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.899631 13751 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:31.972815 13550 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:31.990094 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:31.996660 10124 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:32.000257 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:31.978832 13646 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:31.982098 13612 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:31.982788 13748 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.012881 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.014031 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.015740 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.020722 10732 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:32.000341 13550 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:32.026960 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.006772 13018 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:32.028353 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:32.005365 13710 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:15:32.019626 13540 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:15:32.038071 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.020152 13275 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:32.018829 13612 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:32.044044 10732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:35156
W20260709 12:15:32.047081 13752 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:15:32.047835 13754 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:32.059180 13664 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:32.059909 13748 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.029942 13550 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:32.038554 13750 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:32.063874 13708 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.064716 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.031420 13693 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:32.072073 13751 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.025772 13316 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:32.023228 13747 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:32.066264 13605 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.260164 13605 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:32.262112 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.265139 10203 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:32.266955 13621 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:32.267746 10197 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:32.025945 13610 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:15:32.074394 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.076274 10046 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:32.078061 10049 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:32.095896 10047 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:32.098157 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:32.280845 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 206507us
I20260709 12:15:32.281643 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.107282 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.284286 10051 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:32.112865 13574 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:32.124015 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.158761 10199 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:32.158835 10732 raft_consensus.cc:606] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.306986 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.308101 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.160820 10730 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:32.162948 10729 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:32.030658 13018 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.199390 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:32.172587 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 140556us
I20260709 12:15:32.319707 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:32.233443 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.210837 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.321059 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.322836 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:32.323076 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:32.323396 10130 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.323590 10127 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.326997 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.246850 13647 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.167686 10128 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:32.165695 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.349612 10200 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:32.165418 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.214967 13470 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:32.257761 10198 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:32.216639 13096 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:15:32.355798 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 78107.9us
I20260709 12:15:32.278466 13729 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:32.333416 13018 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.343231 13605 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:32.208756 13215 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:32.041944 13185 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.233575 13750 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.301664 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.401007 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.401615 10047 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:32.302248 13708 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:32.353152 13470 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:32.302299 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 204231us
I20260709 12:15:32.406733 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.407325 10052 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.408743 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.222460 13620 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:32.200696 13710 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.238440 13693 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:32.344291 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.073882 13695 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.165952 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:32.414939 10736 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.253738 13652 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:32.420717 13652 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.422819 13652 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.352404 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.423425 10053 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:32.267719 13747 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:32.426187 13747 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.426782 10736 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:32.167038 13664 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.429109 13664 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.356178 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:32.430738 10122 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.435143 13645 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:32.435732 13645 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.437714 13645 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.439766 13695 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.446975 10129 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:32.355906 10127 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:32.457625 10127 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:32.358359 10130 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:32.304919 13574 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:32.276968 10054 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:32.343019 13736 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:32.256824 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.381791 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.383946 13748 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:32.383846 13612 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:32.384886 13540 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.366230 13616 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:15:32.390933 13649 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:32.302489 13720 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:32.402401 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.525965 10047 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.392755 13605 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.409742 13620 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.415829 13490 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:32.465186 10122 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:32.359555 13647 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.545811 13647 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.391999 13215 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:32.546972 13215 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.548022 13215 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.534464 13605 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.390848 13653 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:15:32.377595 13729 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.411087 13713 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:32.522929 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 266179us
I20260709 12:15:32.414964 13693 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:32.611861 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 203208us
I20260709 12:15:32.614387 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.524230 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.407980 13750 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.586772 10123 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:32.618032 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 298384us
I20260709 12:15:32.525810 13720 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:32.521792 13540 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.626699 13747 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.628363 13540 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.628660 13747 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.629007 10200 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:32.629642 13765 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:32.600472 13620 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.448006 13710 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:32.605557 13768 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:15:32.569689 13718 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:32.526027 13645 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:32.613127 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:32.524401 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.639637 13620 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:32.503042 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
W20260709 12:15:32.623494 13759 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:15:32.600909 13574 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.626492 13720 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.537787 13470 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.645946 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:32.646096 10047 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:32.655787 10054 pending_rounds.cc:85] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 4
I20260709 12:15:32.651625 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.656104 10054 pending_rounds.cc:107] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:15:32.656457 10054 raft_consensus.cc:2889] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:32.657065 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.657042 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.659940 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:32.663058 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:32.663581 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.650139 13747 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.619374 13713 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.640328 13275 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:15:32.655131 13647 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:32.664965 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.657562 13490 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:32.648417 13674 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:32.666708 13732 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:32.653666 13550 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.665040 13706 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:32.658983 13431 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:32.664491 13645 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:32.662964 13476 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:32.663566 13574 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:32.662761 13470 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:32.720484 10050 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:32.673368 13747 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.725140 10053 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:32.675808 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.653635 13718 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.698957 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.674787 13647 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:32.681186 13410 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:15:32.744449 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45581.3us
W20260709 12:15:32.745916 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70286.7us
I20260709 12:15:32.746660 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.747751 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.715883 13706 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.757030 13771 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:32.786520 13733 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:32.721356 13018 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.786939 13733 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.787801 13733 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.788623 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.758689 13185 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:32.790218 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.790649 13410 raft_consensus.cc:2764] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:15:32.791246 13781 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:32.752992 13476 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:32.762377 13747 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.791855 13476 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.762647 13729 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.792903 13605 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.793785 13018 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.794030 10198 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:32.764006 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.794555 10128 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:32.752838 13674 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:32.795531 10202 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:32.796484 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.796592 13605 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.797001 13706 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:32.748700 13748 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:32.786676 13316 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:32.797883 13316 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.797542 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.800117 13674 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:32.800549 13674 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:32.778141 13710 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:32.803555 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.792273 13476 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:32.769312 13713 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.770792 13490 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.770718 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.771461 13718 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:32.772554 13774 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:32.743516 13612 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:32.776971 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.743314 13647 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.778410 13642 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:32.779223 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:32.830118 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.779840 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.784888 13693 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.788733 13733 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:32.762043 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:32.760782 13550 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.764508 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:32.753630 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 92144.3us
I20260709 12:15:32.811831 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.813730 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.815452 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.817677 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:32.839666 10202 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:32.832244 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.832696 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.834919 10197 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:32.843896 13718 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:32.845927 13550 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:32.846338 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.851253 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:32.852605 13710 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:32.853086 13550 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:32.853590 13550 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:32.854391 13550 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.855955 13720 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.831295 13612 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.856978 13750 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.859261 13693 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.852732 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.860988 10203 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:15:32.861362 10203 pending_rounds.cc:85] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 9
I20260709 12:15:32.861567 10203 pending_rounds.cc:107] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:15:32.861781 10203 raft_consensus.cc:2889] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:32.862345 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.818650 13729 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:15:32.826921 13490 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.828409 13713 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:15:32.877635 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119571us
I20260709 12:15:32.798720 13316 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:32.881469 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:32.867223 13718 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:32.873054 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:32.885630 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:32.874632 13476 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.868201 13642 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:15:32.889245 10121 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:32.889406 10050 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:32.892407 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.895133  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:32.896976  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.897765  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:32.900031 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.879204 13750 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.874152 13720 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.882462 13431 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:32.890686 13748 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:32.914695 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.895247 13653 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:15:32.901048 13536 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:32.922926 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:32.923452 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:32.925227 10735 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.925396 10729 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:32.923022 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:32.926481 10736 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:32.907336 13316 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.927294 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:32.929113 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:32.929771 10732 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:15:32.932135 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.936717 13536 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.937780 13536 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:32.940388 13490 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:32.903715 13605 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:15:32.942214 10168 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:32.947862 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:32.948423 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:32.978489 10735 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:32.912248 13781 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:15:32.982671 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.983238 10048 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:32.982105 13747 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:32.985836 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79067.5us
I20260709 12:15:32.987088 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:32.941009 13748 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:32.989053 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.987738 10053 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:32.991905 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.995409 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.995944 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:32.941630 13750 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:15:33.009423 10127 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:32.999454 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:32.984851 13747 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.010203 10053 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:33.010560 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:32.999433 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:32.990051 13716 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:32.993871 13610 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:33.019603 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.021942 10125 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:32.998286 13653 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:33.021500 13750 consensus_queue.cc:1243] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:33.013860 13747 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.033846 10730 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:33.011269 13789 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:33.024346 13653 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:33.019083 13275 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:33.054505 13165 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:33.055001 13165 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.055334 13165 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.060133 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:33.060802 10053 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:33.061162 13787 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:15:33.063581 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.066553 10204 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:33.066943 10729 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:33.014024 13771 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:33.035132 13612 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.034304 13652 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:33.087381 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 191366us
I20260709 12:15:33.084908 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.088455 10125 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:33.084858 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.089628 10124 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.994940 13431 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.065826 13275 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:33.035522 13610 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.078609 13732 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:33.079488 13476 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.105862 10124 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:33.097649 10053 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:33.107266 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.107993 13490 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:33.108242 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.111042 10125 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.112043 13608 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.113222 13608 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.118961 10121 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:15:33.121136 10121 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:33.122541 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.123515 13649 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:33.123925 13649 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:33.118233 13165 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.124732 13649 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:33.128562 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2226) took 1547 ms (client timeout 1750 ms). Trace:
W20260709 12:15:33.128995 10046 rpcz_store.cc:269] 0709 12:15:31.580956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:31.621167 (+ 40211us) service_pool.cc:224] Handling call
0709 12:15:33.128376 (+1507209us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54003fa2d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:33.128480 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898090880}
I20260709 12:15:33.130538 13185 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:33.130935 13185 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.131762 13185 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.133617 10125 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:33.134317 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.134845 13165 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.108671 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.087704 13789 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.145946 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:33.097501 13275 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.122321 10121 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:33.100570 13732 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:33.152930 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157032us
I20260709 12:15:33.156638 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:33.154505 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 139146us
I20260709 12:15:33.090313 13652 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.147186 13550 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.152191 13720 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.148149 13490 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:33.158042 13732 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.091078 13748 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.177722 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.182715 10730 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:33.185099 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.185312 10732 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:15:33.187080 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.187569 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:33.188274 10732 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:33.186744 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 178753us
I20260709 12:15:33.191877 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:33.180294 13612 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:33.177033 13806 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:33.101927 13653 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.181819 13753 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:15:33.204509 13806 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.210491 13806 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.190783 13771 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:33.211872 13771 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.212769 13771 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.162961 13674 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.214710 13490 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.194284 13673 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:15:33.214509 13616 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:15:33.205909 13792 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:15:33.208052 13795 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:33.205502 13797 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:15:33.216538 10127 raft_consensus.cc:2368] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:33.183482 13720 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.181618 13550 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.197444 13612 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:33.230162 13801 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:15:33.294301 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 95420.1us
I20260709 12:15:33.295481 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:33.297719 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:33.307871 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.292001 13809 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.292050 13612 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:33.201396 13789 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.295358 13814 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:33.314157 13453 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.313474 13476 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:33.310818 13813 consensus_queue.cc:1175] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 13 status { last_received { term: 11 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:33.327345 13809 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.339268 13816 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:15:33.359999 13816 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:33.346853 13641 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:33.360405 13816 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:33.361220 13816 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.336328 13610 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:33.362800 13018 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.363296 13018 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.365298 13018 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:33.367550 13810 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:33.372603 13275 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.349972 13652 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.349761 13806 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.350165 13653 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.376911 13806 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.351526 13813 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.379357 13720 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.351526 13710 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:33.305050 13647 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.373921 13732 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.362365 13816 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.379205 13813 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.432186 10734 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:33.354497 13605 consensus_queue.cc:1175] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a29bed9eb81541dba9ec7a447986e01e" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:15:33.447666 13813 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:33.451023 13812 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:15:33.466327 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 279817us
I20260709 12:15:33.411813 13720 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:33.468680 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 276855us
I20260709 12:15:33.469625 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.431547 13814 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:33.472674 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.479516 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.475662 10121 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:33.435127 13673 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:33.480602 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:33.482380 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.482491 10049 raft_consensus.cc:2368] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8.
I20260709 12:15:33.384302 13453 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.406330 13476 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.488953 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.489236 10126 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:15:33.490614 10122 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:33.491129 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.491773 10200 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:33.494108 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:33.469002 13718 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.498742 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.480162 13316 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:33.501948 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:33.502574 10732 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:33.503830 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:33.504302 10122 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:33.505214 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.505534 10730 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:33.505795 10125 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:33.506152 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:33.491421 13641 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:33.481534 13720 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.484429 13612 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.497076 13820 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.489702 13673 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.526512 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:33.507797 13275 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:33.496417 13794 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:15:33.549394 13707 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:33.530121 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:33.530494 13816 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:33.549844 13707 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.524726 13652 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:33.550963 13652 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.551349 13652 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:33.553269 13556 raft_consensus.cc:993] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:15:33.555299 13018 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.555876 13018 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.559744 13453 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.559912 10735 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.535578 13747 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.541034 13720 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.541610 13817 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.501581 13718 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.542515 13550 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.543385 10732 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:33.514065 13641 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.543810 13806 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.547871 13612 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.550241 13816 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.531881 13819 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:15:33.582907 10125 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:33.588261 10049 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:33.591130 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.591476 10735 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:33.487277 13814 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.547717 13476 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.599458 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.529093 13820 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.601703 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:33.598834 13707 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.615576 10052 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:15:33.631278 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.680397 10122 raft_consensus.cc:2368] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
I20260709 12:15:33.583789 13431 raft_consensus.cc:1081] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:15:33.669152 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.686945 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:33.687547 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:33.652992 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.604933 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:33.583261 13795 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:33.593637 13018 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:33.688426 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.690028 10728 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:33.595322 13781 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:33.614281 13828 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:15:33.649276 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1954) took 1549 ms. Trace:
I20260709 12:15:33.605037 13816 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.608448 13673 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.645994 13710 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:33.613034 13791 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.690s	user 0.012s	sys 0.004s
W20260709 12:15:33.694700 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:33.658640 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 136875us
I20260709 12:15:33.695555 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.698078 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:33.688933 10732 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:33.623387 13805 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:33.621798 13800 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 12:15:33.606798 13647 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.605075 13641 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.628517 13747 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.663347 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.606612 13814 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.705762 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.708194 10126 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:33.707520 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.707543 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.709280 10203 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:33.708011 10169 leader_election.cc:400] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8.
I20260709 12:15:33.709937 10169 leader_election.cc:403] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:33.697338 10054 rpcz_store.cc:276] 0709 12:15:32.099761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.555454 (+455693us) service_pool.cc:224] Handling call
0709 12:15:32.591485 (+ 36031us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:32.720504 (+129019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.720577 (+    73us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:32.721293 (+   716us) log.cc:844] Serialized 52 byte log entry
0709 12:15:32.819337 (+ 98044us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:32.819372 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.060642 (+241270us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:33.648866 (+588224us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b5400110154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:33.648927 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.648981 (+    54us) raft_consensus.cc:1685] finished
0709 12:15:33.648995 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.649199 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2203,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":4405,"spinlock_wait_cycles":172449408,"thread_start_us":160379,"threads_started":2,"wal-append.queue_time_us":130527}
I20260709 12:15:33.694665 13621 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.712639 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.714167 10197 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:33.697716 13616 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.717823 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1537) took 1309 ms. Trace:
I20260709 12:15:33.605141 13806 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.718181 10123 rpcz_store.cc:276] 0709 12:15:32.408193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.437148 (+ 28955us) service_pool.cc:224] Handling call
0709 12:15:32.586587 (+149439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:32.618041 (+ 31454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.717624 (+1099583us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400231750. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:33.717753 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342920576}
I20260709 12:15:33.719102 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:33.703642 13716 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.704769 13732 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.701038 13805 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.724447 10126 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:33.716223 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:33.707494 13275 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:33.732523 10124 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:33.736114 10047 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:33.603981 13817 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.738588 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.738611 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.740937 10122 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.696842 13781 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.748371 13781 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.748757 10048 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:33.720263 13747 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:15:33.749728 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.750475 10123 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:33.750927 13652 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.752460 10047 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:33.732615 13733 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:33.755049 13275 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.730858 13831 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.756676 13275 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.757086 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.752386 13814 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:33.759137 13814 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:33.759505 13814 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.761360 13820 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:33.761767 13649 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.721010 13710 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:15:33.740197 10125 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:33.758411 13824 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:33.731889 13708 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.717612 13621 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.739643 10054 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:15:33.795522 10122 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:33.758494 13729 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:33.732642 13616 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.799654 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:33.800213 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.803469 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1489) took 1673 ms. Trace:
I20260709 12:15:33.803781 10204 rpcz_store.cc:276] 0709 12:15:32.130286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.226531 (+ 96245us) service_pool.cc:224] Handling call
0709 12:15:32.285649 (+ 59118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:33.077090 (+791441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.803266 (+726176us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54003133d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:33.803424 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784752896}
I20260709 12:15:33.804292 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1952) took 1705 ms. Trace:
I20260709 12:15:33.797148 13708 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.805325 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2246) took 1463 ms. Trace:
I20260709 12:15:33.735620 13716 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.805691 10055 rpcz_store.cc:276] 0709 12:15:32.341822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.633547 (+291725us) service_pool.cc:224] Handling call
0709 12:15:32.633785 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:32.754528 (+120743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.754564 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:32.754608 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:32.754643 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.805120 (+1050477us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400130454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:33.805166 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.805274 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277171456}
I20260709 12:15:33.807384 13716 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.798053 13729 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:33.808668 13729 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.809623 13729 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.773694 13733 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.804689 10051 rpcz_store.cc:276] 0709 12:15:32.099285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.504437 (+405152us) service_pool.cc:224] Handling call
0709 12:15:32.504764 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:32.685964 (+181200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.685997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:32.686040 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:32.686071 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.804072 (+1118001us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400320d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:33.804121 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.804233 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416215424}
I20260709 12:15:33.801728 13470 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:15:33.826105 13616 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.828356 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:33.836756 13786 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.914s	user 0.003s	sys 0.008s
I20260709 12:15:33.839520 13621 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:33.841491 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.844496 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:33.845106 10055 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:33.845853 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:33.846381 10051 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:33.847287 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.848273 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.849346 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.756711 13831 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.850139 13833 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:33.852087 13831 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:33.801704 13805 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.853412 13805 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.860038 10020 leader_election.cc:400] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
W20260709 12:15:33.842314 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.862797 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.864338 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.865733 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.867516 10020 leader_election.cc:403] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:33.868788 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:33.869087 10203 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:33.870065 10054 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:33.872296 13833 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:33.872747 13816 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:33.873508 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.877439 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.874076 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.875100 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.879542 10195 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:33.878720 10203 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:33.880820 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.881601 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.877357 13833 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:33.883001 10051 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:33.876581 13721 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:33.884886 13453 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:33.885205 13718 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.885421 13453 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.886260 13096 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.882354 10197 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:33.886752 13612 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:33.887507 13453 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.878542 13642 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:33.890726 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.891460 13833 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.894731 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:33.894929 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:33.896487 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:33.897457 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:33.898736 10203 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:33.900732 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:33.901263 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.901525 10054 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:15:33.903035 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:33.906934 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:33.855448 13620 consensus_queue.cc:1175] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 12:15:33.907483 10128 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:33.913061 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:33.914006 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:33.914860 13652 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:33.915624 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:33.916237 10197 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:33.875837 13747 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8.
I20260709 12:15:33.873347 13710 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:33.915630 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1497) took 1221 ms. Trace:
I20260709 12:15:33.920032 10128 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:15:33.921032 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53880
I20260709 12:15:33.921631 10047 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.921947 10047 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:33.922645 13616 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:15:33.924715 13721 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:33.925359 13707 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:33.874243 13781 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:33.926618 13781 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.927127 13781 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.926653 13733 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.928121 10051 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:33.921110 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:33.908828 13612 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.937925 10125 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:33.911934 13621 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:33.942134 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.942904 10127 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:33.943543 13652 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:33.943984 13652 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.944327 13652 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:33.944407 13612 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:33.946740 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:33.947494 10129 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:33.904906 13816 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:33.908939 13820 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:33.950924 13814 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:33.953043 13814 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:33.953655 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:33.954404 10129 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:33.927909 13710 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:33.909363 13824 raft_consensus.cc:2764] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:15:33.959100 13621 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:33.946591 13610 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:33.918713 10199 rpcz_store.cc:276] 0709 12:15:32.694401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.694634 (+   233us) service_pool.cc:224] Handling call
0709 12:15:32.696084 (+  1450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:32.718904 (+ 22820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:32.718934 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:32.719451 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:15:32.810760 (+ 91309us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:32.810804 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:32.810873 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:33.836021 (+1025148us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:33.911987 (+ 75966us) raft_consensus.cc:1685] finished
0709 12:15:33.912007 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.915572 (+  3565us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22404,"raft.queue_time_us":22567,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":3742976,"thread_start_us":90947,"threads_started":1,"wal-append.queue_time_us":156750}
I20260709 12:15:33.981004 13431 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:33.957960 13710 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:33.975893 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54849.3us
W20260709 12:15:33.967051 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:33.983681 10204 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:33.962833 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:33.928802 13718 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:33.989117 10047 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.993042 10049 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:33.965783 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 503) took 1070 ms. Trace:
I20260709 12:15:33.981259 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:34.003639 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.003917 10203 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:34.004251 13165 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:34.008260 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.011445 10050 rpcz_store.cc:276] 0709 12:15:32.895763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.896080 (+   317us) service_pool.cc:224] Handling call
0709 12:15:32.896338 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:32.896514 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:33.892307 (+995793us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b18001e4ba0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf
0709 12:15:33.892437 (+   130us) log.cc:844] Serialized 14 byte log entry
0709 12:15:33.965476 (+ 73039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:33.965526 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:33.965566 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:33.965632 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:33.965731 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24698,"prepare.queue_time_us":31121,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":239,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":3811,"spinlock_wait_cycles":67979008,"thread_start_us":112432,"threads_started":2,"wal-append.queue_time_us":100898}
I20260709 12:15:34.022359 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.022902 10047 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.022920 10125 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.026263 10195 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:34.027640 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:34.003913 13610 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:34.007494 13833 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:34.047394 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:34.078728 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.017436 13718 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.033778 13710 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:34.087258 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.087749 10125 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:34.094712 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.034520 13831 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.034744 13822 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:34.018265 13165 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:33.995862 13621 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.031523 13647 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:15:34.068313 13824 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:34.107477 10196 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:34.091547 13716 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.079582 13642 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
I20260709 12:15:34.099669 13814 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:34.125874 13608 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.104264 13831 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.129405 13165 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.122180 13645 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.129973 13716 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.126411 13816 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.134800 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.135375 13809 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.136636 13674 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.147748 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:34.124454 13822 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.152614 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.143452 13608 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:34.143878 13729 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.161767 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:34.160723 13316 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:34.146013 13814 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.139724 13824 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:34.174738 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.145700 13790 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:15:34.145316 13795 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:15:34.173710 10202 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:34.129316 13718 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.155846 13816 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.143220 13610 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.185815 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.150872 13645 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.194016 13824 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.198283 13716 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.201820 10121 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:34.203069 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.175423 13783 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:34.175769 13316 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.168370 13729 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.206202 13612 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:34.207437 13783 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.221480 13783 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:34.225376 13096 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:34.236898 13645 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.238799 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1496) took 1585 ms. Trace:
I20260709 12:15:34.239253 10201 rpcz_store.cc:276] 0709 12:15:32.653241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.653344 (+   103us) service_pool.cc:224] Handling call
0709 12:15:32.654113 (+   769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:32.655431 (+  1318us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:34.032709 (+1377278us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18004381c0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf
0709 12:15:34.032842 (+   133us) log.cc:844] Serialized 14 byte log entry
0709 12:15:34.143944 (+111102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:34.150368 (+  6424us) log.cc:844] Serialized 26 byte log entry
0709 12:15:34.150528 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:34.150562 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:34.150628 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:34.238500 (+ 87872us) raft_consensus.cc:1685] finished
0709 12:15:34.238598 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:34.238728 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15469,"prepare.queue_time_us":29600,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2226,"raft.queue_time_us":1383,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":3177,"spinlock_wait_cycles":7278336,"thread_start_us":104512,"threads_started":2,"wal-append.queue_time_us":82881}
I20260709 12:15:34.241684 10734 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:34.246366 13750 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.246377 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.247195 10121 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:34.247098 13750 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.248427 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.226898 13612 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.254637 13645 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:34.255858 13645 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.256316 13645 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:34.262893 13831 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.264865 13316 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.209717 13822 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.265939 13645 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.270088 13540 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:34.240283 13096 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.276525 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.283249 10128 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:34.281215 10200 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:34.291292 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.292052 10121 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:34.223618 13814 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.296010 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.300263 13096 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.304399 13612 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.307322 10128 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
W20260709 12:15:34.310477 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.314970 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.323573 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.318080 13431 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:34.327105 13649 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:34.327570 13649 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.327909 13649 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:34.294206 13645 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.330993 13431 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:34.332002 13431 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.320451 13707 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.334591 13707 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.336591 13707 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.337549 13781 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.340364 13781 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.336608 13827 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:34.341109 13817 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.341375 13827 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:34.342200 13827 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.343968 10055 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:15:34.306505 13824 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.348026 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.349128 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.343430 13827 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.359218 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.362282 10121 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:34.363241 10731 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:15:34.365890 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.366479 10731 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:34.366748 10198 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:34.367662 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:34.376163 10121 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:34.377540 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.378479 13718 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:34.379200 13718 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.380270 13185 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:34.380067 13718 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.380630 13783 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:34.403002 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.355175 13824 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:34.414212 13847 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:34.371989 13316 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:15:34.370736 13652 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.420387 13652 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.369174 13750 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.424289 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.383263 13817 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:34.426184 10121 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:34.435477 10121 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:34.436671 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.444207 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.448576 13652 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:34.449393 13652 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:34.426628 13817 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.477056 10121 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:34.450582 13783 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.472565 13817 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:34.485821 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.487176 10050 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:34.483767 13647 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:15:34.495517 13431 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:34.495959 13431 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:34.496798 13431 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.498040 13431 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:34.507532 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:34.508435 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.509605 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.510763 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.515512 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.519125 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.520215 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.522956 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.523533 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.521763 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.525391 10124 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:34.526389 10126 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:34.502843 13814 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.530791 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.538232 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.539321 10046 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
W20260709 12:15:34.528337 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 114653us
I20260709 12:15:34.532105 10054 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:34.534202 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.530400 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.541371 10048 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:34.545032 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.545049 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:34.549873 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.527863 13612 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.562091 13716 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:34.562587 13716 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.562932 13716 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:34.567830 13859 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:34.568701 13453 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:34.569126 13453 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.569465 13453 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:34.506246 13652 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.581874 10169 leader_election.cc:400] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:34.582962 13621 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:34.578547 13809 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:34.584751 13809 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.545678 13814 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.586829 13809 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.577183 13713 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:34.587533 13713 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.588093 13814 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.589294 13674 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:34.590075 13674 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.573438 13721 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:34.594051 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.583041 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:34.603469 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.602912 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.603173 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.605101 10203 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:34.606215 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:34.558699 13707 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:15:34.608700 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.609305 10730 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:34.552637 13649 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.624104 13649 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.616999 10199 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:34.613417 13708 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.589488 13713 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.611116 13316 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:34.602859 13806 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.611279 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.626655 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 697) took 1078 ms. Trace:
I20260709 12:15:34.598587 13096 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:15:34.651590 10735 rpcz_store.cc:276] 0709 12:15:33.529736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.529869 (+   133us) service_pool.cc:224] Handling call
0709 12:15:34.608427 (+1078558us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b54005efbd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:34.608535 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22405888}
I20260709 12:15:34.629921 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:34.630437 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46721.7us
I20260709 12:15:34.573886 13817 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.570854 13612 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.590526 13674 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:34.656814 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:34.660877 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.619863 10203 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:34.650120 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.605401 13788 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:34.653237 13859 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:34.609191 13824 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.662837 13859 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.663616 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:34.664953 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:34.598812 13789 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:15:34.666937 13874 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:34.615355 13750 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:34.667649 13874 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:34.671967 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.672755 10736 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:34.673290  9953 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.677510 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:34.677814 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:34.678453 10734 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:34.681643 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 844) took 1002 ms. Trace:
I20260709 12:15:34.683164 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.684374 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.684793 13729 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.685737 10728 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:34.682291 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.662207 13788 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.689729 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:34.689986 13788 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.690300 10732 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:34.687889 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.691835 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:34.692114 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1506) took 1528 ms. Trace:
I20260709 12:15:34.693053 13874 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:34.696250 10728 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:34.607157 13721 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.692516 10198 rpcz_store.cc:276] 0709 12:15:33.163683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.163867 (+   184us) service_pool.cc:224] Handling call
0709 12:15:33.164145 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:34.369382 (+1205237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:34.691905 (+322523us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:34.692056 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765340544}
I20260709 12:15:34.682039 10730 rpcz_store.cc:276] 0709 12:15:33.679386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.679525 (+   139us) service_pool.cc:224] Handling call
0709 12:15:34.609121 (+929596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:34.616493 (+  7372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:34.681437 (+ 64944us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54005efbd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:34.681582 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119922048}
I20260709 12:15:34.701465 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.703671 10202 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:34.703967 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.705098 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.652725 13316 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:34.706494 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:34.706790 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 161810us
I20260709 12:15:34.709192 10199 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:34.712497 10198 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:15:34.712976 10198 pending_rounds.cc:85] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:15:34.713244 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.714247 10201 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:34.713773 10094 leader_election.cc:400] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
W20260709 12:15:34.714393 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60740.9us
I20260709 12:15:34.713282 10198 pending_rounds.cc:107] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:15:34.705308 13831 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:34.716053 10198 raft_consensus.cc:2889] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:34.699985 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.717424 10094 leader_election.cc:403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:34.712872  9953 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 7, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:34.719966 10728 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:34.721591 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.696470 13708 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:15:34.712993 13789 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.697587 13605 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:15:34.723905 13789 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.725967 13789 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.727636 13674 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.730235 13721 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.731914 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1505) took 1582 ms. Trace:
I20260709 12:15:34.732317 10196 rpcz_store.cc:276] 0709 12:15:33.149653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.149807 (+   154us) service_pool.cc:224] Handling call
0709 12:15:33.159048 (+  9241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:34.123426 (+964378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:34.731659 (+608233us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400312ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:34.731853 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175903488}
W20260709 12:15:34.739341 13863 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 12:15:34.740787 13860 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:15:34.743512 13833 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.746526 13788 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:34.746853 10734 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:34.750160  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:34.758910 13867 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:34.770603 13721 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.771193 13721 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.773360 13721 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.777592 13721 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.778121 13721 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.778964 13861 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:34.779534 13861 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.780845 13721 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.781747 13861 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.783207 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:34.783878 10050 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:34.783898 13710 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
W20260709 12:15:34.785879 13852 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 12:15:34.792481 10050 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:34.760068  9953 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 8 to 9, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 9 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.727713 13817 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:34.800285 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43721.3us
I20260709 12:15:34.810940 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.801530 13869 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:34.803422 13867 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:34.822606 13867 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:34.804003 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 93160.9us
I20260709 12:15:34.804461 13732 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:34.805608 13612 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.806788 13716 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:34.807909 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.814734 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.838068 10047 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:34.838328 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.817958 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.819672 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:34.825944 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.826462 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:34.826493 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.840269 10129 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:34.833788 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.841246 10048 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:34.815461 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.845244 10126 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:34.846225 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.844839 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.820500  9953 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 10 to 11, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 11 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.851222 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:34.853700 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.854156 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.853307 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.856455 10195 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:34.858740 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.859241 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.859647 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.854717 10198 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:34.864255 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.804504 13608 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:34.865031 10197 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:34.869781 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.696973 13874 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.883385 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.865140 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.867175 10728 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:34.888810 10094 leader_election.cc:400] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:34.889029 10203 raft_consensus.cc:2368] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
I20260709 12:15:34.889874 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:34.890738 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.873615 13822 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:34.896441 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.895807 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:34.897713 10198 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
W20260709 12:15:34.856493 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 133655us
I20260709 12:15:34.899991 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.895035 13869 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.900787 13861 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:34.901067 13868 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:34.902822 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:34.898618 13490 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:34.903721 13861 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:34.904069 13869 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.903170 13870 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.906315 13610 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:34.905928 13870 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.908174 13870 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:34.911283 13865 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:15:34.875234 13732 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:34.916381 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.916980 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.917770 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.918954 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.919541 10731 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:34.923601 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:34.924619 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:34.894784 13822 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:34.872587 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.824741 13859 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:34.873514 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.932839 10124 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:34.935053 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.935003 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.771325 13316 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.849545 13781 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.874788 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.861733 13783 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:15:34.855479 13871 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:34.875208 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.874742 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:34.942088 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:34.875751 10126 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:34.942638 13871 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:34.943534 13871 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.934088 13858 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:34.937371 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.947067 13858 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.947548 13858 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:34.950052 13858 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.950567 13781 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.951903 10204 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:34.922703 13790 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.877576 13816 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.878381 13716 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.844470 13652 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:34.881974 13866 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:15:34.854657 13729 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:34.877628 10054 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:15:34.859560 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.883378 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:34.867224 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.887425 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:34.896366 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 239811us
I20260709 12:15:34.872026 10129 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:34.893930  9953 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:34.929159 13861 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:34.931929 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.932050 10199 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:34.874168 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:34.935871 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:34.935846 10203 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:35.018908 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:34.936708 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:34.936937 10731 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:34.934381 13859 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.021524 13859 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:34.874979 13819 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:34.886972 13453 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:34.942384 13869 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.024834 13453 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.818652 13710 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:35.025535 13710 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.026227 13819 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.026798 13819 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.027653 13710 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:34.931744 13721 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:35.028815 13819 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.016459 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:34.935211 13822 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.034801 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.037784 13819 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:35.028716  9953 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 5 to 6, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.037994 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.039918 10731 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:35.041484 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:35.019475 10203 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.042289 13819 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:35.045830 13819 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.046175 13819 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:35.050688 10728 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:35.052261 13710 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:35.055830 13859 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.059916 10203 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:34.934480 13732 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:35.070209 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.063036  9953 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 3 to 4, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 4 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.079726 10050 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:35.090265 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.096295 10203 raft_consensus.cc:2410] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:15:35.063055 13859 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:34.931630 13870 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 12:15:34.965224 13858 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.106029 13819 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.108582 13819 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.109874 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:35.015700 13490 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.116955 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.118161 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.016688 10123 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:15:35.101107 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 166310us
I20260709 12:15:35.110512 10736 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:35.122675 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.073117 13868 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.125511 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.018083 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.139981 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.140528 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:35.098569 13869 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:35.147923 10736 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:35.109340 13871 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:35.142213 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:35.144199 10199 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:35.067734 13652 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.145519 13781 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.154054 13710 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.157300 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.161939 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.162532 10736 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:35.155009 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:35.151916 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 133903us
W20260709 12:15:35.091441 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 212328us
I20260709 12:15:35.165571 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.167752 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:35.080319 13729 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.150496 13870 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.067947 13790 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.166162 13716 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.159031  9953 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.156733 13859 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:35.177587 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.178154 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:35.179832 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.182083 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.182011 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.149688 13453 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:35.150229 13641 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:35.150974 13869 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.152185 13718 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:35.193872 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.202939 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.194365 10050 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.143203 13816 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:15:35.195093 10046 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:35.113840 13858 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.212746 10734 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:35.196508 10054 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:35.194953 10049 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:35.124646 13490 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.207317 10094 leader_election.cc:400] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
I20260709 12:15:35.214920 10094 leader_election.cc:403] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:35.196848 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.188313 13781 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:35.205334 13877 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:35.208509 13713 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:35.208842 13814 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:35.223582 13814 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.223994 13814 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.149228 13868 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.224777 13729 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.195986 13869 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.196509 13733 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:15:35.226998 13887 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:35.226408  9953 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 5 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.228048  9953 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:35.229403  9953 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 1 to 6, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 6 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:35.231225  9953 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.218052 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.213675 10050 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
W20260709 12:15:35.241290 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44526.5us
I20260709 12:15:35.242087 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:35.242620 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:35.243151 10047 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.193598 13871 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:35.168767 13710 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.194096 13819 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:35.223615 13882 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:15:35.249611 10123 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:35.249596 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.226963 13733 consensus_queue.cc:1243] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:15:35.252467 10129 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:35.233371 13867 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
I20260709 12:15:35.199641 13649 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:15:35.193300 13870 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.259722 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:35.245734 13859 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:35.247490 13316 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:35.206279 13716 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.263999 13610 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:35.239418 13713 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:35.262292 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:35.268147 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.187594 13732 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.250517 13781 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:35.267187 13641 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:15:35.283823 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.262925 10047 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:35.261564 13874 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:35.265240 13833 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.297708 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:35.285235 13819 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:35.301416 13819 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.301836 13819 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.287535 13831 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:35.305630 13674 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:35.306087 13674 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:35.310403 13819 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.313460 13831 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:35.314764 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.315554 13831 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:35.316138 13851 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.894s	user 0.000s	sys 0.004s
I20260709 12:15:35.320910 13716 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.324437 10126 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:35.327399 10126 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:15:35.330502 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.331306 10129 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:35.334771 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.336450 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.262718 13822 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.339316 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:35.339938 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 122251us
I20260709 12:15:35.341957 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:35.270944 13897 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:15:35.257304 13871 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:35.346131 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 84345.9us
I20260709 12:15:35.343075 13540 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:35.322921 13610 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:35.352046 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:35.353629 10053 raft_consensus.cc:2410] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:15:35.354694 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:35.356067 13710 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:35.356374 13889 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 12:15:35.357708 13871 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.344851 13713 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.324812 13833 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.361057 13833 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.353142 13859 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:35.362679 13859 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:35.353440 13540 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:35.370539 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.358260 13871 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:35.385075 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.385381 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.385079 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.386534 10124 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:35.390857 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:35.392169 10049 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:15:35.394075 10124 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:15:35.395524 10129 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 12:15:35.400012 10046 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:15:35.403162 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.405668 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.406399 10126 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:35.411355 10129 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:15:35.351991 13790 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:35.345060 13645 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:15:35.392262 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.414834 10049 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:35.350613 13875 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:15:35.421192 10123 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:35.419335 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.419791 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.363495 13859 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.379431 13868 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.425084 10055 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:35.382360 13871 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.390676 13782 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:35.370296 13869 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.359148 13781 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.437197 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.427456 13873 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:35.427243 13185 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:15:35.415550 13652 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.414021 10047 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:35.425608 13790 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:35.433090 13871 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.440371 13870 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.440630 13540 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:35.439438 10128 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:35.452817 10126 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:35.461808 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.454857 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:35.462498 10121 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:35.465940 13822 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.443945 13873 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:35.467448 13873 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.438534 13819 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:35.442836 13782 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:35.482309 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:35.481240 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 127478us
I20260709 12:15:35.437397 13814 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.489189 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:35.516533 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:35.490077 13910 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:35.482483 13316 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:35.490267 13540 consensus_queue.cc:1243] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:15:35.521119 13910 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.481263 13733 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:15:35.497009 13610 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:15:35.523662 13795 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:35.545015 10050 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:15:35.530166 13316 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.576213 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:35.577687 13751 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:35.578203 13751 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:35.579110 13751 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.612696 10202 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:35.612782 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.613140 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.613416 10202 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:35.614722 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:35.615293 10730 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:35.615963 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:35.616204 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.617441 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:35.617964 10737 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.614171 10202 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:35.619001 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 102521us
I20260709 12:15:35.619827 10202 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:35.621287 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.622375 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.624050 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.627066 10046 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:35.630475 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:35.628688 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:35.630383 10047 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:35.635600 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:35.636559 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.548619 13795 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.543495 13910 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.542898 13185 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:15:35.743577 10128 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:35.681746 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:35.766472 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.637684 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:35.665498 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.743072 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.765640 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:35.644384 10051 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 7: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:35.675690 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.782989 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:35.720590 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.635515 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.788476 10122 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.648205 10047 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:35.787567 10130 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 6.
I20260709 12:15:35.792946 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:35.791455 10128 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:35.637317 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:35.681298 10730 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:35.795951 10730 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:35.796684 10730 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.791391 10126 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:35.801800 10124 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:35.789243 10121 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:35.638046 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:35.803452 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 165491us
I20260709 12:15:35.689944 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:35.808329 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:35.810962 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:35.811793 10128 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:35.852398 10202 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:15:35.852977 10202 pending_rounds.cc:85] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:15:35.853276 10202 pending_rounds.cc:107] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:15:35.853560 10202 raft_consensus.cc:2889] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:35.804383 13652 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.698222 13590 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:35.905413 13652 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.907634 13652 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.804605 13813 raft_consensus.cc:2764] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:15:35.916746 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 90005.8us
I20260709 12:15:35.708051 13721 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:35.917454 13721 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.710397 13873 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.609983 13316 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:35.918017 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:35.556855 13733 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:35.643430 13905 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:35.800921 13795 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:35.708547 13814 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.709192 13869 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:35.941412 10122 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:35.706017 13861 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.231s
I20260709 12:15:35.699790 13822 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.254s
I20260709 12:15:35.744619 13833 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.188s
I20260709 12:15:35.718216 13871 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.706212 13816 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:35.807770 13870 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 12:15:35.806945 13716 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:15:35.932546 13733 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:35.972570 10052 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:35.557117 13782 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:35.936442 13813 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:35.977002 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.960924 13905 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:35.980429 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:35.985131 10202 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:35.988772 10195 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:35.986168 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.989755 10202 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:35.990610 10202 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:35.991521 10202 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:36.003849 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:36.010942 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:36.031761 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:35.998246 10202 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:15:36.049075 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:35.974988 13833 consensus_queue.cc:1243] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:36.050671 10202 pending_rounds.cc:85] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 5
I20260709 12:15:36.052219 10202 pending_rounds.cc:107] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:36.052575 10202 raft_consensus.cc:2889] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:36.055470 10195 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:35.976943 13816 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.060340 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:36.061456 10129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.059s
W20260709 12:15:36.061872 10129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.059s
I20260709 12:15:35.980516 13897 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.075888 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.037s
W20260709 12:15:36.078811 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.037s
I20260709 12:15:36.075776 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:36.080325 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:36.080631 10195 raft_consensus.cc:2410] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:36.048322 13721 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.050248 13733 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.080513 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 574010us
I20260709 12:15:36.087558 10202 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:36.072687 13816 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:36.122751 13873 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.151778 13861 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:36.171030 13861 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.171680 13917 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:36.173256 13918 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:36.144905 13912 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:15:36.083973 13914 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:36.090161 13733 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.214989 10737 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:36.216952 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:36.213404 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 408480us
I20260709 12:15:36.218741 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:36.205415 10125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.020s	sys 0.043s
I20260709 12:15:36.179280 13918 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:36.221589 10125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.020s	sys 0.043s
I20260709 12:15:36.219295 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.222803 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.223938 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.079519 13897 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:36.212450 13902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.020s
I20260709 12:15:36.177943 13914 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.173357 13861 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.144387 13915 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:36.249266 10047 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:36.226955 13869 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:36.256770 10047 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:15:36.241330 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 551450us
I20260709 12:15:36.233311 13716 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:36.226840 13870 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:36.287357 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:36.239497 13902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.020s
I20260709 12:15:36.240614 13822 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:36.292361 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:36.295151 10046 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:36.227386 13781 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:15:36.299875 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 208987us
I20260709 12:15:36.304988 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:36.243846 13721 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:15:36.310254 10046 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:36.343760 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:36.293026 13620 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:36.193326 13905 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.301954 13732 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:36.298389 13822 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.298449 13861 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:36.368242 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.368295 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:36.309295 13871 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.377010 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.378185 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.380455 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:36.386265 10702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.675s (SENT) [suppressed 24 similar messages]
I20260709 12:15:36.308754 13868 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:15:36.255164 13915 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.361186 13822 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:36.392889 13732 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:36.376164 13934 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.406723 13871 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:36.359997 13620 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.373633 13861 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.411487 13869 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:36.429286 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 177091us
I20260709 12:15:36.306373 13918 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.387890 13870 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:15:36.410205 13733 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.430037 13732 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:36.440539 13925 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:36.469262 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:36.469765 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:36.476580 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:36.478340 10046 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:15:36.501098 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 92054.1us
W20260709 12:15:36.468529 13890 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.192s	user 0.003s	sys 0.006s
W20260709 12:15:36.508168 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 194754us
I20260709 12:15:36.465118 13721 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:36.466041 13918 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:36.431556 13934 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.489276 13868 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:36.506821 13924 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.481568 13453 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:15:36.524501 13921 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:15:36.517488 13788 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.488742 13925 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.557854 13925 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.558620 13925 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:36.540493 13924 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.561591 13924 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.562500 10730 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:36.568300 13910 consensus_meta.cc:287] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.745s	user 0.004s	sys 0.004s
W20260709 12:15:36.552238 13932 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:15:36.537669 13939 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.550287 13316 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.614s	user 0.003s	sys 0.003s
I20260709 12:15:36.555498 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 600) took 1514 ms. Trace:
I20260709 12:15:36.555423 13944 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:36.576421 13858 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.576697 13942 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.495707 13935 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:15:36.580718 13874 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:36.537487 13929 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:15:36.581700 13923 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.582628 13934 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:36.607035 13873 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:36.539572 13945 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:36.676014 13923 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.598114 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 1994) took 1420 ms. Trace:
W20260709 12:15:36.613476 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 97155.5us
W20260709 12:15:36.611166 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 105136us
I20260709 12:15:36.614799 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:36.615792 10195 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:36.554033 13861 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.617791 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:36.681607 10197 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:36.616683 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:36.624112 10730 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:15:36.626588 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:36.528290 13721 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.600495 13788 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.539789 13914 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:36.647086 13795 consensus_meta.cc:287] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.002s
W20260709 12:15:36.551509 13922 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.001s
W20260709 12:15:36.646726 13938 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:15:36.683058 10730 pending_rounds.cc:85] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 7
I20260709 12:15:36.697338 10730 pending_rounds.cc:107] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:15:36.645938 13316 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.688299 10195 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:36.616806 10731 rpcz_store.cc:276] 0709 12:15:35.041148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.042841 (+  1693us) service_pool.cc:224] Handling call
0709 12:15:35.043155 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:35.043487 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.043514 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:35.043991 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:15:35.176094 (+132103us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:35.176137 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.176208 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:36.346286 (+1170078us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:36.555210 (+208924us) raft_consensus.cc:1685] finished
0709 12:15:36.555244 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:36.555437 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1326,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":50958592,"thread_start_us":131727,"threads_started":1,"wal-append.queue_time_us":232335}
I20260709 12:15:36.680393 10053 rpcz_store.cc:276] 0709 12:15:35.177531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.179612 (+  2081us) service_pool.cc:224] Handling call
0709 12:15:36.597893 (+1418281us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54003facd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:36.598047 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364808960}
I20260709 12:15:36.680892 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:36.692050 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1544) took 1077 ms. Trace:
I20260709 12:15:36.704355 10198 rpcz_store.cc:276] 0709 12:15:35.614266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.614373 (+   107us) service_pool.cc:224] Handling call
0709 12:15:35.614719 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:36.048765 (+434046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:36.048804 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:36.049233 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:15:36.292887 (+243654us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:36.292922 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.299149 (+  6227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:36.691860 (+392711us) raft_consensus.cc:1685] finished
0709 12:15:36.691878 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:36.691998 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95414,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":663807,"threads_started":2,"wal-append.queue_time_us":346064}
I20260709 12:15:36.710215 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:36.619128 13910 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:36.696457 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:36.715216 10201 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:36.648272 13877 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:15:36.697582 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.697646 10730 raft_consensus.cc:2889] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:36.717698 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 1993) took 1540 ms. Trace:
I20260709 12:15:36.718464 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 609) took 1100 ms. Trace:
I20260709 12:15:36.718941 10730 rpcz_store.cc:276] 0709 12:15:35.618512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.618958 (+   446us) service_pool.cc:224] Handling call
0709 12:15:35.681133 (+ 62175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:36.562057 (+880924us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5800835dd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4
0709 12:15:36.718186 (+156129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.718386 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755483904}
I20260709 12:15:36.684680 10203 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:36.647811 13874 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:36.719033 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 249322us
I20260709 12:15:36.711721 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:36.718116 10054 rpcz_store.cc:276] 0709 12:15:35.177269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.180403 (+  3134us) service_pool.cc:224] Handling call
0709 12:15:35.180674 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.213517 (+ 32843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.717447 (+1503930us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400309b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:36.717622 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35552128}
W20260709 12:15:36.722249 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 335994us
I20260709 12:15:36.739351 10123 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:36.648121 13942 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:36.697268 13816 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.002s
I20260709 12:15:36.644757 13939 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.740439 10124 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:15:36.678610 13873 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.750727 10200 raft_consensus.cc:2368] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10.
I20260709 12:15:36.750825 10204 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 8: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:36.768043 13943 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:15:36.770073 13748 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:15:36.770236 10049 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:36.772338 13612 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:36.772778 13612 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:36.773583 13612 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.774123 13915 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.747229 13951 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:36.720841 13453 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:36.727175 13431 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:15:36.647353 13944 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:36.824381 13957 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:15:36.735436 13610 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:15:37.019381 13949 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:36.861662 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 130523us
W20260709 12:15:36.942739 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47157.8us
W20260709 12:15:37.001259 10051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.010s
W20260709 12:15:37.059906 10051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.006s	sys 0.010s
I20260709 12:15:37.060642 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 528) took 1411 ms. Trace:
I20260709 12:15:37.060998 10051 rpcz_store.cc:276] 0709 12:15:35.649053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.797942 (+148889us) service_pool.cc:224] Handling call
0709 12:15:35.798210 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.798391 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:36.240512 (+442121us) log.cc:844] Serialized 14 byte log entry
0709 12:15:37.060302 (+819790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:37.060352 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:37.060393 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.060460 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.060581 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":682932,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":89178,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":1234741,"threads_started":3,"wal-append.queue_time_us":263982}
W20260709 12:15:36.975589 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 375446us
W20260709 12:15:36.872695 10196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.013s
W20260709 12:15:37.063766 10196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.004s	sys 0.019s
I20260709 12:15:37.065194 13949 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:37.016270 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 278415us
I20260709 12:15:36.722934 13806 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:15:36.913376 10730 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:15:37.067492 13949 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:36.947151 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:36.680230 13945 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.069428 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.071372 13945 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.696942 13795 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.070309 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.070621 13928 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:15:37.073451 13928 consensus_queue.cc:1243] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:15:37.074249 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.074338 13795 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:36.840031 13873 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.048789 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 604) took 1895 ms. Trace:
I20260709 12:15:37.075387 10734 rpcz_store.cc:276] 0709 12:15:35.153188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.153339 (+   151us) service_pool.cc:224] Handling call
0709 12:15:35.153594 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.213105 (+ 59511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.048532 (+1835427us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:37.048723 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135309056}
I20260709 12:15:37.076604 10737 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:37.047081 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:37.077175 13928 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:37.077626 10731 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:37.077906 13928 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:37.080807 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:37.050155 10052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 529) took 1400 ms (client timeout 1675 ms). Trace:
I20260709 12:15:37.005228 13674 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.082716 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.083408 13674 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:37.083381 10051 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:37.052390 13951 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:37.086366 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.086697 13951 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.089138 13951 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:37.082590 10052 rpcz_store.cc:269] 0709 12:15:35.649309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.720352 (+ 71043us) service_pool.cc:224] Handling call
0709 12:15:37.049983 (+1329631us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400275bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:37.050097 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417239808}
I20260709 12:15:37.023653 13901 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:37.096690 13901 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:36.833060 13944 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.046635 13649 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.100061 13897 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.057063 13867 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.101065 13867 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.103224 13867 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.979839 13788 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.942687 13729 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:36.819613 13881 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:37.012537 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.045009 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.024075 13316 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.018604 13721 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.075040 13718 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:36.790416 13816 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.003556 13923 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.993024 13861 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.007364 13910 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:36.978979 13874 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:36.826763 13939 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:36.844533 13871 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:36.975132 13858 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.129395 10731 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:36.818924 13453 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:36.830305 13942 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:37.149864 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 86478.9us
I20260709 12:15:37.055370 13956 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.157204 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1536) took 2041 ms. Trace:
W20260709 12:15:37.149931 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81761.1us
I20260709 12:15:36.831332 13822 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.100306 13649 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.158876 13718 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.158679 13949 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.138686 13881 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:37.137244 13729 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.175904 13718 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:37.163990 13861 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.175514 13901 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.169521 13858 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.190640 13490 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.200836 13933 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:37.173074 13956 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:37.206760 13893 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.999s	user 0.008s	sys 0.011s
I20260709 12:15:37.208961 13822 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.179562 13949 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.210893 13956 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.212347 13949 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.214187 13861 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.215790 13729 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.217574 13881 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.224756 13881 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:37.271819 10047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.112s	sys 0.147s
W20260709 12:15:37.272646 10047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.113s	sys 0.147s
W20260709 12:15:37.272281 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 196568us
I20260709 12:15:37.275365 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.279505 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 527) took 1630 ms. Trace:
I20260709 12:15:37.280025 10048 rpcz_store.cc:276] 0709 12:15:35.648808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.795252 (+146444us) service_pool.cc:224] Handling call
0709 12:15:35.795496 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:35.918536 (+123040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.918565 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:35.918605 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:35.918632 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.278882 (+1360250us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003f8ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:37.278966 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.279270 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282474368}
I20260709 12:15:37.142652 10054 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:15:37.286861 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.289281 10127 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:15:37.290405 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2287) took 1901 ms. Trace:
W20260709 12:15:37.291036 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:37.292877 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.286877 10055 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:37.313377 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.170006 10196 rpcz_store.cc:276] 0709 12:15:35.115730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.120442 (+  4712us) service_pool.cc:224] Handling call
0709 12:15:35.154297 (+ 33855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:35.154644 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.154672 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:35.155092 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:15:36.355097 (+1200005us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800324be0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:15:37.064178 (+709081us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:37.064447 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 12:15:37.154311 (+ 89864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.154402 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:37.156899 (+  2497us) raft_consensus.cc:1685] finished
0709 12:15:37.156982 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.157134 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99578,"prepare.queue_time_us":434,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":90870,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5253,"spinlock_wait_cycles":7758592,"thread_start_us":708867,"threads_started":1,"wal-append.queue_time_us":1891470}
I20260709 12:15:37.321444 10203 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 12:15:37.321877 10203 pending_rounds.cc:85] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 4
I20260709 12:15:37.323396 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.322268 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.324855 10201 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:37.325357 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.326965 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.327919 10728 raft_consensus.cc:2368] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:37.328820 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.329094 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.329568 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:37.330615 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.331250 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.331735 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.332489 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.333084 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.333688 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.335014 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:37.304006 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.322212 10203 pending_rounds.cc:107] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:15:37.308990 10129 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:15:37.332512 10728 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:37.342350 10203 raft_consensus.cc:2889] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:37.290920 10050 rpcz_store.cc:276] 0709 12:15:35.389311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.389749 (+   438us) service_pool.cc:224] Handling call
0709 12:15:35.390022 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:35.548862 (+158840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.289843 (+1740981us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003f1454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:37.290233 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355802880}
I20260709 12:15:37.300767 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.298732 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.303750 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:37.301522 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.298398 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.371809 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.371426 13316 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.376370 13729 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.376490 13910 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:37.377785 10201 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:37.377408 13729 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.378525 10126 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:37.379088 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.381366 13923 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:37.381731 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.382236 13918 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:37.376610 13861 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:37.382850 13858 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.383356 13861 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.383496 13966 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:37.384380 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55593.2us
I20260709 12:15:37.386005 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.387773 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 627) took 1194 ms. Trace:
I20260709 12:15:37.383859 13861 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.388273 10199 rpcz_store.cc:276] 0709 12:15:36.193702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.194008 (+   306us) service_pool.cc:224] Handling call
0709 12:15:36.200995 (+  6987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:36.423874 (+222879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:36.423910 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:36.423957 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:36.423988 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.387225 (+963237us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540007f654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:37.387297 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.387544 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512091008}
W20260709 12:15:37.390687 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1549) took 1755 ms (client timeout 1503 ms). Trace:
I20260709 12:15:37.391054 10168 leader_election.cc:400] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:37.391399 10168 leader_election.cc:403] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:37.391436 13934 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.391903 13897 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:37.392199 13934 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.392642 13897 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:37.390189 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.387729 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.373703 13822 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:37.395140 10200 rpcz_store.cc:269] 0709 12:15:35.634975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.635357 (+   382us) service_pool.cc:224] Handling call
0709 12:15:37.390120 (+1754763us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:37.390490 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562715392}
I20260709 12:15:37.384330 13966 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.418910 13934 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.383011 13918 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.420701 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.421720 13316 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.422102 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:37.194792 13453 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.377328 13910 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:37.411887 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44449.7us
I20260709 12:15:37.428536 10197 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:37.425854 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.440279 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.443135 13905 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:37.443779 13905 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.444802 13620 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.445003 10735 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:15:37.446687 13989 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:15:37.418001 10198 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:37.423079 10201 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:37.427266 10200 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:37.430892 13923 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:37.422372 13918 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.443694 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.424490 13942 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:15:37.430765 13822 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.430384 13540 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:37.440747 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.374941 13782 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.463699 10130 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:15:37.464094 10130 pending_rounds.cc:85] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 8
I20260709 12:15:37.464352 10130 pending_rounds.cc:107] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:15:37.464622 10130 raft_consensus.cc:2889] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:37.449859 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.451937 10203 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
W20260709 12:15:37.467217 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 168765us
I20260709 12:15:37.430648 13649 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.470610 13868 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.470767 13185 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:37.452294 13729 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.471696 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.479445 10197 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:37.427484 13610 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:37.450675 13923 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.473671 13918 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:37.478803 13185 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.483578 13185 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:37.476326 13951 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.477110 13868 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.449097 13966 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.474161 13822 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.482800 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:37.502099 13907 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:37.502667 13907 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:37.503858 13907 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:37.505565 13936 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.999s	user 0.003s	sys 0.000s
I20260709 12:15:37.457952 13540 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:37.486007 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.507519 13540 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.508395 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.509230 13540 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:37.510645 13966 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:37.511125 13966 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.511281 10055 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:37.487234 13965 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:37.512109 13965 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:37.512526 13942 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:37.514032 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:37.514987 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.514317 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.517230 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.489346 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.481590 13782 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.492959 13316 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.457554 13967 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.493994 13729 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:37.494923 13833 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:37.495875 13910 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:37.489377 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98612.2us
W20260709 12:15:37.497889 13919 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.205s	user 0.003s	sys 0.000s
I20260709 12:15:37.489382 13868 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.499317 13918 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.548389 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 567) took 2064 ms. Trace:
I20260709 12:15:37.500216 13610 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.548566 13718 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.548825 10125 rpcz_store.cc:276] 0709 12:15:35.484426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.484546 (+   120us) service_pool.cc:224] Handling call
0709 12:15:35.520628 (+ 36082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:35.520970 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:35.521001 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:35.523890 (+  2889us) log.cc:844] Serialized 26 byte log entry
0709 12:15:36.221972 (+698082us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:36.222010 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:36.222074 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:37.496936 (+1274862us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:37.547888 (+ 50952us) raft_consensus.cc:1685] finished
0709 12:15:37.547914 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.548188 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1218,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8384,"spinlock_wait_cycles":4609280,"thread_start_us":697804,"threads_started":1,"wal-append.queue_time_us":710130}
I20260709 12:15:37.490128 13781 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:37.511554 13966 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:37.550812 13610 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.486687 13951 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.546280 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.552778 13951 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.518447 13831 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.522010 13967 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.424141 13973 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:15:37.482287 13905 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.513619 13965 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.548022 13918 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.516031 10052 raft_consensus.cc:2368] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
I20260709 12:15:37.548949 10195 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:37.567263 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.554173 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.568027 13910 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:37.589286 13967 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.591079 13788 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:37.591519 13788 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.591878 13788 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:37.592252 13718 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:37.592706 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.583221 13910 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.568995 13861 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.585167 13833 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.600394 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:37.640453 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.636098 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.603078 10197 pending_rounds.cc:85] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 3
I20260709 12:15:37.653918 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:37.654843 10197 pending_rounds.cc:107] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:15:37.655344 10197 raft_consensus.cc:2889] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:37.660020 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:37.664237 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 76668.6us
I20260709 12:15:37.665973 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.697854 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:37.673210 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.674793 13610 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:37.675428 10126 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:37.593593 13831 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.678448 10123 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:15:37.601956 13897 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.685166 13816 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.685745 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.688309 13729 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.724948 13729 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.726099 13831 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.661716 13881 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:37.691512 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1545) took 2076 ms (client timeout 2680 ms). Trace:
W20260709 12:15:37.727500 10204 rpcz_store.cc:269] 0709 12:15:35.615296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.615948 (+   652us) service_pool.cc:224] Handling call
0709 12:15:37.691117 (+2075169us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540007ec54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:37.691320 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607525120}
I20260709 12:15:37.728215 10121 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:37.693960 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.729229 10122 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:37.729403 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.730017 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.694792 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.695606 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:37.696318 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:37.697098 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.603555 13910 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:37.679912 13918 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:37.718601 10128 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:37.720257 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.645866 13185 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.730018 10121 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:37.734970 10046 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 8: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:37.737528 13966 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.738395 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.739382 13610 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.749581 13610 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:37.752048 13997 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:15:37.754539 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 231009us
I20260709 12:15:37.740447 13861 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.741039 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.746605 13185 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.747319 13966 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.767704 13790 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.767902 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.769142 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1604) took 1028 ms. Trace:
I20260709 12:15:37.769546 10124 rpcz_store.cc:276] 0709 12:15:36.740955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.692170 (+951215us) service_pool.cc:224] Handling call
0709 12:15:37.769072 (+ 76902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:37.722586 13788 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.772035 10202 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:37.772636 10055 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:37.773157 10204 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:37.774896 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:37.775596 13783 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.776207 13783 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.768425 13790 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.780494 13790 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.781987 13729 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:37.782549 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 116732us
I20260709 12:15:37.783098 13897 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:37.772195 13788 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.783555 13897 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.783988 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.783092 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 576) took 1046 ms. Trace:
I20260709 12:15:37.785602 10127 rpcz_store.cc:276] 0709 12:15:36.736634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.738398 (+  1764us) service_pool.cc:224] Handling call
0709 12:15:37.288475 (+550077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:37.289918 (+  1443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.782880 (+492962us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54002107d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:37.783031 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264059136}
I20260709 12:15:37.790606 10053 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:37.786027 10737 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:37.783993 13897 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:37.799039 10055 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:37.800875 10128 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:37.804768 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.809087 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:37.727574 13881 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:37.817780 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 263475us
I20260709 12:15:37.819980 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.803262 13729 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:37.821743 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:37.822257 13861 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:37.815353 13966 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:15:37.823503 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.826283 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.830137 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.835330 10126 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:37.835572 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.826637 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:37.836220 10055 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:37.842862 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:37.843773 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.829947 13906 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.796295 13833 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.845095 13816 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:37.856189 13816 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.856688 13816 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:37.862845 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.870029 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.872803 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.873433 10199 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:37.877815 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.879650 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.880151 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.856321 13783 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.883459 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.884151 10121 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:37.884444 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.885350 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.887437 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.881479 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.852286 13729 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.898698 13905 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:37.874315 13831 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:37.901055 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.890909 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.875695 13994 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:15:37.902917 13861 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:37.903685 13431 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:37.913226 10733 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:15:37.906610 10055 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:37.907572 13881 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:37.910588 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84447.9us
I20260709 12:15:37.910418 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.912410 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:37.860884 13906 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.920126 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.920779 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:37.946924 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 88435.2us
I20260709 12:15:37.948340 13612 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:37.952157 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.952399 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:37.948422 13967 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:15:37.955121 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:37.956636 13713 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.957307 13713 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:37.945282 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:37.971189 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50145.2us
I20260709 12:15:37.920436 13965 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:37.972908 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.977768 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:37.978336 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.978629 10200 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:37.980683 13490 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:37.981763 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:37.983547 13729 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:37.985766 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:37.987649 13906 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.988397 13645 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:37.989091 13645 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:37.990516 10196 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:37.991652 13897 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.993813 13897 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.919996 13831 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:37.996017 13831 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:37.972754 13965 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:37.998387 10094 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:38.004521 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:38.004948 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.998579 10199 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:38.005841 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:37.974529 13881 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:15:38.007766 13861 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:38.008157 13861 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:37.977463 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.008536 13861 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:38.009393 13933 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:38.011096 13933 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:38.011461 13933 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:38.011845 13933 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:38.012516 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.015254 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:38.015501 13994 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:37.999346 13867 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:15:37.999352 13967 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:15:37.999475 13951 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:15:38.025293 13490 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.026202 13967 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:37.977912 13713 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.026858 13967 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.004769 13905 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:38.028005 13905 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.028350 13905 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:38.028944 13967 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.025866 13490 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.033154 13490 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.002843 13965 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:38.034585 13816 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.036064 10196 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:38.037586 13816 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.016819 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.065196 13897 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:38.030095 13861 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.044123 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.066172 10128 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:38.068626 13782 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.045399 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.009315 13781 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:38.072309 13781 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.072671 13781 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:38.046540 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:38.074061 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58885us
I20260709 12:15:38.051728 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:38.065384 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48653.5us
I20260709 12:15:38.052260 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.052407 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.052940 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:38.053287 10735 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:38.053586 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.055591 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.081353 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.059396 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.060474 13713 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.061543 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:38.074144 10125 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:38.051429 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.291218 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:38.292541 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 269432us
I20260709 12:15:38.290879 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.281225 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.278195 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.291610 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.292052 10050 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
W20260709 12:15:38.142069 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75664.2us
I20260709 12:15:38.302798 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:38.142025 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88023.5us
I20260709 12:15:38.156224 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.144860 10128 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:38.305579 10729 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:15:38.270714 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 149146us
I20260709 12:15:38.320791 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.326087 10126 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:38.326371 10731 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:15:38.332368 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.337083 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.270529 13907 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:38.343331 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.312759 13540 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:38.270895 13868 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:38.356153 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:38.339365 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:38.358845 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 236102us
W20260709 12:15:38.362725 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 64327.7us
I20260709 12:15:38.363201 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:38.363400 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:38.276062 13729 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:38.365118 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:38.367172 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.156724 13782 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.188s
I20260709 12:15:38.364090 10046 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:38.138931 13910 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.367725 10735 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:15:38.176035 13965 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.373837 10123 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:38.331036 13612 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:38.346688 13906 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:38.380306 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:38.368019 13868 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.374588 13897 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:15:38.384905 13788 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:38.338403 13713 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.342378  9951 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 8, term changed from 11 to 12, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to <none>, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:15:38.399860 14006 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:15:38.401010 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:38.400926 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.410037 10730 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:38.384508 13951 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:38.421169 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 94142.2us
I20260709 12:15:38.386245 13540 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:38.401224 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:38.417719 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:38.399957 13999 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.466s	user 0.001s	sys 0.001s
W20260709 12:15:38.423957 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 61190.7us
I20260709 12:15:38.373574 13905 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.357048 13833 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.424743 10204 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:38.404371 14007 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
I20260709 12:15:38.437402 13185 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:38.393953 10127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:15:38.403682 13906 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.439427 10702 leader_election.cc:400] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
I20260709 12:15:38.439738 10702 leader_election.cc:403] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:38.440371 13910 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.440680 13906 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.441541 13790 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:38.443533 13905 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.444432 13540 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.445864 13431 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.446319 13431 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.446771 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.448414 13431 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.450085 13713 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.406291 13868 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.420694 13490 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:38.451718 13490 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.452498 13861 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.453675 13490 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.398669 13612 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:38.424431 10122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.008s	sys 0.029s
I20260709 12:15:38.457870 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:38.458166 10122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.008s	sys 0.029s
I20260709 12:15:38.458715 10195 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:38.460134 10126 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:38.446283 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1563) took 1113 ms. Trace:
I20260709 12:15:38.461158 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:38.461452 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.462968 10729 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:38.454180 13490 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:38.427320 13951 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:38.461158 10201 rpcz_store.cc:276] 0709 12:15:37.333159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.538852 (+205693us) service_pool.cc:224] Handling call
0709 12:15:37.539224 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:37.539700 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:37.539728 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:37.540421 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:15:37.633413 (+ 92992us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:37.633449 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.633511 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.446095 (+812584us) raft_consensus.cc:1685] finished
0709 12:15:38.446116 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.446231 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3179,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"thread_start_us":92590,"threads_started":1,"wal-append.queue_time_us":219561}
I20260709 12:15:38.469074 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:38.433089 13867 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:38.430712 13781 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.471333 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:38.481055 10729 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:38.482657 10195 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:38.427239 13897 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:15:38.487020 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:38.488817 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:38.486526 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1562) took 1153 ms. Trace:
I20260709 12:15:38.464819 13923 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
I20260709 12:15:38.490756 10197 rpcz_store.cc:276] 0709 12:15:37.332847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.480078 (+147231us) service_pool.cc:224] Handling call
0709 12:15:37.518752 (+ 38674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:37.724757 (+206005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:37.724789 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:37.725393 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:15:37.853290 (+127897us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:37.853333 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.000149 (+146816us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b54003133d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:38.000227 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.475265 (+475038us) raft_consensus.cc:1685] finished
0709 12:15:38.475285 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.486449 (+ 11164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":33087,"spinlock_wait_cycles":173007232,"thread_start_us":127535,"threads_started":1,"wal-append.queue_time_us":193139}
I20260709 12:15:38.475569 13490 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.497841 13490 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.469316 13788 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:38.477807 13951 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:38.500303 10053 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:15:38.474706 13674 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:38.450546 13928 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:15:38.527420 13781 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.529039 13612 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:38.511091 13788 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:38.530695 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:38.530467 13788 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:38.540781 13833 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:38.541680 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.544607 13966 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:38.545042 13966 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:38.548679 10203 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:15:38.398485 13729 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.545925 13966 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:38.569300 13933 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.004s
I20260709 12:15:38.580302 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.581499 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:38.582653 13612 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:38.583233 13612 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.585232 13612 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.585915 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.570499 13816 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:38.588380 13966 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:38.601970 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.599561 13713 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:38.605487 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.606673 13645 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:38.614549 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.589967 13933 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.609396 13790 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:38.618319 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.606845 13713 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:38.627166 13951 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:38.629876 10127 raft_consensus.cc:606] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.630283 10127 raft_consensus.cc:614] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:38.612949 13965 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.632921 10198 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:38.635104 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.635367 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:38.636168 10126 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:38.640556 10053 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:38.642236 10055 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:38.645605 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.648135 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.648756 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.651173 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.630030 13713 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:38.657332 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.652333 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.650235 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.651835 10054 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:38.629379 13951 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.655946 10052 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:38.662976 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:38.653661 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:38.707065 10730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:15:38.707803 10730 raft_consensus.cc:606] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:38.708159 10730 raft_consensus.cc:614] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:38.713402  9951 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 7, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:38.715224  9951 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 9, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:38.717551  9951 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 8, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 8 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.640625 13612 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:38.737005 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.737672 13933 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:38.742834 13729 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:38.751410 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 69065.6us
I20260709 12:15:38.775055 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.776007 10198 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:15:38.684238 13928 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:38.784116 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:38.786190 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.790946 13453 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.791567 10050 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:38.784463 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:38.784754 13861 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:38.793970 13612 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:38.808756 13814 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.014s	sys 0.052s
I20260709 12:15:38.791648 13453 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.811882 13868 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:38.811689 13906 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:38.841811 10729 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:38.851368 13868 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.854051 13868 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:38.855289 13906 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:38.829531 13951 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:38.859699 13453 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:38.833117 13814 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.015s	sys 0.052s
W20260709 12:15:38.961651 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:39.012013 14015 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:15:39.076467 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.011s
W20260709 12:15:39.078871 10199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.001s	sys 0.014s
W20260709 12:15:39.079190 10199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.014s
W20260709 12:15:39.081387 10202 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.006s	sys 0.010s
W20260709 12:15:39.081787 10202 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.006s	sys 0.010s
W20260709 12:15:39.076830 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.004s	sys 0.011s
W20260709 12:15:39.083685 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 648470us
W20260709 12:15:39.085073 10196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.004s	sys 0.012s
W20260709 12:15:39.086455 10196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.004s	sys 0.012s
W20260709 12:15:39.055488 13185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.020s	sys 0.027s
W20260709 12:15:39.089367 10197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.014s	sys 0.008s
W20260709 12:15:39.090732 10197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.008s
W20260709 12:15:39.091110 13185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.021s	sys 0.027s
W20260709 12:15:39.092082 13905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.018s	sys 0.035s
W20260709 12:15:39.098188 10129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.016s	sys 0.037s
W20260709 12:15:39.100025 10129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.016s	sys 0.037s
I20260709 12:15:39.096692 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:39.104445 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:39.097433 13867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.027s	sys 0.026s
W20260709 12:15:39.112334 10701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.031s
I20260709 12:15:39.077109 13951 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:39.129037 10701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.031s
W20260709 12:15:39.098747 13718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.030s	sys 0.046s
W20260709 12:15:39.099740 13905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.019s	sys 0.035s
W20260709 12:15:39.136725 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 528535us
W20260709 12:15:39.103480 13897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.011s
I20260709 12:15:39.098652 13185 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:39.125113 13831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.021s	sys 0.026s
W20260709 12:15:39.231755 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.001s	sys 0.011s
W20260709 12:15:39.178709 13967 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.018s
W20260709 12:15:39.137317 13867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.028s	sys 0.026s
W20260709 12:15:39.236464 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.001s	sys 0.011s
W20260709 12:15:39.223388 13718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.030s	sys 0.046s
I20260709 12:15:39.238372 13955 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:39.231575 13897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.008s	sys 0.011s
W20260709 12:15:39.236315 13831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.022s	sys 0.026s
W20260709 12:15:39.245767 10203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.001s	sys 0.013s
W20260709 12:15:39.247352 10195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.007s	sys 0.007s
W20260709 12:15:39.237540 13967 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.012s	sys 0.018s
W20260709 12:15:39.249717 10195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.007s	sys 0.007s
I20260709 12:15:39.248698 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:39.249677 10203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.013s
W20260709 12:15:39.245610 13781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.008s
I20260709 12:15:39.258823 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.238456 13939 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:39.275252 10201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.004s	sys 0.031s
I20260709 12:15:39.255429 13955 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.276546 14025 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.277424 13897 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:39.277273 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:39.278276 10737 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:39.254616 13540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.014s
W20260709 12:15:39.280100 10201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.005s	sys 0.031s
I20260709 12:15:39.254822 13942 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:39.260739 13781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.005s	sys 0.008s
I20260709 12:15:39.286170 13942 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:39.284291 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 179908us
I20260709 12:15:39.290993 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:39.258551 13867 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.288760 13942 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:39.294579 13540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.015s
I20260709 12:15:39.296633 13939 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.290607 13185 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.310776 13939 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.311338 13939 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:39.359509 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 267601us
W20260709 12:15:39.365747 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67884us
W20260709 12:15:39.368804 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 61448.2us
I20260709 12:15:39.297410 13923 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.302102 14036 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:39.306137 14032 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.362192 13868 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:39.385653 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1993) took 1090 ms. Trace:
I20260709 12:15:39.402057 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:39.403110 10127 raft_consensus.cc:2410] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:15:39.406919 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:39.384848 13782 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.421036 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:39.418671 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:39.420851 10123 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:15:39.424060 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:39.363920 13867 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.425874 10121 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:39.426221 10124 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:15:39.395457 10202 rpcz_store.cc:276] 0709 12:15:38.295185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.295301 (+   116us) service_pool.cc:224] Handling call
0709 12:15:38.320955 (+ 25654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.354062 (+ 33107us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:39.082167 (+728105us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.384301 (+302134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:39.384509 (+   208us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:39.385026 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.385234 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.385524 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161724,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":966187,"threads_started":2}
I20260709 12:15:39.404012 13788 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.439906 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1573) took 1107 ms. Trace:
I20260709 12:15:39.386945 13923 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.443382 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:39.443732 14045 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.306272 14025 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.417071 13905 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:15:39.453855 14030 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:15:39.454814 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:39.403626 14032 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.440487 10196 rpcz_store.cc:276] 0709 12:15:38.332436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.333024 (+   588us) service_pool.cc:224] Handling call
0709 12:15:38.343026 (+ 10002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.394722 (+ 51696us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:39.086841 (+692119us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.439277 (+352436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:39.439387 (+   110us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:39.439474 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.439739 (+   265us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.439854 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9816,"prepare.queue_time_us":130512,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":977427,"threads_started":2}
I20260709 12:15:39.440775 13816 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.443899 13788 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.441500 13831 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:39.476328 13831 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.478920 13831 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.472455 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:39.475597 13713 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.813s	user 0.004s	sys 0.007s
I20260709 12:15:39.480657 13831 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:15:39.470789 14027 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:15:39.437474 13782 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.482117 13831 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:39.484807 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:39.485092 13966 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.878s	user 0.003s	sys 0.007s
I20260709 12:15:39.485720 13185 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.521317 13185 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.488988 13816 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.524996 13816 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.541502 14052 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.541738 13923 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.488672 13951 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.542897 14052 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.543362 13955 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.517907 13831 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:39.518307 14046 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:39.545032 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1579) took 1088 ms. Trace:
I20260709 12:15:39.518297 14022 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:39.519116 13867 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.488735 14032 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.545301 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.460579 14045 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.546492 10733 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:39.545499 10203 rpcz_store.cc:276] 0709 12:15:38.456556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.560461 (+103905us) service_pool.cc:224] Handling call
0709 12:15:38.560807 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.564244 (+  3437us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:15:38.592030 (+ 27786us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.256725 (+664695us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:39.259489 (+  2764us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.259961 (+   472us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:39.260028 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.260173 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.544822 (+284649us) raft_consensus.cc:1685] finished
0709 12:15:39.544844 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.544975 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23038,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":60022,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":7218,"thread_start_us":644985,"threads_started":1,"wal-append.queue_time_us":763491}
I20260709 12:15:39.547464 14052 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.544121 13782 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.548676 14052 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.549599 14052 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.519022 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:39.555392 14021 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:39.546651 14022 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.556339 14022 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:39.557054 13867 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.557700 13867 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.558785 13955 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:39.559866 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.560118 13867 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.555773 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:39.563498 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:39.563514 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.565819 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2004) took 1129 ms. Trace:
I20260709 12:15:39.567165 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:39.566368 10201 rpcz_store.cc:276] 0709 12:15:38.436290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.559900 (+123610us) service_pool.cc:224] Handling call
0709 12:15:38.568727 (+  8827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.589861 (+ 21134us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:38.602652 (+ 12791us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.366390 (+763738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:39.381394 (+ 15004us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.381550 (+   156us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:39.381585 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.381660 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.565638 (+183978us) raft_consensus.cc:1685] finished
0709 12:15:39.565656 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.565767 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1604,"prepare.queue_time_us":15624,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1353,"raft.queue_time_us":33113,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":11898,"thread_start_us":747382,"threads_started":2,"wal-append.queue_time_us":950720}
I20260709 12:15:39.565788 13788 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.568969 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.562276 13185 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.565754 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:39.570045 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 595) took 1126 ms. Trace:
I20260709 12:15:39.469928 14025 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.570547 14052 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:39.482184 13713 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.548503 14045 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.575634 13910 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:39.566136 14047 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:39.577600 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 652) took 1553 ms. Trace:
W20260709 12:15:39.583840 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 799757us
W20260709 12:15:39.586018 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 216440us
I20260709 12:15:39.586759 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:39.585734 13185 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:39.585541 10129 rpcz_store.cc:276] 0709 12:15:38.443487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.456078 (+ 12591us) service_pool.cc:224] Handling call
0709 12:15:38.471090 (+ 15012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.471448 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.471475 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:38.479815 (+  8340us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.101284 (+621469us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:39.101324 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.101386 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.569819 (+468433us) raft_consensus.cc:1685] finished
0709 12:15:39.569852 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.569989 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18356,"raft.queue_time_us":6724,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2385,"thread_start_us":604056,"threads_started":1,"wal-append.queue_time_us":1071395}
I20260709 12:15:39.591698 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:39.594626 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.595359 10729 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:39.594626 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:39.590114 10199 rpcz_store.cc:276] 0709 12:15:38.023916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.024297 (+   381us) service_pool.cc:224] Handling call
0709 12:15:38.024569 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.342731 (+318162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.342761 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:38.369061 (+ 26300us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.079535 (+710474us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:39.079578 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.079644 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.576759 (+497115us) raft_consensus.cc:1685] finished
0709 12:15:39.576779 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.577540 (+   761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301163,"raft.queue_time_us":295802,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11829,"thread_start_us":659323,"threads_started":1,"wal-append.queue_time_us":1080218}
I20260709 12:15:39.597836 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.589501 13910 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:39.601079 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.601576 13910 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:39.601760 13814 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:39.603339 10733 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:15:39.601878 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:39.605633 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 1994) took 1242 ms. Trace:
I20260709 12:15:39.606549 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:39.596529 13955 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:39.606954 10195 rpcz_store.cc:276] 0709 12:15:38.363312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.493714 (+130402us) service_pool.cc:224] Handling call
0709 12:15:38.499564 (+  5850us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:38.505737 (+  6173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:39.256506 (+750769us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.586489 (+329983us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:39.596555 (+ 10066us) log.cc:844] Serialized 52 byte log entry
0709 12:15:39.596818 (+   263us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:39.597153 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:15:39.605098 (+  7945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.605191 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.605230 (+    39us) raft_consensus.cc:1685] finished
0709 12:15:39.605242 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.605580 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3808,"prepare.queue_time_us":19922,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":14147,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":8281,"thread_start_us":1014439,"threads_started":2,"wal-append.queue_time_us":293671}
I20260709 12:15:39.604029 14022 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.609817 14057 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:39.599881 14052 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:39.600157 14050 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:39.605826 14044 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.618775 14057 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.621771 14057 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:39.622609 13713 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.624241 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:39.619060 14052 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.629377 14052 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.619755 14044 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.631880 14044 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.633025 13831 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:39.633694 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.000s	sys 0.059s
I20260709 12:15:39.634804 14045 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:39.635506 13713 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:39.631518 14057 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.648821 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.650121 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.638103 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:39.639789 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:39.634897 10129 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 12:15:39.638453 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.643191 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.347777 10203 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:40.348958 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.349562 10203 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:39.646248 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:39.641966 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:40.375250 10199 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:39.647951 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.615991 14055 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:15:39.618572 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.380872 10051 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:40.381865 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.383035 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:40.383212 10737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.008s	sys 0.013s
W20260709 12:15:40.383589 10737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.008s	sys 0.013s
I20260709 12:15:39.660573 14045 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.386926 14045 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:39.660279 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.000s	sys 0.061s
I20260709 12:15:39.597437 13942 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.389734 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.663272 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.391286 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.391863 10046 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:40.392691 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.665160 14057 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.393697 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.687726 13816 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:39.710080 14060 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.394680 13816 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.394802 14060 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:39.710129 14052 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.396812 13816 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.715219 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.397819 10122 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:39.756506 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.398691 10053 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:40.399518 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.400247 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2324) took 1010 ms. Trace:
I20260709 12:15:39.757603 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.774420 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.400923 14052 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.402891 14052 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.403079 10050 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:39.777421 13871 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:40.404477 13871 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:40.405308 13871 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.406572 13871 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:40.407123  9951 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.785843 10195 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:15:39.791338 10204 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:40.409582 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2005) took 1120 ms. Trace:
I20260709 12:15:40.409644 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.805982 13939 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.410642 13939 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.412758 13939 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:40.410339 10195 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
W20260709 12:15:39.811741 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1576) took 1452 ms (client timeout 1503 ms). Trace:
W20260709 12:15:40.413579 10200 rpcz_store.cc:269] 0709 12:15:38.358846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.384791 (+ 25945us) service_pool.cc:224] Handling call
0709 12:15:39.811511 (+1426720us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:39.811668 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030815488}
I20260709 12:15:40.413934 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.414606 10195 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:40.414846 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:39.823529 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.416404 10202 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:40.417585 10202 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:39.829182 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.396832 14060 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:39.832568 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:39.833021 14064 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.833575 14063 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.400661 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.420498 10053 raft_consensus.cc:2410] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:15:40.420066 14063 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.412940 13942 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.844734 13907 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:40.422706 13907 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.424185 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.424836 13907 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:39.871950 13814 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.425550 13814 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:39.660729 13713 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:40.419607 10055 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:15:40.427167 13713 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.428687 10055 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:39.925735 13868 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.950155 14017 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.981462 13867 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:39.656446 14022 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.072153 13933 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:40.430810 13868 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.430886 14017 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.431740 10121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:47016
I20260709 12:15:40.431632 13933 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.432304 10121 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.432657 10121 raft_consensus.cc:614] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:40.432997 13868 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:40.133041 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.433640 13933 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:40.112934 14025 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:40.409157 10128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.005s	sys 0.012s
I20260709 12:15:40.193478 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.435324 10047 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:40.224117 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.230458 14067 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:40.237134 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2039) took 1491 ms. Trace:
I20260709 12:15:40.440438 14067 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.440378 10048 rpcz_store.cc:276] 0709 12:15:38.745658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.780022 (+ 34364us) service_pool.cc:224] Handling call
0709 12:15:38.784822 (+  4800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.785176 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.785204 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:38.791102 (+  5898us) log.cc:844] Serialized 26 byte log entry
0709 12:15:40.224233 (+1433131us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180045be00. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:15:40.231492 (+  7259us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:40.232061 (+   569us) log.cc:844] Serialized 14 byte log entry
0709 12:15:40.232299 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.232383 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:40.236869 (+  4486us) raft_consensus.cc:1685] finished
0709 12:15:40.236950 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:40.237074 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":6025,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":3631,"spinlock_wait_cycles":6963584,"thread_start_us":7047,"threads_started":1,"wal-append.queue_time_us":1443381}
I20260709 12:15:40.442054  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:39.662142 13831 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:40.288020 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:40.443562 10735 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.444024  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:40.445082  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:40.291055 13910 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.005s
I20260709 12:15:40.302870 14073 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.446741 13910 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.446887 14073 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.306732 13645 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.317139 13718 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.448941 13910 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:40.449390 13718 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.450246 10201 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:40.448990 14073 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:40.451638 13718 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.322130 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.418992 10198 raft_consensus.cc:2410] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:15:40.452720 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 130812us
W20260709 12:15:40.434984 10128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.005s	sys 0.013s
I20260709 12:15:40.453900 13453 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:40.328538 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:40.327913 13781 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:15:40.339442 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 92303.7us
I20260709 12:15:40.455476 13781 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:40.455821 13781 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:40.456542 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.450717 14064 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.457755 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:40.350410 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.458830 14064 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.458942 14057 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:40.356834 13748 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.459496 14057 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.457787 10054 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:15:40.459939 14057 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.460569 13814 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.357751 14066 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.461714 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2325) took 1064 ms. Trace:
I20260709 12:15:40.461524 14066 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.357273 13185 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:40.409955 10204 rpcz_store.cc:276] 0709 12:15:39.289672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.638206 (+348534us) service_pool.cc:224] Handling call
0709 12:15:40.409529 (+771323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:40.362231 13906 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:40.456665 13781 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.362599 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.374778 10196 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:40.388274 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 2.02027e+06us
I20260709 12:15:40.463682 10124 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:40.463831 13748 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.465271 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:40.465984 13748 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.409135  9951 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 9 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.367323 14042 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:40.466822 14042 consensus_queue.cc:1243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:15:39.926295 13897 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:39.620177 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.434325 14025 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.467890 14066 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.467703 13897 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.466022 13674 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:40.468686 13674 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:40.468106 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 847946us
I20260709 12:15:40.469138 14025 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.469662 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.175207 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.470568 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.246341 14069 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.468698 14036 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:40.471465 13674 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:40.470762 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.471589 14069 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.472548 14022 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:40.232470 13965 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:40.449335 13645 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.473836 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.474061 14069 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.462081 10054 rpcz_store.cc:276] 0709 12:15:39.397089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.757346 (+360257us) service_pool.cc:224] Handling call
0709 12:15:40.461529 (+704183us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400276ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:40.461658 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122182528}
I20260709 12:15:40.476174 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.434654 10055 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:40.462694 13185 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.467329  9951 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:40.430997 13867 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.331712 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.474973 13781 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:40.400658 10052 rpcz_store.cc:276] 0709 12:15:39.389372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.738556 (+349184us) service_pool.cc:224] Handling call
0709 12:15:39.738958 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.398200 (+659242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:40.398228 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:40.398282 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:40.398310 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.400025 (+  1715us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400087354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:40.400065 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:40.400173 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515669760}
I20260709 12:15:40.353271 14071 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:40.364022 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.486210 10127 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:40.479887 10130 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:40.479924 10203 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:40.471300 14036 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:40.471210 13933 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:40.511808 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:40.469728 13897 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.484218 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.483188 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.483938 13994 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:40.468405 14066 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:40.491297 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:40.422343 14063 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.491835 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.508088 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.561077 10200 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:15:40.510509 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.511708 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.480687 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.468855 13905 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:15:40.480770 14069 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:40.476464 13718 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:15:40.563454 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:40.514756 10199 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:15:40.552234 13185 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:40.551657 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 181307us
I20260709 12:15:40.554078 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.555018 13645 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:40.510978 14036 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.555814  9951 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:40.557158 10202 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:40.471276 13967 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:15:40.491662 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.561803 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.433004 14017 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.564400 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.564251 10196 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:40.587441 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.572373 10203 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:40.480854 13942 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:15:40.573575 10729 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:40.586018 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.574105 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:40.463562 14067 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:40.575866 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.491097 13748 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:40.594413 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:40.594261 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 102660us
I20260709 12:15:40.590788 10201 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:40.593711 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.608536 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.558912 13994 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:40.595515 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 104298us
I20260709 12:15:40.603384 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:40.617708 10199 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:40.577474  9951 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 10, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 10 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:40.604903 13185 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:40.613548 10735 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:40.616431 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.511440 13910 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:15:40.618726 10200 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:40.618942 10047 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:40.644228 10734 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:40.644153 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.620131 10203 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:15:40.645342 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2326) took 1247 ms. Trace:
I20260709 12:15:40.645051 10202 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:40.651160 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:40.653353 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 289435us
I20260709 12:15:40.586879 14084 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:40.649127 10047 rpcz_store.cc:276] 0709 12:15:39.397482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.193129 (+795647us) service_pool.cc:224] Handling call
0709 12:15:40.645287 (+452158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:40.647095  9951 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 5 to 10, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 10 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:40.669490 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:40.619148 10019 connection.cc:256] RPC call timeout handler was delayed by -1.0581024539999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:15:40.671353 10019 connection.cc:256] RPC call timeout handler was delayed by -1.0392024539999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 12:15:40.669586 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.671465 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.671803 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:40.668318 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.672459 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.672739 10055 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:40.677075 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.677845 10055 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:40.499631 14071 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.618345 13906 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:40.700663 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.701689 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.681243 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.702697 10052 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:40.619813 13994 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.643661 14060 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.693140 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.693434 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.694336 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.700320  9951 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 7, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:15:40.704648 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50351.1us
I20260709 12:15:40.614627 13897 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:40.692057 10046 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:40.665445 13814 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:40.618525 14025 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:15:40.690994 13868 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:40.733650 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:40.735020 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:40.686260 10076 debug-util.cc:398] Leaking SignalData structure 0x7b080011e640 after lost signal to thread 8910
I20260709 12:15:40.753258 10055 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:40.738513 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:40.753835 10076 debug-util.cc:398] Leaking SignalData structure 0x7b080011cf20 after lost signal to thread 9987
I20260709 12:15:40.739562 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.755051 10199 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:40.703541 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 131768us
I20260709 12:15:40.732518 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:40.705924 13871 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.751462 10054 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:40.750106 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:40.700296 14066 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:40.755112 10076 debug-util.cc:398] Leaking SignalData structure 0x7b08000d63a0 after lost signal to thread 10079
I20260709 12:15:40.689487 13910 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:40.788273 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.749941 13897 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:40.699999 13906 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:40.756625 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.675267 14067 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:15:40.793350 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.777274 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:40.793431 10047 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:40.757897 10050 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:40.755899 10201 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:40.707464 14077 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:40.779652 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 299016us
W20260709 12:15:40.785403 10076 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6520 after lost signal to thread 10080
I20260709 12:15:40.794054 10124 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:40.807812 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:40.808295 10076 debug-util.cc:398] Leaking SignalData structure 0x7b080029b5a0 after lost signal to thread 10154
I20260709 12:15:40.750840 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.808951 10735 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:40.752183 14075 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:40.786909  9951 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 10, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 10 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:40.808581 10076 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9de0 after lost signal to thread 10155
W20260709 12:15:40.811226 10076 debug-util.cc:398] Leaking SignalData structure 0x7b08002de6c0 after lost signal to thread 10228
W20260709 12:15:40.812475 10076 debug-util.cc:398] Leaking SignalData structure 0x7b0800257920 after lost signal to thread 10761
W20260709 12:15:40.812752 10076 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7560 after lost signal to thread 10762
I20260709 12:15:40.788882 10055 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:40.809917 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.817646 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:40.818262 10128 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:40.819372 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:40.817315 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.795529 13897 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.822299 10127 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:15:40.817174 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.824517 10122 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:15:40.824774 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:40.825451 10046 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:40.825670  9951 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 5 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 9 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.751914 13814 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.793708 13942 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:40.862808 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:40.678922 14084 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.806490 13906 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:40.794581 13910 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:40.794840 13905 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:40.860631 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:40.858067 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48492.9us
I20260709 12:15:40.884279 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:40.884661 10732 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:15:40.757154 14060 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.785111 13871 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.885107 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.887753  9951 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 9 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:15:40.889022 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 187343us
I20260709 12:15:40.889205 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.890364 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.891819 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:40.891718 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:40.894876 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:40.861927 13942 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.896687 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:40.794487 14066 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:40.905035 10128 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:40.882651 13453 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:40.899245  9951 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 8, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 8 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:40.883742 13748 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:40.882756 13867 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:40.915939  9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 266) took 23757 ms (client timeout 15000 ms). Trace:
I20260709 12:15:40.918397 14057 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.920846 14057 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:40.921475 14057 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:40.921926 14057 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:40.918702  9953 rpcz_store.cc:269] 0709 12:15:16.923636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.923861 (+   225us) service_pool.cc:224] Handling call
0709 12:15:40.670866 (+23747005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:35.472081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:35.472652 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:35.472687 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:15:35.472706 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:35.474500 (+  1794us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:35.474587 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:35.474617 (+    30us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:15:35.475609 (+   992us) tablet.cc:701] Row locks acquired
0709 12:15:35.475627 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:35.475785 (+   158us) write_op.cc:270] Start()
0709 12:15:35.475902 (+   117us) write_op.cc:276] Timestamp: P: 1783599335475741 usec, L: 0
0709 12:15:35.475923 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:35.542016 (+ 66093us) log.cc:844] Serialized 4911 byte log entry
0709 12:15:37.198159 (+1656143us) op_driver.cc:464] REPLICATION: finished
0709 12:15:37.200398 (+  2239us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78be28 00007fc1821c6581 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901 00007fc1821c9b2d 0000000000388634 0000000000388479
0709 12:15:37.224074 (+ 23676us) write_op.cc:301] APPLY: starting
0709 12:15:37.224139 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:37.224302 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:37.224314 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:37.225353 (+  1039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:37.225508 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:15:37.225538 (+    30us) write_op.cc:312] APPLY: finished
0709 12:15:37.225750 (+   212us) log.cc:844] Serialized 89 byte log entry
0709 12:15:37.225903 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:37.226035 (+   132us) write_op.cc:454] Released schema lock
0709 12:15:37.226083 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:37.226467 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:37.226491 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":270327,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":19857,"apply.run_cpu_time_us":2324,"apply.run_wall_time_us":2323,"num_ops":12,"prepare.queue_time_us":164863,"prepare.run_cpu_time_us":32894,"prepare.run_wall_time_us":1728538,"raft.queue_time_us":357511,"raft.run_cpu_time_us":5407,"raft.run_wall_time_us":45869,"replication_time_us":1713876,"spinlock_wait_cycles":3779968,"thread_start_us":1071605,"threads_started":4,"wal-append.queue_time_us":845597,"wal-append.run_cpu_time_us":16695,"wal-append.run_wall_time_us":1854209}]]}
I20260709 12:15:40.892844 14067 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:40.898630 14090 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:40.932042  9951 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 6, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:40.908192 13942 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:40.911039 13905 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:40.817203 14077 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.911221 13645 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:40.931622 13867 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:40.952663 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.918035 13748 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:40.928133 13868 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:40.956352 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 179156us
I20260709 12:15:40.955881  9951 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.934581 14090 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:40.961632 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 63822us
I20260709 12:15:40.962632 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.965891 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:40.960201 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:40.958470 13748 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:40.969950 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.972183 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:40.977908 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:40.959080 13645 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:40.967051 13905 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:40.999004 13814 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.000794 13910 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.003651 13871 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.022794 10052 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
I20260709 12:15:41.000743 10204 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:40.981860 13933 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:40.935990 14036 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.011101  9951 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:41.028575  9951 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 12, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 12 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.970256 14067 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:41.030680 14067 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:40.966099 14090 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.034454 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:41.035018 14091 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:15:41.035122 10729 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:41.033401 14067 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:40.994411 13674 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.520s	user 0.003s	sys 0.006s
I20260709 12:15:41.036165 14060 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.026825 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.024295 13453 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.037045 10736 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:15:40.954265 14057 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.043551 14084 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.036312 13674 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.002214 13994 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.048501 13674 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.049899 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:41.050465 13994 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.051286 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:41.051790 14094 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:15:41.052181 13910 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.041841  9951 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 7, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:41.053469  9951 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 1 to 6, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 6 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:15:41.054749  9951 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.995054 14071 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.051059 14066 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.058794 14090 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.063483 14090 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.064674 14105 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:41.065197 14077 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.065908 13868 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:15:41.067600 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89737.5us
I20260709 12:15:41.069130 14088 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:41.069379 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.069619 14088 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:41.069986 14088 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.070465 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.071086 14097 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.071792 10203 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:41.072229 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 100088us
I20260709 12:15:41.072777 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.073925 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.073694 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.074649 10196 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:41.075002 14097 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:41.075237 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 402831us
I20260709 12:15:41.076014 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.069151 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.077047 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.070137 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.057765  9951 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 9, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 9 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:41.005852 13645 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.077172 10204 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:41.080037 13718 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.080614 13713 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.081178 13813 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:41.093762 13813 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.083518 14069 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:41.094627 14069 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:41.084762 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.072345 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.095947 13813 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.096552 10122 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.089190  9951 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 9, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 9 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:41.090610 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.082836 14017 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.107015 14104 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:41.025614 13933 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.110355 14017 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:41.115283 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.106801 13906 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.110787 14104 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.118778 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.119951 13185 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:41.012015 13967 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:15:41.120551 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.121037  9951 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:41.123617 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.127094 13185 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:41.127554 13185 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:41.127913 13185 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:41.101779 14066 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:15:41.124720 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 224211us
I20260709 12:15:41.128530 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.135867 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.115988 14063 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:41.133219 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 316588us
I20260709 12:15:41.117491 13933 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.139762 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.148366 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.140350 13907 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:41.143126 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:41.147035 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 62462.5us
I20260709 12:15:41.151862 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.152456 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.152467 10121 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:41.155608 10124 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.141513 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:41.158737 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.126276 13718 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.160079 10204 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.160521 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.161334 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.161476 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.170727 10052 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:41.162294 10125 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:41.146767 14023 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:41.164162 10050 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:41.172312 10203 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:41.165655 13748 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.147607 14066 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.166446 14025 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:41.167143 14060 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.167551 14064 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:41.168061 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.125005 14104 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.155627 13907 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:41.158190 14075 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:41.168943 14052 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:15:41.173641 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54952.3us
I20260709 12:15:41.185925 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.186578 10129 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:15:41.187004 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.197193 10195 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.134032 13813 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:41.195807 10201 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:41.171442 14105 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:41.212801 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.215550 10121 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:41.218355 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.226284 10124 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:41.185220 13910 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.182703 14023 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:41.184378 14101 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.226037 14057 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:41.191399 14084 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:41.197225 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.255761 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.196377 13868 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.195365 13814 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:41.195611 13907 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.257431 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:41.259893 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 91911.9us
W20260709 12:15:41.261051 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48345.7us
I20260709 12:15:41.255010 13185 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.197490 13939 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:15:41.268678 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.270323 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.278887 10125 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:41.276121 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.276489 10731 raft_consensus.cc:1217] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:15:41.275104 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.280402 10731 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:15:41.283496 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47641.7us
I20260709 12:15:41.209818 14045 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 12:15:41.285249 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88093.3us
I20260709 12:15:41.286056 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.286396 10121 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:41.287528 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.285323 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.290901 13185 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.290759 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.291800 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.293727 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.285030 13906 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.302455 13910 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.304329 14108 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:41.265928 14105 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.258116 13897 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.259256 13813 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:41.306767 13813 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:41.307013 14105 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.307493 13897 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:41.310878 14080 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.521s	user 0.004s	sys 0.006s
I20260709 12:15:41.265345 14023 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.308691 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.314157 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:41.314502 10129 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:41.312547 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2022) took 1510 ms. Trace:
I20260709 12:15:41.265789 14057 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:41.274276 14025 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.319873 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.318531 10197 rpcz_store.cc:276] 0709 12:15:39.802077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.421287 (+619210us) service_pool.cc:224] Handling call
0709 12:15:40.421619 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:40.477684 (+ 56065us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:40.594958 (+117274us) log.cc:844] Serialized 14 byte log entry
0709 12:15:40.927842 (+332884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:40.933056 (+  5214us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:40.933106 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.001348 (+ 68242us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b180043b6a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a3522 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:41.312314 (+310966us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54001040d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:41.312362 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:41.312493 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9828,"prepare.queue_time_us":168400,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":56916,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13924,"spinlock_wait_cycles":131688704,"thread_start_us":413032,"threads_started":3,"wal-append.queue_time_us":321060}
I20260709 12:15:41.322067 14076 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:15:41.324100 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:41.324805 14042 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:41.325155 13813 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.260381 14070 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:15:41.326594 13645 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.266328 14017 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.328296 13748 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.329331 10198 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.290179 14063 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:15:41.331068 14111 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:15:41.359233 14057 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:41.319061 14022 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.288930 14102 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:15:41.379088 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55056us
I20260709 12:15:41.385777 14106 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:41.360081 14036 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.384506 14105 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:41.382534 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 90827.5us
W20260709 12:15:41.381861 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 188228us
I20260709 12:15:41.389542 10198 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.312554 13868 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 12:15:41.392449 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 116398us
I20260709 12:15:41.336138 13939 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.337538 14064 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.395645 14017 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.319326 13867 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.359486 13814 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.269472 14084 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:41.383404 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63592.1us
I20260709 12:15:41.433991 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.387079 14060 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.423509 10198 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.436535 10198 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.392588 14063 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:41.392907 13897 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:15:41.393621 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.319641 13718 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:15:41.392030 14075 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.415879 13910 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.397720 14042 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.421511 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:41.438863 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.804s (SENT) [suppressed 3 similar messages]
I20260709 12:15:41.421047 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.423380 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.425577 13868 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.425872 13813 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.429229 13907 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.403259 13748 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:15:41.403084 14105 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.436223 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:41.478721 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.469812 10127 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.479866 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.480638 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.386092 14088 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.329497 14066 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.435225 14084 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:41.446472 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.449028 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:41.447623 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.440604 13994 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.497196 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.497735 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.469952 10123 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:41.470455 14079 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:15:41.471499 14113 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:15:41.473440 13816 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.470538 14075 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.476464 14023 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.496177 13814 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:41.435478 14090 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:15:41.489228 10129 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.445806 14120 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:15:41.440399 14064 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:41.515628 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.464152 13868 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.492391 14063 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:15:41.575796 14063 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.576170 14063 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:41.516415 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.517777 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:41.577564 10197 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:41.498796 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59959.1us
W20260709 12:15:41.521294 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 72361us
I20260709 12:15:41.464152 14108 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:41.443117 13674 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:15:41.523113 10127 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:41.515601 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.541635 13816 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:41.524444 14060 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:41.526885 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.527637 14042 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:41.528360 14112 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 12:15:41.529033 13933 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.603641 13933 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.489699 13965 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:41.604455 13965 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.604866 13965 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.606684 14120 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:41.607897 14120 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:41.608258 14120 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:41.609068 14120 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.483587 14105 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:41.610605 14120 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:41.488876 14045 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.612838 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.613554 10734 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:41.539486 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:41.627262 14119 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:41.628809 13923 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:41.629237 13923 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:41.630002 13923 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.631783 13645 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.633292 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.635263 13907 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.636904 14023 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.638846 13910 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:41.639313 13910 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.640225 13910 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.641672 13910 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.643060 13816 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.644367 13816 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.648234 13868 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.541697 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.650043 10128 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:41.442803 13897 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:41.544337 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.651957 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.652570 10051 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:41.545740 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:41.549222 10737 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:15:41.553102 14057 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.554374 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.657799 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:41.573004 14118 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:41.555589 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.557175 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.659832 10203 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.558535 10199 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:41.661320 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.558771 10204 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:41.561503 10196 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:15:41.496186 13813 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:41.520974 14055 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:41.492440 10052 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:41.683686 10731 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:15:41.684320 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.562227 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:41.567317 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.501694 13994 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:41.538985 14073 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:41.572868 10129 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:41.573770 13967 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.574990 10124 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:41.583393 10049 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:41.523874 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.562933 13814 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.588351 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.588949 14063 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:41.591130 13713 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:41.591488 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.593528 13951 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:41.593768 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:41.579308 14109 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 12:15:41.655630 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:41.631395 13923 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.675523 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.652246 14101 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:15:41.651630 13897 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.530378 14069 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.680280 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:41.680474 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.682129 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:41.599429 13942 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.004s
I20260709 12:15:41.683418 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:41.563073 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.586351 14090 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:41.686492 10199 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:41.684405 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.687908 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.683506 14036 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:15:41.688597 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.737980 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.694631 10048 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:41.696026 10123 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.737215 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.600793 14060 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:41.658635 14076 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.705406 10195 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:41.706768 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.676362 14118 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:41.683421 14055 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:41.676644 10197 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:41.745152 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.694114 14073 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.689082 13813 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:41.727626 14064 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:41.728842 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.729324 14095 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:15:41.699718 13814 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:41.732056 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.754747 10049 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:41.755187 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.755676 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:41.732343 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51965.9us
I20260709 12:15:41.756000 14076 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.756597 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.757668 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.740584 10204 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:41.758481 13897 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.759147 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.759941 14057 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.714627 13951 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:41.736955 13994 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.761549 14055 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.762778 14060 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.763980 13814 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.765111 10052 raft_consensus.cc:2368] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14.
I20260709 12:15:41.732760 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.737155 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:41.696044 14072 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:15:41.747064 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.750591 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.736264 14090 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:41.758056 14076 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.763899 14060 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:41.741712 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 242693us
I20260709 12:15:41.766002 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:41.698836 13967 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:41.727674 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 133969us
I20260709 12:15:41.707355 14071 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:15:41.739566 13868 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:41.769480 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.747480 14088 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.781688 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.765857 14073 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:41.781536 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:41.797914 10199 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:41.799626 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.785230 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.802237 10046 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:41.779752 14084 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.739382 13942 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.810004 10049 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:41.744553 14118 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.792701 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.801723 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.805305 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:41.806028 14107 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:15:41.806476 14084 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:41.817865 10123 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:41.832367 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 175791us
I20260709 12:15:41.796471 14076 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:15:41.848064 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55439.8us
I20260709 12:15:41.848397 10048 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:41.853325 10198 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:15:41.854035 13831 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:15:41.854934 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 666) took 2052 ms. Trace:
I20260709 12:15:41.855361 10198 rpcz_store.cc:276] 0709 12:15:39.802830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.452796 (+649966us) service_pool.cc:224] Handling call
0709 12:15:40.453121 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.329244 (+876123us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002c6620. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:41.853865 (+524621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.854885 (+  1020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352117504}
I20260709 12:15:41.755431 14064 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.857262 10197 raft_consensus.cc:1217] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[11.8-14.10]   Dedup: 11.8->[12.9-14.10]
I20260709 12:15:41.857832 10197 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: [11.8-14.10]
I20260709 12:15:41.858263 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:41.755245 13813 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:41.867309 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 97881.8us
I20260709 12:15:41.869534 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.869469 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.877394 14017 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.879832 14110 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:41.798089 14077 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:15:41.882258 10048 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.882340 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:41.794847 14102 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:15:41.852698 14072 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:41.855079 13713 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.884083 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:41.863346 14108 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.908955 14072 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.895947 14133 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:41.918836 14134 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:41.921996 10203 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:41.891085 14110 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:41.909966 13939 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:41.937235 10196 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:41.935307 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:41.945276 10048 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:41.947162 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.948163 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:41.948374 13910 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:41.948941 14045 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:41.949494 14045 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:41.950641 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.951754 10048 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:41.950989 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 98626us
I20260709 12:15:41.952840 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.924845 14072 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.956388 14064 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:41.975405 10054 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:41.957943 10050 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:41.898011 13965 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:41.981804 10200 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:41.974117 13814 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:41.863190 14090 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.944052 14076 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:41.923728 14017 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:15:41.989882 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 107630us
I20260709 12:15:41.990278 10049 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:41.924732 13713 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:15:41.995824 10123 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:41.996336 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:41.995451 13816 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:42.001153 13713 consensus_queue.cc:1243] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:15:42.001710 14132 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:15:42.002580 14085 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:15:41.981036 13939 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:41.983110 14064 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.007146 10055 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:41.925688 14108 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:41.958966 14105 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.013612 14097 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:15:42.018255 13674 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:42.018733 13674 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:42.019140 14076 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.019585 13674 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.020814 13674 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:41.994033 13967 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:42.019790 10049 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:42.018743 14045 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.022491 14127 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.994761 13814 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:15:42.037539 14137 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:42.023590 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.033612 13939 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.046576 14110 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.051724 10049 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:42.052829 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:42.059705 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 300614us
I20260709 12:15:42.091354 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:42.019519 13718 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:15:42.073457 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119946us
I20260709 12:15:42.075718 10123 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:41.993391 14140 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:15:42.094528 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.098156 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:42.098134 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74616.4us
I20260709 12:15:42.099650 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.096272 10046 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:42.062903 14042 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:42.106021 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:42.110796 10130 raft_consensus.cc:2410] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:42.104324 10126 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:42.096998 10049 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.111655 10049 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:42.087845 14106 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:42.128605 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:42.136252 10127 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:42.128922 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.130079 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:42.162247 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:42.093293 13718 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:42.163954 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 422837us
I20260709 12:15:42.102890 14088 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.167371 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.134873 13674 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:42.141856 13816 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:42.166865 13871 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:15:42.233476 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 124141us
I20260709 12:15:42.172289 14102 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.173290 14106 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:42.245085 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:42.235595 10702 leader_election.cc:336] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.527s (SENT)
I20260709 12:15:42.172785 14142 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.246285 14142 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:42.248030 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.135864 14042 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:42.252339 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 78936.7us
I20260709 12:15:42.238605 14057 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.293572 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:42.303273 10051 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:42.240347 14139 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:42.275714 14120 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 12:15:42.238086 13827 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.281s
I20260709 12:15:42.309898 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:42.310848 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 75293.7us
I20260709 12:15:42.326329 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:42.273263 14071 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:42.314882 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.248108 14073 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.333742 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:42.329048 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 153585us
I20260709 12:15:42.342954 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:42.324764 14022 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.923s	user 0.006s	sys 0.005s
I20260709 12:15:42.352150 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:42.240605 14102 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.313251 14060 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:42.353482 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:42.313060 13965 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:42.341974 14104 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.124s	user 0.006s	sys 0.006s
I20260709 12:15:42.359860 10122 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:42.322546 14166 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:42.339416 14088 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.364559 10732 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:42.307281 14106 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:15:42.275453 13718 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.327648 14108 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:42.373885 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:42.359311 14022 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:42.356938 14060 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:42.357787 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:42.375523 10130 raft_consensus.cc:2410] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:42.377322 14163 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.368505 14105 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:42.363850 14104 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.388849 14042 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:42.384047 14159 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.390257 14159 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:42.390821 14153 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:15:42.358443 14072 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.382118 13965 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:42.407173 10203 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:42.384073 14060 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:42.386682 14154 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:15:42.408793 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:42.386935 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:42.371261 14166 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:42.412760 10731 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:42.413745 14072 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:42.413554 14166 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:42.394165 10732 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:42.413681 14073 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:42.404084 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:42.395443 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:42.397575 10049 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:42.399878 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:42.416987 10201 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:42.400170 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:42.417835 10737 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:42.400812 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:42.404723 10734 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:42.405932 14159 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:42.422900 10199 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:42.370944 14088 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.389093 14104 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:42.375309 13674 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:42.441582 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:42.442937 14167 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:15:42.444284 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 57446.2us
I20260709 12:15:42.447362 10702 leader_election.cc:400] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14.
I20260709 12:15:42.447881 10702 leader_election.cc:403] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:42.403533 13718 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:42.415895 14077 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:42.462922 10737 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:42.454849 14072 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:15:42.458632 14148 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:15:42.438825 14142 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.472822 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:42.474045 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:42.481993 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:42.482759 10124 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:42.482077 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:42.483768 10130 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:42.491807 10127 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:42.492828 10126 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:42.469645 14072 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.475215 14143 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14.
I20260709 12:15:42.514591 14177 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:15:42.515228  9942 maintenance_manager.cc:419] P f9411c2085cc41508a7b355517791fc1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033405
I20260709 12:15:42.482482 13813 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:15:42.576992 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55897.8us
I20260709 12:15:42.578469 14164 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:42.579053 14174 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:15:42.582692 14169 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:15:42.480232 14077 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:42.575980 14101 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:42.605264 10130 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:42.469883 14017 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:42.623546 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:42.670037 13923 consensus_meta.cc:287] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.944s	user 0.015s	sys 0.004s
W20260709 12:15:42.714143 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.484699 14073 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 12:15:42.585638 14127 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:42.622874 14072 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:42.870136 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.687474 14104 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:42.936674 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.919958 14102 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:42.758365 14159 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:42.686829 14063 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:42.992950 14104 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:42.987553 14118 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.136s	user 0.008s	sys 0.010s
W20260709 12:15:43.015596 10124 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 12:15:43.016444 10124 raft_consensus.cc:2410] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:43.017596 14172 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:15:42.961707 10049 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:42.972093 14170 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:42.925115 14167 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:42.974805 13923 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:42.924836 13965 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:15:42.940775 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.919997 14147 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.998577 14159 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.015027 14088 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.005125 14118 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.048846 14170 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.053925 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:42.921583 14101 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.036164 13923 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.036341 13965 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:43.068311 10201 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.002s
W20260709 12:15:43.070096 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 356940us
I20260709 12:15:43.070542 10201 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:43.072202 10729 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.072798 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:43.074324 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.057729 14088 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.082815 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.083822 10049 raft_consensus.cc:2410] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:43.084798 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:43.040890 14167 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.066443 14102 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:43.051898 14147 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.090550 14073 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:43.090898 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:43.091733 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.094376 14073 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.076128 14097 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:15:43.108873 14073 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.110033 14073 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:43.112000 14184 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:15:43.112365 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:43.113157 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 561) took 1510 ms (client timeout 1955 ms). Trace:
W20260709 12:15:43.113480 10053 rpcz_store.cc:269] 0709 12:15:41.602493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.740314 (+137821us) service_pool.cc:224] Handling call
0709 12:15:43.112230 (+1371916us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:15:43.113081 (+   851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5707008}
I20260709 12:15:43.115254 13185 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:43.115660 13185 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:43.116420 13185 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.117493 13185 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:43.120183 14167 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.120579 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.121667 14101 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.123807 14170 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.124256 14055 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.125459 13185 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:43.126289 14176 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.126085 13185 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.101437 13923 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.128063 13923 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:43.128170 13185 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.130903 14104 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.082087 14088 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.140791 14088 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.096347 13965 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.142607 13965 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:43.144299 14189 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:43.144956 14189 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.146409 14172 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:43.147079 14172 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.147986 14172 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.149506 13713 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:43.149693 14159 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.149957 13713 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:43.104404 13813 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:43.151806 13813 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:43.152263 14152 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.152730 13813 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.154750 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.155107 14077 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.155632 13942 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.158243 14104 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:43.158762 14104 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:43.159968 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2361) took 1366 ms. Trace:
I20260709 12:15:43.159574 14104 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.160375 10055 rpcz_store.cc:276] 0709 12:15:41.793680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.869318 (+ 75638us) service_pool.cc:224] Handling call
0709 12:15:43.159774 (+1290456us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400086e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.159907 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268996224}
I20260709 12:15:43.165666 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1602) took 1476 ms. Trace:
I20260709 12:15:43.166076 10196 rpcz_store.cc:276] 0709 12:15:41.689327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.689466 (+   139us) service_pool.cc:224] Handling call
0709 12:15:41.937037 (+247571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.943778 (+  6741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.165458 (+1221680us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003133d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.165599 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568686976}
I20260709 12:15:43.095429 14102 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.170046 14102 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:43.126592 14118 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.177358 14147 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.150862 13713 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.155602 14077 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.192816 13713 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:43.200546 14088 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.152777 14152 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.231199 10201 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:43.235615 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 187140us
I20260709 12:15:43.236944 10199 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:43.225585 14071 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:43.238315 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.238633 14072 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.239180 13867 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:43.239586 13867 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:43.240353 13867 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.240988 14152 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.241179 14147 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.221774 14088 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.205907 14077 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.241490 13867 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.243860 10201 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.223012 14102 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:43.247037 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.240816 14072 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:43.245925 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 173245us
I20260709 12:15:43.246110 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.247444 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.251039 10196 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:43.251497 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.223449 13906 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:43.243695 13814 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.252555 10204 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:43.248626 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.249502 10053 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:43.243513 13816 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.263211 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.267866 10204 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:43.238729 14071 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.241699 14147 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.279572 10201 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:43.268707 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.267000 10199 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:43.269599 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:43.269789 10053 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:43.280690 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.271064 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.281378 10196 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:43.281821 10198 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:43.281793 10201 raft_consensus.cc:2410] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:15:43.282460 10196 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:43.262262 13814 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:43.286121 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.268663 14170 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.286727 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:43.289731 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52124.1us
I20260709 12:15:43.289955 10737 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.286849 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.259946 13906 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.288142 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.259754 14063 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:15:43.288695 10047 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:43.252400 14102 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.295936 13906 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.296499 14102 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.272701 14055 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.297180 14055 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.299367 14055 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.283948 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.300734 10203 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:43.290486 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:43.301590 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.302119 13867 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:43.290843 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.304819 14077 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.304962 14073 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.291949 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.306010 10729 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:15:43.292418 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.300562 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.307206 14077 raft_consensus.cc:2764] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:43.308358 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.294176 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.291491 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.302724 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.305641 14073 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.293910 14025 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.304960 14196 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:43.286243 13814 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:43.309623 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.287810 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.311661 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.317031 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.312816 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.318041 10737 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:43.272033 13816 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.287288 14193 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:43.319756 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.322600 14073 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.323438 10195 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:43.323962 13713 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:43.314317 14025 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.335402 13713 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:43.335531 14025 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.317302 14106 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.338020 14147 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.338516 14193 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:43.293557 14170 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.338981 14193 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.306141 14071 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.318228 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.327574 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.315243 14077 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.328215 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.341960 10201 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:43.345523 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:43.343044 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.102s	sys 0.166s
I20260709 12:15:43.341343 14106 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.317052 13906 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:15:43.346310 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.102s	sys 0.167s
I20260709 12:15:43.349340 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.352224 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.378624 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.379081 10048 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:43.377866 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.381433 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.382195 10196 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:43.381593 10195 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 4.
I20260709 12:15:43.350724 13813 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.388526 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.396220 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.338541 14088 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.345316 14073 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:43.348104 14106 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:43.389462 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55930.2us
I20260709 12:15:43.400863 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.378448 14142 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.403262 14142 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.403692 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.405386 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.405386 14142 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.407393 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:43.405530 14147 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.408020 10053 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:43.408362 14147 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.408022 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.410630 10195 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:43.384001 14150 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.377048 14071 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:15:43.348428 14189 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.416455 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.418962 10049 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:43.419062 10734 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:43.421918 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:43.423557 14194 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:43.423673 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:43.424615 14152 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:43.424834 14060 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:43.422187 14170 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.422093 13951 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.422580 14204 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:43.414243 13713 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.387738 14055 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:15:43.411268 14088 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:43.417261 14107 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.426666 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.425114 14152 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.426203 10701 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:43.462848 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:43.447868 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 102441us
I20260709 12:15:43.462317 10195 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:43.464497 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.465215 10195 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:43.465811 14152 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.469666 14025 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.470819 14088 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:43.471735 14088 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.472736 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:43.473526 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:43.473801 10051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2065) took 1938 ms (client timeout 2108 ms). Trace:
W20260709 12:15:43.474237 10051 rpcz_store.cc:269] 0709 12:15:41.535182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.750254 (+215072us) service_pool.cc:224] Handling call
0709 12:15:43.473633 (+1723379us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.473739 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224706816}
I20260709 12:15:43.475423 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.476032 10051 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:43.477859 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:43.448956 14147 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.478785 14147 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.479180 14147 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.479521 14147 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.470712 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1605) took 1773 ms. Trace:
I20260709 12:15:43.449980 13816 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.417608 13906 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:43.455705 13951 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.456005 13713 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.409634 14193 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.411679 13813 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.460721 10048 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:43.501706 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.482194 10197 rpcz_store.cc:276] 0709 12:15:41.697217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.758612 (+ 61395us) service_pool.cc:224] Handling call
0709 12:15:41.759119 (+   507us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:41.863787 (+104668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.470460 (+1606673us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b5400061dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:43.470640 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225220864}
I20260709 12:15:43.466303 10195 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:43.506300 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.481952 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.478912 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:15:43.487589 14161 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.043s	user 0.005s	sys 0.010s
I20260709 12:15:43.488257 13923 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:43.487887 13906 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.488801 14174 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:43.490098 10051 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:43.419817 14150 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:43.492973 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.457715 14106 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.461045 10053 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:15:43.461982 14194 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.487905 14164 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.517889 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.514711 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:43.526173 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.519966 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.526325 10053 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:43.510114 14166 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.006s	sys 0.016s
W20260709 12:15:43.531445 14166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.006s	sys 0.016s
I20260709 12:15:43.512279 13923 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.511224 14097 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.510696 14205 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.533654 14146 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:43.515179 14174 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:43.534027 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 646) took 1133 ms. Trace:
W20260709 12:15:43.533692 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.541401 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.513648 14072 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:43.542279 14072 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.542660 14072 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.544866 14106 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.535177 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.534154 14123 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:43.533924 14172 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.486524 14107 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.545504 14189 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.539510 10736 rpcz_store.cc:276] 0709 12:15:42.400114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.400214 (+   100us) service_pool.cc:224] Handling call
0709 12:15:42.403223 (+  3009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.403404 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:42.485373 (+ 81969us) log.cc:844] Serialized 14 byte log entry
0709 12:15:43.533507 (+1048134us) log.cc:844] Serialized 14 byte log entry
0709 12:15:43.533693 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:43.533737 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:43.533776 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.533844 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:43.533955 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1842,"prepare.queue_time_us":199407,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":41002,"raft.queue_time_us":3232,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":4314,"thread_start_us":1122506,"threads_started":3,"wal-append.queue_time_us":532788}
I20260709 12:15:43.537513 13923 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:43.553280 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2257) took 1934 ms. Trace:
I20260709 12:15:43.537880 13674 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.555667 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.545882 14174 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:43.555452 10128 rpcz_store.cc:276] 0709 12:15:41.619197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.650811 (+ 31614us) service_pool.cc:224] Handling call
0709 12:15:41.871725 (+220914us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:15:41.871955 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:42.059243 (+187288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:42.059276 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:42.076192 (+ 16916us) log.cc:844] Serialized 26 byte log entry
0709 12:15:42.254656 (+178464us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:42.254700 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.255831 (+  1131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:43.480915 (+1225084us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:43.553072 (+ 72157us) raft_consensus.cc:1685] finished
0709 12:15:43.553094 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:43.553223 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188713,"raft.queue_time_us":187684,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20213,"spinlock_wait_cycles":39780480,"thread_start_us":146030,"threads_started":1,"wal-append.queue_time_us":278255}
I20260709 12:15:43.554478 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.554450 13951 raft_consensus.cc:2764] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:43.564530 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.532965 14164 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.557341 13868 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:43.568857 13951 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:43.550700 14152 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:15:43.571607 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.572289 10203 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:43.559376 14123 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.573698 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.558339 13674 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.575430 14192 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:43.569053 14025 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.577875 13674 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:43.578359 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.557221 14189 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.579633 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.581586 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:43.583670 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.571543 14150 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.586345 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.591707 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.591835 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.580539 14106 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.547734 14194 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.592938 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.594611 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:43.595125 14145 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:43.595995 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:43.596763 10734 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:43.597281 10731 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.596621 10204 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.592826 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:43.598305 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.600337 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:43.586099 13674 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:43.601768 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.603578 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:43.606473 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.593900 14193 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.604398 14025 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.608731 14025 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.589181 14107 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.598681 14145 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.586380 14208 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:43.608129 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:43.603188 14150 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:43.604806 13674 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.607376 14207 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.610807 13906 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:43.605341 14097 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.606382 13907 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:43.617823 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.622823 10204 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:43.616528 13674 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:43.624037 10051 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.611125 14147 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.621642 14192 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:43.621997 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:43.633215 14213 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:15:43.636897 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:43.637336 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.637152 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.638360 10130 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:43.639571 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.637696 10124 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:43.640208 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.640167 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:43.683825 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45300.2us
I20260709 12:15:43.685011 10122 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:43.639099 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.687345 10125 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:43.607767 14123 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.638717 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.688732 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.637463 10731 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
W20260709 12:15:43.689613 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50966.3us
I20260709 12:15:43.618286 14150 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.639796 10128 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:15:43.643736 13868 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:43.686667 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.691174 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.642584 14207 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.693536 14192 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:43.690442 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.624626 14097 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.625978 13907 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.643075 13713 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.696574 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:43.696512 10204 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.688081 13994 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.708388 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:43.711771 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.713186 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.714036 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.696012 14193 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:43.718770 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.717998 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:43.710734 14192 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:43.697741 13868 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.173182  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:43.707855 13816 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:43.729635 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.709607 14164 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:43.732584 10054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2060) took 2193 ms (client timeout 1664 ms). Trace:
W20260709 12:15:43.734020 10054 rpcz_store.cc:269] 0709 12:15:41.533891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.580375 (+ 46484us) service_pool.cc:224] Handling call
0709 12:15:43.727419 (+2147044us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002751d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.727522 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595529088}
I20260709 12:15:43.736299 13907 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.727450 13868 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:43.739179 14216 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:15:43.740522 14215 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:15:43.717135 14177 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:43.730324 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.720829 14063 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:43.749617 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.720645 13965 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:43.722894 14060 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:43.760023 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.760893 10198 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:43.763590 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.689615 14145 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.708232 14207 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.766253 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.717002 13713 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.750165 14193 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:43.762142 13951 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.760071 14063 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.789705 13906 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:43.760058 13965 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.762619 14060 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.731175 14116 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:43.798676 14150 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.803915 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.854116 10128 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
W20260709 12:15:43.807000 10202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 675) took 2646 ms (client timeout 1828 ms). Trace:
I20260709 12:15:43.806892 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:43.808269 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.786794 14192 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:43.854894 10202 rpcz_store.cc:269] 0709 12:15:41.147826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.148087 (+   261us) service_pool.cc:224] Handling call
0709 12:15:43.794272 (+2646185us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54000e88d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.794446 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825518848}
I20260709 12:15:43.856027 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.856685 10204 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:43.853468 13923 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:43.813130 14199 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.411s	user 0.002s	sys 0.001s
I20260709 12:15:43.816000 14147 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.858841 10197 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:43.859723 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.860571 14147 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.860910 14147 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:43.861238 14147 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.862265 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2063) took 2327 ms. Trace:
I20260709 12:15:43.791016 14193 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.862890 14193 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.863675 14097 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.862531 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:43.867004 10204 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:43.867093 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.821434 14072 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.869660 14072 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.872184 13816 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.872640 13816 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.872897 13674 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.808008 14060 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:43.795915 14063 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.821529 14174 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.787463 14070 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:43.792747 13951 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.824889 14170 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:43.829399 14106 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:43.830255 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2042) took 2325 ms (client timeout 2036 ms). Trace:
I20260709 12:15:43.787170 14107 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:43.831574 14145 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.833544 14025 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.835619 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1652) took 1526 ms. Trace:
I20260709 12:15:43.836196 13713 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:43.836645 14180 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.257s	user 0.000s	sys 0.011s
I20260709 12:15:43.842525 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.899122 10126 rpcz_store.cc:276] 0709 12:15:42.309188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.309334 (+   146us) service_pool.cc:224] Handling call
0709 12:15:42.492614 (+183280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.493269 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.835426 (+1342157us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001d5950. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.835563 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420754816}
I20260709 12:15:43.842756 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.844487 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.844594 14146 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.845124 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.845572 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 575) took 1368 ms. Trace:
I20260709 12:15:43.846530 14069 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:43.830991 13906 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.883728 13933 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.849766 13868 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.851348 13813 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.852891 14159 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.854938 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.856719 10130 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:43.876372 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.876991 10050 rpcz_store.cc:276] 0709 12:15:41.534710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.879070 (+344360us) service_pool.cc:224] Handling call
0709 12:15:41.879466 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.980822 (+101356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.862063 (+1881241us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54001315d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:43.862212 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180024192}
I20260709 12:15:43.815197 14207 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.877933 14177 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.879316 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:43.922999 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88002.9us
I20260709 12:15:43.884255 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.874516 14116 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.855413 14143 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:43.858877 13923 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.899096 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:43.899618 10734 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:15:43.901613 10124 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:43.930270 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.930686 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:43.894649 14107 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.808245 13965 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:43.892787 13951 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.902376 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:43.919337 10046 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:43.931517 14177 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.941844 10046 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:43.943156 10046 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:43.944121 10046 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:43.918954 10049 rpcz_store.cc:276] 0709 12:15:42.477236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.084490 (+607254us) service_pool.cc:224] Handling call
0709 12:15:43.845403 (+760913us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400275bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.845520 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766255488}
W20260709 12:15:43.921245 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44940.2us
I20260709 12:15:43.892413 14170 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:43.946864 10049 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:43.947069 14170 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:43.892634 10200 rpcz_store.cc:269] 0709 12:15:41.505034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.554102 (+ 49068us) service_pool.cc:224] Handling call
0709 12:15:43.830090 (+2275988us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:43.830189 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593202560}
I20260709 12:15:43.919478 13816 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.948953 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.949545 10197 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:15:43.927721 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.952194 13868 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.843721 14189 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.918751 14045 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.954873 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:43.954993 14045 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.955466 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:43.956063 10200 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.957613 14045 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.940444 10130 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:43.955500 10731 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:43.920819 13713 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:15:43.961027 13713 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:43.961370 13713 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:43.933295 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.928067 14159 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.962894 10054 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 4.
I20260709 12:15:43.929450 14143 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:43.964643 10121 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:43.967374 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.940546 14174 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.923241 14146 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.973901 10197 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:43.931315 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:43.975123 10053 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:43.978739 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:43.979348 10130 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:43.980077 13813 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.980633 13813 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.980111 14146 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.923573 13933 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.985950 13933 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:43.986512 14189 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.987268 10125 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:43.987027 14189 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.989063 14189 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.964807 14143 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.946161 14193 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.962155 13713 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:43.991374 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.986912 10731 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:43.992568 10048 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:43.990222 14150 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:43.974877 14017 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:15:43.990054 14143 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:43.969250 14107 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:43.984102 13813 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.932637 14106 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:43.992097 14193 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.992197 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:43.978648 13674 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:44.009618 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:44.001839 13713 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:43.987501 14177 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:43.985376 14060 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:43.970165 13816 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:44.004958 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:43.993511 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.015401 10200 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:44.016786 10731 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:44.018286 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:44.023828 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 92418.9us
I20260709 12:15:44.013001 14189 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:44.031747 14189 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:44.032757 14189 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.013195 13868 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:44.024528 13674 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:44.035113 13868 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:44.036473 14116 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:44.036127 13868 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.035148 13674 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.037616 13674 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:44.025977 10055 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:44.027714 14220 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:15:44.014843 13816 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.030682 14075 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:44.003104 14150 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.082845 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:44.039104 14177 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.110296 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:44.111454 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:44.112249 10054 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:44.111044 10053 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:44.043538 13816 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:44.119817 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:44.085986 14222 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.120661 10049 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:44.096218 14070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49520 (request call id 0) took 2990 ms. Trace:
I20260709 12:15:44.040619 13933 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:15:44.050808 14116 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:15:44.125515 14190 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:44.107028 14066 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:15:44.120664 14177 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.159929 13965 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.162802 10050 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:44.135715 14070 rpcz_store.cc:276] 0709 12:15:41.059192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.059454 (+   262us) service_pool.cc:224] Handling call
0709 12:15:41.095009 (+ 35555us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b540011c720. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e70d520 00007fc17e796b42 00007fc17e795800 00007fc17e78e9fa 00007fc1837564c9 00007fc17ccd2c54 00007fc17ccd2be2 00007fc17ccd2b11 00007fc17ccd2a8c 00007fc17ccd1d42
0709 12:15:41.156988 (+ 61979us) log.cc:844] Serialized 501 byte log entry
0709 12:15:41.524674 (+367686us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b2c00010c48. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d098a0a 00007fc17d098693 00007fc17d098631 00007fc17e7ccb52 00007fc17e7cccf5 00007fc17e709691 00007fc17e6e9eaa 00007fc17e6f0d53 00007fc17e6f0cd9 00007fc17e6f0c69
0709 12:15:41.526918 (+  2244us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18002a07c0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a3522 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:44.041726 (+2514808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23044,"raft.queue_time_us":40792,"raft.run_cpu_time_us":2361,"raft.run_wall_time_us":151443,"spinlock_wait_cycles":84267136,"thread_start_us":180035,"threads_started":1,"wal-append.queue_time_us":262094,"wal-append.run_cpu_time_us":2570,"wal-append.run_wall_time_us":1221539}
I20260709 12:15:44.171314 14193 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.171811 14193 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.173750 14193 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.174556 14148 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.175048 14148 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.174196 14193 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:44.176976 13871 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.177636 13871 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.162247 13965 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.180371 10128 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
I20260709 12:15:44.184448 10047 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:44.130817 14147 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:44.177292 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 694054us
W20260709 12:15:44.188397 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.148850 14190 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.192183 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.192919 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.200486 10202 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:44.191231 10200 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:44.195933 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.197777 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:44.203063 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.203297 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.183743 13951 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.206339 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:44.221639 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:44.223573 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.177000 14148 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.207703 10053 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:44.209067 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.209831 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.204581 14063 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.214600 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.215298 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.215705 10735 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:44.217011 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:44.217725 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.218837 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.219614 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.227267 10737 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:44.228721 10728 raft_consensus.cc:2368] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:44.229034 10204 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:44.227337 10731 raft_consensus.cc:2368] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:44.181366 14107 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:44.244757 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.137019 14222 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.204660 14190 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.177655 14193 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.246233 14228 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.247551 14231 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:44.231849 13951 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.247229 14045 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.207463 13816 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.299108 14222 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:44.299748 14063 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.300757 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:44.301229 14147 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.302376 14150 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.248788 13674 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.295578 14231 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:44.297426 14045 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.327421 14107 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.332747 10202 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:44.295753 14228 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.324807 14231 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:44.348546 14228 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:44.355465 14110 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.358178 13994 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:44.358901 13994 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.359577 13674 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.330907 14045 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.362085 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:44.373509 10731 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:44.362834 10732 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:44.364207 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.367484 10737 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:44.369457 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.369868 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.371093 10196 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:44.375718 10199 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:44.372495 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.374352 10201 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:44.377492 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.380237 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.380831 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.382157 10199 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:44.383451 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.385243 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.385808 10196 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:44.339251 13923 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.386782 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:44.371848 14150 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.390688 10201 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:44.355845 14193 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:44.395540 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:44.390980 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:44.392103 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.396311 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:44.396977 10053 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:44.400532 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.401680 10204 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:44.401572 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:44.403143 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 178380us
I20260709 12:15:44.403689 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:44.406118 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:44.406080 10203 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:44.413607 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:44.385515 14147 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:44.414319 10049 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:44.423560 10196 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:44.431326 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:44.387262 14073 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:15:44.450043 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:44.411062 14193 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:44.454632 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:44.455266 10126 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:44.394170 13923 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:44.459702  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:44.414314 14017 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:15:44.443884 13813 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:44.456365 14107 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:44.462828 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:44.478762  9939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45876.3us
I20260709 12:15:44.464010 14069 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.464542 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:44.465464 10129 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:44.469753 10126 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:44.474129 10049 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:44.463518 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:44.485459 10127 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.453481 14072 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:44.426702 14228 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:15:44.487830 10729 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:44.432555 14147 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.479914 10053 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 5.
I20260709 12:15:44.476063 14159 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.453099 13965 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:15:44.497709 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:44.500416 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:44.405786 14150 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.501085 10129 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:44.492451 13813 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:44.482463 14116 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:15:44.487454 14069 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.495847 14072 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:44.485766 14107 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:44.507157 13965 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:44.500898 13816 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:44.512737 14159 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:44.531672 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 285725us
W20260709 12:15:44.521224 13713 consensus_meta.cc:287] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 12:15:44.517683 13813 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:44.540256 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:44.583921 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 106938us
I20260709 12:15:44.538332 14159 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:44.622736 14238 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:15:44.624239 14240 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:44.662868 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.536808 14237 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:15:44.594110 13994 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.147392 14150 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.148957 14107 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.149887 14159 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.153110 13813 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:45.154485 13813 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.787288 14073 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.127137 14069 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:45.128798 14045 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.742s	user 0.004s	sys 0.004s
W20260709 12:15:45.131253 14241 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:15:45.134579 14072 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:45.140782 14231 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.000s
I20260709 12:15:45.376458 14090 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:45.371932 14190 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.079s	user 0.004s	sys 0.006s
I20260709 12:15:45.415217 10728 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:45.416069 14204 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.416682 14204 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.379694 14240 consensus_queue.cc:1243] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:15:45.422556 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.015s	sys 0.031s
I20260709 12:15:45.378239 14147 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:45.424813 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.016s	sys 0.031s
W20260709 12:15:45.434366 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 894115us
I20260709 12:15:45.435799 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:45.419703 13933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.009s	sys 0.033s
I20260709 12:15:45.384275 14246 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:45.453702 10168 leader_election.cc:400] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:45.456105 10168 leader_election.cc:403] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.389034 14160 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:45.372999 14073 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.423779 13923 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.374796 14045 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.382117 14231 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:45.457458 13933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.010s	sys 0.034s
I20260709 12:15:45.421048 14190 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:45.477449 10197 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:45.526928 10167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.000s	sys 0.016s
W20260709 12:15:45.529305 10167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.017s
W20260709 12:15:45.528816 10703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.007s
W20260709 12:15:45.531309 10703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.007s
I20260709 12:15:45.542440 13923 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:45.461705 14160 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:45.546634 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.016s
W20260709 12:15:45.547065 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.005s	sys 0.016s
W20260709 12:15:45.547911 10702 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.021s	sys 0.041s
W20260709 12:15:45.548250 10702 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.021s	sys 0.041s
W20260709 12:15:45.548527 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 668573us
W20260709 12:15:45.552228 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.544108 14174 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.545106 14073 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.543471 13933 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:45.548417 14233 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:45.555152 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.555626 14073 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.559146 14247 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:45.559392 14045 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.559315 14073 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.559752 14247 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.560086 14045 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.560626 14045 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:45.561916 14247 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.555490 14174 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.557222 14090 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:45.554837 14246 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9.
I20260709 12:15:45.562399 14247 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.563755 14066 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:45.564579 14174 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.557287 14233 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:45.562479 13871 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.570648 14247 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:45.556030 14110 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.200s	user 0.011s	sys 0.001s
I20260709 12:15:45.572189 14066 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:45.573594 14247 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.574179 14066 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.564256 14090 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.571738 14233 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:45.562451 14045 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.568066 14254 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:45.576934 14090 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.565599 14073 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.579028 14254 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.581214 14254 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.557751 13933 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.567739 14248 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:45.586905 14248 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:45.588913 14248 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.577035 14190 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.584038 14231 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:45.584233 14075 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:45.595320 14075 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:45.596237 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2272) took 1115 ms. Trace:
I20260709 12:15:45.596175 14075 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.545629 13923 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.593327 14233 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.599184 13923 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.600275 14233 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.575924 14077 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.585461 14160 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:45.575714 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 122189us
I20260709 12:15:45.602026 10168 leader_election.cc:400] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:45.602342 10168 leader_election.cc:403] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.603206 14077 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.606588 10730 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:45.606739 14244 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.608026 14244 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.610209 14233 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:45.606855 14150 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:45.596686 10123 rpcz_store.cc:276] 0709 12:15:44.480917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.481192 (+   275us) service_pool.cc:224] Handling call
0709 12:15:44.489890 (+  8698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.594138 (+1104248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:45.594192 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:45.594246 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:45.594280 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.595977 (+  1697us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400174654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:45.596015 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:45.596169 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538959232}
I20260709 12:15:45.616380 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 776) took 1311 ms. Trace:
I20260709 12:15:45.616035 14244 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.619078 14244 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:45.619577 14244 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.616161 14150 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.621989 14150 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.616791 10728 rpcz_store.cc:276] 0709 12:15:44.300308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.300471 (+   163us) service_pool.cc:224] Handling call
0709 12:15:45.611188 (+1310717us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005505d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:45.611314 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561395584}
I20260709 12:15:45.600287 14075 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:45.615360 13813 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:45.627059 13813 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:45.629138 13813 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.606405 14077 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:45.615667 13933 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:45.622057 14244 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:45.840896 10127 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.351s	user 0.008s	sys 0.021s
W20260709 12:15:46.054754 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.031s	sys 0.045s
I20260709 12:15:46.054937 10127 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
W20260709 12:15:46.055117 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.031s	sys 0.045s
W20260709 12:15:46.057722 10127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2270) took 1601 ms (client timeout 1553 ms). Trace:
W20260709 12:15:46.058143 10127 rpcz_store.cc:269] 0709 12:15:44.453652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.456373 (+  2721us) service_pool.cc:224] Handling call
0709 12:15:46.055447 (+1599074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.055876 13933 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.059391 14244 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.059324 14233 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:46.063419 10169 connection.cc:256] RPC call timeout handler was delayed by -1.071391919000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:15:46.063972 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0092919189999066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:15:46.063983 14233 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:46.064363 13933 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.067278 13933 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.063454 14244 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:46.088771 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.677s	user 0.012s	sys 0.017s
W20260709 12:15:46.099826 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.688s	user 0.012s	sys 0.017s
W20260709 12:15:46.100636 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 1.69441e+06us
I20260709 12:15:46.099150 14233 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.101727 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:46.103817 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:46.103484 13813 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:46.105628 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:46.105731 14150 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:46.106938 14150 consensus_queue.cc:1243] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:46.107095 13813 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:46.107558 13813 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.107877 13813 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.105149 14147 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:46.108430 14147 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.108803 14147 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:46.112828 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.115360 13813 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.116629 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.117343 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:46.117621 10200 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:46.117115 14147 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.118130 14259 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:46.118670 14259 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:46.119647 14147 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.119493 14259 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.124924 14244 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.125631 14106 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.125998 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.127519 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.128167 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.131433 10196 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:46.131585 10201 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:46.128302 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.130137 10202 raft_consensus.cc:1217] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[10.10-14.12]   Dedup: 10.10->[12.11-14.12]
I20260709 12:15:46.132995 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:15:46.134060 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.133950 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.134732 10199 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:46.136392 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.136757 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:46.137069 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.137599 10198 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.138586 10196 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:46.139757 10196 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:46.140931 10196 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:46.132969 10202 pending_rounds.cc:85] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:15:46.146440 10202 pending_rounds.cc:107] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:15:46.146698 10202 raft_consensus.cc:2889] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:46.144555 10200 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.151183 10198 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:46.156143 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.156810 10195 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:46.146044 14120 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:46.158977 14120 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:46.142568 14102 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.159849 14120 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.160235 14102 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.158929 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.163836 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:46.164783 10199 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:46.167042 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:46.167634 10731 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.168895 14259 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:46.168251 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.176302 10731 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:46.132085 13965 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.132202 14106 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.177968 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.135953 14244 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.132483 13933 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.193584 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.143035 14147 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:46.142860 14150 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:46.162315 14102 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:46.202772 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66099.1us
I20260709 12:15:46.204950 10200 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:46.158372 13813 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.183020 14175 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.211184 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.214990 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.215361 10127 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:46.216024 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.216355 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.218997 10199 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.217908 10054 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:46.225392 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:46.229229 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.229882 10123 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:46.230131 10195 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:46.230269 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.226104 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:46.231055 10054 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:46.231784 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.235850 10199 raft_consensus.cc:1217] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[11.8-14.10]   Dedup: 11.8->[12.9-14.10]
I20260709 12:15:46.236516 10199 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: [11.8-14.10]
I20260709 12:15:46.237237 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.237941 10123 raft_consensus.cc:2368] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11.
I20260709 12:15:46.194895 13965 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.232906 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.244237 10054 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:46.245205 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.245761 10054 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:46.246539 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.247051 10054 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:46.246994 14240 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:46.240623 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.208815 14147 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.247916 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.248817 10054 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:46.249593 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.249728 14147 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.247892 14240 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:46.250634 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.221477 14175 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.251194 10054 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:46.250927 14240 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.251930 14240 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.252854 14175 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:46.253063 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.208386 13933 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.254531 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.254896 13933 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.206907 14244 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.256174 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:46.209939 14150 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.246896 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.258999 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.262846 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.263434 10731 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:46.259500 10200 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:46.261560 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.265079 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.265867 10198 raft_consensus.cc:2368] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:46.266547 14222 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:46.263137 14077 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:46.267222 14077 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.262192 14150 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.267601 14077 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.268208 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.269168 14257 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:46.269698 14257 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:46.236804 13813 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:46.266769 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.270697 13813 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.267093 14222 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.271011 10127 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:46.271577 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.271860 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.272655 14222 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.261700 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.262283 14060 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.261480 14244 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.262516 13965 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.265334 14205 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:46.274734 13813 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.267093 14071 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:46.257126 14175 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:46.275523 14071 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.275779 14205 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.277725 14071 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.274050 10127 raft_consensus.cc:2410] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:46.278671 10123 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.287711 10733 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:46.293854 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:46.294718 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:46.294840 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.256536 14063 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:46.296391 10123 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:46.297549 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.300137 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.291898 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.279263 14175 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.284871 14244 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.301283 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.303575 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.303836 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.304378 10196 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:46.304039 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:46.304548 10123 raft_consensus.cc:2376] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13. Re-sending same reply.
I20260709 12:15:46.307245 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.300019 14063 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:46.311332 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.312075 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.303226 14175 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:46.328408 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.305609 14244 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.333922 14063 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.336117 14244 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.302981 14205 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.342756 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.344115 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.344694 14275 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:46.345490 14275 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:46.346488 14275 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.339049 14273 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:46.305058 14270 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:46.339859 14204 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.270555 14257 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.350221 10127 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:46.336943 10196 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:46.356069 14270 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.364323 14270 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.367228 14273 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:46.368311 14273 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:46.450268 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.958s (SENT) [suppressed 22 similar messages]
W20260709 12:15:46.351727 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50530.7us
I20260709 12:15:46.461774 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.352067 14277 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:46.328506 14071 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:46.353045 13813 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:46.571609 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 250739us
W20260709 12:15:46.605219 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 301223us
I20260709 12:15:46.606909 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:46.608652 14278 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:46.591446 13965 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.561596 14071 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.618584 13965 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:46.619159 14077 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.620940 13965 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:46.622444 10050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2371) took 2742 ms (client timeout 1636 ms). Trace:
W20260709 12:15:46.622908 10050 rpcz_store.cc:269] 0709 12:15:43.880244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.921860 (+ 41616us) service_pool.cc:224] Handling call
0709 12:15:46.622195 (+2700335us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54003f1454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:46.622345 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532182400}
I20260709 12:15:46.627470 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.621292 14077 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.561084 14277 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.639277 14175 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.633144 14077 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:46.640930 14077 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.641314 14077 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.603595 14268 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.618602 14071 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:46.664026 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:46.669485 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.670050 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.670960 10127 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:46.610364 14278 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:46.674067 13965 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.674533 14060 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.674929 14177 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.646617 14277 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:46.666615 14106 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.698868 13965 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.652158 13813 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.660820 14063 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:46.702455 13965 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:46.671624 14268 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:46.703503 10055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.237s	user 0.009s	sys 0.025s
I20260709 12:15:46.704430 14268 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.698483 14060 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.678611 14148 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:46.700610 14170 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:46.702160 14106 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.689318 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.720755 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.721391 10130 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
W20260709 12:15:46.708294 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 101450us
I20260709 12:15:46.722216 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.724188 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.724882 10127 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
W20260709 12:15:46.707542 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 245867us
I20260709 12:15:46.679107 14270 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.682929 14259 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:46.710608 14280 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:46.710876 14148 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.712877 14060 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.734663 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.726271 10123 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:46.741405 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.729353 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:46.723529 14071 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:46.731868 10055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.265s	user 0.010s	sys 0.026s
I20260709 12:15:46.742805 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.719341 14175 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.696136 14278 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.748245 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.724040 10130 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:15:46.746660 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2390) took 2339 ms. Trace:
I20260709 12:15:46.749493 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.748970 10055 rpcz_store.cc:276] 0709 12:15:44.404256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.405049 (+   793us) service_pool.cc:224] Handling call
0709 12:15:44.405350 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.411405 (+  6055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.411437 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.411987 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:15:46.743383 (+2331396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:46.743437 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.743509 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.743545 (+    36us) raft_consensus.cc:1685] finished
0709 12:15:46.743556 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.743676 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5651,"raft.queue_time_us":5849,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3793,"thread_start_us":2276686,"threads_started":1,"wal-append.queue_time_us":149135,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1001652}
I20260709 12:15:46.751374 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.752105 10055 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:46.753944 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.742057 14222 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.754204 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.755739 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.756270 10054 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:46.749372 10127 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:15:46.756671 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.757854 10055 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:46.759300 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.759840 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.760932 10055 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:46.761957 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.762599 10055 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:46.763465 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.764734 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:46.747640 13827 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:46.908489 13827 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:46.908977 13827 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.776187 14273 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.911484 14273 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.918679 14273 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:46.839593 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.768189 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:46.756719 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.758683 14222 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.771180 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.775568 14275 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:46.774961 10095 connection.cc:256] RPC call timeout handler was delayed by -1.8206525050002256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:15:46.776175 14270 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:46.774998 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.779935 14148 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.734273 14259 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.782588 14071 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.784350 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.775084 14077 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.927671 14205 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.931403 14205 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:46.932675 14077 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:46.787703 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1654) took 4461 ms. Trace:
I20260709 12:15:46.933422 14205 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:46.793249 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.809011 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:46.897425 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.809732 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.810460 10737 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:46.754330 14278 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.907002 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.933302 10121 rpcz_store.cc:276] 0709 12:15:42.327185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.327347 (+   162us) service_pool.cc:224] Handling call
0709 12:15:42.327633 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:43.964468 (+1636835us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b54001feb20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:43.969954 (+  5486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.787431 (+2817477us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:46.787613 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794034688}
I20260709 12:15:46.907910 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:46.938146 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:46.938560 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:46.938786 10121 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:46.947649 10121 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:46.924896 10055 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
W20260709 12:15:46.926102 10095 connection.cc:256] RPC call timeout handler was delayed by -1.765651250000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:15:46.951459 10095 connection.cc:256] RPC call timeout handler was delayed by -1.5551021920000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:15:46.951819 10095 connection.cc:256] RPC call timeout handler was delayed by -1.4777021919999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:15:46.952090 10095 connection.cc:256] RPC call timeout handler was delayed by -1.2869021920000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:15:46.952346 10095 connection.cc:256] RPC call timeout handler was delayed by -1.1213021920000301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 12:15:46.927197 10196 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:46.929535 10199 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:46.929621 10735 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:46.930302 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:46.934026 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 917) took 2718 ms (client timeout 2467 ms). Trace:
I20260709 12:15:46.935704 10054 raft_consensus.cc:2410] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:15:46.936062 10731 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:15:46.953462 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:46.955844 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:46.953401 10730 rpcz_store.cc:269] 0709 12:15:44.215435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.217491 (+  2056us) service_pool.cc:224] Handling call
0709 12:15:46.933829 (+2716338us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54007102d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:46.933941 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3169170304}
I20260709 12:15:46.958082 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.959192 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.928692 14275 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.967746 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:46.968302 10199 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:46.968408 10127 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:46.969821 10127 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:46.970451 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.928304 14273 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.970896 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:46.971201 10196 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:46.973944 10730 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:46.973913 10055 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:46.974833 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.975893 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.976464 10196 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:46.977298 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.974310 10730 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:46.978175 14273 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.978603 10730 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:46.979640 10052 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:15:46.996608 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.979542 10730 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:46.997496 10051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.549s	user 0.001s	sys 0.028s
I20260709 12:15:46.998216 10126 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:15:46.998322 10051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.570s	user 0.001s	sys 0.028s
I20260709 12:15:46.997706 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.995234 10130 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:15:46.999924 10130 pending_rounds.cc:85] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:15:47.000263 10130 pending_rounds.cc:107] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:15:47.000595 10130 raft_consensus.cc:2889] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:46.962809 14259 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:47.009771 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70867.2us
W20260709 12:15:47.011315 10701 connection.cc:256] RPC call timeout handler was delayed by -1.0662822720000804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 12:15:47.008422 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:47.012663 10199 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:47.013012 10203 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:46.961769 14071 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:15:47.006546 14120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.003s	sys 0.007s
I20260709 12:15:47.017511 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:46.964075 14277 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.003400 14284 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:15:47.015188 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:47.033778 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 912) took 2820 ms (client timeout 1958 ms). Trace:
I20260709 12:15:46.997771 14205 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:15:47.017900 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62720.8us
I20260709 12:15:47.051023 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.068082 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.043846 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.069376 10735 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:47.025807 10055 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:47.078361 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.079144 10055 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.080422 10730 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:15:47.060667 10733 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:47.031718 10046 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:47.062004 10732 rpcz_store.cc:269] 0709 12:15:44.213856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.214311 (+   455us) service_pool.cc:224] Handling call
0709 12:15:47.033565 (+2819254us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540015a754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:47.033686 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312246528}
I20260709 12:15:47.061779 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.070950 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.070622 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.013754 14297 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:47.085834 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.086907 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.087396 10053 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:47.088500 10730 pending_rounds.cc:85] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 9
I20260709 12:15:47.088749 10730 pending_rounds.cc:107] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:47.088961 10730 raft_consensus.cc:2889] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:47.089032 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.081856 10196 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:47.092561 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:47.093106 10196 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:47.093554 10055 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:47.095404 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.097289 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.096947 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.099731 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.070499 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:47.020473 14120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.003s	sys 0.007s
I20260709 12:15:47.027673 14270 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:15:47.076728 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.036254 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.108275 10731 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:47.103788 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:47.116724 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.042640 14273 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.082626 14116 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:15:47.084823 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.030766 14275 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.101976 10203 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:47.104267 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.027927 14204 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:15:47.056372 14277 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.148523 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.107249 14077 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:47.152387 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:47.155474 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.104660 10053 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
W20260709 12:15:47.164144 10702 leader_election.cc:336] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.531s (SENT)
I20260709 12:15:47.165725 10196 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:47.143564 10055 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:15:47.156229 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 72480.1us
I20260709 12:15:47.166754 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.167421 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.168216 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.168443 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.169013 10053 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:47.170092 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.033272 13827 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.131798 14270 consensus_queue.cc:1243] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:15:47.170892 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.171589 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.033272 14278 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.173390 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.133530 14170 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:15:47.175590 10055 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:47.177407 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:47.292518 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119221us
W20260709 12:15:47.292862 10702 leader_election.cc:336] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.674s (SENT)
I20260709 12:15:47.321924 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:47.293211 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.221644 10094 leader_election.cc:400] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:47.328970 10094 leader_election.cc:403] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:47.329552 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 123365us
I20260709 12:15:47.331984 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:47.332607 10121 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:47.326028 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.179136 14175 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:47.199657 14290 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:15:47.186872 14075 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.199991 14205 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:47.202348 10199 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:47.332804 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.167459 10196 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:47.329432 10204 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:47.319976 14259 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:47.342777 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.324898 10053 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:47.320542 14240 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.172938 14163 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:47.328037 14273 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:47.342980 10204 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:47.346117 10055 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:47.347252 10196 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:47.348891 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:47.188568 14148 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:47.333926 13906 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.337078 14297 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:47.178970 14077 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:47.353420 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.354081 10121 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 12:15:47.337066 14204 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:47.335549 14175 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.361266 14175 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.364096 14278 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.364574 13827 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.367064 14116 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.377364 10055 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:47.378396 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.352661 14273 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:47.387130 14163 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:47.388731 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.396112 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:47.370841 14204 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:47.399710 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.397269 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 771) took 3748 ms. Trace:
I20260709 12:15:47.400624 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2391) took 2996 ms. Trace:
I20260709 12:15:47.402395 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.403362 10055 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:15:47.404570 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.350948 14259 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.346383 14075 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.407239 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.411782 10050 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.400695 10734 rpcz_store.cc:276] 0709 12:15:43.640571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.641463 (+   892us) service_pool.cc:224] Handling call
0709 12:15:43.682754 (+ 41291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:43.929830 (+247076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.388615 (+3458785us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400731ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:47.388922 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497886976}
I20260709 12:15:47.407395 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.408555 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:47.401508 10051 rpcz_store.cc:276] 0709 12:15:44.404597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.404742 (+   145us) service_pool.cc:224] Handling call
0709 12:15:44.427666 (+ 22924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.999108 (+2571442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.999143 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:46.999617 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:15:47.165609 (+165992us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:15:47.165643 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.165710 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:47.400380 (+234670us) raft_consensus.cc:1685] finished
0709 12:15:47.400405 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.400560 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14879,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6290,"thread_start_us":2690650,"threads_started":2,"wal-append.queue_time_us":327413}
I20260709 12:15:47.413220 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.367566 14116 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.352510 14240 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.414392 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.418715 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 7.
I20260709 12:15:47.419503 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:47.419747 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.421857 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.422652 10055 raft_consensus.cc:2368] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:47.423502 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.424276 10055 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:47.359856 10053 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:47.399030 14273 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.425962 10051 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:47.401363 14187 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:47.430253 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:47.424557 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 92299.9us
I20260709 12:15:47.370965 14148 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.396740 14278 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:47.429666 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.435102 10051 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:47.425704 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.436741 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.424110 13827 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:47.437639 10055 raft_consensus.cc:2410] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:15:47.436975 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.427492 14270 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:47.440464 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:47.440562 13827 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:47.463675 13827 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:47.464337 14116 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.466606 14240 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.468468 14259 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.470283 14075 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.440874 10051 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:47.429363 14196 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:47.457393 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.472306 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.481447 10055 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.473073 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.442708 14163 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.462009 14204 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.462666 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.463187 14148 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.446884 14305 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:47.439930 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.459898 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:47.520030 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.522094 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.543638 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:47.438406 14278 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.487406 14057 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:47.648268 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.656435 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 224575us
I20260709 12:15:47.523530 14305 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:47.436679 14077 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.692991 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:47.529585 14075 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.523607 14187 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:47.593958 14205 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.593875 14170 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:47.692952 14196 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:15:47.692747 14116 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.695217 14305 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:47.717933 14319 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:47.719725 14278 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.720485 14297 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:47.677346 14175 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.724381 14175 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:47.697362 14270 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:15:47.700307 14075 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.730175 14075 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:47.730536 14187 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.734586 14116 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.736824 14116 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.715245 14205 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.739491 14205 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.753582 14273 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.755829 14305 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.713816 13827 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.761770 13827 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.789768 14305 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:47.828469 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.829898 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.481055 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.481523 10051 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:47.474011 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.841223 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:47.852423 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 330220us
W20260709 12:15:47.856594 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 416566us
I20260709 12:15:47.862576 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:47.863543 10130 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:47.865130 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:47.869134 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:47.870370 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:47.872282 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.872675 10127 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:47.873967 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:47.872108 10130 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:47.875507 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.876624 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.881657 10055 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:47.887229 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.891481 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:47.894454 10197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1628) took 3525 ms (client timeout 1960 ms). Trace:
W20260709 12:15:47.895193 10197 rpcz_store.cc:269] 0709 12:15:44.368250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.369628 (+  1378us) service_pool.cc:224] Handling call
0709 12:15:47.892966 (+3523338us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540003b454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:47.893252 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533432064}
I20260709 12:15:47.858192 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:47.896068 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:47.899020 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.899811 10055 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:15:47.906805 14278 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:47.755862 14273 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.908246 14278 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:47.909986 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2396) took 1225 ms. Trace:
I20260709 12:15:47.912252 10055 rpcz_store.cc:276] 0709 12:15:46.684756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.907306 (+1222550us) service_pool.cc:224] Handling call
0709 12:15:47.908995 (+  1689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.909446 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.909479 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:47.909554 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:47.909591 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.909699 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.909861 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.914094 14278 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.914913 14278 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.916929 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2397) took 1231 ms. Trace:
I20260709 12:15:47.917834 14278 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:47.919251 14293 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:47.919783 14293 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:47.920331 14293 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:47.917359 10055 rpcz_store.cc:276] 0709 12:15:46.684993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.915806 (+1230813us) service_pool.cc:224] Handling call
0709 12:15:47.916307 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.916595 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.916619 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:47.916675 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:47.916706 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.916755 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.916859 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.919407 14297 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:47.934608 14278 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:47.942755 10130 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:47.950598 10051 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:47.952981 10051 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:47.954304 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2410) took 1184 ms. Trace:
I20260709 12:15:47.954813 10051 rpcz_store.cc:276] 0709 12:15:46.769700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.952262 (+1182562us) service_pool.cc:224] Handling call
0709 12:15:47.952738 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.954003 (+  1265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.954246 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.946713 14293 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:47.953303 10050 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.004s
I20260709 12:15:47.962873 10050 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:47.966683 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.966924 14273 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:15:47.967679 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68942.3us
I20260709 12:15:47.966403 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:47.968631 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:47.969712 14259 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.976826 14259 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:47.976039 14283 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:47.967849 10055 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:47.979357 14283 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:47.980962 14259 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:47.980912 14283 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:47.982102 10095 leader_election.cc:400] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:15:47.983714 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2411) took 1192 ms. Trace:
I20260709 12:15:47.984165 10051 rpcz_store.cc:276] 0709 12:15:46.791779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.978919 (+1187140us) service_pool.cc:224] Handling call
0709 12:15:47.983009 (+  4090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.983345 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.983373 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:47.983416 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:47.983487 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.983537 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.983643 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.985574 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:47.987044 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:47.990950 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 652) took 3623 ms. Trace:
I20260709 12:15:47.991874 10049 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:15:47.992642 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 596) took 1785 ms. Trace:
I20260709 12:15:47.992992 10049 rpcz_store.cc:276] 0709 12:15:46.207074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.990850 (+1783776us) service_pool.cc:224] Handling call
0709 12:15:47.991287 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.992356 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.992579 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.991441 10729 rpcz_store.cc:276] 0709 12:15:44.367242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.367366 (+   124us) service_pool.cc:224] Handling call
0709 12:15:44.367671 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:44.489365 (+121694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.990321 (+3500956us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002d5d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:47.990676 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275587328}
I20260709 12:15:47.986346 10051 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:48.009935 10049 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:48.012290 10049 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:48.018610 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2281) took 1805 ms. Trace:
I20260709 12:15:48.019050 10128 rpcz_store.cc:276] 0709 12:15:46.212842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.017235 (+1804393us) service_pool.cc:224] Handling call
0709 12:15:48.017723 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.018089 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:48.018113 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:48.018186 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:48.018221 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.018269 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.018393 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:48.026825 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.026983 14170 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:48.027172 14305 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.027941 14305 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:48.018188 10051 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:48.029232 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:48.030213 14170 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:48.021406 14293 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:48.037878 14281 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.422s	user 0.014s	sys 0.021s
I20260709 12:15:48.037277 14305 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:48.047456 10197 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:48.048990 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:48.053584 14075 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:48.054446 14075 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:48.057381 14075 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:48.058007 14075 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:48.059134 14273 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:48.074200 14273 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:48.074682 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45661.1us
I20260709 12:15:48.075660 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:48.075778 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:48.076748 10201 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 15 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:15:48.076876 14273 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:48.077535 14273 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:48.059687 14305 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:48.061648 14057 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:48.078475 14305 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:48.078965 14170 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:48.074195 14075 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.081084 14305 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:48.065706 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:48.050251 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:48.068483 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 641) took 1717 ms. Trace:
I20260709 12:15:48.068370 14286 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:48.082155 10126 rpcz_store.cc:276] 0709 12:15:46.351348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.953736 (+602388us) service_pool.cc:224] Handling call
0709 12:15:46.971635 (+ 17899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.998808 (+ 27173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.067933 (+1069125us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001d5954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:48.068290 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28007296}
I20260709 12:15:48.083925 10197 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:48.079411 14170 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:48.084924 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:48.085609 14075 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:48.085732 14170 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.086745 10198 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:48.087657 14170 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:48.071818 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:48.073087 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2108) took 1345 ms. Trace:
I20260709 12:15:48.092645 10203 rpcz_store.cc:276] 0709 12:15:46.727180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.185765 (+458585us) service_pool.cc:224] Handling call
0709 12:15:47.186160 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.187895 (+  1735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.187925 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:47.222348 (+ 34423us) log.cc:844] Serialized 26 byte log entry
0709 12:15:47.408826 (+186478us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:47.408885 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.408962 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:48.072655 (+663693us) raft_consensus.cc:1685] finished
0709 12:15:48.072691 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.072914 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905,"raft.queue_time_us":1115,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":10587,"thread_start_us":72080,"threads_started":1,"wal-append.queue_time_us":201295}
I20260709 12:15:48.095703 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:48.096581 10124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2279) took 1884 ms (client timeout 2182 ms). Trace:
W20260709 12:15:48.096930 10124 rpcz_store.cc:269] 0709 12:15:46.212300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.095214 (+1882914us) service_pool.cc:224] Handling call
0709 12:15:48.096523 (+  1309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.092656 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:48.079248 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:48.081759 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:48.103061 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 600) took 1891 ms (client timeout 1692 ms). Trace:
W20260709 12:15:48.103539 10048 rpcz_store.cc:269] 0709 12:15:46.211921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.102740 (+1890819us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:48.102880 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:15:48.104100 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2277) took 1892 ms (client timeout 1511 ms). Trace:
W20260709 12:15:48.104490 10129 rpcz_store.cc:269] 0709 12:15:46.211730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.103771 (+1892041us) service_pool.cc:211] Skipping call since client already timed out
0709 12:15:48.103898 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:15:48.105427 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:48.106195 10203 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:48.114290 14259 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.119717 14259 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:48.124166 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2392) took 3719 ms (client timeout 2089 ms). Trace:
I20260709 12:15:48.124598 14286 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:48.125125 14286 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.125447 14286 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:48.127970 14259 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:48.128619 14259 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.124702 10046 rpcz_store.cc:269] 0709 12:15:44.404931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.417155 (+ 12224us) service_pool.cc:224] Handling call
0709 12:15:48.123746 (+3706591us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b5400351e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:48.123941 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5935135488}
I20260709 12:15:48.139595 14305 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:48.136744 14283 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.140734 14283 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:48.144506 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65457.8us
I20260709 12:15:48.146461 14120 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:48.147069 14120 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:48.148178 14283 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:48.146299 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68996.1us
I20260709 12:15:48.147197 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2408) took 1393 ms. Trace:
I20260709 12:15:48.129102 14259 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.149530 10054 rpcz_store.cc:276] 0709 12:15:46.753196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.767902 (+ 14706us) service_pool.cc:224] Handling call
0709 12:15:48.146768 (+1378866us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400274cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:48.147004 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25239936}
W20260709 12:15:48.155855 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1671) took 4262 ms (client timeout 1513 ms). Trace:
W20260709 12:15:48.156354 10125 rpcz_store.cc:269] 0709 12:15:43.882310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.882465 (+   155us) service_pool.cc:224] Handling call
0709 12:15:48.143985 (+4261520us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b5400173254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:48.144172 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134084992}
W20260709 12:15:48.157431 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.248862 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:48.148710 14120 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:48.269994 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54642.7us
W20260709 12:15:48.272418 10020 connection.cc:256] RPC call timeout handler was delayed by -2.8692592490001516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 12:15:48.273012 10020 connection.cc:256] RPC call timeout handler was delayed by -2.3814984690002348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:15:48.273317 14331 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.274084 14331 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:48.273316 10020 connection.cc:256] RPC call timeout handler was delayed by -2.1415768080000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 12:15:48.312376 10020 connection.cc:256] RPC call timeout handler was delayed by -1.7377619720000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2799s for a response
W20260709 12:15:48.312654 10020 connection.cc:256] RPC call timeout handler was delayed by -1.6384284880002724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2756s for a response
I20260709 12:15:48.268333 14278 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:48.405735 14278 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:48.406320 14278 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:48.414829 14259 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:48.553905 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.567725 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.703677 10197 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:15:48.763726 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 602809us
W20260709 12:15:48.772022 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.773362 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62430.7us
I20260709 12:15:48.777848 14259 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.787758 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.788321 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.788618 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.788895 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.792689 14273 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:48.798648 14284 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:48.799190 14284 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:48.800321 14284 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:48.779747 14057 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:48.843806 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52269.6us
I20260709 12:15:48.801889 14284 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:48.881922 10151 debug-util.cc:398] Leaking SignalData structure 0x7b0800167280 after lost signal to thread 8907
W20260709 12:15:48.882494 10151 debug-util.cc:398] Leaking SignalData structure 0x7b0800164ae0 after lost signal to thread 8910
W20260709 12:15:48.846185 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60651.4us
I20260709 12:15:48.781652 14170 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:48.939329 14170 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.941650 14170 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:48.948784 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 794430us
I20260709 12:15:48.789455 14259 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.953531 14057 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.982671 14057 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:48.984511 14143 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:48.985291 14143 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:48.986804 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:48.988632 14143 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:48.990015 14057 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:48.942346 14331 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:49.057920 14286 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.000s
W20260709 12:15:49.073179 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49878.1us
W20260709 12:15:49.063283 14278 consensus_meta.cc:287] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.005s
W20260709 12:15:49.079833 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89625.5us
I20260709 12:15:49.067102 14331 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:49.091028 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.096758 14312 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.375s	user 0.010s	sys 0.033s
I20260709 12:15:49.103755 14331 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:49.106490 14187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.014s	sys 0.021s
W20260709 12:15:49.104242 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.112591 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.112821 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.123292 14275 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.123970 14275 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.124779 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:49.125869 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 662) took 2026 ms (client timeout 1947 ms). Trace:
W20260709 12:15:49.126271 10737 rpcz_store.cc:269] 0709 12:15:47.099605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.101148 (+  1543us) service_pool.cc:224] Handling call
0709 12:15:49.124385 (+2023237us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800003998. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:15:49.125749 (+  1364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5273344}
I20260709 12:15:49.128408 14297 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.129230 14259 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.129168 14297 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.145543 14297 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.129796 14170 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.146862 14170 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.130661 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.132082 10728 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:49.150830 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 932) took 1187 ms. Trace:
I20260709 12:15:49.151171 10728 rpcz_store.cc:276] 0709 12:15:47.963653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.131334 (+1167681us) service_pool.cc:224] Handling call
0709 12:15:49.131717 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.150540 (+ 18823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.150742 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:49.132763 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.152494 10124 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:49.153548 10700 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.178.254:37497, user_credentials={real_user=slave}} blocked reactor thread for 1.44635e+06us
I20260709 12:15:49.126191 14275 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.133651 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:49.158716 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45730.3us
I20260709 12:15:49.159025 10130 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:49.079427 14286 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.160023 10128 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:15:49.161232 14286 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.161908 14170 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.134341 14266 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.162781 14266 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.165220 14266 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.169164 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1641) took 3039 ms. Trace:
I20260709 12:15:49.171666 14148 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.172348 14148 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.173965 14120 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:49.174621 14187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.014s	sys 0.021s
I20260709 12:15:49.177582 14266 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:49.143151 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.179500 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.184769 10130 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:49.209076 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:49.210919 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 97581.6us
I20260709 12:15:49.211838 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.212814 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.214079 14275 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:49.214602 14266 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:49.214701 14170 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:49.225946 14308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.005s
I20260709 12:15:49.084352 14278 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.153614 14259 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.231642 10203 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:15:49.226369 14308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.005s	sys 0.005s
I20260709 12:15:49.226480 14286 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:49.223147 14266 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:49.224478 14170 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.277216 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:49.278784 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.266323 14170 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:49.281607 10127 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:49.169641 10202 rpcz_store.cc:276] 0709 12:15:46.129529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.129651 (+   122us) service_pool.cc:224] Handling call
0709 12:15:46.129974 (+   323us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:46.147307 (+ 17333us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:47.057016 (+909709us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b18003989e0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:47.172581 (+115565us) log.cc:844] Serialized 14 byte log entry
0709 12:15:47.409682 (+237101us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:47.416056 (+  6374us) log.cc:844] Serialized 52 byte log entry
0709 12:15:47.416226 (+   170us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:47.416500 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:15:47.587132 (+170632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.587216 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:49.168709 (+1581493us) raft_consensus.cc:1685] finished
0709 12:15:49.168754 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.168965 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116140,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":111581,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":27417,"spinlock_wait_cycles":21118720,"thread_start_us":387016,"threads_started":3,"wal-append.queue_time_us":380122,"wal-append.run_cpu_time_us":2737,"wal-append.run_wall_time_us":1115362}
I20260709 12:15:49.282958 10127 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:49.283775 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.250111 14259 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.274735 14286 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:49.298108 14273 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:15:49.302335 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.303193 10019 leader_election.cc:336] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Timed out: RequestConsensusVote RPC to 127.8.178.195:33595 timed out after 1.960s (SENT)
I20260709 12:15:49.303462 10127 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.304562 10127 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.305642 10122 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:15:49.306245 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2280) took 3093 ms. Trace:
I20260709 12:15:49.306542 10122 rpcz_store.cc:276] 0709 12:15:46.212581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.304879 (+3092298us) service_pool.cc:224] Handling call
0709 12:15:49.305233 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.305994 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.306198 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:49.312081 14259 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.312343 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.314733 14338 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.314764 14259 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.315550 14338 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.315593 14259 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.276661 14275 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:15:49.317975 14259 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.318672 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2398) took 2621 ms. Trace:
I20260709 12:15:49.319039 10055 rpcz_store.cc:276] 0709 12:15:46.697243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.923121 (+1225878us) service_pool.cc:224] Handling call
0709 12:15:47.967640 (+ 44519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.979061 (+ 11421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.318453 (+1339392us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54003fa2d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:49.318601 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101200640}
I20260709 12:15:49.330140 14266 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.331892 14266 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:49.286126 14283 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.334910 14283 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.337956 14283 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.340601 14278 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.342962 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.343998 10728 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:49.302515 14205 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:15:49.307801 14296 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.319054 10054 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.317941 14338 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.368469 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.371208 10055 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:15:49.374032 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.366505 14148 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.359439 14296 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.378364 14296 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.380882 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:49.381886 14163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.015s	sys 0.006s
W20260709 12:15:49.382032 10169 connection.cc:256] RPC call timeout handler was delayed by -3.0952829509999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 12:15:49.382375 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:49.382728 10169 connection.cc:256] RPC call timeout handler was delayed by -3.0952829509999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:15:49.389338 14163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.657s	user 0.016s	sys 0.007s
I20260709 12:15:49.389523 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.390208 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:49.391099 10736 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:49.394465 10732 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:49.394683 14187 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:49.395015 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:49.396293 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:49.396664 10737 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:49.402359 14143 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:49.403337 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.406474 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.407382 14143 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:49.407912 14143 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:49.408890 14143 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.411932 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.413300 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.417503 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.362594 14286 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.418705 14273 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.419310 14273 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.420862 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:49.421533 10055 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.421628 14273 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.423085 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.424069 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.424676 10125 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:49.424832 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.425503 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:49.425586 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.424345 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.427497 10122 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:49.428406 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.429514 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.430212 10122 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:15:49.426770 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.430815 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 593) took 5030 ms. Trace:
I20260709 12:15:49.431257 10126 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.432102 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.432541 14331 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.433043 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.431234 10052 rpcz_store.cc:276] 0709 12:15:44.400077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.400199 (+   122us) service_pool.cc:224] Handling call
0709 12:15:44.400559 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.996634 (+2596075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.430377 (+2433743us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54003e6a54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:49.430642 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5930660224}
I20260709 12:15:49.418236 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:49.426354 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.426743 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:49.424407 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.439795 10121 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:49.439972 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.440874 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.441443 10730 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:49.442003 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.446931 10121 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:49.446267 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2123) took 2035 ms. Trace:
I20260709 12:15:49.460747 10125 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:49.462014 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.462934 10051 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:49.456223 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.466209 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.467530 14102 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.468648 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.470152 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.471010 10728 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.471238 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.471895 10052 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.470197 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.477056 10732 raft_consensus.cc:2368] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11.
I20260709 12:15:49.476651 14170 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.477362 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.477981 10052 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:49.478878 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.479427 10052 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:49.468183 14102 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.477874 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.472572 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.473274 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.482412 10126 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 9: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.476038 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.486080 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.486377 10046 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:15:49.488168 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51442.5us
I20260709 12:15:49.488826 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.488312 10129 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.451562 10049 rpcz_store.cc:276] 0709 12:15:47.411170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.013672 (+602502us) service_pool.cc:224] Handling call
0709 12:15:48.148495 (+134823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.148783 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:48.396245 (+247462us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.077878 (+681633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:49.077938 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:49.077989 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.078059 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.446085 (+368026us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400274cd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:49.446203 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":945648,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":114,"raft.queue_time_us":99185,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":309147520,"thread_start_us":397897,"threads_started":2,"wal-append.queue_time_us":466437}
I20260709 12:15:49.492885 10053 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 15 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:15:49.494954 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.495682 10121 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.497453 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.497980 10127 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:49.501581 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.508481 10122 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
W20260709 12:15:49.515712 10169 connection.cc:256] RPC call timeout handler was delayed by -1.9156643780002014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:15:49.515802 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:49.516324 10169 connection.cc:256] RPC call timeout handler was delayed by -1.8658215479999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:15:49.516691 10169 connection.cc:256] RPC call timeout handler was delayed by -1.8658215479999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:15:49.516595 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:49.517058 10169 connection.cc:256] RPC call timeout handler was delayed by -1.7668438160001187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:15:49.517357 10169 connection.cc:256] RPC call timeout handler was delayed by -1.7533215480000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:15:49.517617 10169 connection.cc:256] RPC call timeout handler was delayed by -1.7533215480000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 12:15:49.517601 10125 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:15:49.518047 10169 connection.cc:256] RPC call timeout handler was delayed by -1.7015026420001504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:15:49.519373 10169 connection.cc:256] RPC call timeout handler was delayed by -1.6669862990002002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:15:49.519672 10169 connection.cc:256] RPC call timeout handler was delayed by -1.6602243650002038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:15:49.519932 10169 connection.cc:256] RPC call timeout handler was delayed by -1.6588215480001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:15:49.520191 10169 connection.cc:256] RPC call timeout handler was delayed by -1.6588215480001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:15:49.520475 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5998627569999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 12:15:49.520689 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5998627569999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 12:15:49.520838 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5481215480001538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:15:49.520982 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5112215480000941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 12:15:49.521124 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3555215480000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:15:49.521266 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3555215480000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:15:49.521406 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3024215479999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 12:15:49.521559 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1008215480001127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24680000000000002s for a response
W20260709 12:15:49.521698 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1008215480001127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24680000000000002s for a response
W20260709 12:15:49.521839 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0504215480000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
W20260709 12:15:49.522135 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0459215480000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2529s for a response
I20260709 12:15:49.522894 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:49.523919 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.524461 10130 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:49.524987 10130 raft_consensus.cc:2410] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:15:49.525914 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.526573 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.518851 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.525808 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.556015 10130 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:49.527266 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.577384 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.577643 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.578706 10129 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:49.498703 14266 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.579342 10201 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:49.581337 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.496703 14338 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:49.582566 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.583274 14344 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:49.583570 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.583320 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.586511 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.586805 14102 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.587338 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.599684 10203 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:49.599565 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:49.600260 10203 raft_consensus.cc:2410] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:15:49.601158 10151 debug-util.cc:398] Leaking SignalData structure 0x7b0800164a00 after lost signal to thread 9987
I20260709 12:15:49.601406 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2394) took 2918 ms. Trace:
W20260709 12:15:49.601680 10151 debug-util.cc:398] Leaking SignalData structure 0x7b0800167160 after lost signal to thread 10007
I20260709 12:15:49.602067 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:49.602978 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba6a0 after lost signal to thread 10079
W20260709 12:15:49.603271 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6220 after lost signal to thread 10080
I20260709 12:15:49.587906 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.601307 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.591300 10737 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
W20260709 12:15:49.595005 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 112937us
I20260709 12:15:49.596908 10125 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:49.598915 10734 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:49.594880 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:49.600208 10048 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:49.604893 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 934) took 1640 ms. Trace:
W20260709 12:15:49.603930 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74702.1us
I20260709 12:15:49.592748 10055 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:15:49.612748 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.605242 10734 rpcz_store.cc:276] 0709 12:15:47.964669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.586102 (+1621433us) service_pool.cc:224] Handling call
0709 12:15:49.604837 (+ 18735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:49.594899 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.616636 10122 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:49.618815 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:49.620786 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08003c21e0 after lost signal to thread 10154
I20260709 12:15:49.625696 10130 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.627116 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:49.628314 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080011ce80 after lost signal to thread 10155
I20260709 12:15:49.628782 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.630228 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:49.632465 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47473.6us
I20260709 12:15:49.633437 10121 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.634966 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:49.635404 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 139032us
I20260709 12:15:49.637130 10051 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:49.593572 14170 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.595969 14338 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.641117 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.642030 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.638407 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.638926 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.643368 10197 raft_consensus.cc:2393] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.644469 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 663) took 2371 ms. Trace:
I20260709 12:15:49.646502 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.647535 10198 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:15:49.601747 10047 rpcz_store.cc:276] 0709 12:15:46.683395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.683524 (+   129us) service_pool.cc:224] Handling call
0709 12:15:46.698789 (+ 15265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.701508 (+  2719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.701537 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:46.701999 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:15:46.747894 (+ 45895us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:46.747943 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.600847 (+2852904us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b54003d0254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:49.600922 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:49.600976 (+    54us) raft_consensus.cc:1685] finished
0709 12:15:49.600990 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.601235 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1019,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":5467520,"thread_start_us":45547,"threads_started":1,"wal-append.queue_time_us":237990,"wal-append.run_cpu_time_us":9944,"wal-append.run_wall_time_us":1470762}
I20260709 12:15:49.653045 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.655268 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.656378 14266 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.675405 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.652596 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:49.676461 10051 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:49.657735 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:49.658362 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 52991.8us
I20260709 12:15:49.650262 10055 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:49.651669 10732 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:49.659675 10734 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 5.
I20260709 12:15:49.639072 14148 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:49.662189 10047 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:49.663528 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60247.8us
I20260709 12:15:49.663955 14116 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:49.664362 10202 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:49.659675 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.642695 14331 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:49.646498 14338 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:49.667769 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:49.668511 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:49.669620 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:49.670491 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2293) took 3243 ms (client timeout 1618 ms). Trace:
I20260709 12:15:49.670771 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.657194 14296 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.645035 10733 rpcz_store.cc:276] 0709 12:15:47.126984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.331273 (+2204289us) service_pool.cc:224] Handling call
0709 12:15:49.331684 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.332070 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:49.369805 (+ 37735us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.497031 (+127226us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.497516 (+   485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:49.497568 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:49.497607 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.497670 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.497772 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81288,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":1668,"raft.queue_time_us":8847,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2325,"spinlock_wait_cycles":44630528,"thread_start_us":121929,"threads_started":3,"wal-append.queue_time_us":112012}
I20260709 12:15:49.684397 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:49.688139 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48760.3us
I20260709 12:15:49.688997 10121 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:49.691084 10701 connection.cc:256] RPC call timeout handler was delayed by -1.0585166889998163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:15:49.687485 10123 rpcz_store.cc:269] 0709 12:15:46.272606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.311121 (+ 38515us) service_pool.cc:224] Handling call
0709 12:15:49.490985 (+3179864us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000997d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:49.515912 (+ 24927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916264832}
I20260709 12:15:49.692662 14358 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:49.693075 10728 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:49.693140 14358 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.693497 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.694648 14116 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.692338 14296 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.696806 14296 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.696952 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:49.696830 14116 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:49.699146 14116 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:49.699606 14116 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.699697 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.700058 14116 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:49.700182 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.701146 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.701767 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.683207 14222 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.694578 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.687641 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.719300 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
W20260709 12:15:49.704257 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49069us
I20260709 12:15:49.719883 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.702773 10124 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:49.683838 14148 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.703286 10125 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:49.700479 14339 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:49.694494 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.721764 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.722143 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.702211 14259 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:49.685591 14331 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:49.730897 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.725111 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:49.731485 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:49.726199 10130 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 7.
W20260709 12:15:49.735539 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 51528.8us
I20260709 12:15:49.737002 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.739995 10124 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:49.740454 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.741225 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.722064 14170 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:49.723816 14296 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:49.749451 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.727667 14148 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:49.702937 14358 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:49.753925 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.731603 14331 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.757238 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.757970 10123 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:49.728243 14339 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:49.751398 14361 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:49.759428 10732 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:49.757104 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.752755 14286 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:49.754721 14259 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:49.743348 14344 consensus_queue.cc:1243] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:15:49.756712 14305 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:49.764822 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.767076 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:49.757283 14362 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:49.760839 14278 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:49.771760 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.772114 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.763636 14170 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:49.773967 10047 raft_consensus.cc:2410] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:15:49.774948 10733 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:49.776057 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.761656 14106 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:15:49.777210 14367 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:49.767200 14259 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.777976 14259 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.778337 14275 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.779162 14275 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.781343 14275 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.781781 14367 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.782194 14367 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.763742 14361 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:49.763268 14222 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:49.761325 14339 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:49.756837 14273 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:15:49.789214 14273 consensus_queue.cc:1243] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:49.789763 14273 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:49.790103 14273 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:49.790258 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.768872 14344 raft_consensus.cc:2764] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:15:49.786582 14355 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:15:49.769419 14305 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:49.794010 10051 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
W20260709 12:15:49.777420 14357 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:15:49.777650 14228 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:49.773419 14278 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.784929 14170 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.799750 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:49.788524 14361 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:49.804114 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49354.9us
I20260709 12:15:49.805480 14170 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:49.804775 10052 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:15:49.800112 14305 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:49.811333 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110287us
I20260709 12:15:49.804018 14228 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:49.812268 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.806146 14278 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:49.803452 14362 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:49.814214 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:49.810201 14266 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:49.824256 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53690.3us
I20260709 12:15:49.825227 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:49.816004 14228 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.824275 14338 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.840209 14338 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.833600 14259 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.837148 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:49.837095 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.836517 13907 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:49.842555 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.843122 10048 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:49.849380 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.846213 10129 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:49.848627 14286 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:49.816303 14344 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:15:49.863205 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49054.7us
I20260709 12:15:49.845949 14331 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.869295 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:49.872242 10052 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.873693 14331 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.874349 10198 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:49.875034 10051 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.851101 14363 raft_consensus.cc:2764] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:15:49.877322 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 177708us
W20260709 12:15:49.880250 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51486.9us
I20260709 12:15:49.864728 14338 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:49.865514 14344 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:49.875046 14369 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:49.863903 14286 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.886402 10201 pending_rounds.cc:85] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 12
I20260709 12:15:49.887416 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:49.888938 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98738.4us
I20260709 12:15:49.875034 14148 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.886209 14344 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:49.903776 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.905005 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:49.886720 10201 pending_rounds.cc:107] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:15:49.907648 10201 raft_consensus.cc:2889] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:49.908922 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.910773 10701 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.914872 14187 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:49.915182 14363 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:49.916647 14361 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:15:49.919260 14077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.189s	user 0.074s	sys 0.062s
I20260709 12:15:49.919368 14369 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:49.883014 14338 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:49.920069 14338 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:49.920287 10198 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:49.881249 14273 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.921253 14259 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:49.887619 14286 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:49.922796 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:49.923255 14305 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.924201 13907 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:49.919732 14077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.190s	user 0.074s	sys 0.062s
I20260709 12:15:49.924698 13907 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:49.926843 14369 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.927713 13907 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.926136 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:49.931257 10051 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:49.923810 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:49.950027 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 73766.8us
I20260709 12:15:49.921368 14273 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:49.961122 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:49.948698 14163 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:49.957860 14266 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:49.970844 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.919411 14228 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:49.966888 14361 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:49.978016 14373 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 12:15:49.979970 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56255.7us
I20260709 12:15:49.981513 14367 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.009809 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:49.982587 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71957.3us
I20260709 12:15:49.990556 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2118) took 1918 ms. Trace:
I20260709 12:15:50.010951 10198 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:49.990939 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.963433 14331 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:15:49.995048 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:49.995214 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:49.997223 10127 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:49.997390 10051 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:49.978523 14259 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:49.984972 14344 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:49.978785 14305 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:50.015700 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:50.018213 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2117) took 1977 ms (client timeout 2032 ms). Trace:
W20260709 12:15:50.020879 10196 rpcz_store.cc:269] 0709 12:15:48.040466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.945985 (+1905519us) service_pool.cc:224] Handling call
0709 12:15:50.018163 (+ 72178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:50.010020 14296 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.040966 10197 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:50.014626 14369 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:49.977013 14116 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.010929 10204 rpcz_store.cc:276] 0709 12:15:48.040920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.701017 (+1660097us) service_pool.cc:224] Handling call
0709 12:15:49.701366 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.701656 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:15:49.702011 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.953676 (+251665us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.959138 (+  5462us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.959292 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:49.959338 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:49.959379 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.959453 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.959567 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13420,"prepare.queue_time_us":33143,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":25316,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":12253,"spinlock_wait_cycles":11530240,"thread_start_us":248044,"threads_started":2,"wal-append.queue_time_us":165604}
I20260709 12:15:50.055507 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:50.058284 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51399.4us
W20260709 12:15:50.057179 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 88960.4us
I20260709 12:15:50.088730 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.091161 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.047816 14297 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:50.138793 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.138834 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:50.148088 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59434.7us
W20260709 12:15:50.148448 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.153151 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62482.1us
I20260709 12:15:50.090868 14187 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:50.155028 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66671.8us
I20260709 12:15:50.155750 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:50.153043 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:50.049371 14283 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:15:50.048375 14362 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:15:50.160148 10200 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:50.056025 14296 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.157702 14331 consensus_queue.cc:1243] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:15:50.180079 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.137672 14278 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.181322 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.183249 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:50.157384 14148 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:50.184160 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:50.231635 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66954.4us
I20260709 12:15:50.237859 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:50.236333 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.251673 10020 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.252640 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.184311 14391 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:50.182144 14259 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:50.240955 14284 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:50.265611 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.242954 14189 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:50.267417 10200 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:50.177426 14358 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.245467 14380 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.252413 14331 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:50.260007 14077 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:50.260963 14148 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:50.279845 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.264784 14228 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:50.265460 14391 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.282604 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:50.297194 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 144248us
I20260709 12:15:50.283068 10204 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 4.
I20260709 12:15:50.298784 14387 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:50.299185 10204 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:50.299729 10199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.604s	user 0.023s	sys 0.045s
W20260709 12:15:50.299990 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080023fd40 after lost signal to thread 10228
W20260709 12:15:50.300336 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2040 after lost signal to thread 10229
I20260709 12:15:50.300484 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:50.301448 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080038cc80 after lost signal to thread 10761
W20260709 12:15:50.301759 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080014d900 after lost signal to thread 10762
I20260709 12:15:50.285387 14344 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:50.287742 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:50.300112 10199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.605s	user 0.023s	sys 0.045s
I20260709 12:15:50.301731 10197 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:50.306473 10197 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:50.277638 14367 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:50.277582 14331 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.320740 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.279394 14077 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:50.333750 10731 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:50.294684 14148 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.296689 14189 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:15:50.317466 14375 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 12:15:50.349532 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.351189 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 930) took 3176 ms. Trace:
I20260709 12:15:50.299196 14387 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:50.307049 14391 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:50.343246 14284 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:50.282668 14380 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.365888 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.362797 10731 rpcz_store.cc:276] 0709 12:15:47.174300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.049150 (+2874850us) service_pool.cc:224] Handling call
0709 12:15:50.157190 (+108040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:50.350929 (+193739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:50.351131 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:50.344787 14331 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:50.367601 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47075.8us
W20260709 12:15:50.373524 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 85838.7us
I20260709 12:15:50.343991 14116 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:50.379611 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.356842 14148 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:50.354498 14394 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.384225 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:50.361013 14369 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:50.367386 10197 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.358856 14388 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:50.358915 14367 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.397078 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.364573 14390 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:50.374084 14362 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:50.365273 14189 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:50.374442 14278 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:50.430847 14170 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.002s
I20260709 12:15:50.449676 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:50.459100 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.428131 10197 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:50.451505 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.448992 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:50.429159 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 245051us
I20260709 12:15:50.429808 14402 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:50.430575 14358 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:50.430995 14381 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:15:50.441347 14383 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:15:50.432906 14286 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.004s
I20260709 12:15:50.434773 14284 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.435840 14398 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:50.424099 14394 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:50.437323 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 185720us
I20260709 12:15:50.364643 14259 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.518211 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.457357 10202 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:50.418741 14388 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:50.451232 14386 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:15:50.431860 14409 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:50.516769 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.438675 14296 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:50.450907 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.440506 14367 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.441100 14397 raft_consensus.cc:2764] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:50.458412 14377 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.444087 14380 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:50.555967 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.561305 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.556201 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.484457 14170 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.530049 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.504668 14402 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.534556 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.556942 10197 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:50.532800 14278 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.553191 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.563532 10204 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
W20260709 12:15:50.520458 14379 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:15:50.562913 10200 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:50.541092 14388 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:50.547089 14409 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:50.565574 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 407919us
I20260709 12:15:50.592207 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:50.601508 10197 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:50.602460 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 72488.3us
I20260709 12:15:50.519112 14286 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.559857 14369 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:50.562254 14401 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.452955 14077 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.609305 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.607941 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:50.655810 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 97612.4us
I20260709 12:15:50.452721 14387 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.555977 14404 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:50.570031 14297 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:50.564656 14402 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:50.659638 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:50.654932 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47143.5us
W20260709 12:15:50.660441 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51216.5us
I20260709 12:15:50.604066 14409 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:50.630139 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.577091 14367 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:50.665844 10129 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:50.562085 14296 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:15:50.668413 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.669842 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:50.687075 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 82180.9us
I20260709 12:15:50.690315 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:50.690996 10733 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:50.692682 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.571038 14278 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.694793 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1689) took 1262 ms. Trace:
I20260709 12:15:50.696377 10126 rpcz_store.cc:276] 0709 12:15:49.425972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.432813 (+  6841us) service_pool.cc:224] Handling call
0709 12:15:50.688278 (+1255465us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54000992d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:50.688453 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111946496}
I20260709 12:15:50.698016 10728 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:50.700594 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:50.579620 14421 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:15:50.654297 14187 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:15:50.575673 14400 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.249s
I20260709 12:15:50.577437 14408 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:15:50.575575 14377 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.718327 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:50.611658 14189 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:50.719012 10731 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:50.719259 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.720372 14365 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:50.720836 14365 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:50.721220 14365 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:50.721616 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 61226.3us
I20260709 12:15:50.729722 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.698410 14397 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.733281 14411 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:50.737013 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:50.705811 14369 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:15:50.716702 14339 consensus_meta.cc:287] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
W20260709 12:15:50.719017 14414 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:15:50.722615 14077 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:50.788745 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.789438 10202 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:15:50.786203 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 51200.8us
W20260709 12:15:50.790795 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.794147 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 45952.9us
I20260709 12:15:50.801999 10128 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:50.746455 14369 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:50.808614 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78962.9us
I20260709 12:15:50.809875 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:50.700778 14401 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.793426 14387 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:50.789575 14390 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:50.890636 10731 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
W20260709 12:15:50.923738 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 118816us
W20260709 12:15:50.890576 14338 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.960s	user 0.012s	sys 0.007s
I20260709 12:15:50.839885 14335 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:50.894487 14286 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:50.896324 14170 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:50.795500 14411 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:50.927731 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:50.813187 14273 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.001s
I20260709 12:15:50.930105 10733 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
W20260709 12:15:50.930835 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.810755 14369 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:50.918032 10202 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:50.932493 14390 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:50.950049 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.784996 14339 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.958329 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:50.961119 10202 raft_consensus.cc:2376] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10. Re-sending same reply.
I20260709 12:15:50.963421 10121 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:50.956338 10195 raft_consensus.cc:2376] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12. Re-sending same reply.
W20260709 12:15:50.963011 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.009s	sys 0.028s
W20260709 12:15:50.970136 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.028s
W20260709 12:15:50.970758 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 591176us
I20260709 12:15:50.971589 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.973102 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:50.973757 14424 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.197s	user 0.000s	sys 0.008s
I20260709 12:15:50.974102 14286 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:50.974365 14374 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.008s
I20260709 12:15:50.973754 10195 raft_consensus.cc:2376] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11. Re-sending same reply.
I20260709 12:15:50.976558 10195 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:50.952486 14335 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:50.980335 10049 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:50.802259 14397 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:50.975263 14425 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:15:50.996207 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:50.799829 14297 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:50.994766 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:50.984251 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:15:51.001273 14331 consensus_meta.cc:287] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.000s
I20260709 12:15:51.004571 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.010414 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2139) took 1057 ms. Trace:
W20260709 12:15:51.010878 14148 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.564s	user 0.002s	sys 0.007s
I20260709 12:15:51.011158 14377 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:50.956961 14338 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.015146 10731 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:50.958385 14390 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:51.014036 10198 rpcz_store.cc:276] 0709 12:15:49.952781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.952935 (+   154us) service_pool.cc:224] Handling call
0709 12:15:49.966125 (+ 13190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:50.015197 (+ 49072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.010126 (+994929us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.010319 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102662400}
I20260709 12:15:50.979600 14394 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:51.049108 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44621.8us
I20260709 12:15:50.982955 14392 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:50.981762 14170 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:15:51.099604 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 289768us
I20260709 12:15:51.100601 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.024452 14401 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:50.982751 14387 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:15:51.048272 14284 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:51.011720 14411 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.018756 14331 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.142365 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:51.022933 14148 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.026945 13907 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:15:51.103901 14377 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:51.027323 14363 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 12:15:51.155560 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51411.5us
I20260709 12:15:51.070688 14365 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.079680 14388 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.149670 14392 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:51.168614 10731 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
W20260709 12:15:51.189860 14430 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:15:51.157958 14273 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:15:51.167623 14438 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:51.202206 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:51.205380 14148 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.206256 14397 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.219660 10736 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:51.146095 14335 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.210790 14278 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:51.208261 14412 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.464s	user 0.040s	sys 0.026s
I20260709 12:15:51.248101 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.254279 14397 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:51.257660 14397 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:51.258033 14397 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:51.261020 14363 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:51.263521 14365 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:51.264945 14439 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:15:51.273741 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 658) took 4150 ms (client timeout 2229 ms). Trace:
W20260709 12:15:51.274235 10735 rpcz_store.cc:269] 0709 12:15:47.064660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.076471 (+ 11811us) service_pool.cc:224] Handling call
0709 12:15:51.195542 (+4119071us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:51.214525 (+ 18983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6486613888}
I20260709 12:15:51.213796 14438 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:51.278466 14438 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:51.283108 14335 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:51.289419 14388 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:51.295670 14359 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.639s	user 0.005s	sys 0.000s
W20260709 12:15:51.300413 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.302831 14338 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.220376 14339 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:51.312363 14409 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 12:15:51.312896 14409 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:51.316459 14391 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.001s
I20260709 12:15:51.316947 14391 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.321033 14331 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:51.327762 14402 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
I20260709 12:15:51.328315 14402 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:51.330979 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 128856us
I20260709 12:15:51.332258 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.333449 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:51.334909 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 138276us
I20260709 12:15:51.337045 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:51.340889 13907 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:51.341471 13907 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:51.342634 13907 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.367820 14278 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:51.368559 14278 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:51.371862 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.376752 14409 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.390842 14391 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:51.397686 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60711.6us
I20260709 12:15:51.398743 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.399580 14363 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:51.405961 14369 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.408265 14369 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.415367 14402 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.416664 14148 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:51.417781 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84406us
I20260709 12:15:51.418326 14331 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:51.423177 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:51.481186 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.433408 14391 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:51.371668 14278 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.461407 14077 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:51.462659 14296 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:15:51.473874 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:51.494233 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:51.496066 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.027s
W20260709 12:15:51.497290 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.004s	sys 0.027s
W20260709 12:15:51.497751 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 686689us
I20260709 12:15:51.498597 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:51.490991 14296 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:51.508050 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 794) took 2117 ms. Trace:
W20260709 12:15:51.507814 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 344353us
I20260709 12:15:51.505352 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:51.489290 14365 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:51.509428 10736 rpcz_store.cc:276] 0709 12:15:49.380769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.414201 (+ 33432us) service_pool.cc:224] Handling call
0709 12:15:51.218050 (+1803849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:51.245985 (+ 27935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.497782 (+251797us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400731250. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:51.497935 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4054909312}
I20260709 12:15:51.493201 14297 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.512496 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:51.516522 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.517024 10019 leader_election.cc:400] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11.
I20260709 12:15:51.517937 10019 leader_election.cc:403] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:51.519853 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.520677 10130 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:51.517959 10125 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:51.498098 14163 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:51.524753 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.524077 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:51.526361 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50390.8us
I20260709 12:15:51.496533 14278 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:51.491918 14391 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.530629 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.494799 14077 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.531795 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.530550 14331 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:51.492059 14438 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.517529 14369 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:51.549597 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.547104 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.547605 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.582188 10125 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:51.490010 14390 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.528255 14388 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:51.552096 10122 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:51.528754 14402 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:51.528630 14163 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:51.585839 10126 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:51.586814 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59854.8us
W20260709 12:15:51.592509 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 75616.5us
I20260709 12:15:51.594192 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.595801 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:51.598129 14438 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.600932 14077 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.601491 14077 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.603085 14419 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:51.603492 14419 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:51.603856 14391 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.546525 14392 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11.
I20260709 12:15:51.604374 14419 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.605357 14296 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:51.606419 14296 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:51.611006 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.516973 14365 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.613503 14365 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.613991 14365 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.582060 14331 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:51.615790 14382 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.474s	user 0.006s	sys 0.008s
I20260709 12:15:51.616770 14331 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.543782 14278 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.618891 14278 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.526068 14297 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.620872 14297 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:51.551515 14421 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:51.542857 14338 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:51.621868 14338 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.623852 14338 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:51.624567 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2148) took 1853 ms (client timeout 1564 ms). Trace:
W20260709 12:15:51.624953 10048 rpcz_store.cc:269] 0709 12:15:49.771346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.771496 (+   150us) service_pool.cc:224] Handling call
0709 12:15:51.624379 (+1852883us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b5400321254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:51.624494 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159378688}
W20260709 12:15:51.626287 14444 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:15:51.627002 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 689) took 1707 ms. Trace:
I20260709 12:15:51.627374 10129 rpcz_store.cc:276] 0709 12:15:49.919172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.919918 (+   746us) service_pool.cc:224] Handling call
0709 12:15:49.920183 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:50.668395 (+748212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.626773 (+958378us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003a0554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.626936 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714441600}
W20260709 12:15:51.630689 14102 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:15:51.634946 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 687) took 1789 ms. Trace:
I20260709 12:15:51.635339 10121 rpcz_store.cc:276] 0709 12:15:49.845473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.847012 (+  1539us) service_pool.cc:224] Handling call
0709 12:15:49.847329 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:50.963797 (+1116468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.634699 (+670902us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400243954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.634886 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565997952}
I20260709 12:15:51.636513 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:51.637341 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.637945 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 685) took 2022 ms. Trace:
I20260709 12:15:51.601950 14077 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.648038 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:51.604907 14388 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:51.649006 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:51.656474 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.657310 10125 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:51.664455 10733 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
W20260709 12:15:51.665483 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.638299 10124 rpcz_store.cc:276] 0709 12:15:49.615797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.752505 (+136708us) service_pool.cc:224] Handling call
0709 12:15:49.752800 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.759581 (+  6781us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:15:49.764443 (+  4862us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.929668 (+165225us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b180042dae0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a3522 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:50.580286 (+650618us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180042dae0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:50.654174 (+ 73888us) log.cc:844] Serialized 14 byte log entry
0709 12:15:50.811101 (+156927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:50.811140 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:50.811170 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.637751 (+826581us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b5400099cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.637792 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.637897 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15791,"prepare.queue_time_us":6352,"raft.queue_time_us":39733,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":5245,"spinlock_wait_cycles":30744832,"thread_start_us":141906,"threads_started":1}
I20260709 12:15:51.668919 14102 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:51.670989 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 734) took 1804 ms. Trace:
W20260709 12:15:51.671484 14441 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:15:51.671478 10201 rpcz_store.cc:276] 0709 12:15:49.867504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.875324 (+  7820us) service_pool.cc:224] Handling call
0709 12:15:49.880291 (+  4967us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:49.916200 (+ 35909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:49.916229 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:49.916739 (+   510us) log.cc:844] Serialized 52 byte log entry
0709 12:15:49.967690 (+ 50951us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:49.967730 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.967795 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.669989 (+1702194us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b2400260348. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e1fb0 00007fc17e358488 00007fc17e358be8 00007fc17e330398 00007fc17e32b76a 00007fc17e32abb6
0709 12:15:51.670580 (+   591us) raft_consensus.cc:1685] finished
0709 12:15:51.670605 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.670904 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":446,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":10892544,"thread_start_us":50551,"threads_started":1,"wal-append.queue_time_us":94737}
I20260709 12:15:51.673486 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1679) took 1019 ms. Trace:
I20260709 12:15:51.674316 14427 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:51.674777 14427 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:51.675179 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 728) took 4631 ms. Trace:
I20260709 12:15:51.673840 10202 rpcz_store.cc:276] 0709 12:15:50.654642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.967117 (+312475us) service_pool.cc:224] Handling call
0709 12:15:51.013174 (+ 46057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:51.097514 (+ 84340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:51.097548 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:51.104560 (+  7012us) log.cc:844] Serialized 26 byte log entry
0709 12:15:51.463989 (+359429us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:51.464031 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.464118 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.673271 (+209153us) raft_consensus.cc:1685] finished
0709 12:15:51.673292 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.673424 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23104,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":304290,"threads_started":1,"wal-append.queue_time_us":360898}
W20260709 12:15:51.677865 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 82131.4us
I20260709 12:15:51.683497 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:51.685807 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2152) took 1823 ms. Trace:
I20260709 12:15:51.686251 10049 rpcz_store.cc:276] 0709 12:15:49.862457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.866183 (+  3726us) service_pool.cc:224] Handling call
0709 12:15:49.879054 (+ 12871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:51.015706 (+1136652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.685539 (+669833us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400309b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.685743 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532325248}
I20260709 12:15:51.680714 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.689744 10130 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:51.689217 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:51.690814 10124 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:51.692194 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98076.8us
I20260709 12:15:51.693157 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.663635 14380 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:51.675565 10199 rpcz_store.cc:276] 0709 12:15:47.044134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.342504 (+298370us) service_pool.cc:224] Handling call
0709 12:15:47.355220 (+ 12716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.600757 (+245537us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:47.695158 (+ 94401us) log.cc:844] Serialized 14 byte log entry
0709 12:15:50.348879 (+2653721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:50.361800 (+ 12921us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:50.388434 (+ 26634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.674942 (+1286508us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54000622d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:51.674983 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.675095 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94238,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":85630,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":6109,"spinlock_wait_cycles":183430912,"thread_start_us":2775854,"threads_started":2,"wal-append.queue_time_us":284236,"wal-append.run_cpu_time_us":1727,"wal-append.run_wall_time_us":1003741}
I20260709 12:15:51.674335 14390 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:51.689213 14438 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:51.685115 14373 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:51.683658 14102 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:51.717825 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:51.614385 14365 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.722730 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:51.723398 10050 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:51.725199 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:51.730108 10047 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:51.731982 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:51.732648 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:51.733495 10048 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:51.701081 14402 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:51.675626 14427 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.713645 14331 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.713035 14380 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:51.713258 14419 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:51.810925 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:51.811626 10050 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:51.816453 10052 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:51.731681 14339 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:51.820653 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 81166.2us
I20260709 12:15:51.821962 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:51.823534 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.720603 14296 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:15:51.738196 14338 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.825557 14378 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:15:51.828238 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:51.824905 14175 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 12:15:51.825924 14390 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:51.846165 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:51.838330 14429 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.885s	user 0.005s	sys 0.010s
I20260709 12:15:51.838711 14196 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:15:51.852387 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:51.854919 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:51.860977 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.862532 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:51.863286 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.860595 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:51.864665 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:51.871441 10048 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:51.732641 10053 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:51.872478 10125 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:52.040267 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 697) took 1482 ms. Trace:
I20260709 12:15:52.036295 10122 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
W20260709 12:15:52.084321 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.963534 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.137701 10052 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:52.036970 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.138074 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:51.964638 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.139292 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:52.139714 10055 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:51.939327 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.827229 14427 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:52.075816 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 231078us
I20260709 12:15:51.991768 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.118165 10126 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
W20260709 12:15:52.040095 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.945199 10195 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:51.945536 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.143337 10203 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:15:51.971764 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.144670 10196 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:51.901271 10130 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:52.135574 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.086454 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2131) took 2711 ms. Trace:
I20260709 12:15:51.944639 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.145720 10197 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:52.146404 10198 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.136175 10200 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:52.139148 10127 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
W20260709 12:15:52.074296 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 223554us
I20260709 12:15:52.135336 10128 rpcz_store.cc:276] 0709 12:15:50.557524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.562405 (+  4881us) service_pool.cc:224] Handling call
0709 12:15:50.688445 (+126040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:50.803993 (+115548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.588842 (+784849us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000992d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:52.040062 (+451220us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000992d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:52.040205 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549884160}
W20260709 12:15:52.149993 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 286777us
I20260709 12:15:52.083648 10050 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:52.152024 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:51.826819 14077 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.153621 10733 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:51.990857 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.141396 10204 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:51.738216 14369 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:51.735009 14438 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.146116 10054 rpcz_store.cc:276] 0709 12:15:49.375037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.383487 (+  8450us) service_pool.cc:224] Handling call
0709 12:15:49.401195 (+ 17708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:49.458323 (+ 57128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:49.458357 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:49.475416 (+ 17059us) log.cc:844] Serialized 26 byte log entry
0709 12:15:50.693498 (+1218082us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003fb500. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:15:50.787846 (+ 94348us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:50.798596 (+ 10750us) log.cc:844] Serialized 14 byte log entry
0709 12:15:51.018666 (+220070us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b18003fb500. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6712a6 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db
0709 12:15:51.625246 (+606580us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18003fb500. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:51.729459 (+104213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.729536 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.837693 (+108157us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:52.086181 (+248488us) raft_consensus.cc:1685] finished
0709 12:15:52.086206 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.086360 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2148,"prepare.queue_time_us":10444,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":169541,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":17288,"spinlock_wait_cycles":58641024,"thread_start_us":198228,"threads_started":2,"wal-append.queue_time_us":1363934}
I20260709 12:15:52.175238 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.181810 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.097186 14453 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:52.184286 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.182384 10048 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:52.086203 14365 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:52.182928 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.183162 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:51.731410 14397 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.187554 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:51.830647 14421 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.346s
I20260709 12:15:52.189491 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.192144 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.197381 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.198025 10197 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:52.191386 10201 raft_consensus.cc:2376] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11. Re-sending same reply.
I20260709 12:15:52.197383 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.198336 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.201010 10048 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:52.199872 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:52.201180 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 372435us
W20260709 12:15:52.201865 10124 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
I20260709 12:15:52.202268 10124 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:52.202402 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.203189 10054 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:52.171295 14378 raft_consensus.cc:2764] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:15:52.010895 14175 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 12:15:52.205184 10733 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:52.210156 10733 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:52.196755 10049 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:15:52.172060 14449 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.205406 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:51.729521 14388 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:52.186652 14106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.014s	sys 0.027s
I20260709 12:15:52.208994 10732 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:52.159358 14451 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:52.209542 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.216300 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.189563 14077 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.206180 10126 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:15:52.218729 10052 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:52.104139 14163 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.194816 14205 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.223691 10728 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:51.936874 14331 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.184381 14453 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:52.209040 14369 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:52.222731 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.228618 10048 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:51.875216 14338 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.228885 10126 pending_rounds.cc:85] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 6
I20260709 12:15:52.244165 10126 pending_rounds.cc:107] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:15:52.230057 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.244316 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.221647 10733 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.205585 14259 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:52.194939 14349 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:51.972836 14102 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.239224 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:52.233906 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.250911 10196 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:52.181566 14148 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:52.227454 14106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.015s	sys 0.027s
I20260709 12:15:52.035892 14380 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:51.998629 14402 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.241580 10200 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:52.241665 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:52.220853 14431 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:52.206713 14373 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:52.244468 10126 raft_consensus.cc:2889] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:52.245306 10054 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:52.246026 10736 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:52.251196 10201 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:52.233809 14189 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:52.252123 10047 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:52.253125 10733 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:52.227716 14443 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:52.255921 10048 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:52.257078 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.262753 10052 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:52.264362 14397 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.237633 14378 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.270341 14438 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.271679 14453 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:52.274276 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.274658 14365 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:52.277716 14331 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.250264 14451 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:52.251857 14057 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:52.253824 14349 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.281181 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.290789 10198 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:52.285075 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:52.324592 10195 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:52.295539 10201 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:52.325222 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:52.325457 14305 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:52.326256 14305 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:52.252816 14205 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.327392 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.328677 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:52.329067 14205 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.329403 14222 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:52.235524 14449 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.302538 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.280565 14431 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.330298 14222 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:52.330588 14431 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:52.330698 14222 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.331097 14222 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.331525 14418 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:52.331944 14418 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.332217 14449 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.306862 14163 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.290314 14434 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:52.332773 14418 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:52.333721 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.237416 14077 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.334312 10054 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:15:52.331197 14175 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:52.335467 14175 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:52.335917 14175 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:52.310083 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.325280 10201 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:52.289131 10200 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:52.338399 10201 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.338877 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.339689 10201 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:52.340608 10200 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:52.329658 14205 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:52.284329 14189 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.343320 14205 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.343760 14205 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.344122 14459 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:52.343959 14189 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.345412 14189 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:52.334089 14418 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.346583 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.347267 10198 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:15:52.318715 10733 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:15:52.292564 14373 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:52.357049 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.359323 10201 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:52.329772 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:52.379846 10047 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:52.304966 14365 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:52.384099 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 199869us
I20260709 12:15:52.312251 14397 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:52.304683 14443 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:52.385540 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55845us
I20260709 12:15:52.408893 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:52.393178 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 96548.3us
I20260709 12:15:52.308235 14338 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.412628 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:52.301029 14378 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:52.403147 14419 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 12:15:52.399538 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.379266 14057 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.397847 14393 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:52.401109 14259 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.398090 14365 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:52.426208 10197 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:52.427798 14349 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.423849 14275 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:15:52.353116 14463 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:15:52.415920 14434 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:52.410306 14453 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.436218 10203 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 6.
I20260709 12:15:52.411430 14392 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:52.352768 14369 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.455263 10199 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:52.430267 14077 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.397797 14222 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.465158 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.497255 10051 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:52.423081 14397 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.483067 14443 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.485764 10053 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:52.487813 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.488018 14175 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.488598 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.491637 10048 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:52.492825 14369 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.472452 14338 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:52.494894 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.495785 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.462883 14434 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:52.451838 14470 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:15:52.499402 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.532301 10049 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:52.499662 14057 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:52.525365 10702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 2.649s (SENT) [suppressed 38 similar messages]
I20260709 12:15:52.500147 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.500530 14222 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.500711 14259 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.538704 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.501634 10055 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:52.451898 13906 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:52.502976 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.541836 10125 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:52.503677 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.504983 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.506004 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.506153 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.543555 10130 raft_consensus.cc:2376] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14. Re-sending same reply.
I20260709 12:15:52.508633 14205 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.510486 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.452179 14393 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.521252 10127 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:52.533093 10051 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:15:52.533195 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.457034 14431 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.543046 10052 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:52.532373 14434 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.454062 14373 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.564657 14397 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:52.573541 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 159753us
I20260709 12:15:52.574225 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.508654 14419 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:15:52.546780 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.580224 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.580948 10129 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:52.580854 10125 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:52.549775 14393 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.545353 10051 pending_rounds.cc:85] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 10
I20260709 12:15:52.582046 10051 pending_rounds.cc:107] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:15:52.582504 10051 raft_consensus.cc:2889] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:52.577216 10128 raft_consensus.cc:2410] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:52.571806 13906 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.547825 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.587168 10052 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:52.591105 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.582650 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.604005 10122 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:52.579845 14222 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:15:52.649205 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.649906 10203 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.650578  9950 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 6 to 8, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.582718 14405 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:15:52.654400 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.655089 10196 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:15:52.656474  9941 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.379s	user 0.007s	sys 0.006s
I20260709 12:15:52.690933 10129 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:52.691308 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.692276 10125 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:15:52.700778 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 175441us
I20260709 12:15:52.711455 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.715755 10052 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:52.598147 14284 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:52.730419 10203 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:52.730939 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.584570 14427 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 12:15:52.728029 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.700310 14455 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.752069 10728 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:15:52.755388 10730 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:52.761997 10052 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:52.769667 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.762532 13906 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.773741 14175 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.777091 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.778038 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.778738 10047 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:15:52.779023 10050 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:15:52.781298 14470 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.781813 14470 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.782836 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.783157 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.783459 10055 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:52.783852 10051 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:52.777519 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.784369 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.784739 10054 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:52.784894 10055 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:52.785733 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.786339 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:52.784021 14470 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.790797 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.792096 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.793198 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.784602 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.794612 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.801574 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.803100 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:52.703437 14398 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:15:52.804798 10052 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:52.803544 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:52.717236 14189 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:15:52.803534 10053 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:52.704522 14405 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:15:52.807585 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:52.809370 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:52.814486 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.817751 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.817885 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.821200 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.821892 10047 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:52.824209 10734 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:15:52.817299 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:52.750723 14284 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.834405 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.838835 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.839742 10129 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:52.832057 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:52.820406 14458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.083s	sys 0.111s
W20260709 12:15:52.842355 14458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.083s	sys 0.112s
I20260709 12:15:52.838912 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.848853 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:52.850157 10053 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:52.841764 10728 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:52.849124 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.850212 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.851447 10198 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:52.852409 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.852988 10198 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:52.820729 14470 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:52.858511 10125 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
W20260709 12:15:52.861331 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44112us
I20260709 12:15:52.865518 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:52.760783 14455 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.866652 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.868268 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:52.871330 10198 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:52.871887 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.876240 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.876564 14399 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:52.877362 14390 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:52.876885 14427 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.878722 14427 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.880985 14427 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.834977 14473 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.885901 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.886844 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.887188 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.831187 14389 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:15:52.864182 14398 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:52.864372 14409 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:52.873169 14338 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:52.898839 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.846804 14163 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:52.873554 14402 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:52.899510 10199 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:15:52.888213 14339 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:52.869211 14196 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:15:52.907176 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.911648 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:52.869086 14362 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:15:52.893383 14470 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:52.891534 14473 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.919536 14470 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.920476 14470 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.921726 14473 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.894675 14398 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.922665 14398 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:52.924795 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.925611 10130 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:52.926412 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.926787 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.927026 10130 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:52.928736 14431 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.929925 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.930190 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.931061 10129 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:52.932184 10129 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:52.933351 10129 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:52.933768 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:52.934290 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 423144us
I20260709 12:15:52.882776 14077 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:15:52.934357 10129 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:52.936482 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.944041 10049 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:52.944388 10197 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:52.914960 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:52.939730 10121 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:52.940096 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.945410 10199 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:52.947504 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.945678 10129 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:15:52.936573 10200 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:52.935117 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.951135 10121 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:15:52.936362 10130 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:15:52.939004 10195 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:52.952090 10195 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:52.934579 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 170693us
I20260709 12:15:52.934943 13907 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:52.959519 10122 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:52.903555 14402 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.956712 10130 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:52.904386 14409 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:52.962788 10200 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:52.937265 14489 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:52.966089 10125 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:52.970957 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:52.971563 10049 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:52.967847 10130 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:52.929921 14492 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:52.969074 14102 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:52.969976 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.975103 10199 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:52.975920 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.977190 14363 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:52.978264 14461 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:52.978657 14461 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:52.979436 14461 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:52.985004 14456 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.718s	user 0.005s	sys 0.007s
I20260709 12:15:52.985991 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.987524 14447 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:52.987942 14447 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:52.988179 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:52.988906 14434 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:52.989348 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:52.990705 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:52.991248 14455 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:52.992738 14378 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:52.977231 14392 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:52.994669 14392 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:52.995630 14392 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:52.997815 14196 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:52.998214 14196 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:52.914851 14477 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:53.006752 10197 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:53.008873 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.009109 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:53.004627 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57218us
I20260709 12:15:53.005097 10733 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:53.011780 10737 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:52.980608 14461 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:53.014573 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.017342 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.016227 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:53.031630 10730 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:53.032174 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:52.972529 14402 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:53.048978 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:52.999038 14196 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.010706 14438 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:53.056110 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 177650us
I20260709 12:15:53.015404 14421 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:53.057960 14397 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:53.058450 14397 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:53.058949 14397 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:53.058102 10050 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:53.058415 14175 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:53.060984 14175 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.063040 14175 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:53.062951 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 203114us
I20260709 12:15:53.074999 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.075176 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.074123 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:53.076707 10047 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:53.045850 14477 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:53.079936 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.050709 14390 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:53.068444 14438 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.081429 14284 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:53.083308 14421 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:53.050211 14473 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:53.033771 14338 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:15:53.052410 14259 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:53.014338 13906 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:15:53.093561 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:53.050776 14222 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:15:53.095920 14196 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:53.097856 10195 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.098906 10195 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:53.100339 14477 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:53.102947 14365 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
I20260709 12:15:53.103369 14365 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.105458 14365 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.080262 14449 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:53.080075 14175 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:15:53.106813 14449 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:53.107743 14449 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.108525 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.110172 14431 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:53.110586 14431 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.110961 14431 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:53.077385 14409 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:53.106326 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.095825 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:53.117549 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:53.121753 10201 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:53.055959 14275 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:15:53.055758 14427 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:15:53.137512 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.120265 14434 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:53.142935 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.143965 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:53.090570 14455 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:53.147979 10195 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:15:53.148826 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 99919.8us
I20260709 12:15:53.149550 10019 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:53.151043 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.151648 10201 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:53.117791 14259 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:53.157471 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.170118 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 155619us
I20260709 12:15:53.170702 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:53.171025 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:53.152596 14419 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:15:53.172191 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:53.159224 14469 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.738s	user 0.005s	sys 0.000s
I20260709 12:15:53.176779 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:53.146521 14222 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:53.176993 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.145308 14397 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:53.180454 14500 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:15:53.182565 14421 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:53.166049 14373 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:15:53.157696 14338 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:53.157229 14259 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:53.086257 14447 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.262462 10734 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:53.178570 14378 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:53.266537 10046 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:53.265748 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 95190.7us
I20260709 12:15:53.270371 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.267699 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:53.274765 10201 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:53.273716 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:53.265136 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:53.276374 10052 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 8: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:53.275887 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.277132 10201 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:53.186656 14369 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:15:53.277860 10201 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:53.277375 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:53.281270 10049 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:53.281123 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:53.264406 10731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cb0ac432438495091e62290dd19b812"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:15:53.283186 10731 raft_consensus.cc:606] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.283524 10731 raft_consensus.cc:614] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:53.285022 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.265102 14222 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:53.290405 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.217602 14402 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.286132 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.300560 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.275321 14338 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.277062 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.273749 14378 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:53.325126 10201 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:53.326239 10052 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:53.282090 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:53.344785 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74492.4us
W20260709 12:15:53.346406 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74326.7us
I20260709 12:15:53.348116 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.350674 10201 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:15:53.353958 10201 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:53.364667 10054 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:53.324800 14163 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:53.326483 14338 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:53.366935 10049 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:53.363744 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:53.326886 14378 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:53.370931 10049 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:53.282631 14501 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 12:15:53.417845 10052 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:53.419673 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:53.421274 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 45764.8us
I20260709 12:15:53.423131 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:53.424269 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 76927.8us
I20260709 12:15:53.420456 14392 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:53.375118 14363 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:53.431030 10052 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:53.436545 10052 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:15:53.441649 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.445237 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:53.445463 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.445554 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:53.434813 10733 raft_consensus.cc:2955] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:53.446355 10125 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:53.459072 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.437289 10052 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:53.448536 14514 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:15:53.464051 14296 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:15:53.448854 14504 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:15:53.418574 14222 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.500454 14222 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:53.501407 14509 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:15:53.501616 14431 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.502768 14296 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:15:53.509119 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50801.6us
I20260709 12:15:53.510468 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.427894 14438 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:53.502699 14506 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:15:53.513083 10199 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:53.504000 14405 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:53.500255 14397 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:53.500665 14511 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:15:53.531291 10202 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:53.532433 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:53.527637 14516 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:15:53.538556 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 113587us
I20260709 12:15:53.511967 14363 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:53.528728 14505 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 12:15:53.535193 14526 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:53.567353 14363 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.568163 14530 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:15:53.532742 14489 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:53.545135 14431 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.547667 14106 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:53.551496 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:53.586490 10123 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:53.586561 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.552608 14398 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.629s	user 0.016s	sys 0.000s
I20260709 12:15:53.536495 14284 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:53.522733 14296 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:53.554039 14515 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:15:53.533846 14391 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:15:53.554685 14402 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:53.529229 14434 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:53.559049 14338 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.570801 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:15:53.542042 14510 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:15:53.576659 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:53.575778 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.585913 10199 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:53.607159 10199 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:53.552412 10128 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:53.569803 14405 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:15:53.589316 14284 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:53.586145 14106 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:53.569428 14378 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.617684 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.618508 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.592077 14205 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.621215 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.617528 10199 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.622418 10199 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:53.622624 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51896.5us
I20260709 12:15:53.624936 10054 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:53.613691 14284 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:53.626485 14524 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.626780 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:53.633560 10123 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:53.624497 14389 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:15:53.561183  9941 maintenance_manager.cc:643] P f9411c2085cc41508a7b355517791fc1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.568s	user 0.191s	sys 0.072s Metrics: {"bytes_written":29394,"cfile_init":1,"dirs.queue_time_us":368674,"dirs.run_cpu_time_us":491,"dirs.run_wall_time_us":58113,"drs_written":1,"lbm_read_time_us":400,"lbm_reads_lt_1ms":4,"lbm_write_time_us":117915,"lbm_writes_1-10_ms":7,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":20,"peak_mem_usage":0,"rows_written":63,"thread_start_us":452031,"threads_started":2,"wal-append.queue_time_us":375600}
I20260709 12:15:53.624640 14449 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:53.614827 14463 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:53.590932 14398 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.689538 10199 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:15:53.655349 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.673888 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.678238 10130 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:53.656278 14502 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:53.596297 14527 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:15:53.620342 14102 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:53.682443 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.699434 10124 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:53.683607 14449 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:53.745280 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62938.5us
I20260709 12:15:53.694819 14458 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:53.683346 14459 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:15:53.747162 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 123474us
W20260709 12:15:53.707234 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.753415 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 134996us
I20260709 12:15:53.754159 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.702548 14102 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:53.744618 14449 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:53.703217 14477 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:15:53.678818 14524 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:53.768760 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.693914 14463 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:53.769866 14526 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.764475 14102 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:53.748286 14458 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:53.789310 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.776374 14163 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:53.698418 14502 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:53.748893 14529 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:53.769115 14525 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:53.827697 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.837237 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.842450 14363 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:53.843209 14380 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:53.843618 14380 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.843953 14380 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:53.846612 13907 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:53.847265 14535 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.847640 13907 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:53.848064 13907 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:53.755221 14106 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.848963 14106 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:53.850005 14518 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 12:15:53.831622 14338 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.851516  9942 maintenance_manager.cc:419] P f9411c2085cc41508a7b355517791fc1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9893 bytes on disk
I20260709 12:15:53.854000  9941 maintenance_manager.cc:643] P f9411c2085cc41508a7b355517791fc1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":307,"lbm_reads_lt_1ms":4}
I20260709 12:15:53.854813 14463 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.857504 14529 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:53.858494 14529 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:53.865080 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 331125us
I20260709 12:15:53.836800 14502 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:53.833246 14519 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:53.874887 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:53.876155 10729 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:53.836356 14525 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:53.841380 14378 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:53.866245 14363 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:53.873986 14259 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:15:53.870592 14393 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:15:53.847779 14535 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.917834 10729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:15:53.917363 14259 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.918608 10729 raft_consensus.cc:606] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.872567 13906 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:15:53.872184 14421 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:53.830037 14526 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.885459 14525 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.916539 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:53.922078 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48923.5us
I20260709 12:15:53.910879 14398 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:53.848908 13907 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:53.912321 14524 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.910328 14507 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:15:53.882190 14461 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:15:53.926463 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 476839us
I20260709 12:15:53.932564 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.934480 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.913151 14519 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:15:53.915848 14378 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:15:53.938782 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:53.939805 14552 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:53.940255 14552 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:53.940680 14552 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:53.941097 14536 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:53.941473 14536 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.941779 14536 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:53.943135 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:15:53.943691 10050 raft_consensus.cc:606] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:53.943997 10050 raft_consensus.cc:614] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:53.945713 14532 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 12:15:53.946532 14544 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:15:53.948681 14535 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:53.951607 14541 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:15:53.953293 14539 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:15:53.953929 14521 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 12:15:53.955909 14552 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.884699 14458 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:53.957408 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.958031 14458 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:53.958257 14535 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:53.958674 14535 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.959029 14535 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:53.959618 14526 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:53.965899 10052 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:53.968736 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.969386 10197 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:53.969825 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2168) took 2104 ms. Trace:
I20260709 12:15:53.970223 10202 rpcz_store.cc:276] 0709 12:15:51.865680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.215280 (+349600us) service_pool.cc:224] Handling call
0709 12:15:52.233823 (+ 18543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:53.531715 (+1297892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.969580 (+437865us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002648d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:53.969765 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983292160}
I20260709 12:15:53.971416 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.973752 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.974501 10197 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:53.978909 14538 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 12:15:53.979807 14531 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:15:53.981503 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.981881 10197 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:15:53.985132 14552 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:53.987195 14363 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:53.989388 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.990006 10195 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:53.929518 14409 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:53.990641 14409 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:53.990824 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:53.991048 14409 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:53.991591 10198 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:53.927893 14421 consensus_queue.cc:1243] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:54.000654 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:54.002835 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.006402 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:53.957562 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.010653 10129 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:54.012820 10201 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:54.013183 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:53.999745 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.014420 10198 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:54.014149 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:54.014802 10198 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:54.012243 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 64586us
I20260709 12:15:54.017397 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:53.927640 14296 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:15:54.019057 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:53.995419 14547 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:53.936805 14524 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:54.024008 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.032449 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:54.023036 10049 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:54.025686 10050 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:54.028141 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.958760 14369 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:54.015528 10198 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.031659 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:53.940178 14391 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:15:54.009282 13907 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:54.009652 14338 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.041846 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.012113 14402 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.041508 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.046993 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:54.033704 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 764) took 1196 ms. Trace:
I20260709 12:15:54.051784 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.075867 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:53.987228 14535 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.037178 14369 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:54.095463 14205 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:54.096081 14205 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:54.096735 14470 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:54.096972 14205 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:54.086915 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.058727 10200 rpcz_store.cc:276] 0709 12:15:52.837751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.975051 (+137300us) service_pool.cc:224] Handling call
0709 12:15:52.975326 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.975510 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:53.016644 (+ 41134us) log.cc:844] Serialized 14 byte log entry
0709 12:15:53.931741 (+915097us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800325960. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:15:54.033397 (+101656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:54.033447 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:54.033488 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:54.033550 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.033653 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44602,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":68272,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8233,"spinlock_wait_cycles":29921664,"thread_start_us":101536,"threads_started":1}
I20260709 12:15:54.086385 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.088027 14557 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:54.088603 14561 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:54.089556 14556 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.046989 14419 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:15:54.092466 14535 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.039122 14284 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.097447 14470 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:54.087558 14554 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:15:54.099598 10049 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:15:54.053938 14189 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:15:54.057152 14259 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.131542 10195 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:54.100072 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:54.120039 14393 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:54.070070 14338 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:54.139412 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 110387us
I20260709 12:15:54.084897 14222 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:15:54.139055 14554 consensus_queue.cc:1243] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:54.116343 14380 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.100560 14449 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.094409 14536 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.120102 14102 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.142716 14561 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:54.145493 14398 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:54.170529 14284 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.174484 10202 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:54.175395 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 147762us
I20260709 12:15:54.177543 10734 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:54.206274 10729 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:54.207084 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63619.9us
W20260709 12:15:54.208459 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.151872 14106 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:15:54.171916 14398 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.212972 14453 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.214857 14453 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.216954 14453 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.218734 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.224354 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.220796 14569 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:54.233675 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 301164us
I20260709 12:15:54.234726 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:54.220611 14398 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:54.163872 14470 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:54.241287 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 209696us
I20260709 12:15:54.242121 10702 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.231985 14222 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.235335 14569 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:54.260401 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.262403 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.247822 14189 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:15:54.286687 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 650) took 1018 ms. Trace:
I20260709 12:15:54.269312 10052 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:54.302203 10197 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:15:54.302438 14473 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:15:54.302886 14554 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.303428 14554 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.304402 14389 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:54.304828 14389 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:54.307188 10728 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:54.305546 14554 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.286206 14106 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.308264 14106 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.310510 14106 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.299945 10048 rpcz_store.cc:276] 0709 12:15:53.268573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.268680 (+   107us) service_pool.cc:224] Handling call
0709 12:15:53.268982 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:54.097913 (+828931us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b1800335800. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc17e788060 00007fc17e788bfb 00007fc17e79364b
0709 12:15:54.098028 (+   115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:54.098053 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:54.098540 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:15:54.242649 (+144109us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:54.259265 (+ 16616us) log.cc:844] Serialized 14 byte log entry
0709 12:15:54.259495 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:54.259596 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:54.286321 (+ 26725us) raft_consensus.cc:1685] finished
0709 12:15:54.286447 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.286620 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13861,"prepare.queue_time_us":16429,"raft.queue_time_us":57034,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":11295,"spinlock_wait_cycles":31942656,"thread_start_us":205584,"threads_started":2,"wal-append.queue_time_us":184751}
I20260709 12:15:54.263826 14530 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:54.305697 14389 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.266708 14461 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:54.266852 14556 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.295025 14102 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.295301 14338 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.266395 14578 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:54.340483 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 78143.7us
W20260709 12:15:54.334738 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 73406.1us
I20260709 12:15:54.337237 14389 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:54.337492 14380 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.350138 10048 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:54.351933 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:54.354125 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 119473us
I20260709 12:15:54.360639 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.361955 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.269203 14571 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 12:15:54.362493 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.289451 14409 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.363281 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:54.337301 14536 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.363588 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.362386 10051 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:54.368188 10052 raft_consensus.cc:2368] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12.
I20260709 12:15:54.362936 10055 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:54.368953 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:54.363698 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.253897 14561 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.370298 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.370786 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:54.372012 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.374006 14556 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:54.407536 10126 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:54.407757 14556 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:54.408164 14556 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:54.408252 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45857.2us
I20260709 12:15:54.343716 13907 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:54.361575 14335 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:54.382688 14580 raft_consensus.cc:993] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:15:54.383190 14449 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.384869 14409 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:54.387034 14512 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.887s	user 0.000s	sys 0.002s
W20260709 12:15:54.392948 14502 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 12:15:54.359000 14578 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:54.373868 14106 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:15:54.395473 14564 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.418790  9950 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.342473 14569 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.366931 14519 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:54.397574 14398 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.398975 14525 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.399905 14447 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:54.401543 14369 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.410100 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:54.407644 10047 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:54.414896 10129 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:54.432765 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.415380 10122 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
W20260709 12:15:54.418123 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 46259.3us
I20260709 12:15:54.395735 14570 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:15:54.418236 14335 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:54.435261 13907 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:54.420109 14102 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:15:54.435559 14556 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.435169 14369 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:54.436867 14556 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:54.437593 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2184) took 1597 ms. Trace:
I20260709 12:15:54.437973 10204 rpcz_store.cc:276] 0709 12:15:52.840587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.049120 (+208533us) service_pool.cc:224] Handling call
0709 12:15:53.064566 (+ 15446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:53.076331 (+ 11765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.076367 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:53.084413 (+  8046us) log.cc:844] Serialized 26 byte log entry
0709 12:15:53.283743 (+199330us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:53.283781 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.283852 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:54.386472 (+1102620us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:54.437314 (+ 50842us) raft_consensus.cc:1685] finished
0709 12:15:54.437336 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.437533 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34003,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":16541568,"thread_start_us":198947,"threads_started":1,"wal-append.queue_time_us":330085}
I20260709 12:15:54.439797 14567 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:54.440260 14567 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.440625 14567 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:54.426836 14564 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.423601 14580 raft_consensus.cc:1081] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:15:54.448305 10730 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:54.427069 14519 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.449064 14564 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.444591 13907 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.450093 13907 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:54.452484 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.452329 14578 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.454644 14569 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:54.423213 14502 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.456684 14502 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:54.458078 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48046.8us
I20260709 12:15:54.463790 14335 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.464673 14339 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.465617 14339 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:54.469357 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:54.475487 10055 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
W20260709 12:15:54.454310 14523 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.891s	user 0.002s	sys 0.000s
I20260709 12:15:54.477837 10050 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:54.481348 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.482820 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.483860 10048 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:54.480233 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:54.459720 14519 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:54.488394 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.459349 14443 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.467705 14535 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:15:54.478282 14570 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.489573 10197 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:54.505348 10197 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:54.485340 10055 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:54.490741 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:54.491240 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:54.464571 14338 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.488415 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:54.492614 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:54.494200 14513 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.133s	user 0.003s	sys 0.000s
I20260709 12:15:54.498821 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:54.487469 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:54.499053 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:54.499580 10204 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:54.539799 10203 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:54.477913 14102 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.508222 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:54.543493 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2425) took 1645 ms (client timeout 2038 ms). Trace:
W20260709 12:15:54.547663 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60267.2us
I20260709 12:15:54.549331 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.550638 10203 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:15:54.551054 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:15:54.551685 10737 raft_consensus.cc:606] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.551975 10200 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:54.546885 10053 rpcz_store.cc:269] 0709 12:15:52.898276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.899600 (+  1324us) service_pool.cc:224] Handling call
0709 12:15:54.543307 (+1643707us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54002756d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:54.543435 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604464000}
W20260709 12:15:54.521142 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:54.555569 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47417.9us
I20260709 12:15:54.544660 14106 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:54.481133 14529 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:15:54.560271 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.504766 14535 consensus_queue.cc:1243] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:54.563130 14106 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.504616 14443 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.550139 14338 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.552196 14077 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.598786 14077 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.567813 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:54.600162 10195 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:54.600862 14077 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.601905 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:54.574136 10197 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.603037 10197 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:54.604223 13907 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.605985 14102 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:54.606781 14102 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:54.607470 14102 consensus_queue.cc:1243] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:54.607901 14102 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:54.609380 10200 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:54.607813 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 823) took 1621 ms. Trace:
I20260709 12:15:54.598392 14338 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.613665 10732 rpcz_store.cc:276] 0709 12:15:52.986340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.014769 (+ 28429us) service_pool.cc:224] Handling call
0709 12:15:53.047410 (+ 32641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:53.047789 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.047816 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:53.054270 (+  6454us) log.cc:844] Serialized 26 byte log entry
0709 12:15:53.096687 (+ 42417us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b48000b0dd8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:53.205975 (+109288us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:53.206020 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.206277 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:54.457133 (+1250856us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:54.607598 (+150465us) raft_consensus.cc:1685] finished
0709 12:15:54.607632 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.607757 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":482,"raft.run_cpu_time_us":2035,"raft.run_wall_time_us":45805,"spinlock_wait_cycles":20945536,"thread_start_us":119355,"threads_started":1,"wal-append.queue_time_us":196404}
I20260709 12:15:54.615902 14106 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.620612 13907 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.558344 14561 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.625442 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 831) took 1478 ms. Trace:
I20260709 12:15:54.625838 10733 rpcz_store.cc:276] 0709 12:15:53.147124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.147385 (+   261us) service_pool.cc:224] Handling call
0709 12:15:53.153158 (+  5773us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:53.186638 (+ 33480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.264190 (+ 77552us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:53.276470 (+ 12280us) log.cc:844] Serialized 527 byte log entry
0709 12:15:53.368045 (+ 91575us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:53.657607 (+289562us) log.cc:844] Serialized 14 byte log entry
0709 12:15:53.685230 (+ 27623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.685301 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:54.453704 (+768403us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:15:54.622418 (+168714us) raft_consensus.cc:1685] finished
0709 12:15:54.625242 (+  2824us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.625384 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39486,"raft.queue_time_us":58606,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":3503,"spinlock_wait_cycles":7439616,"thread_start_us":88493,"threads_started":1,"wal-append.queue_time_us":251980}
I20260709 12:15:54.554838 14380 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:54.498371 14567 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.543411 14398 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.621166 14525 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.623023 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:54.499631 14571 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 12:15:54.624004 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.624416 10197 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:54.596537 14443 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.632763 14566 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:54.573630 14259 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:54.613472 14577 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.639578 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:54.648892 10046 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:54.641413 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.655390 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:54.656474 10049 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:54.662665 10169 leader_election.cc:400] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12.
I20260709 12:15:54.536273 14570 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.675379 10169 leader_election.cc:403] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:54.633934 14567 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.647683 14389 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:54.687390 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:54.693020 10046 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:54.646471 14339 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.627867 14568 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:15:54.688820 13907 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12.
I20260709 12:15:54.694689 14389 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.711251 14077 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:54.711644 14077 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:54.712459 14077 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.713002 14519 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.714041 14077 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:54.721829 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:54.722820 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.723755 14470 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:54.724215 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:54.725488 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:54.726449 14473 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:54.726781 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:54.727167 14473 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:54.727698 14259 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:54.727977 14529 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:54.728699 14473 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.728957 14519 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:54.729337 14473 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:54.731007 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.732100 14473 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:54.732250 14560 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.644s	user 0.003s	sys 0.000s
I20260709 12:15:54.732743 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 832) took 1582 ms. Trace:
W20260709 12:15:54.732877 14551 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.703s	user 0.002s	sys 0.002s
I20260709 12:15:54.733120 10728 rpcz_store.cc:276] 0709 12:15:53.150018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.150133 (+   115us) service_pool.cc:224] Handling call
0709 12:15:53.150392 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:54.307650 (+1157258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:54.732496 (+424846us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:54.732676 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659975552}
I20260709 12:15:54.730846 14259 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:54.735195 14259 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:54.742080 14363 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:15:54.663617 14561 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:15:54.761265 10197 pending_rounds.cc:85] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 6
I20260709 12:15:54.787796 10197 pending_rounds.cc:107] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:15:54.788753 10197 raft_consensus.cc:2889] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:54.791687 10200 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:54.799139 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:54.696213 14461 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:15:54.803025 14077 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:54.803493 14568 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.807583 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:54.809147 10200 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:54.810321 10204 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:54.815281 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:54.816918 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:54.800742 14339 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:54.743341 14389 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:54.812397 14561 consensus_queue.cc:1243] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:54.835407 10201 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:15:54.819792 14077 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:54.828864 14473 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:54.814392 14568 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.848133 14473 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:54.925174 14520 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.383s	user 0.001s	sys 0.004s
I20260709 12:15:54.925266 14473 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:54.924602 14077 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:54.928198 14592 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:15:54.930063 10202 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:54.930497 10202 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:54.931166 10202 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:54.932415 10202 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:54.826655 14535 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:15:54.858445 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.963028 14570 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:54.834493 14339 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:54.974947 10202 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:15:54.971740 14578 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:54.978741 14427 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.993119 14578 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.024731 14578 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.025301 14399 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.026086 14399 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.028560 14399 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:54.980749 14392 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:15:55.032548 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 342281us
W20260709 12:15:55.041178 14591 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:15:55.043100 14593 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:15:55.044493 14389 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.047354 14389 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.018267 14568 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.005661 14427 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.055958 14189 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.074575 14419 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.075191 14419 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.077306 14419 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.079222 14339 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.068238 14566 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.089592 14566 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.059396 14561 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:55.094110 14561 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.095362 14566 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.096287 14561 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.099447 10196 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:55.099844 10196 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:55.093576 14189 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.100652 10196 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.102818 14582 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:55.103395 14582 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.106336 14519 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:55.106797 14519 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:55.107899 14189 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.108566 14473 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.114604 14473 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.122388 14427 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.069446 14363 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.126127 14363 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.128433 14363 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.131480 10199 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:55.131908 10199 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:55.132706 10199 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.133739 10199 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:55.136018 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:55.136394 14473 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.136647 10203 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:55.137600 14554 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.138067 14554 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.139572 14566 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.140056 14566 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.141458 10199 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:15:55.141810 10199 pending_rounds.cc:85] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:15:55.142019 10199 pending_rounds.cc:107] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:15:55.143241 14392 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:55.143765 14392 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.145849 14392 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.147059 14427 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:55.147579 14427 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.154973 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.155586 10732 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:55.156280 14427 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:55.148339 14601 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:15:55.149185 14554 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.155596 14566 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.156868 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:55.147580 14106 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.158475 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:55.159193 14566 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:55.158267 14106 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.160782 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:55.161461 14566 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:55.161995 14106 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.162129 14566 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:55.149276 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.163447  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:15:55.163177 14566 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.149451 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.147832 10129 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:15:55.166684 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.167827 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:55.158206 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 958) took 1367 ms. Trace:
I20260709 12:15:55.107601 14519 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.148715 10126 pending_rounds.cc:85] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 9
I20260709 12:15:55.150892 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:55.173352 10126 pending_rounds.cc:107] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:15:55.173776 10126 raft_consensus.cc:2889] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:55.174070 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.151316 10123 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:55.152478 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.153476 10122 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:15:55.154001 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.153349 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.163203 10737 raft_consensus.cc:2393] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:55.165632 10130 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:15:55.150321 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:55.171195 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:55.165618 10124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2323) took 2241 ms (client timeout 2222 ms). Trace:
I20260709 12:15:55.142241 10199 raft_consensus.cc:2889] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:55.178292 10052 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:55.179255 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2197) took 1191 ms. Trace:
I20260709 12:15:55.179668 10199 rpcz_store.cc:276] 0709 12:15:53.987935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.988601 (+   666us) service_pool.cc:224] Handling call
0709 12:15:53.988892 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.131367 (+1142475us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54002ca220. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:55.179007 (+ 47640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.179196 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49424128}
I20260709 12:15:55.180941 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:55.178606 10124 rpcz_store.cc:269] 0709 12:15:52.924106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.939808 (+ 15702us) service_pool.cc:224] Handling call
0709 12:15:55.165404 (+2225596us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001d5454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:55.165547 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731203328}
I20260709 12:15:55.181939 10199 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:55.183323 10128 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:55.183490 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:55.174695 10127 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:55.185038 10127 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:55.170149 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.207780 10052 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:55.172413 10203 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:55.168692 10730 rpcz_store.cc:276] 0709 12:15:53.791165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.791383 (+   218us) service_pool.cc:224] Handling call
0709 12:15:53.820849 (+ 29466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:54.448730 (+627881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.157999 (+709269us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400570dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:55.158155 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442590592}
I20260709 12:15:55.212973 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:55.221855 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.240854 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.209438 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:55.243381 10125 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:55.245872 10124 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:55.247417 10130 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:55.248523 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.249172 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:55.253520 10122 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:55.259124 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:55.261040 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.263595 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:55.266553 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.266862 10701 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:15:55.241137 14555 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:15:55.137073 14473 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.188324 10121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:54462
I20260709 12:15:55.188668 14106 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:55.298202 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.299928 10123 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.356854 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 693) took 1329 ms. Trace:
I20260709 12:15:55.356767 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.357579 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.357996 10122 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:55.349556 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.358716 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:55.357371 10734 rpcz_store.cc:276] 0709 12:15:54.027106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.027923 (+   817us) service_pool.cc:224] Handling call
0709 12:15:55.356651 (+1328728us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400533254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:55.356792 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269415680}
W20260709 12:15:55.359369 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87574.4us
I20260709 12:15:55.363416 10728 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.365952 10121 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.366408 10121 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:55.200994 14554 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:55.368304 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.273213 14549 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.262998 14453 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:55.367870 14393 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:15:55.368086 14189 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.374496 14189 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.376533 14427 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:55.377095 14427 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.379457 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:55.380081 10122 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:55.382624 14453 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:55.383697 14453 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.385412 14380 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.373888 14562 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:55.382930 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.390631 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:55.391292 10199 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:55.388806 10730 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:55.274379 14461 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.263829 14536 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.394330 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:55.399540 10047 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:55.402485 10122 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:55.254921 14363 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.386019 14380 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.344274 14582 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:55.388782 14592 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:15:55.407814 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.371385 14554 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:55.253338 14529 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:55.388406 14562 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:55.412606 10198 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:55.447305 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:55.448160 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.448143 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:55.413787 14554 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:55.452796 10198 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:55.454056 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1704) took 1460 ms. Trace:
I20260709 12:15:55.454500 10198 rpcz_store.cc:276] 0709 12:15:53.993726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.995709 (+  1983us) service_pool.cc:224] Handling call
0709 12:15:53.996029 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.400963 (+1404934us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540032b7a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e705a1d 00007fc17e6ec1a4 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419
0709 12:15:55.453691 (+ 52728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.453983 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470904064}
I20260709 12:15:55.456732 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.442713 14549 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.405102 14461 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.459048 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:55.460125 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.463860 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:55.408353 14536 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.444993 14529 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:55.469794 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:55.481258 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.482903 14459 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:55.470223 14549 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.485251 14455 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:55.485671 14455 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:55.413286 14363 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.487557 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.500587 10204 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:55.488726 10198 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
W20260709 12:15:55.469297 14421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:15:55.512208 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:55.488070 14568 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:55.512269 10199 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:15:55.515795 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.517627 10199 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:15:55.521369 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.469606 14419 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:15:55.549275 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.553742 10122 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:55.556519 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.559435 10199 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:55.562343 10055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.062s	sys 0.108s
W20260709 12:15:55.562781 10055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.063s	sys 0.108s
I20260709 12:15:55.520929 14389 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:55.567724 10204 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:55.571007 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:55.572161 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.573781 10048 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.576431 10199 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.580152 10055 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:55.581837 10049 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:55.506040 14562 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.585729 10053 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:15:55.586133 10053 pending_rounds.cc:85] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:15:55.586365 10053 pending_rounds.cc:107] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:15:55.586630 10053 raft_consensus.cc:2889] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:55.588270 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:55.566517 14389 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.579762 14398 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.611936 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.582839 14106 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.614612 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.617538 10054 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:55.617542 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.620553 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.624442 10053 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:55.625363 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.626086 10055 raft_consensus.cc:2368] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12.
I20260709 12:15:55.617985 10054 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:55.613611 14389 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:55.609010 14473 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:55.641902 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.621608 14562 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:55.631672 10054 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.623534 14582 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:55.662600 10054 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:55.629244 14578 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.630141 14380 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.583304 14529 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.669173 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.621935 14398 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:55.623257 14106 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.674937 14380 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:55.677627 14380 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:55.678004 14380 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:55.681614 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.686180 10121 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.688359 10121 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.693478 10054 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:15:55.694633 10054 pending_rounds.cc:85] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 7
I20260709 12:15:55.694932 10054 pending_rounds.cc:107] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:15:55.695144 10054 raft_consensus.cc:2889] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:55.677871 14607 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:15:55.674587 14566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.016s	sys 0.020s
I20260709 12:15:55.672811 14536 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:55.703459 14608 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:15:55.670267 14578 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.706930  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:15:55.703653 14605 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:15:55.674247 14461 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.710976 10054 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:55.696022 14363 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.722693 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.724958 14530 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.728284 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:55.725137 14578 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:55.720768 14566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.019s	sys 0.020s
W20260709 12:15:55.737475 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 265445us
W20260709 12:15:55.740137 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 270381us
I20260709 12:15:55.716598 14524 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.715303 14477 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.722267 14338 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.695802 14380 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.772630 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.773308 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:55.775092 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.727087 14473 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:55.778996 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:55.740532 14363 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.783461 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.784533 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.786559 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.787138 10049 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:55.787940 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.791028 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.792855 10130 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:15:55.783913 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.797118 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1719) took 1036 ms. Trace:
I20260709 12:15:55.788497 10049 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:55.797667 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.798822 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.797526 10197 rpcz_store.cc:276] 0709 12:15:54.760488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.760627 (+   139us) service_pool.cc:224] Handling call
0709 12:15:54.761027 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:54.800565 (+ 39538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:54.800674 (+   109us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:54.801265 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 12:15:55.184595 (+383330us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:55.184634 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.184692 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:55.795392 (+610700us) raft_consensus.cc:1685] finished
0709 12:15:55.795411 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.797057 (+  1646us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10873,"raft.queue_time_us":10606,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3773,"spinlock_wait_cycles":1830272,"thread_start_us":383021,"threads_started":1,"wal-append.queue_time_us":671381}
I20260709 12:15:55.799988 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.801083 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:55.788882 14363 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.804275 10195 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.806382 10202 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:55.770898 14568 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:55.774830 14477 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.741187 14530 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.769492 14524 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.830747 14524 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.833143 14530 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.834028 10049 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:55.782604 14473 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.776997 14338 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:55.814886 14616 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:15:55.827514 14380 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:55.828855 14363 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.811725 10195 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:55.806118 14077 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:15:55.837435 14398 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.842170 10049 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:55.850742 10055 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:55.854368 10196 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:55.854796 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:55.852998 14380 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.843343 14365 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:15:55.852772 14363 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:55.846985 14554 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.855564 14106 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.905695 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:55.908602 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1715) took 1416 ms. Trace:
I20260709 12:15:55.909026 10201 rpcz_store.cc:276] 0709 12:15:54.492589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.537205 (+ 44616us) service_pool.cc:224] Handling call
0709 12:15:54.835189 (+297984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:54.838119 (+  2930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.908374 (+1070255us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000eb5d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:55.908538 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684544256}
I20260709 12:15:55.862915 14398 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:55.916169 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 172709us
I20260709 12:15:55.917728 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:55.918304 14077 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:55.911535 10201 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:15:55.867410 14568 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:55.919474 14568 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:55.919895 14463 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:55.919530 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 199633us
I20260709 12:15:55.920500 14568 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.921147 10129 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.921999 14568 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:55.922032 10197 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:55.923247 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:55.921082 14189 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:55.931753 14189 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:55.932562 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:55.933331 14582 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:55.933823 14582 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:55.934581 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:55.936787 14463 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.937258 14463 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:55.939193 10202 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:55.940102 10197 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:55.932880 14189 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:15:55.947544 14391 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:55.948062 14391 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:55.940383 10202 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:55.950098 10202 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:55.941183 14455 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.955694 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:15:55.957890 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.959335 10197 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:15:55.966902 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:55.978180 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 56522us
I20260709 12:15:55.861544 14380 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.905887 14524 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.977664 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.910182 14530 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.981248 10202 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:55.914201 14621 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:15:55.914315 14106 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:55.989457 10197 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:55.988713 10202 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:55.990650 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:55.985718 10168 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:55.900499 14363 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:55.993768 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:55.994726 10203 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:55.981528 14398 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.910672 14611 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:15:56.018882 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:56.024721 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.020087 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.065424 10197 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:56.066145 14625 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:55.990042 14535 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.987028 14455 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:56.082484 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 179091us
I20260709 12:15:56.022029 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:56.070989 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:56.087163 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.993016 14626 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:56.092267 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.067231 14628 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:56.094264 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.105944 10197 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:15:56.096318 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:56.108572 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 86616.3us
I20260709 12:15:56.110191 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:56.096966 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 106409us
I20260709 12:15:56.086838 14566 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:56.097457 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 185089us
I20260709 12:15:56.099792 10050 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:55.992525 14392 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:15:56.021057 14549 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:55.948942 14391 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:55.992700 14524 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:56.126164 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:56.121781 14529 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:55.992247 14530 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.134299 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.139089 10730 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:56.145162 10095 leader_election.cc:400] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12.
I20260709 12:15:56.145496 10095 leader_election.cc:403] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:56.137426 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:56.066774 14398 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.216010 10125 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:56.175001 10196 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:56.216953 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1703) took 2226 ms. Trace:
I20260709 12:15:56.217351 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.217968 10127 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:56.220278 10128 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:56.223899 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.225020 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.128352 14473 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:56.128865 14632 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.227439 10130 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:56.236692 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 302235us
I20260709 12:15:56.228161 10128 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:56.217346 10196 rpcz_store.cc:276] 0709 12:15:53.990978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.992263 (+  1285us) service_pool.cc:224] Handling call
0709 12:15:53.992540 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.099341 (+1106801us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400329ea0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:55.854146 (+754805us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b580038abd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4
0709 12:15:56.216688 (+362542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.216894 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160406016}
I20260709 12:15:56.088389 14535 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.240003 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.242352 10126 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:15:56.237473 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:56.231053 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2203) took 1090 ms. Trace:
I20260709 12:15:56.234282 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.231433 10047 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:56.138523 14529 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.214809 14633 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.237951 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:56.231786 14378 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:15:56.169585 14635 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:56.216126 14628 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:56.229303 10048 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:56.249653 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.269134 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.269853 10128 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:56.231129 10203 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:56.247155 10123 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:56.251789 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.253876 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.271323 10197 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:56.230078 14644 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:56.230294 14391 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:56.246018 14529 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:56.132743 14566 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.265527 10127 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:56.257190 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.245677 10204 rpcz_store.cc:276] 0709 12:15:55.140600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.568431 (+427831us) service_pool.cc:224] Handling call
0709 12:15:55.568676 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.568860 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:55.870464 (+301604us) log.cc:844] Serialized 14 byte log entry
0709 12:15:56.229638 (+359174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.229776 (+   138us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:56.229905 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.229967 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.230999 (+  1032us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415656,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":631294,"threads_started":2}
I20260709 12:15:56.302000 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.302651 10204 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:56.302826 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.303989 10730 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:56.239719 14473 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.307734 10130 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:15:56.274549 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 137203us
I20260709 12:15:56.308521 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:56.251421 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:56.278658 10197 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:56.274734 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:56.309329 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60255.3us
I20260709 12:15:56.309652 10126 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:56.288705 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:55.989313 14421 consensus_queue.cc:1175] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 13 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:56.311378 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:56.298018 10123 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:56.228125 14284 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:15:56.305171 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.306921 10203 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:56.249392 14629 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:15:56.271070 14461 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:56.286446 10049 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:56.323761 10197 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:56.324988 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.242061 14632 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.247754 14611 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:15:56.330329 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.330783 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:56.310624 14624 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 12:15:56.340401 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.343895 10123 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:56.324909 14630 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:15:56.345517 10128 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:56.315882 14644 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:56.350656 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.316139 14554 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.351290 10128 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:56.352217 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.353674 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.354318 10123 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:56.257658 14633 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.355863 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.356597 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:56.314568 14473 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.357484 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.310750 14654 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12.
I20260709 12:15:56.359387 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.360173 10126 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:56.361172 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.333209 14380 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:56.368661 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.368772 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:56.459707 10055 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:56.369983 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.423364 10123 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:56.423067 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.424275 10128 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:15:56.427357 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.355945 14284 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.344470 14635 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:56.431720 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.356469 14524 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:56.362251 14631 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 12:15:56.434607 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 122688us
I20260709 12:15:56.364342 14653 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:56.441186 14634 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:15:56.441916 14639 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:15:56.442590 14636 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:15:56.443142 14398 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:56.355877 14530 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:56.445561 14463 consensus_meta.cc:287] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.001s
I20260709 12:15:56.377770 14077 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 12:15:56.447603 14638 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 12:15:56.449715 14389 consensus_meta.cc:287] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.000s
I20260709 12:15:56.481061 14653 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.500273 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:56.439215 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 108481us
I20260709 12:15:56.466048 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.501073 10049 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:56.436457 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.424110 14363 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.502203 10126 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:56.469492 14633 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:56.481472 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 365855us
I20260709 12:15:56.423067 14649 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:56.429713 14380 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:56.485255 10053 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:15:56.478068 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.489552 14535 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.432922 14657 raft_consensus.cc:2764] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:15:56.492743 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 64159.5us
I20260709 12:15:56.468420 14618 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:56.459120 14554 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:56.452637 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.499193 10055 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:56.336056 14461 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.514212 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:56.514662 14461 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:56.515969 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:56.516175 14647 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:56.518051 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:56.518522 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:56.518842 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.503444 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:56.434644 14644 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:15:56.494573 14530 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:56.480134 14284 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.490748 14662 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:56.502753 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:56.530076 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:56.504382 14653 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:56.540755 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2206) took 1399 ms. Trace:
I20260709 12:15:56.541155 10200 rpcz_store.cc:276] 0709 12:15:55.141285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.736276 (+594991us) service_pool.cc:224] Handling call
0709 12:15:55.736607 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.738202 (+  1595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.738236 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:55.774037 (+ 35801us) log.cc:844] Serialized 26 byte log entry
0709 12:15:55.995395 (+221358us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:55.995431 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.995494 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.540542 (+545048us) raft_consensus.cc:1685] finished
0709 12:15:56.540562 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.540698 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1179,"raft.queue_time_us":113030,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5066,"thread_start_us":221059,"threads_started":1,"wal-append.queue_time_us":395910}
I20260709 12:15:56.539682 14519 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:56.546720 14667 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:15:56.547807 14665 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:56.549418 14665 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:56.547856 14363 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:15:56.547863 14658 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:56.550182 14665 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:15:56.555356 14647 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:56.555841 14647 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:56.556216 14398 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:56.556768 14398 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:56.557657 14398 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.519968 14649 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.560427 14649 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.560945 14649 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:56.561242 14649 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:56.494943 14463 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.562990 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:56.500393 14389 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.533758 14618 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:56.584722 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 82034.4us
I20260709 12:15:56.586386 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:56.588442 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.589197 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.528981 14654 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:15:56.563870 14582 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.005s
I20260709 12:15:56.556227 14647 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:56.514228 14554 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.596879 10051 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:15:56.583230 14648 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:15:56.555428 14284 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:56.523231 14380 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.569583 14657 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:56.598846 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:56.606302 10122 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:56.599303 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:56.582554 14610 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:56.602146 10051 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:15:56.536159 14530 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:56.612556 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.651291 10130 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:56.651945 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:56.656262 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.587455 14667 consensus_queue.cc:1243] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:56.651597 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:56.597877 14618 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:15:56.668071 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.669770 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:56.672132 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 154144us
I20260709 12:15:56.673026 10094 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:56.583421 14635 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:15:56.537436 14662 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.613266 14657 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:56.664906 14664 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:15:56.614023 14610 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.676895 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2216) took 1272 ms. Trace:
I20260709 12:15:56.732498 10201 rpcz_store.cc:276] 0709 12:15:55.404135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.927502 (+523367us) service_pool.cc:224] Handling call
0709 12:15:55.938795 (+ 11293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.939110 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:56.491439 (+552329us) log.cc:844] Serialized 14 byte log entry
0709 12:15:56.676541 (+185102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.676602 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:56.676650 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.676718 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.676837 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62065,"prepare.queue_time_us":192602,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":46011,"thread_start_us":677627,"threads_started":2}
W20260709 12:15:56.685227 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 122516us
I20260709 12:15:56.667906 14663 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:56.599189 14582 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:56.681110 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 160165us
I20260709 12:15:56.599615 14649 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.760949 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:56.762295 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 89360.5us
I20260709 12:15:56.727034 14657 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:56.685691 14632 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.675721 14519 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:56.774958 14519 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.777475 14519 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.666678 14667 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:15:56.675045 14659 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:56.770994 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:56.725384 14427 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:56.708608 14284 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.679071 14363 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:56.787285 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2454) took 1075 ms. Trace:
W20260709 12:15:56.766624 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 92801.9us
I20260709 12:15:56.761237 14610 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:56.798291 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:56.761778 14473 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:56.771930 14641 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:15:56.728019 14654 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:15:56.799525 10054 rpcz_store.cc:276] 0709 12:15:55.712172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.952257 (+240085us) service_pool.cc:224] Handling call
0709 12:15:55.952655 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.953002 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.953028 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:55.958492 (+  5464us) log.cc:844] Serialized 26 byte log entry
0709 12:15:56.087636 (+129144us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:56.087674 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.087735 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.787048 (+699313us) raft_consensus.cc:1685] finished
0709 12:15:56.787071 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.787218 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2618,"raft.queue_time_us":613,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":23537,"thread_start_us":128822,"threads_started":1,"wal-append.queue_time_us":381864}
I20260709 12:15:56.764370 14644 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:56.803848 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:56.841812 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2204) took 1701 ms. Trace:
I20260709 12:15:56.765247 14663 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:56.863415 10199 rpcz_store.cc:276] 0709 12:15:55.140809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.577195 (+436386us) service_pool.cc:224] Handling call
0709 12:15:55.592678 (+ 15483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.851464 (+258786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.852353 (+   889us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:55.855705 (+  3352us) log.cc:844] Serialized 26 byte log entry
0709 12:15:56.085437 (+229732us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:56.085477 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.085548 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.841606 (+756058us) raft_consensus.cc:1685] finished
0709 12:15:56.841627 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.841753 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84129,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":92,"thread_start_us":435808,"threads_started":2,"wal-append.queue_time_us":697863}
I20260709 12:15:56.791621 14519 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:56.792837 14667 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:15:56.839813 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:56.904975 14562 consensus_meta.cc:287] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.240s	user 0.006s	sys 0.006s
I20260709 12:15:56.801192 14555 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.919036 10054 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:56.834906 14688 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:56.793308 14676 consensus_queue.cc:1175] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" responder_term: 11 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: [10.7-10.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:56.922947 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.843847 14463 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.828650 14380 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.844744 14530 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.829655 14662 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.828123 14651 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:15:56.927759 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.955812 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:56.897719 14657 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.827349 14389 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:56.873728 14674 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:56.924626 10736 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:56.870378 14632 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.761107 14669 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.196s
I20260709 12:15:56.944294 14696 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:56.926833 14655 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 12:15:56.924346 14688 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.927011 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.977180 10730 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:56.919023 14455 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:56.809892 14363 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.997884 14363 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.807200 14284 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:56.999782 14284 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:56.999941 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.921880 14536 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:56.947685 14391 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.005s
I20260709 12:15:57.000613 14696 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:56.974320 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 204105us
I20260709 12:15:56.946458 14473 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:56.979246 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.002900 14696 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.004431 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 749) took 1079 ms. Trace:
I20260709 12:15:57.004848 10129 rpcz_store.cc:276] 0709 12:15:55.925237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.925393 (+   156us) service_pool.cc:224] Handling call
0709 12:15:55.925711 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:56.067609 (+141898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.067645 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:56.068304 (+   659us) log.cc:844] Serialized 52 byte log entry
0709 12:15:56.274278 (+205974us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:56.274311 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.274384 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.004175 (+729791us) raft_consensus.cc:1685] finished
0709 12:15:57.004203 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.004367 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21289,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":246821,"threads_started":2,"wal-append.queue_time_us":405440}
W20260709 12:15:57.006273 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 709391us
I20260709 12:15:57.007057 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.007833 14175 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:57.008796 14673 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.950453 14667 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:56.919476 14519 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:56.983016 14670 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:15:56.983693 14679 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:15:56.928797 14555 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:56.987021 14671 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:56.990289 14657 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.990801 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2456) took 1278 ms. Trace:
I20260709 12:15:56.991446 14554 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:56.993140 14688 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.993958 14582 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:56.959585 14676 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:57.020772 10737 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:57.025218 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.028667 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:57.056875 10125 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:57.028905 10047 rpcz_store.cc:276] 0709 12:15:55.712641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.932288 (+219647us) service_pool.cc:224] Handling call
0709 12:15:56.990608 (+1058320us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400351e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:56.990728 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685607808}
I20260709 12:15:57.027963 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:56.980551 14632 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:57.036152 14614 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.360s	user 0.005s	sys 0.000s
I20260709 12:15:57.036782 14362 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:57.037431 14458 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:57.016692 14455 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.039340 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.096302 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57100.7us
I20260709 12:15:57.100198 10204 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:57.039935 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2205) took 1425 ms. Trace:
I20260709 12:15:57.040439 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:57.041296 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 788) took 1797 ms. Trace:
I20260709 12:15:56.845809 14618 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:56.959416 14652 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:15:57.060192 10732 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:57.059922 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.061272 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59388.1us
I20260709 12:15:57.061196 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:57.044106 14175 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.026309 14628 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.009303 14673 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.082870 14473 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:57.088912 14529 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.000s
I20260709 12:15:57.091264 14659 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:57.028394 14580 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.043830 14463 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.054081 14568 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.102573 10729 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:56.959179 14663 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.000181 14461 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.102511 10195 rpcz_store.cc:276] 0709 12:15:55.244377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.848692 (+604315us) service_pool.cc:224] Handling call
0709 12:15:55.853355 (+  4663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.082147 (+228792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.082177 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.082217 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:56.082244 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.041053 (+958809us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400062cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:57.041102 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.041240 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525721984}
W20260709 12:15:57.106472 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 283501us
I20260709 12:15:57.107249 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:57.107362 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47536.5us
I20260709 12:15:57.110527 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:57.110699 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.170337 10054 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:57.113919 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:57.070286 14582 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:57.115737 14365 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:15:57.149071 14477 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.112664 14175 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.138616 14529 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.153622 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:57.110584 14657 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:57.156332 10729 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:57.101765 10050 rpcz_store.cc:276] 0709 12:15:55.614526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.615972 (+  1446us) service_pool.cc:224] Handling call
0709 12:15:55.616343 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.122443 (+506100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.039683 (+917240us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54003e6554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:57.039879 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111156480}
W20260709 12:15:57.181342 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 74177.2us
I20260709 12:15:57.182201 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.106297 14557 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.160001 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:57.161054 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 390109us
I20260709 12:15:57.110446 14676 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:57.107676 14633 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:15:57.151240 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.187384 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:57.167999 14611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.046s	sys 0.041s
I20260709 12:15:57.113310 14628 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.202535 14674 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:57.203303 14477 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:57.189684 10050 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:15:57.204609 14477 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:57.205010 14477 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:57.190814 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:57.171810 14453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.007s	sys 0.010s
W20260709 12:15:57.206583 14453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.798s	user 0.008s	sys 0.010s
I20260709 12:15:57.193863 14686 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:57.207336 14686 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.178622 14335 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:57.173031 14582 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:15:57.186038 14647 consensus_meta.cc:287] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.002s
I20260709 12:15:57.185140 14657 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.194952 14676 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.195562 14175 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.183923 14421 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:57.191951 14189 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:15:57.185956 14633 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.207705 14686 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:57.197019 14653 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.001s
I20260709 12:15:57.197320 14554 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:57.189225 14557 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.167512 14463 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.186875 14663 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:57.109165 14623 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:15:57.223896 14633 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:57.209622 10052 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:15:57.236456 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.194106 14659 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.211681 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.209371 10729 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.241518 10729 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:57.242002 14392 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:15:57.217427 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.215904 14647 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.218051 14699 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:15:57.216061 14657 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.214073 14582 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:57.167995 14568 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.205777 14477 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.226398 14681 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:15:57.228296 14557 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.230329 14393 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:57.219415 14421 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.232236 14463 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.238322 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.212307 14649 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:57.257985 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.258644 10049 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:15:57.242961 10127 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:57.245229 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.245152 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.260197 10051 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:57.260241 14530 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:57.157871 14580 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.260643 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:15:57.254354 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63610.3us
I20260709 12:15:57.246415 14392 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:57.248589 14677 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.263827 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.267361 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.267839 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.270318 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.270320 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.271659 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.271899 10128 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:57.273010 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.273912 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.254310 14189 consensus_queue.cc:1243] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:15:57.243090 14692 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:15:57.279621 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.251724 14519 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.282199 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.282888 10130 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:57.286192 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.255664 14393 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:57.258263 14421 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:57.290868 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.259044 14284 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:57.291004 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.239614 14653 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.263075 14555 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.294834 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.260736 14530 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:57.307833 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.297492 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.308661 10732 raft_consensus.cc:2410] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:15:57.269846 14524 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:57.300190 10195 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:57.303695 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.305111 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.279863 14473 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.308480 10122 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:57.250567 14642 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:15:57.310242 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:57.310720 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.279711 14685 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:57.309525 10737 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:57.288457 14667 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:57.328724 10737 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 6: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:57.309522 10731 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:57.290930 14535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.011s	sys 0.012s
W20260709 12:15:57.330981 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 69133.5us
I20260709 12:15:57.375468 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.301234 14284 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.330588 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.336771 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.311631 14530 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:57.279724 14296 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:15:57.376060 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:57.328967 10729 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:57.377482 10733 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:55.785151  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.381664  9950 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 6 to 7, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 7 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:15:57.391417 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.311367 14455 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.289131 14391 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:15:57.393138 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.439797 10195 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:15:57.381484 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 100161us
I20260709 12:15:57.419654 10197 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:57.308990 14651 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:57.471530  9950 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 4 to 8, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.330279 14555 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.310516 14524 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:57.433393 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44122.4us
I20260709 12:15:57.387439 14189 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.435570 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.481389 10122 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:15:57.302059 14644 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:15:57.437274 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.489020 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51795.1us
I20260709 12:15:57.468461 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.475739  9951 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 273) took 26758 ms (client timeout 15000 ms). Trace:
I20260709 12:15:57.381886 14399 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:57.477063 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.375095 14419 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:57.434048 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 127943us
W20260709 12:15:57.499241 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.493188  9950 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 7 to 8, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.479748 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:57.434870 14163 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:15:57.389380 14667 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.387578 14284 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:57.393059 14652 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:57.435329 14681 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:57.431512 14673 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.330636 14473 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.501035 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.285532 14677 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.471899 14635 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.524605 14635 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.526106 14473 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.526805 14635 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:57.527365 14706 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:15:57.528052 14389 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:57.528471 14389 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:57.529003 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.529299 14389 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.530306 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:57.492610 14399 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:57.509266 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.480520 14524 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.511118 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.486318 14529 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.470618 14674 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:15:57.466004 14393 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.565733 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.566514 10197 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:57.491878 14189 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.516978 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.520839 14685 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:57.501962 14419 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:57.521817 14690 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:15:57.522068 14698 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:57.560547 14647 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.522107 14697 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 12:15:57.480186 14651 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.523350 14580 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.523999 14677 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.503690 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.531780 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.551870 10730 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:57.594332 10129 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:57.558377 14633 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.511356 14535 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:57.486014 14555 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.513487 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.573166 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:57.573308 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 83323.3us
I20260709 12:15:57.514110 14681 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.575333 10123 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:57.531517 14398 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:57.516366 14578 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:57.494940 14692 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:57.512956 14667 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.511711 14632 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.591223 10128 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:57.526836 10049 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:57.553990 14389 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:57.624912 14651 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.609231 14398 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:57.625222  9950 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 6 to 7, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:57.628737 10198 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:57.629551 10050 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:57.634002 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1759) took 1328 ms. Trace:
I20260709 12:15:57.634442 10127 rpcz_store.cc:276] 0709 12:15:56.305295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.305654 (+   359us) service_pool.cc:224] Handling call
0709 12:15:56.305966 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.242737 (+936771us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54001b3b20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:57.259643 (+ 16906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.633730 (+374087us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001b3b20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e793a02 00007fc17e78fdd6 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:57.633945 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360339968}
W20260709 12:15:57.597599 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 91296.1us
I20260709 12:15:57.635630 14409 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.641089 14409 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.642366 10121 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:15:57.642483 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.643335 14697 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:57.601044 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.644718 10020 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.644886 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.645510 14697 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:57.645289 14657 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.646452 10201 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:57.607792 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 94395.6us
I20260709 12:15:57.647353 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.608481 14455 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.595697 14399 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:57.613904 14709 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:57.658339 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.614109 14419 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:57.614521 14701 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:15:57.616595 14702 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:15:57.668148 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.609607 14580 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:57.669018 14580 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.669437 14580 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.609822 14681 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:57.671564 14399 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:57.604660 14393 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:57.635674 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.640455 10048 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:57.635725 14653 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.646126 14722 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:15:57.606444 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.651208 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:57.683166 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.651571 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.674892 10048 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:57.697582 10127 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
W20260709 12:15:57.699577 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48135.2us
I20260709 12:15:57.604144 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:57.655746  9950 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 5 to 9, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:57.659063 10122 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 8.
I20260709 12:15:57.605773 14669 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:57.611927 14677 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.665329 10737 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:57.666905 10730 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:57.667479 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.698572 10050 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:57.700342 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.704018 10728 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:15:57.705363 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:57.701236 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 97162.2us
I20260709 12:15:57.655680 14651 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.707863 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:57.708081 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.709031 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.733157 10127 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:15:57.733856 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:57.734177 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.734779 10050 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:15:57.490383  9951 rpcz_store.cc:269] 0709 12:15:30.628487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.628681 (+   194us) service_pool.cc:224] Handling call
0709 12:15:57.386254 (+26757573us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:41.632497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:41.633170 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:41.633221 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:15:41.633240 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:41.770772 (+137532us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:41.787441 (+ 16669us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:41.791993 (+  4552us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:15:41.808682 (+ 16689us) tablet.cc:701] Row locks acquired
0709 12:15:41.808728 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:15:41.808885 (+   157us) write_op.cc:270] Start()
0709 12:15:41.809030 (+   145us) write_op.cc:276] Timestamp: P: 1783599341808824 usec, L: 0
0709 12:15:41.809053 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:15:41.939232 (+130179us) log.cc:844] Serialized 9886 byte log entry
0709 12:15:42.589505 (+650273us) op_driver.cc:464] REPLICATION: finished
0709 12:15:42.868699 (+279194us) write_op.cc:301] APPLY: starting
0709 12:15:42.919865 (+ 51166us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:42.971464 (+ 51599us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:42.971611 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:42.974372 (+  2761us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:42.975155 (+   783us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:15:42.975201 (+    46us) write_op.cc:312] APPLY: finished
0709 12:15:42.993357 (+ 18156us) log.cc:844] Serialized 170 byte log entry
0709 12:15:43.004003 (+ 10646us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:43.004205 (+   202us) write_op.cc:454] Released schema lock
0709 12:15:43.004279 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:43.014642 (+ 10363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:43.015827 (+  1185us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2127617,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":278853,"apply.run_cpu_time_us":6027,"apply.run_wall_time_us":136001,"num_ops":25,"prepare.queue_time_us":140021,"prepare.run_cpu_time_us":15595,"prepare.run_wall_time_us":550543,"raft.queue_time_us":211666,"raft.run_cpu_time_us":11619,"raft.run_wall_time_us":322359,"replication_time_us":780271,"spinlock_wait_cycles":80768,"thread_start_us":550071,"threads_started":4,"wal-append.queue_time_us":203115,"wal-append.run_cpu_time_us":27319,"wal-append.run_wall_time_us":1830910}]]}
I20260709 12:15:57.712819 10129 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:15:57.716270 14421 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.735421 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.665968 14663 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:57.666077 14697 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.663795 14642 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:57.654662 14378 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.726590 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.727187 14657 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.722195 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.741183 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:57.729245 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.654678 14656 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.655963 14682 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.699888 10048 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.719659 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:57.765676 10199 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:57.736593 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.739423 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:57.742473 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.767546 10127 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:57.743078 10019 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.744935 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:57.771693 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.745877 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.708483 14692 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:57.756559 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.775729 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.776481 10733 raft_consensus.cc:2410] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:15:57.753809 10204 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:57.708451 14419 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:57.719560 14555 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.762768 10195 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:57.772372 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:15:57.772527 10129 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:57.783082 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.783787 10129 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:57.773501 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:57.731405 14635 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:15:57.784934 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.774763 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.747750 14674 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.785984 10734 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:57.787010 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.748973 14662 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:57.793151 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.778404 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:57.732503 14669 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.793869 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.794211 10204 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:57.794150 10129 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:15:57.658339 14455 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.795224 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.809808 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.772703 14656 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.796283 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.796564 14667 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.796581 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.819082 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.798645 14529 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.800622 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.788362 14698 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:57.822353 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.801018 14662 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:57.798739 14669 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.798969 14725 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:57.800524 14673 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:57.754146 14697 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:57.804986 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.805354 10127 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:57.831981 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:57.832993 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.795135 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:57.749250 14392 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:57.811545  9950 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:57.801849 14712 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 12:15:57.809823 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:57.813275 10123 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:57.815398 10199 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:57.779779 14535 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:57.743093 14651 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.865760 14651 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.865926 14392 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:57.869041 14681 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:57.869935 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2353) took 2126 ms (client timeout 2246 ms). Trace:
I20260709 12:15:57.871826 14427 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:57.872308 14427 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:57.873248 14427 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.875290 14459 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:57.875770 14459 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:57.876681 14459 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.877820 14459 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.830024 14284 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.881119 14284 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:57.883092 14724 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:57.883450 14654 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:57.883924 14654 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:57.885144 14455 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.884848 14654 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.889855 14566 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.780421 14692 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.757923 14378 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.890693 14692 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:57.891677 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2212) took 1525 ms. Trace:
I20260709 12:15:57.892175 14378 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:57.893018 10126 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:57.895984 10126 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:15:57.822288 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:57.817282 14582 consensus_meta.cc:287] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.003s
I20260709 12:15:57.827638 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.829063 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.898684 14582 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.900655 10129 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:57.900970 14582 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.902670 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.892066 10053 rpcz_store.cc:276] 0709 12:15:56.366408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.369297 (+  2889us) service_pool.cc:224] Handling call
0709 12:15:57.891475 (+1522178us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5400110154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:57.891617 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44241280}
I20260709 12:15:57.903594 10054 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:15:57.903750 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.904449 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:57.905299 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.902736 14338 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:57.898689 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 76497.2us
I20260709 12:15:57.907205 10122 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:57.907620 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:57.908560 14477 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:57.908707 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:57.909566 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:57.910320 14378 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:57.910606 14566 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:57.910722 14378 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:57.911056 14566 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.911178 14378 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:57.911464 14566 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:57.911806 14697 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.904397 10053 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:15:57.901746 10196 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
W20260709 12:15:57.916438 14686 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.003s
I20260709 12:15:57.874320 14427 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:57.896126 14421 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:57.916910 14380 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:57.918610 14380 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:57.919516 14380 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.922654 10202 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:57.923323 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 793) took 2138 ms. Trace:
I20260709 12:15:57.923632 10202 rpcz_store.cc:276] 0709 12:15:55.784583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.939994 (+155411us) service_pool.cc:224] Handling call
0709 12:15:55.940270 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:57.922355 (+1982085us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540032f3a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e792d87 00007fc17e793470 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:57.923045 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.923267 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551833344}
I20260709 12:15:57.925161 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:57.870391 10121 rpcz_store.cc:269] 0709 12:15:55.743208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.743360 (+   152us) service_pool.cc:224] Handling call
0709 12:15:57.869727 (+2126367us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540009a6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:57.869865 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4292696832}
I20260709 12:15:57.926049 10202 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:15:57.818636 14473 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:57.839767 10729 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:15:57.775667 14682 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.841487  9950 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 5 to 8, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 8 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } }
I20260709 12:15:57.821497 14189 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:57.823772 14618 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:57.941834  9950 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 8 to 2, term changed from 12 to 11, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from VOTER to NON_VOTER. New cstate: current_term: 11 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:15:57.845208 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.843617 10127 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:57.824005 14662 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:57.807053 14674 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.824888 14725 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:57.863421 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 53682.4us
I20260709 12:15:57.905694 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:57.834542 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.841176 14530 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.927009 14688 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.930568 14580 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:57.931216 14610 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.085s	user 0.007s	sys 0.004s
I20260709 12:15:57.928793 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.939769 14378 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:57.947314 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:15:57.947921 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.952490 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2219) took 1460 ms. Trace:
I20260709 12:15:57.935367 14651 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:57.942190 14677 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:57.935720 14473 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:57.962829 10124 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:57.963137 10046 rpcz_store.cc:276] 0709 12:15:56.492467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.532099 (+ 39632us) service_pool.cc:224] Handling call
0709 12:15:56.991155 (+459056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.051098 (+ 59943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:57.051136 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:57.051670 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.269571 (+217901us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:57.269610 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.269687 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.616194 (+346507us) raft_consensus.cc:1685] finished
0709 12:15:57.616216 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.952174 (+335958us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400351e50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:57.952416 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120989,"raft.queue_time_us":69702,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12566,"spinlock_wait_cycles":1054921088,"thread_start_us":217606,"threads_started":1,"wal-append.queue_time_us":462631}
I20260709 12:15:57.967195 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.968837 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:57.967408 14651 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:57.946396 14662 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:57.977267 10054 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:57.916863 14686 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.970248 14651 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:57.970153 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:57.981619 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:57.985081 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1753) took 1762 ms (client timeout 1879 ms). Trace:
W20260709 12:15:57.985515 10125 rpcz_store.cc:269] 0709 12:15:56.222958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.224812 (+  1854us) service_pool.cc:224] Handling call
0709 12:15:57.984909 (+1760097us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400210054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:57.985023 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787266816}
I20260709 12:15:57.986738 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.987389 10125 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:57.988296 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:57.989008 10125 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:57.953413 14725 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:57.967259 14697 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:57.980670 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:57.981674 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.990319 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:57.965531 14421 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:58.005725 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:58.007835 10125 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:57.970464 14549 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:57.971692 14473 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:58.011010 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:58.010107 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:57.957252 14688 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:57.980304 14618 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:57.963490 14610 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.020283 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.022514 14389 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:15:58.025377 14378 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.026962 10129 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:15:58.009526 14163 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:58.027326 14682 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.154459 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.155483 10733 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:15:58.024080 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:58.067499 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.683s (SENT) [suppressed 4 similar messages]
I20260709 12:15:58.006718 14697 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.021703 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:58.099289 10129 pending_rounds.cc:85] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 5
I20260709 12:15:58.007433 14681 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.018451 14582 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:58.013330 14455 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:58.187099 10129 pending_rounds.cc:107] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:58.192862 10129 raft_consensus.cc:2889] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:58.191120 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:58.020576 14623 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:58.194877 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:58.195968 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 174336us
I20260709 12:15:58.196938 10130 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:58.199626 10047 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:58.200042 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:58.200930 10204 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:58.199748 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:58.103556 14163 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.029953 14732 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.212889 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.213500 10733 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 6.
I20260709 12:15:58.214160 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:58.211967 14163 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:58.203372 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:58.192131 14697 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:58.194746 14557 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.229346 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:58.194960 14625 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:58.219302 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:58.100051 14618 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.221956 14743 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:58.241819 14743 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.242228 14743 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:58.205878 10204 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:58.234673 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 796) took 1133 ms. Trace:
I20260709 12:15:58.210498 14623 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:58.244463 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:58.243893 10196 rpcz_store.cc:276] 0709 12:15:57.098823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.098943 (+   120us) service_pool.cc:224] Handling call
0709 12:15:58.232468 (+1133525us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540007f654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:58.232577 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652226944}
I20260709 12:15:58.236307 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:58.241091 14618 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.233011 14656 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.268311 10196 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:58.288781 14380 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:58.289337 14380 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:58.289737 14380 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:58.245919 14742 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:58.263979 14399 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 12:15:58.258004 14389 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:58.218056 14732 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.301365 14742 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.236142 14557 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.310282 14530 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.311441 14580 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.332527 14686 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:58.337986 14735 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:58.324626 14674 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.331236 14742 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:58.346738 14725 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.348453 14725 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:15:58.342229 14733 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:15:58.352495 14732 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.357103 14743 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.222819 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:58.389897 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:58.393697 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:58.395175 10054 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:58.396530 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:58.400053 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.401360 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:58.415525 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 347879us
I20260709 12:15:58.417212 14189 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:15:58.418577 14189 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.421929 14189 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:58.299885 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45118us
I20260709 12:15:58.426225 10196 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:58.441294 10129 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:15:58.427275 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1752) took 1038 ms. Trace:
I20260709 12:15:58.447924 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1745) took 2278 ms. Trace:
I20260709 12:15:58.455976 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:58.436350 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.440722 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.451545 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:58.341291 14649 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.074s	user 0.014s	sys 0.003s
I20260709 12:15:58.457533 14743 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:58.446949 14477 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.538s	user 0.016s	sys 0.006s
I20260709 12:15:58.484416 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:58.426239 14557 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.491236 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2365) took 1180 ms. Trace:
W20260709 12:15:58.494580 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 280310us
I20260709 12:15:58.495982 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:58.433454 14391 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.496053 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:58.491767 10130 rpcz_store.cc:276] 0709 12:15:57.310215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.310490 (+   275us) service_pool.cc:224] Handling call
0709 12:15:57.310799 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.199561 (+888762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.455190 (+255629us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400231254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:58.490724 (+ 35534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037355904}
W20260709 12:15:58.486924 14698 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 12:15:58.507196 14698 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:58.507853 14692 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.001s
I20260709 12:15:58.427163 14610 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.481190 10124 rpcz_store.cc:276] 0709 12:15:56.169238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.169354 (+   116us) service_pool.cc:224] Handling call
0709 12:15:56.169656 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:57.967771 (+1798115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.447240 (+479469us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400243e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:58.447651 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4123149568}
I20260709 12:15:58.521953 14749 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:58.526082 14748 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.526355 14747 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.527210 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:58.527009 14748 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.527385 14747 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.528359 10731 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:58.530915 14748 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.480104 10203 rpcz_store.cc:276] 0709 12:15:57.388799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.831210 (+442411us) service_pool.cc:224] Handling call
0709 12:15:57.862158 (+ 30948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.864454 (+  2296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:57.864491 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:57.865077 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:15:58.012466 (+147389us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:58.012631 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.012713 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.426612 (+413899us) raft_consensus.cc:1685] finished
0709 12:15:58.426661 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.427047 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1717,"raft.queue_time_us":1958,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":147010,"threads_started":1,"wal-append.queue_time_us":377925}
I20260709 12:15:58.531819 14398 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.533103 14398 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:58.533649 10203 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:58.534727 14391 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.537451 14391 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.537770 14409 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.539378 10195 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:15:58.541352 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49765.4us
I20260709 12:15:58.541752 14557 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:15:58.544184 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.544450 14463 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:58.544948 14463 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:58.546768 14686 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:15:58.522545 14749 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:58.548152 14749 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:58.546811 14656 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:15:58.557278 14568 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.518261 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:58.559074 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:58.559693 14582 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:15:58.560925 10195 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:58.336113 14623 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.561635 14686 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.588446 10729 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:58.597117 10196 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:15:58.598610 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 79543.2us
I20260709 12:15:58.530268 14747 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.572381 14698 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.573853 14189 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.592438 14582 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:58.508401 14692 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:58.602088 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44316.3us
I20260709 12:15:58.601462 14419 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.615458 10054 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:58.563352 14463 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.621098 14692 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.621626 14463 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:58.621680 14633 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.625622 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:58.628288 10196 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:58.630716 10199 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:58.631086 10733 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:58.632443 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:58.605242 14698 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.636125 14698 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:58.636349 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:58.671700 10199 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:58.673972 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:58.674896 10130 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:58.676077 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:58.674921 14692 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.676931 10130 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:58.677007 14692 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.675894 14725 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:58.678489 14725 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:58.676713 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44472us
I20260709 12:15:58.682157 10130 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
W20260709 12:15:58.632614 14473 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.613s	user 0.003s	sys 0.015s
I20260709 12:15:58.705119 14686 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.701839 14473 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:58.726470 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 167621us
I20260709 12:15:58.729568 10046 raft_consensus.cc:2410] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:15:58.731056 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49514.7us
I20260709 12:15:58.732617 14698 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:58.735101 14461 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.760449 14189 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.761633 14698 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:15:58.680065 14378 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:58.779731 14698 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:58.789256 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.778328 14378 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:58.765336 14568 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:58.789129 14676 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.805299 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1792) took 1034 ms. Trace:
I20260709 12:15:58.806543  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.619187 14419 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:58.834543 14734 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.625s	user 0.000s	sys 0.003s
I20260709 12:15:58.828151 10123 rpcz_store.cc:276] 0709 12:15:57.770352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.445749 (+675397us) service_pool.cc:224] Handling call
0709 12:15:58.476603 (+ 30854us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:58.521750 (+ 45147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.521787 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:58.522543 (+   756us) log.cc:844] Serialized 52 byte log entry
0709 12:15:58.593112 (+ 70569us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:58.610871 (+ 17759us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.699770 (+ 88899us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.699935 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.700005 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.804941 (+104936us) raft_consensus.cc:1685] finished
0709 12:15:58.804965 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.805117 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92951,"prepare.queue_time_us":21504,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":91755,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":225,"thread_start_us":68446,"threads_started":1,"wal-append.queue_time_us":270344}
I20260709 12:15:58.789698 14461 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:58.852648 14742 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.009s
I20260709 12:15:58.853138 14742 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.853544 14685 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.854166 14685 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:58.857344 14529 consensus_meta.cc:287] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.008s
I20260709 12:15:58.857827 14529 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:58.858791 10053 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
W20260709 12:15:58.861819 14524 consensus_meta.cc:287] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.293s	user 0.006s	sys 0.013s
I20260709 12:15:58.862457 14524 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.863159 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:58.863709 10055 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:58.865173 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:58.865978 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:58.866251 14666 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.866922 14666 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.867702 14618 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:58.868260 14618 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:58.868870 14524 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.869336 14618 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.870929 14686 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.866361 14725 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:58.871505 14725 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.871671 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:58.871949 14725 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:58.872628 10200 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:15:58.873656 14697 consensus_meta.cc:287] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.008s
I20260709 12:15:58.875344 14692 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:58.878157 14651 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.007s
I20260709 12:15:58.884317 14651 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.885272 14725 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.890834 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.891052 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:58.891825 10731 raft_consensus.cc:2368] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10.
W20260709 12:15:58.883749 14566 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.972s	user 0.004s	sys 0.016s
I20260709 12:15:58.893280 14566 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:58.880805 14459 consensus_meta.cc:287] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.002s	user 0.013s	sys 0.009s
I20260709 12:15:58.893052 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.895130 10731 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:58.887935 14557 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:58.895869 14557 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:58.896306 14557 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:58.896984 14566 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.897485 14742 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.889595 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:58.899226 10733 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:58.901717 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:15:58.874109 14697 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.905123 10196 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:15:58.911043 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:58.838969 14568 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:15:58.912081 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 184628us
I20260709 12:15:58.913769 10047 raft_consensus.cc:2368] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:15:58.844033 14698 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.938813 10123 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:15:58.942255 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.930529 14633 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.948009 14699 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:58.948734 14699 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:58.935076 14380 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.005s
I20260709 12:15:58.950549 14654 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:58.950313 14380 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:58.951715 14754 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:15:58.954632 14378 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.955765 14628 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.848426 14676 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:58.940816 14473 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.959825 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:58.947907 14633 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.899283 14651 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.985000 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:58.955814 14378 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:58.898881 14725 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:58.924690 14461 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:58.995455 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:58.999145 10733 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:58.997550 14380 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:58.999382 10123 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:58.998049 14582 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.000413 10196 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:58.982098 14419 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:59.009544 14163 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.785s	user 0.015s	sys 0.025s
I20260709 12:15:59.009716 14666 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.010224 14163 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.011059 14685 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.003363 14189 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.017627 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.007332 14699 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.011147 14461 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.008001 14697 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:15:59.029736 14764 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:15:59.030172 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:59.030723 14421 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.993s	user 0.015s	sys 0.014s
I20260709 12:15:59.035576 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:59.037550 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 975) took 2542 ms (client timeout 1683 ms). Trace:
I20260709 12:15:59.039804 14582 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.040740 14568 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.042464 14698 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.043360 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.043509 14633 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.043974 14666 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:59.047755 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 681) took 1812 ms. Trace:
I20260709 12:15:59.051894 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2383) took 1087 ms. Trace:
I20260709 12:15:59.059835 10733 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 7.
W20260709 12:15:59.059273 10736 rpcz_store.cc:269] 0709 12:15:56.495362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.495507 (+   145us) service_pool.cc:224] Handling call
0709 12:15:59.037136 (+2541629us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400453154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.037324 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929740544}
I20260709 12:15:59.067246 10055 rpcz_store.cc:276] 0709 12:15:57.235178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.530079 (+294901us) service_pool.cc:224] Handling call
0709 12:15:59.047523 (+1517444us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003fa7d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.047673 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064792960}
I20260709 12:15:59.064254 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:15:59.065577 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56619.7us
I20260709 12:15:59.070410 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.067888 10124 rpcz_store.cc:276] 0709 12:15:57.964570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.523018 (+558448us) service_pool.cc:224] Handling call
0709 12:15:58.523609 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.590079 (+ 66470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.590112 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:58.600026 (+  9914us) log.cc:844] Serialized 26 byte log entry
0709 12:15:58.978717 (+378691us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:58.978752 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.978810 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.051663 (+ 72853us) raft_consensus.cc:1685] finished
0709 12:15:59.051684 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.051833 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43909,"raft.queue_time_us":67771,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11476,"thread_start_us":348458,"threads_started":1,"wal-append.queue_time_us":395303}
I20260709 12:15:59.074879 14455 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:59.075740 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.075218 10130 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:15:59.082082 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 807) took 1425 ms. Trace:
W20260709 12:15:59.095757 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 75417.5us
I20260709 12:15:59.102303 10124 raft_consensus.cc:2368] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:15:59.102342 10055 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:59.107191 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:15:59.107792 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.068969 14421 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:59.121259 14662 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.136s	user 0.007s	sys 0.020s
I20260709 12:15:59.121798 14662 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.122641 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1795) took 1179 ms. Trace:
I20260709 12:15:59.124058 14554 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:59.124321 14662 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.124807 14163 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.128997 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.129994 10055 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:59.130013 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:59.131116 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.123049 10129 rpcz_store.cc:276] 0709 12:15:57.943363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.488318 (+544955us) service_pool.cc:224] Handling call
0709 12:15:58.523333 (+ 35015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.543012 (+ 19679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.543057 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:58.543703 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 12:15:58.600428 (+ 56725us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:58.600492 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.600649 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.122389 (+521740us) raft_consensus.cc:1685] finished
0709 12:15:59.122409 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.122581 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18784,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":53523,"threads_started":1,"wal-append.queue_time_us":517050}
I20260709 12:15:59.132505 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.133253 10055 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:59.134052 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.134714 10199 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.136868 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.137104 14676 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.137494 10195 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
W20260709 12:15:59.129016 14749 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.005s
I20260709 12:15:59.137940 10204 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:59.138062 14749 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.138590 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.139338 10203 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:15:59.140000 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:59.140300 14749 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.134267 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.144694 10196 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:59.145465 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1789) took 1375 ms. Trace:
I20260709 12:15:59.146085 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1794) took 1322 ms. Trace:
I20260709 12:15:59.142753 14652 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:15:59.147290 14763 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:59.148643 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1787) took 1379 ms. Trace:
I20260709 12:15:59.149083 10125 rpcz_store.cc:276] 0709 12:15:57.769098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.194087 (+424989us) service_pool.cc:224] Handling call
0709 12:15:58.194461 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.194815 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.194843 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:58.450253 (+255410us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b2c00010c48. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:15:58.498440 (+ 48187us) log.cc:844] Serialized 26 byte log entry
0709 12:15:58.908317 (+409877us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:58.908359 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.922753 (+ 14394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.148193 (+225440us) raft_consensus.cc:1685] finished
0709 12:15:59.148213 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.148458 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4046,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7674,"spinlock_wait_cycles":5226368,"thread_start_us":401581,"threads_started":1,"wal-append.queue_time_us":544605}
I20260709 12:15:59.145810 10127 rpcz_store.cc:276] 0709 12:15:57.769567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.403204 (+633637us) service_pool.cc:224] Handling call
0709 12:15:58.403935 (+   731us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:58.404627 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.404679 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:58.413520 (+  8841us) log.cc:844] Serialized 52 byte log entry
0709 12:15:58.917477 (+503957us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:58.940915 (+ 23438us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.075790 (+134875us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b18002f60e0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:59.144652 (+ 68862us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b18002f60e0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:15:59.144855 (+   203us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.145057 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.145125 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.145168 (+    43us) raft_consensus.cc:1685] finished
0709 12:15:59.145181 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.145308 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162269,"prepare.queue_time_us":234617,"prepare.run_cpu_time_us":2580,"prepare.run_wall_time_us":11899,"raft.queue_time_us":36166,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":309,"spinlock_wait_cycles":85168640,"thread_start_us":415043,"threads_started":1,"wal-append.queue_time_us":617708}
I20260709 12:15:59.146458 10128 rpcz_store.cc:276] 0709 12:15:57.823173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.482164 (+658991us) service_pool.cc:224] Handling call
0709 12:15:58.492991 (+ 10827us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:58.493906 (+   915us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:15:58.496298 (+  2392us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.917053 (+420755us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:58.954737 (+ 37684us) log.cc:844] Serialized 78 byte log entry
0709 12:15:58.954884 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:59.144972 (+190088us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.145316 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.145553 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.145704 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.145768 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.145803 (+    35us) raft_consensus.cc:1685] finished
0709 12:15:59.145813 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.145936 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189813,"prepare.queue_time_us":195032,"prepare.run_cpu_time_us":187,"prepare.run_wall_time_us":267,"raft.queue_time_us":8772,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":5735,"thread_start_us":387792,"threads_started":1,"wal-append.queue_time_us":513619}
I20260709 12:15:59.139436 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1759) took 1172 ms. Trace:
I20260709 12:15:59.082242 14459 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.148559 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.077219 14455 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:59.084596 14398 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.004s
I20260709 12:15:59.139506 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 678) took 1916 ms. Trace:
I20260709 12:15:59.153308 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1786) took 1384 ms. Trace:
I20260709 12:15:59.162057 10204 rpcz_store.cc:276] 0709 12:15:57.966743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.293294 (+326551us) service_pool.cc:224] Handling call
0709 12:15:58.490725 (+197431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.138355 (+647630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.139195 (+   840us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002634d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.139380 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487742208}
I20260709 12:15:59.144604 10055 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:59.172049 10052 rpcz_store.cc:276] 0709 12:15:57.223103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.926810 (+703707us) service_pool.cc:224] Handling call
0709 12:15:59.116149 (+1189339us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:15:59.138755 (+ 22606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.139017 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.139041 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.139083 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:59.139110 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.139161 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.139280 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12713856}
I20260709 12:15:59.175855 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.177758 10199 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:59.154719 14652 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:59.180125 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:59.171939 10122 rpcz_store.cc:276] 0709 12:15:57.768667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.771518 (+  2851us) service_pool.cc:224] Handling call
0709 12:15:59.152890 (+1381372us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400212354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.153118 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300436736}
I20260709 12:15:59.180562 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.086776 14633 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.180927 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.179612 10200 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:59.171983 14459 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.163153 14554 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.182914 10055 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:59.183269 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:59.183393 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.184134 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 677) took 1970 ms. Trace:
I20260709 12:15:59.104146 10197 rpcz_store.cc:276] 0709 12:15:57.643181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.886292 (+243111us) service_pool.cc:224] Handling call
0709 12:15:57.886702 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.540252 (+653550us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:58.540713 (+   461us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.591082 (+ 50369us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.605002 (+ 13920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:58.605055 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:58.605099 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.048484 (+443385us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b1800359da0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:15:59.060683 (+ 12199us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540007f154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.060744 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.068706 (+  7962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34571,"prepare.queue_time_us":1688,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":64967,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":19470,"spinlock_wait_cycles":1517362304}
I20260709 12:15:59.189663 14722 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:59.190644 14633 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:59.194067 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1742) took 1929 ms (client timeout 2026 ms). Trace:
I20260709 12:15:59.195979 10202 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:59.196682 14666 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:59.198171 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1784) took 1429 ms. Trace:
I20260709 12:15:59.166039 14455 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:59.182159 14163 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:59.201047 10053 rpcz_store.cc:276] 0709 12:15:57.213754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.915113 (+701359us) service_pool.cc:224] Handling call
0709 12:15:57.915406 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.859228 (+943822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.183868 (+324640us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54003f98d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.184080 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168665856}
I20260709 12:15:59.206022 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:15:59.203262 10201 rpcz_store.cc:269] 0709 12:15:57.264807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.281877 (+ 17070us) service_pool.cc:224] Handling call
0709 12:15:59.193542 (+1911665us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002639d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.193822 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817586048}
I20260709 12:15:59.202783 14554 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:59.221568 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.205514 14666 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.223136 10736 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:15:59.203039 14722 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:59.211596 14163 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.224298 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.205561 10121 rpcz_store.cc:276] 0709 12:15:57.768216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.937821 (+169605us) service_pool.cc:224] Handling call
0709 12:15:58.001059 (+ 63238us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:58.001467 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.001498 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:15:58.002182 (+   684us) log.cc:844] Serialized 78 byte log entry
0709 12:15:58.226462 (+224280us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:58.518827 (+292365us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.613936 (+ 95109us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.698806 (+ 84870us) log.cc:844] Serialized 14 byte log entry
0709 12:15:58.699072 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.699207 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.699251 (+    44us) raft_consensus.cc:1685] finished
0709 12:15:58.699263 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.195039 (+495776us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4800240258. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:15:59.197785 (+  2746us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54001900d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.197946 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100614,"prepare.queue_time_us":209889,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":898,"raft.queue_time_us":106323,"raft.run_cpu_time_us":1946,"raft.run_wall_time_us":608181,"spinlock_wait_cycles":150131328,"thread_start_us":386127,"threads_started":2,"wal-append.queue_time_us":305191}
I20260709 12:15:59.232089 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.233911 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.228076 14666 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.239792 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.240059 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.232199 14163 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:59.242698 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.243224 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.240854 10055 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:15:59.245774 10125 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:15:59.246083 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.247144 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.247812 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.242472 14580 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:59.252717 14632 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:59.253082 10051 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:15:59.254107 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.253005 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.256608 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.257326 10055 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:59.259074 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.259011 10197 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:59.257117 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:15:59.241196 14557 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.268604 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.272786 14647 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.274890 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.269779 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.273370 14647 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.273789 14722 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:59.276878 14771 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 12:15:59.277287 14722 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.277753 14647 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:59.272831 10049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 680) took 2037 ms (client timeout 2133 ms). Trace:
I20260709 12:15:59.267777 14676 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:15:59.281980 14736 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.865s	user 0.004s	sys 0.001s
I20260709 12:15:59.281634 14676 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:59.273818 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2489) took 1315 ms (client timeout 1749 ms). Trace:
W20260709 12:15:59.279049 10049 rpcz_store.cc:269] 0709 12:15:57.234875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.292193 (+ 57318us) service_pool.cc:224] Handling call
0709 12:15:59.272526 (+1980333us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400321c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.272679 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489459072}
I20260709 12:15:59.285146 14673 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:15:59.286379 14459 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.287173 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2238) took 1309 ms. Trace:
W20260709 12:15:59.288317 10046 rpcz_store.cc:269] 0709 12:15:57.958909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.968545 (+  9636us) service_pool.cc:224] Handling call
0709 12:15:59.273587 (+1305042us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400140354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.273761 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438652288}
I20260709 12:15:59.294799 10054 rpcz_store.cc:276] 0709 12:15:57.978242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.400812 (+422570us) service_pool.cc:224] Handling call
0709 12:15:59.286964 (+886152us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400110154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.287091 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490176384}
I20260709 12:15:59.294312 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.282812 10737 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:15:59.292968 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:59.296823 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.298774 14676 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.301414 10733 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:15:59.303352 14519 raft_consensus.cc:2764] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:15:59.300621 10052 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:15:59.307583 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.300024 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2485) took 1650 ms. Trace:
I20260709 12:15:59.309861 10054 rpcz_store.cc:276] 0709 12:15:57.649207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.298915 (+1649708us) service_pool.cc:224] Handling call
0709 12:15:59.299355 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.299648 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.299671 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.299735 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:59.299767 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.299835 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.299952 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.299975 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:59.308943 10168 leader_election.cc:400] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10.
I20260709 12:15:59.310781 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:59.311044 10168 leader_election.cc:403] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:15:59.311843 10734 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:59.311527 10055 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:15:59.313285 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.319952 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.321624 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:15:59.322570 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:59.321548 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 76268.7us
I20260709 12:15:59.317997 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:15:59.320253 10049 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
W20260709 12:15:59.326979 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.328842 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.329694 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2495) took 1353 ms. Trace:
I20260709 12:15:59.308270 14633 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.311362 14398 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:59.337618 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.332882 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:15:59.335291 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.330065 10047 rpcz_store.cc:276] 0709 12:15:57.976629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.200191 (+223562us) service_pool.cc:224] Handling call
0709 12:15:59.329475 (+1129284us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54003e7454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.329628 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588699520}
I20260709 12:15:59.330999 10048 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:59.343143 10051 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:59.334580 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2230) took 1673 ms. Trace:
W20260709 12:15:59.332253 14772 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:15:59.332832 14755 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:15:59.344214 10202 rpcz_store.cc:276] 0709 12:15:57.661457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.928121 (+266664us) service_pool.cc:224] Handling call
0709 12:15:59.195442 (+1267321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:59.214988 (+ 19546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.334314 (+119326us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002639d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.334522 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913590656}
W20260709 12:15:59.333767 14768 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.199s	user 0.001s	sys 0.002s
I20260709 12:15:59.352169 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:15:59.351445 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2234) took 1405 ms. Trace:
I20260709 12:15:59.348881 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.356370 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 682) took 2112 ms. Trace:
I20260709 12:15:59.327739 14378 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:59.357877 10734 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:15:59.357144 10047 rpcz_store.cc:276] 0709 12:15:57.946504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.346472 (+1399968us) service_pool.cc:224] Handling call
0709 12:15:59.351008 (+  4536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.351179 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.351201 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.351235 (+    34us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:59.351260 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.351305 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.351378 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.356678 10198 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:15:59.359444 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2228) took 1629 ms. Trace:
I20260709 12:15:59.348464 10053 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.360584 10054 rpcz_store.cc:276] 0709 12:15:57.730549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.310759 (+1580210us) service_pool.cc:224] Handling call
0709 12:15:59.345009 (+ 34250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.359138 (+ 14129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.359165 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.359206 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:59.359235 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.359292 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.359392 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.360226 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:59.362625 10736 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:59.350781 14688 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.356767 10051 rpcz_store.cc:276] 0709 12:15:57.235426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.300762 (+2065336us) service_pool.cc:224] Handling call
0709 12:15:59.338084 (+ 37322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.347869 (+  9785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.348085 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.363659 14687 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:59.380350 14687 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.380852 14687 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.364809 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.382041 10050 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:59.312767 14673 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:15:59.372850 10020 leader_election.cc:400] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:15:59.385875 10020 leader_election.cc:403] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:15:59.385165 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 683) took 2141 ms. Trace:
I20260709 12:15:59.387406 10046 rpcz_store.cc:276] 0709 12:15:57.235656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.308617 (+2072961us) service_pool.cc:224] Handling call
0709 12:15:59.344342 (+ 35725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.360488 (+ 16146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.360516 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.377249 (+ 16733us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:59.377290 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.377348 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.377456 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.389999 10052 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:59.390690 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.391512 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2236) took 1425 ms. Trace:
I20260709 12:15:59.392894 10052 rpcz_store.cc:276] 0709 12:15:57.965864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.388736 (+1422872us) service_pool.cc:224] Handling call
0709 12:15:59.389204 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.390513 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.391421 (+   908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.393822 14676 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:15:59.395270 10049 raft_consensus.cc:1217] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
W20260709 12:15:59.395195 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.395882 10049 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:15:59.384986 14378 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:15:59.375706 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.376434 14536 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:59.345388 14398 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.379362 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.396976 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2232) took 1641 ms. Trace:
I20260709 12:15:59.374895 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.399875 10050 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:15:59.400104 10200 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:15:59.401852 10049 rpcz_store.cc:276] 0709 12:15:57.755669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.336743 (+1581074us) service_pool.cc:224] Handling call
0709 12:15:59.385572 (+ 48829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:59.396701 (+ 11129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.396916 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:59.411616 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 83653.5us
I20260709 12:15:59.409540 14580 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:59.413829 10047 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:15:59.414541 10051 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:15:59.414642 14580 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.415262 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2492) took 1451 ms. Trace:
I20260709 12:15:59.415571 10051 rpcz_store.cc:276] 0709 12:15:57.963482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.377611 (+1414129us) service_pool.cc:224] Handling call
0709 12:15:59.402675 (+ 25064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.414996 (+ 12321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.415210 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.419358 14633 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:59.419713 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2497) took 1419 ms. Trace:
I20260709 12:15:59.420112 10052 rpcz_store.cc:276] 0709 12:15:58.000310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.397369 (+1397059us) service_pool.cc:224] Handling call
0709 12:15:59.419128 (+ 21759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.419381 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.419407 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.419444 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:59.419474 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.419527 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.419641 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:59.421322 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.422801 14713 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:59.423171 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.423375 14713 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.408090 14626 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:59.423744 14632 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:59.422640 14625 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:59.424705 14633 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.425161 14633 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:59.405431 14421 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10.
I20260709 12:15:59.403558 14398 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:59.424394 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70400.3us
I20260709 12:15:59.429955 10052 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:59.432374 10736 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:15:59.434824 10053 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:15:59.424292 14626 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.424288 14677 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:59.440259 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:15:59.413486 14529 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:15:59.437990 14626 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:59.446902 14647 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:15:59.447886 14647 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:59.448210 14647 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:59.448999 14647 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:59.450129 14775 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:15:59.442566 14677 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.454787 14677 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:59.450214 14647 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.443490 14713 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.470798 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:59.471040 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.471470 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.472033 14722 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:59.475629 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62817.7us
I20260709 12:15:59.473374 14666 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.474110 10050 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:59.481587 14106 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:59.482473 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.483302 10130 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:59.486325 14626 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.474761 14378 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.490038 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.490962 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2230) took 1748 ms. Trace:
I20260709 12:15:59.491354 10055 rpcz_store.cc:276] 0709 12:15:57.740272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.325806 (+1585534us) service_pool.cc:224] Handling call
0709 12:15:59.384334 (+ 58528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.387289 (+  2955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.387320 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.387374 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:59.387411 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.387476 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.488316 (+100840us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5400131fd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:15:59.488400 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61654272}
W20260709 12:15:59.491761 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 116150us
W20260709 12:15:59.495133 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 81500.8us
I20260709 12:15:59.496106 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:15:59.500142 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.502728 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.498169 14580 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:59.504741 10123 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:15:59.506199 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.502518 14106 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.508044 14580 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.508495 14580 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:59.508394 14106 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.508869 14455 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.510146 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.510768 10126 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:59.511917 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.510653 14654 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:59.516024 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:15:59.519891 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79684.7us
I20260709 12:15:59.500252 14557 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.524335 14699 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:59.526010 14699 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:59.522718 14106 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.531302 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:15:59.532022 10050 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:15:59.533363 10050 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:59.516860 14536 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:59.500650 14529 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.545673 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:15:59.526386 14699 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.535684 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.548326 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2235) took 1593 ms. Trace:
I20260709 12:15:59.551316 10047 rpcz_store.cc:276] 0709 12:15:57.955398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.363809 (+1408411us) service_pool.cc:224] Handling call
0709 12:15:59.364242 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:59.414268 (+ 50026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.548082 (+133814us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b5400087354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.548266 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96983936}
I20260709 12:15:59.534976 14780 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:59.558629 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.560989 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.565205 10048 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 12:15:59.566879 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63924.5us
I20260709 12:15:59.547777 14536 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.565659 10048 pending_rounds.cc:85] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:15:59.549319 14666 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:15:59.576542 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53066.2us
I20260709 12:15:59.579124 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.580964 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.574915 10048 pending_rounds.cc:107] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:15:59.586550 10048 raft_consensus.cc:2889] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:59.559839 14673 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.554956 14699 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.596421 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2220) took 3093 ms. Trace:
I20260709 12:15:59.596773 14685 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.576351 14557 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:59.612735 10126 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:15:59.606606 14652 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.607470 14529 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.606271 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.621495 10204 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.577564 14536 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:59.609685 10048 rpcz_store.cc:276] 0709 12:15:56.502870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.557368 (+ 54498us) service_pool.cc:224] Handling call
0709 12:15:56.557708 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:57.640359 (+1082651us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b54004f1120. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:15:59.330286 (+1689927us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b58005f7ed0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4
0709 12:15:59.596125 (+265839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.596344 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420199424}
I20260709 12:15:59.574007 14780 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:15:59.625404 14780 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.581779 14632 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:59.616461 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.618702 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.614298 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.579675 14455 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.623733 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.624276 14673 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:59.640058 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.647758 10053 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:59.647545 10198 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:15:59.618229 14557 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:59.656261 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69388.4us
I20260709 12:15:59.660811 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:15:59.666571 14786 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:59.641185 14421 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:59.634727 14633 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.679940 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.680377 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.681489 10128 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:59.682380 10127 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:15:59.678725 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.683633 10129 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:15:59.691788 10129 pending_rounds.cc:85] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 5
I20260709 12:15:59.692023 10129 pending_rounds.cc:107] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:15:59.692237 10129 raft_consensus.cc:2889] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:59.683771 14554 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.684646 14626 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.664096 14677 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.629418 14685 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.686165 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.686892 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.658704 14557 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.647166 14529 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:59.696499 10124 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:15:59.695712 10204 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
W20260709 12:15:59.701015 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77353.1us
I20260709 12:15:59.700975 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2239) took 1195 ms. Trace:
I20260709 12:15:59.691283 14421 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.711655 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.712524 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.714052 10123 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:59.718787 14662 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:59.700421 14654 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:15:59.732251 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.733947 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2237) took 1761 ms. Trace:
I20260709 12:15:59.736059 10129 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:59.736266 10046 rpcz_store.cc:276] 0709 12:15:57.972260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.390292 (+1418032us) service_pool.cc:224] Handling call
0709 12:15:59.433577 (+ 43285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.573628 (+140051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.573663 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.573707 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:59.573739 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.733677 (+159938us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400274cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.733736 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.733881 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306185088}
I20260709 12:15:59.722299 14421 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:59.745697 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 229730us
I20260709 12:15:59.708693 10049 rpcz_store.cc:276] 0709 12:15:58.503798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.407912 (+904114us) service_pool.cc:224] Handling call
0709 12:15:59.432150 (+ 24238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.440956 (+  8806us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:59.461995 (+ 21039us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.696173 (+234178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.696226 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:59.697188 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.697258 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.697380 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9307,"prepare.queue_time_us":20846,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":23047,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2689,"thread_start_us":194416,"threads_started":2,"wal-append.queue_time_us":162416}
W20260709 12:15:59.747502 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68910.2us
W20260709 12:15:59.737645 14672 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:15:59.757148 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.759030 10121 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:59.713297 14580 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.747939 14398 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:15:59.762563 14783 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:15:59.764763 14654 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.768764 14633 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:15:59.776366 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2502) took 1146 ms. Trace:
I20260709 12:15:59.779765 10053 rpcz_store.cc:276] 0709 12:15:58.630200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.435507 (+805307us) service_pool.cc:224] Handling call
0709 12:15:59.435799 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.648206 (+212407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.776112 (+127906us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400309b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:15:59.776304 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487053184}
I20260709 12:15:59.782742 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.742875 14722 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:59.795814 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.798748 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:15:59.800050 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.805691 10130 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:15:59.805989 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.759052 14687 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.814216 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:15:59.815109 10734 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:15:59.808441 14163 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.005s
I20260709 12:15:59.803682 14625 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:59.819638 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:15:59.820353 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.852978 14163 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.800103 14720 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:15:59.875768 10126 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
W20260709 12:15:59.818790 14778 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.322s	user 0.007s	sys 0.005s
I20260709 12:15:59.877141 14697 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:59.878561 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.915292 10197 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:15:59.880251 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.881146 14687 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:15:59.883484 14632 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:59.883934 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:15:59.883385 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.885958 10121 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:15:59.885986 14536 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:15:59.924322 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:59.886798 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:15:59.913264 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:59.888540 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67190.3us
I20260709 12:15:59.912959 10129 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:15:59.926334 14189 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:59.926848 14189 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.927098 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:15:59.927407 10202 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:15:59.818970 14722 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:59.924304 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.936439 10124 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:59.923417 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 690) took 1057 ms. Trace:
I20260709 12:15:59.924079 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:15:59.928395 10195 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:15:59.929299 10737 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:15:59.930493 14106 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:59.924248 14626 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.927211 14189 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:59.932333 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.933100 14676 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:15:59.947921 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.935564 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.892441 14672 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:59.948799 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:15:59.919296 14647 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.946606 14676 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:15:59.926286 14536 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.922796 14780 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:59.951042 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.951866 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:15:59.918735 14580 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:15:59.937338 10051 rpcz_store.cc:276] 0709 12:15:58.865570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.480118 (+614548us) service_pool.cc:224] Handling call
0709 12:15:59.485518 (+  5400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:59.486111 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.486139 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:59.486729 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 12:15:59.725569 (+238840us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:15:59.741480 (+ 15911us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.923114 (+181634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.923188 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.923228 (+    40us) raft_consensus.cc:1685] finished
0709 12:15:59.923240 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.923361 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16344,"prepare.queue_time_us":16972,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4149,"raft.queue_time_us":20473,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":93,"spinlock_wait_cycles":36373248,"thread_start_us":403392,"threads_started":2,"wal-append.queue_time_us":310586}
I20260709 12:15:59.968312 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.941848 14106 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.970238 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.969826 14106 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:59.978273 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54037.1us
I20260709 12:15:59.997107 14790 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:15:59.997576 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 191656us
I20260709 12:15:59.997771 14790 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:15:59.999500 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50779.8us
I20260709 12:15:59.967269 14662 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:59.955883 14676 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.005439 10123 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:15:59.971123 14780 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:00.014878 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:15:59.977192 14554 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.047742 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:15:59.964166 14647 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:00.051869 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50605.5us
I20260709 12:15:59.965797 14626 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:15:59.972748 14557 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.042574 14672 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:00.006881 14792 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:00.005609 14662 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:00.064543 14662 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:00.058171 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59592.7us
I20260709 12:16:00.071120 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.043092 14677 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.072608 14804 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.063256 14672 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.075510 14790 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.064061 14792 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:00.078758 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.078399 14792 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.079514 10201 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:00.080396 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.081496 14676 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:00.081831 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.083796 10019 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.085300 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.049507 14398 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.051088 14687 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:00.088444 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 161403us
I20260709 12:16:00.053747 14625 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:00.052537 14697 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:00.079596 14792 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:00.093245 10125 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 9.
I20260709 12:16:00.097324 10128 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
W20260709 12:16:00.098644 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 96104.1us
I20260709 12:16:00.064718 14626 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.090255 14554 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:00.088207 14720 raft_consensus.cc:2764] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 12:16:00.112048 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53678.8us
I20260709 12:16:00.078649 14536 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:16:00.094359 14801 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:00.116793 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.125982 14626 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:00.127475 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.129627 14652 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.130812 14647 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.130841 10200 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:16:00.132344 14685 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.134343 10200 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:16:00.111547 14554 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:00.145941 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.119429 14163 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:00.139741 14806 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:16:00.159338 10124 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:00.144843 14554 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:00.140460 14780 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.180321 14421 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:00.180469 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.162412 14687 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:00.159888 10202 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:00.184496 10201 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:00.185166 10195 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:00.187211 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:00.190378 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 78521.7us
I20260709 12:16:00.191216 14804 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:00.191887 14794 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:00.192536 14647 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:00.192972 14794 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:00.193472 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.193151 10203 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:00.194228 14398 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:00.194546 14647 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:00.195138 14398 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:00.178289 14557 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:00.195194 14801 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:00.185653 14687 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:00.194504 14794 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:00.196856 14794 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:00.197777 14794 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.198971 14794 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:00.196112 14398 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.200836 14398 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:00.202993 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.125183 14697 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.205379 14106 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.206847 14421 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.140524 14672 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:00.216398 14672 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:00.217423 14672 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.218142 14625 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.218920 14672 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:00.218724 14625 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.219844 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.220456 10203 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:00.220857 14625 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:00.223528 14781 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:00.226354 10197 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:16:00.226979 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.227602 10734 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:00.228058 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.229280 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.229949 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:00.230888 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.231865 10203 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:00.234042 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:00.234835 14666 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:00.235189 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.234846 10733 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:00.237977 14666 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:00.238541 14666 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:00.239585 14666 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.243060 10169 leader_election.cc:400] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
W20260709 12:16:00.243898 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 92661.8us
I20260709 12:16:00.244655 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:00.245527 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:00.255833 14106 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.266911 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:00.270239 14699 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.005s
I20260709 12:16:00.270913 14699 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.272960 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.236847 10736 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
W20260709 12:16:00.294657 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:00.331674 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 145771us
W20260709 12:16:00.332377 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59630.9us
W20260709 12:16:00.332973 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.320228 14807 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.304165 14632 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:00.349967 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 225584us
I20260709 12:16:00.351999 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.350546 14794 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:00.351001 14625 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:00.355571 14625 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.357699 14625 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:00.325793 14421 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:16:00.358973 14557 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.325369 14688 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:00.359921 14688 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:00.359586 14557 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.360335 14688 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:00.359036 14189 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.351411 14632 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:00.363358 14632 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:00.364598 14189 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.365633 10127 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:00.366151 14557 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.367775 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.370002 14626 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:00.336066 14398 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:16:00.375564 14792 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:00.376505 14677 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:00.377763 14398 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:00.378130 14398 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:00.378892 14398 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.374857 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.382838 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:00.383137 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.383981 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:00.384601 10737 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:00.384802 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.385586 10733 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:16:00.385917 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.386713 14792 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:00.386917 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:00.387558 10731 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:00.383486 10736 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:00.388962 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56590.2us
I20260709 12:16:00.390345 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:00.391016 10733 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:00.396176 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:00.398200 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:00.409363 10199 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:00.408305 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.391736 14722 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:16:00.423137 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:00.414119 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.385591 14672 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:00.388883 14792 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:00.445636 14792 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:00.428442 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.348791 14662 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.431612 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.432264 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.432843 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.347769 14807 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.433537 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.459826 10047 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:00.439055 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.422240 14529 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:00.412571 14804 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:00.443881 14722 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:00.445156 14699 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.452222 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:00.457515 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.458647 10053 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:00.413720 14557 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:00.459216 10050 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:00.508587 10046 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:00.429490 14163 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:00.512233 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 83892.9us
I20260709 12:16:00.515548 10200 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:00.516076 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.461792 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.519131 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:00.520170 14807 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.520766 14557 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.520262 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:00.522946 10124 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:00.526547 14792 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.527016 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.527609 10196 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:00.528555 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.529248 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.529642 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.529886 10201 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:00.531960 14688 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.532519 10124 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:00.510854 14804 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:00.533457 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:00.510380 14687 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:00.534551 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.479990 14632 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.534833 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.535542 10202 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:00.535873 14687 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:00.536337 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.537086 10202 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:00.510193 14529 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:00.538287 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.533514 14804 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.539778 10198 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:00.538936 10204 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:00.530243 10196 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:00.534190 10124 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:00.543447 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.545513 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:00.549145 10053 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:00.528649 14792 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.463924 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:00.463698 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:00.442219 14554 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.556653 10054 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:00.563395 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.538575 14529 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:00.566828 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50882.6us
I20260709 12:16:00.568115 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.571183 10053 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:00.572495 10202 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:00.540737 14794 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:16:00.573539 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.573705 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.522924 14557 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.575978 10048 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.584334 10054 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:00.595599 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:00.536377 14632 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.596583 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.597512 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.652868 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.522771 14163 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.558709 14807 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:00.625193 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.620648 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.566545 14781 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.595587 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.646052 10198 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:00.638792 10052 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:00.653652 10054 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
W20260709 12:16:00.653663 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 56227.5us
I20260709 12:16:00.684628 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.603660 14633 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:16:00.685317 10054 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:00.692328 10204 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:00.699415 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 374111us
I20260709 12:16:00.673277 14473 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.677349 14699 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:00.724519 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.725469 10053 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 9: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:00.726568 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.730935 10731 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:00.735544 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.736294 10054 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:00.705968 14647 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:00.746371 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.747146 10054 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:00.700783 14781 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:00.754510 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 202513us
I20260709 12:16:00.675797 14722 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.758773 10127 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:00.763826 14814 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:16:00.764420 14781 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:00.764567 14816 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:16:00.765312 10204 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:00.749567 14632 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:16:00.771798 14554 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.772581 10047 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:00.772887 14687 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:00.774675 14163 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:00.756058 14688 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:00.760020 14421 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:16:00.782801 14662 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.732568 14473 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:00.755376 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 199514us
I20260709 12:16:00.822247 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.789813 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:00.792215 10048 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:00.792701 10054 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:00.798322 14794 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:00.807710 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:00.808565 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.827696 10201 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:00.810348 10053 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:00.820883 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.822932 10204 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:00.755148 14713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.005s	sys 0.010s
I20260709 12:16:00.826367 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:00.830557 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.831598 10048 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:00.838590 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:00.819943 14687 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:00.831311 14713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.005s	sys 0.010s
I20260709 12:16:00.842365 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.825309 14801 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:00.844415 10201 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:00.852022 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:00.851397 14804 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.858003 14529 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:00.860203 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.861456 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.887061 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.863095 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2237) took 1156 ms. Trace:
I20260709 12:16:00.865082 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.887696 10047 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:00.888113 10046 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:00.866907 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:00.870024 14398 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.871024 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:00.872028 14823 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:00.835413 14163 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:00.894742 10048 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
W20260709 12:16:00.884932 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 205710us
I20260709 12:16:00.889431 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.897724 10055 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.898818 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:00.902474 10049 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:16:00.889319 10199 rpcz_store.cc:276] 0709 12:15:59.706930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.707106 (+   176us) service_pool.cc:224] Handling call
0709 12:15:59.728901 (+ 21795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.409866 (+680965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.862839 (+452973us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54002215d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:00.863032 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564443392}
I20260709 12:16:00.840723 14824 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:00.893472 10122 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
W20260709 12:16:00.958351 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 59635.2us
I20260709 12:16:00.957967 10204 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
W20260709 12:16:00.886970 14817 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:16:00.834407 14794 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:00.973702 10047 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:00.980010 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:00.980790 10201 raft_consensus.cc:2368] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
I20260709 12:16:00.897936 14163 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:00.895444 14834 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.990254 10203 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:00.990692 14529 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:00.887605 14687 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:00.990175 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:00.993468 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:00.997371 10204 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:00.957912 14713 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:01.000933 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:00.961299 14824 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.003774 14826 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:01.003923 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:00.887287 14801 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.023516 10123 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:01.005793 10203 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:16:01.006296 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:01.006913 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:01.007522 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:00.998641 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.010166 10053 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:00.979173 14626 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:01.028403 14713 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:01.028936 14824 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.028571 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.030647 10204 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:00.998919 14163 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:01.032346 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.033485 10201 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:01.029727 14804 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.054914 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.056285 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.056541 14804 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:01.057374 14804 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.057866 14804 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.060029 14662 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.060369 10127 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:01.029692 14713 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.061436 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.062347 14632 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:16:01.062603 10127 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:01.063542 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.064357 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.064915 10127 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:01.042227 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.065424 14662 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.066466 10129 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.067862 14662 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:01.065163 14632 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:01.068979 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:01.072399 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.074759 10055 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:01.076769 10055 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:16:01.069070 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 273325us
I20260709 12:16:01.078127 10201 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:01.085347 10204 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:01.086751 10129 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:01.060024 14804 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.089908 14687 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:01.011513 14834 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.091573 10123 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:01.163702 10123 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.092351 10126 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:01.092796 14557 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:01.092819 14625 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:01.094067 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.094080 14662 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:01.099462 14780 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:01.101986 14801 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.103349 14794 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.082053 14626 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:01.110737 14163 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.114827 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:01.117547 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 265610us
W20260709 12:16:01.116829 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 271753us
I20260709 12:16:01.135157 10053 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:01.115912 14781 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:16:01.149174 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 187176us
W20260709 12:16:01.192706 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.081337 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:01.157518 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:01.155081 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.166965 10123 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.178787 14780 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:16:01.180721 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 86713.5us
I20260709 12:16:01.198622 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.198922 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:01.197069 10731 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:01.194927 10196 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:01.199605 10054 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:01.199937 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.200451 14699 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:01.201112 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:01.175557 14632 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:16:01.201562 14801 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:01.201889 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.202621 14557 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:01.176781 14626 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.216500 14557 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:01.219532 14626 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.219777 14557 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.220825 14626 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:01.220317 14804 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:01.202343 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 121144us
I20260709 12:16:01.205149 14163 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.168447 14666 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:01.222702 14804 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.209280 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.223822 10737 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.224651 14699 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:01.225538 14804 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.226543 10123 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:01.227043 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.229110 10736 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
W20260709 12:16:01.229656 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.231491 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.231701 14163 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:01.232172 14163 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:01.232409 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.234690 14672 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:01.235113 14672 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:01.235492 14672 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.218091 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.167498 14687 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:01.231534 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:01.239034 10203 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:01.240231 10046 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:01.245100 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.245824 10124 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:01.245934 10128 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:01.247202 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.249070 10734 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:01.250301 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.251061 10731 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.251876 10737 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:01.165753 14823 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.211002 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.265030 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.265663 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:01.201316 14836 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:01.198108 14780 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:01.267307 14780 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.213235 14834 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.215099 14625 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:01.216531 10127 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:16:01.215157 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:01.269245 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54183.2us
I20260709 12:16:01.270006 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.248536 14845 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:16:01.270841 10201 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:01.253513 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:01.253690 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.275745 10729 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:01.253880 10736 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:16:01.254164 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.248591 14626 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:01.254614 14687 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.268522 14780 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:01.235634 14842 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:01.255213 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.278650 14842 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:01.279212 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.279618 14846 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:01.280079 14846 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:01.279794 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.254333 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.223321 14666 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.280467 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.282159 14687 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:01.282598 14666 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.282752 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.283226 10733 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:01.283463 10202 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:01.249006 14844 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:16:01.234591 14839 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:01.284350 14839 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:01.284771 14839 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:01.285282 14699 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:01.285934 14699 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.286958 14699 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.258365 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:01.293663 10047 raft_consensus.cc:2410] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:16:01.260540 14825 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
I20260709 12:16:01.256218 10051 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:01.262884 14189 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:01.264382 10203 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:01.266162 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.283833 14106 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:01.285270 14626 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.258889 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.262007 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:01.395303 10204 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.257337 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.303690 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:01.343763 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:01.294946 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53197.1us
W20260709 12:16:01.332419 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62496.8us
I20260709 12:16:01.397555 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:01.277452 14838 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:01.291343 14847 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:01.291138 14823 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.348851 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:01.291030 14163 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.349574 10731 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:01.347959 14801 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:16:01.348105 14378 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:01.303587 14677 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:01.283564 14473 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.345034 14189 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.280398 14846 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:01.382779 14697 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:01.365630 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 74599.7us
I20260709 12:16:01.294679 14722 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:01.375783 10729 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:16:01.415114 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:01.374133 14529 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:01.373939 14792 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:01.344419 14822 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:01.433511 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.406795 14838 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:01.419201 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 171932us
I20260709 12:16:01.442128 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.407090 14826 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.418378 14687 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:01.439898 10204 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:01.444310 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.419618 14189 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:16:01.443037 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 170105us
I20260709 12:16:01.444797 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:01.406546 14625 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:16:01.490571 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 46344.5us
I20260709 12:16:01.510221 10049 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:01.513636 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:01.513762 10019 leader_election.cc:400] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
I20260709 12:16:01.514500 10019 leader_election.cc:403] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:16:01.484449 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.431270 14529 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:01.497745 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.510480 14106 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:01.446352 14421 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:16:01.500368 14818 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.808s	user 0.000s	sys 0.004s
W20260709 12:16:01.523175 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.523442 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.425168 14697 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.447571 14688 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:01.526861 10122 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:16:01.538484 10122 pending_rounds.cc:85] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 11
I20260709 12:16:01.538744 10122 pending_rounds.cc:107] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:16:01.538954 10122 raft_consensus.cc:2889] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:01.505566 14824 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:01.534094 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.515439 14687 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.542119 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.540359 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.543845 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.547623 10129 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:01.544770 10121 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:01.524382 14840 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:01.448511 14826 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.523794 14844 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:01.520763 14106 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.447134 14792 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.528384 14398 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:01.534870 14654 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.522660 14859 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:01.521795 14828 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:16:01.518746 14790 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:16:01.574904 14860 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:16:01.539444 14827 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.553936 10731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:01.577065 14790 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:01.577438 14790 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.578357 14697 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.578255 14790 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.579386 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 833) took 1336 ms. Trace:
I20260709 12:16:01.539371 14807 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:16:01.549644 14853 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:16:01.520464 14801 consensus_queue.cc:1243] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 14.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:16:01.579787 10197 rpcz_store.cc:276] 0709 12:16:00.242821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.242976 (+   155us) service_pool.cc:224] Handling call
0709 12:16:00.243337 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:00.243703 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.243734 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:00.244229 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:16:00.509868 (+265639us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:00.509918 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.509987 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:01.499613 (+989626us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:01.579077 (+ 79464us) raft_consensus.cc:1685] finished
0709 12:16:01.579106 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:01.579326 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1113,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":13532032,"thread_start_us":264410,"threads_started":1,"wal-append.queue_time_us":372035}
I20260709 12:16:01.576599 14827 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.584208 14827 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.580307 14807 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:01.586064 14807 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.587795 14792 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.468480 14847 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:16:01.579504 14790 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.551575 14554 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13.
I20260709 12:16:01.557745 14822 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:01.570173 10129 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:01.608139 10197 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:01.560912 14666 raft_consensus.cc:2764] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:16:01.612988 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.561160 14688 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.634744 10731 raft_consensus.cc:606] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.635222 10731 raft_consensus.cc:614] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:01.539765 14626 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.563109 14863 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:16:01.630702 14822 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.571669 14398 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.566329 14839 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:01.645682 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 108128us
I20260709 12:16:01.593003 14654 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.648983 14654 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.650677 14722 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:01.651085 14722 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:01.651346 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.651958 10197 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:01.653522 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.654356 14834 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:01.608160 14529 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.654762 14834 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.655157 14834 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:01.632539 14840 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:01.664781 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 220060us
I20260709 12:16:01.668015 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.668726 10201 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:01.672417 14865 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.673002 14865 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.675277 14865 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.676332 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:01.677153 14865 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:01.677560 14865 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.677899 14865 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:01.679293 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.681596 14654 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.682121 14654 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.683881 10197 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:01.684298 14654 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.687026 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.687770 14869 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:01.690037 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:01.695267 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54727.3us
I20260709 12:16:01.651889 14722 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.666158 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:01.655233 14529 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:01.704392 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:01.707100 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:01.711068 14856 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:16:01.714885 14632 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:01.715370 14632 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.715956 14839 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.691017 14845 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:16:01.716265 14632 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.716985 14473 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:01.717454 14473 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:01.718221 14473 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.691242 14863 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.722788 14863 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.723176 14792 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:01.724191 14867 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:01.724756 14867 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.725075 14863 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.725677 14867 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.726666 14840 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.694999 14804 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:16:01.727552 14838 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.728447 14842 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.732517 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.740123 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.743398 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:01.742774 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.744132 10204 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:01.743992 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.740919 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:01.745512 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.747244 10198 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:01.639482 14687 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.752280 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.755579 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.756224 10124 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:01.756333 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:01.756785 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.756963 10055 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:01.734131 14863 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:01.734650 14662 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:01.758330 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:01.738408 14632 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:01.760277 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.759979 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:01.760847 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:01.769161 10737 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:01.769593 10737 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7.
I20260709 12:16:01.755167 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.762609 10055 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:01.759634 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:01.763584 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.767539 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.764767 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:01.767871 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:01.770993 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:01.772475 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:01.772985 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:01.773118 10203 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:01.689118 14106 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.771589 10126 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:01.776922 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:01.777470 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.769889 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:01.778733 10729 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:01.774369 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.746052 14722 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:01.751708 14781 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:01.757638 14699 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.782532 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:01.784622 14823 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:01.741019 14845 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:16:01.771132 14842 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:01.801565 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:01.767454 14662 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:01.788280 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:01.755002 14633 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:01.761361 14378 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:01.726576 14688 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.760931 14473 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:01.780447 14625 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:01.782824 14666 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:01.782958 14864 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:01.790941 14838 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:01.790524 14792 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:01.790849 14844 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.800391 14697 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:01.791499 14839 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.802551 14823 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.805840 14857 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:01.822010 14824 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:01.821796 14828 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:01.820271 14662 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:01.845796 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 72891.1us
I20260709 12:16:01.782320 14847 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:16:01.752005 14822 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.849093 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:01.800089 14699 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.822041 14869 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:16:01.831624 14697 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:01.821560 14781 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:16:01.837069 14792 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:01.849723 14672 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:16:01.835153 14823 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:01.851557 14824 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:01.836439 14864 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.902899 14864 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.834254 14844 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.904985 14844 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:01.879519 14868 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 12:16:01.880009 14834 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.906886 10130 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:01.885843 14677 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:01.908931 14834 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.900879 14824 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.848767 14859 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:01.910740 14859 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.912976 14859 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.836063 14839 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:01.915102 14839 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:01.924099 14699 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:01.900839 14875 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:16:01.927922 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119470us
I20260709 12:16:01.931252 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.932529 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.875443 14398 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:01.944262 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:01.890836 14697 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:01.955322 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:01.952955 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 189452us
I20260709 12:16:01.957943 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:01.966593 14794 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:01.967209 14794 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.969466 14794 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:01.978112 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 129081us
I20260709 12:16:01.943327 14837 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:01.986618 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:01.990550 14870 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 12:16:01.928735 14672 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:02.002350 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 738318us
I20260709 12:16:02.010087 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:02.011112 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.001567 14662 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:01.986486 14378 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:01.954241 14625 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:02.013351 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:01.976238 14421 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.953205 14865 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.016623 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:01.994129 14189 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.032680 10053 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:02.033552 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:02.015062 14633 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:02.015751 14847 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:16:02.037273 14780 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.759s	user 0.003s	sys 0.008s
I20260709 12:16:02.059566 10733 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:02.036934 14378 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:02.036588 14869 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:02.061609 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.083091 10196 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.037971 14877 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:02.055313 14828 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:02.088617 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.064996 14826 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.065783 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:02.071921 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.073107 10730 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:02.056233 14847 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:02.053862 14885 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:02.076699 14801 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.077304 14722 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:02.031672 14666 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:02.084818 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.106573 14826 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.107080 14826 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.109115 14826 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.109665 14826 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:02.053913 14834 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:02.106514 14828 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.111274 14834 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:02.084928 14869 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:02.087724 14878 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:02.056686 14840 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:02.079522 14794 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:16:02.100641 14662 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.037062 14792 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.036979 14421 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.101897 10196 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:02.075438 14889 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.104271 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.117098 14869 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.110314 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.130919 10047 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:02.090626 14877 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.134670 14877 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:02.137130 14846 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.000s
I20260709 12:16:02.137609 14846 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.095486 14633 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.095738 14632 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:02.140295 14632 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.140723 14632 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.121376 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.141372 10054 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:02.109364 14842 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:02.098532 14847 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:02.145763 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.156083 14842 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.115644 14899 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.122884 10728 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:02.124537 14878 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:02.128413 14885 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.163462 14421 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.163236 14823 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.163798 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.165867 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.117789 14801 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.167055 14672 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.167277 14833 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:02.171150 14189 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.117491 14106 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.177568 10052 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:02.153173 14378 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.114637 14625 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:02.188845 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 123159us
I20260709 12:16:02.187834 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:02.197705 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.198086 10195 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:02.201121 14867 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:02.116443 14722 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.202843 10201 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:02.145529 14889 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.202273 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.258296 10203 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.203784 10729 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:16:02.111076 14666 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.112274 14834 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.191314 14794 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.161656 14847 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.243516 14878 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:02.245179 14897 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:16:02.246033 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.246837 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.247694 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:02.248031 10736 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:02.248498 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.208983 14833 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:02.254287 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:02.542364 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 288131us
W20260709 12:16:02.252728 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 219233us
W20260709 12:16:02.265996 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 78231.1us
W20260709 12:16:02.278668 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:02.545591 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.283517 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:02.546846 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 263388us
I20260709 12:16:02.547449 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:02.548266 10129 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
W20260709 12:16:02.549690 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.438546 14888 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 12:16:02.453249 14823 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.454448 14889 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.437676 14842 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.437500 14880 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.202s
I20260709 12:16:02.562105 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:02.453876 10050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2523) took 1697 ms (client timeout 2163 ms). Trace:
W20260709 12:16:02.563627 10050 rpcz_store.cc:269] 0709 12:16:00.756856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.983807 (+226951us) service_pool.cc:224] Handling call
0709 12:16:02.453655 (+1469848us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002a0b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:02.453814 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2856914176}
I20260709 12:16:02.460031 10049 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [13.10-14.11]
I20260709 12:16:02.447010 14722 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.452483 14882 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.565615 14882 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.567618 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.568307 10195 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.571451 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:02.576938 14865 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.374802 14807 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.439142 14892 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.187s
I20260709 12:16:02.359673 10203 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:02.579406 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.580632 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:02.581112 14907 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:16:02.581369 10203 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:02.439750 14901 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.582559 14901 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.376879 14189 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:16:02.205392 14885 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.588297 14722 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:02.588871 14722 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.369527 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.348536 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2264) took 1107 ms. Trace:
I20260709 12:16:02.590376 10053 rpcz_store.cc:276] 0709 12:16:01.240831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:01.248792 (+  7961us) service_pool.cc:224] Handling call
0709 12:16:02.348287 (+1099495us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54002742d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:02.348463 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741195520}
I20260709 12:16:02.208067 14869 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.593007 14869 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.199249 14899 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.290145 14677 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.093s
W20260709 12:16:02.345021 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65074.4us
I20260709 12:16:02.278941 14554 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:02.287623 14626 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:02.257700 14633 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:16:02.257164 14697 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.290800 14794 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.557843 14804 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:02.338999 14687 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.511737 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.511375 10730 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
W20260709 12:16:02.516599 14906 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:16:02.517747 14908 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:16:02.518905 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1007) took 1274 ms. Trace:
I20260709 12:16:02.519767 14781 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:02.520809 14847 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:02.493019 14790 consensus_meta.cc:287] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.005s
I20260709 12:16:02.334803 14877 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.460875 14801 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.369184 10202 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:02.382272 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:02.538470 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.348635 10048 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:02.552732 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.553028 10019 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7.
I20260709 12:16:02.665706 10019 leader_election.cc:403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:02.560527 10122 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:16:02.554884 14647 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.666800 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.666980 14647 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.667511 10048 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.600950 10195 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:02.670130 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.670909 10195 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:02.671118 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 789) took 1139 ms. Trace:
I20260709 12:16:02.671716 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.602574 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.602773 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:02.603355 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.603988 10204 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
W20260709 12:16:02.674593 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71899.1us
I20260709 12:16:02.675631 10053 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:16:02.676306 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:02.671548 10125 rpcz_store.cc:276] 0709 12:16:01.532546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:01.532712 (+   166us) service_pool.cc:224] Handling call
0709 12:16:01.545636 (+ 12924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:01.696374 (+150738us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:01.729943 (+ 33569us) log.cc:844] Serialized 14 byte log entry
0709 12:16:02.198208 (+468265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:02.198274 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:02.198317 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:02.670860 (+472543us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540009abd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:02.670911 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:02.671043 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75296,"prepare.queue_time_us":14017,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":91,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3624,"spinlock_wait_cycles":375950592,"thread_start_us":467930,"threads_started":1,"wal-append.queue_time_us":605101}
I20260709 12:16:02.604878 10121 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:02.544345 14792 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.678239 14792 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.680337 14792 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:02.643211 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 100128us
I20260709 12:16:02.681169 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:02.681905 14666 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.683207 10048 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:02.453620 14632 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.686713 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.687538 10048 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:02.649577 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.674306 10052 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:02.688838 10054 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:02.650269 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.653156 14804 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.691481 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.692489 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.651736 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.693729 14837 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:02.694008 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 143561us
I20260709 12:16:02.694757 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:02.653779 10047 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:02.695642 10046 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:16:02.655171 10733 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:02.695638 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:02.578176 14807 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.657349 10728 rpcz_store.cc:276] 0709 12:16:01.244190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:01.244321 (+   131us) service_pool.cc:224] Handling call
0709 12:16:02.518713 (+1274392us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400570dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:02.518816 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846962432}
I20260709 12:16:02.605962 14106 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.605654 14554 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:02.658771 14781 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:02.625041 14867 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:02.647377 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.690006 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.556200 14894 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:02.693113 10053 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.698807 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.699295 10050 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:16:02.712368 10050 pending_rounds.cc:85] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:16:02.712646 10050 pending_rounds.cc:107] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:16:02.712873 10050 raft_consensus.cc:2889] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:02.693742 10049 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:02.688126 14632 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.665421 10736 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:02.702112 14801 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:02.694837 14804 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:16:02.693181 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 147067us
I20260709 12:16:02.698992 14790 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:02.705253 10730 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:02.706705 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:02.708530 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:02.691088 14878 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:02.724561 10199 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:02.710216 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.710361 14807 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.710839 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:02.703019 10198 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:02.720669 10735 raft_consensus.cc:606] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:02.726073 10735 raft_consensus.cc:614] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:02.734934 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:02.712033 14473 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:16:02.711342 14792 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:02.738968 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.658738 14687 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.719542 14801 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:02.766733 14801 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:02.726199 14878 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:02.769959 14878 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:02.770725 14554 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.771371 14189 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:02.711189 14106 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.773625 14666 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:02.725063 14889 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:16:02.720434 14885 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.774741 14889 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:02.775118 14889 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:02.775923 14889 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.777050 14889 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.702405 14837 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:16:02.778188 14189 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:02.778759 14554 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:02.779079 14837 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:02.715058 14867 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.779471 14837 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:02.780313 14837 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:02.771917 14722 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.778896 14189 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:16:02.762202 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.773751 14106 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:02.784869 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 58142.5us
I20260709 12:16:02.784324 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:02.785460 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.657439 14833 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.786537 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:02.789634 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:02.790228 10048 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.723745 14790 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.794960 14677 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:02.795433 14677 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:02.795786 14677 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.795900 14790 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.797883 14826 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:02.798290 14826 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:02.799085 14826 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:02.800017 14826 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:02.727176 14713 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:16:02.810844 10049 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:02.806109 14801 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.812247 10049 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:02.813398 10049 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
W20260709 12:16:02.813934 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.781548 14837 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:02.815411 14878 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:02.816967 14903 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.440s	user 0.000s	sys 0.001s
I20260709 12:16:02.818579 14794 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:02.819864 14877 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.820782 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.820583 14781 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:02.823691 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:02.824312 10730 raft_consensus.cc:2376] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14. Re-sending same reply.
I20260709 12:16:02.741416 14901 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.824505 10201 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:16:02.828786 10049 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:02.840312 10051 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:16:02.841524 10702 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:02.781486 14867 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.843657 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.787340 10053 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:02.823935 14687 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:02.842758 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.787057 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:02.851647 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:02.853842 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:02.854498 10728 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:02.857193 10122 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:02.859800 10123 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:02.861377 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:02.864496 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:02.865085 10123 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:02.868223 10048 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:02.836265 14697 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.837391 14878 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:02.854749 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:02.990684 10122 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
W20260709 12:16:02.993397 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 137549us
I20260709 12:16:02.996475 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:02.996873 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:02.845299 14554 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:02.813323 14801 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:02.844374 14473 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 6. Current term is 7.
W20260709 12:16:02.998170 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 143519us
I20260709 12:16:03.039698 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.041306 10130 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:03.041885 10122 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:16:03.049067 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:03.071173 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 284459us
W20260709 12:16:03.071743 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:02.849779 14840 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:02.846563 14713 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:03.078416 10728 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:03.080349 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:03.050122 10123 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:03.142094 10054 raft_consensus.cc:2410] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:16:03.006328 14626 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:03.140249 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.147434 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.157401 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:03.157572 10199 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:02.992426 14794 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.045531 14877 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:03.162447 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:02.853143 14923 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.289s
I20260709 12:16:03.144698 10196 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:03.147289 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.146456 10728 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:03.147018 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.157842 10122 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:03.148706 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.169618 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:03.145757 10731 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:16:03.145385 10197 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:03.148631 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 109019us
I20260709 12:16:03.080063 14662 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.159920 10125 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:03.038991 14792 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.158468 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:03.174082 10123 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.161945 10734 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:16:03.144553 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.144176 14905 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:03.178880 10130 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:16:03.080083 14834 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:03.142407 14697 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:03.189453 10123 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:03.043897 14827 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 12:16:03.147547 14801 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:03.195501 10125 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:16:03.185433 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:03.196009 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.196919 10130 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:03.162479 14878 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.195422 10129 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:03.073005 14554 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.139406 14632 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:16:03.235802 14899 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.165200 14877 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:03.186823 14473 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:16:03.239575 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.241761 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.241086 14905 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:03.269301 10197 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
W20260709 12:16:03.246701 14895 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.127s	user 0.005s	sys 0.006s
W20260709 12:16:03.247437 14921 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:16:03.248183 14890 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:16:03.249071 14654 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.251231 14722 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:03.184748 14713 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.198920 14933 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.252413 14898 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.230731 14925 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.316138 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.316834 10125 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:03.266569 14877 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:03.256348 14837 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:03.257493 14901 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:03.258313 10729 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14.
I20260709 12:16:03.259802 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:03.260303 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:03.320796 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:03.320747 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 61026.7us
I20260709 12:16:03.261576 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.322229 10048 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:03.262095 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.323047 10202 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:03.164615 14889 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:16:03.263077 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.242671 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:03.265658 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.173112 14794 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.329380 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:03.329547 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:03.330062 10048 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.185186 14662 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.294592 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.192582 14792 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.240444 14937 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:03.301146 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.369063 10198 raft_consensus.cc:2410] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:03.370800 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.371496 10125 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 8.
I20260709 12:16:03.312673 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.194446 14834 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.240247 14878 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.266274 14473 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:03.326090 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63108.1us
I20260709 12:16:03.326731 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.269034 14894 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.330204 10203 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:03.299814 14722 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:03.364738 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 122606us
I20260709 12:16:03.379617 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:03.380028 10127 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:03.372746 10048 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:03.376360 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.378506 10049 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:03.367560 10195 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:03.299573 14654 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.334761 14885 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:03.381093 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:03.385659 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.380914 14473 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:03.397641 10051 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:03.314658 14933 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.335083 14189 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:03.335009 14944 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:16:03.362704 14837 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.426168 10195 raft_consensus.cc:1217] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[11.8-17.11]   Dedup: 11.8->[12.9-17.11]
I20260709 12:16:03.296414 14626 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.423367 10202 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:03.319013 14898 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.325031 14925 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.437670 10195 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: [11.8-17.11]
W20260709 12:16:03.437983 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58428.4us
W20260709 12:16:03.440145 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 254761us
I20260709 12:16:03.444080 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:03.384826 14894 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.454460 10125 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:03.433013 14632 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:03.459833 10051 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:16:03.463201 10125 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:03.445815 14885 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:03.493809 14950 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:16:03.494174 14941 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:03.443387 14189 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:03.383810 14905 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.456872 14899 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:03.520982 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.523293 10735 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:16:03.528754 14936 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:03.529148 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.555208 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.528949 14944 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:16:03.529686 14946 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:16:03.530296 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.528595 10736 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:03.533280 14956 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:03.530591 14940 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:16:03.530190 14878 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.535029 14945 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.535226 14834 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:03.524677 14554 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.540119 14948 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.540557 14846 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.542600 14794 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.542925 14189 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.588647 14936 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:03.544320 14654 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.427946 14722 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.546058 14837 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.542586 14877 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.547461 10047 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:03.642565 14877 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.624658 14949 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:16:03.645573 14949 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:03.646601 14934 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:16:03.456403 14869 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:16:03.589248 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.555779 10195 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:03.654846 14960 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.655074 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.656313 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:03.656896 14662 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.657385 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.517025 14941 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:03.658349 14898 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.603852 14956 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.658936 14941 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.660306 14941 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.661068 14956 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.518004 14952 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.662734 14952 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.665004 14952 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.520354 14901 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:03.609253 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.666211 14901 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.585120 14824 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.668111 14824 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.668445 14901 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.543618 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.669348 10202 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:03.518319 14885 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.672354 14837 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.672927 14837 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:03.674752 14826 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.874s	user 0.001s	sys 0.010s
I20260709 12:16:03.675099 14837 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.679979 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.681313 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:03.682633 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.629077 14936 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:03.688374 14922 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:03.688825 14922 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:03.690030 14677 consensus_meta.cc:287] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.852s	user 0.009s	sys 0.000s
I20260709 12:16:03.689632 14922 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.629750 14947 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:16:03.708145 10196 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:16:03.630389 14713 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.630765 14883 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:16:03.631211 14900 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:16:03.631903 14935 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:16:03.634546 14554 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:03.635038 14951 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:16:03.635885 14925 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.587925 14899 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.636940 14792 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.637646 14937 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.625317 14948 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.615270 14945 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.690852 14933 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:03.692536 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.627440 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:03.634394 14894 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:03.670113 14824 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.699436 10123 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:16:03.699685 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.680598 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.707180 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.708530 10196 pending_rounds.cc:85] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:03.702174 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:03.709851 14632 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:03.713793 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:03.714344 14962 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.714852 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.739403 10737 raft_consensus.cc:606] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.672319 14885 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.715454 14554 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.717463 10202 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:16:03.714290 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.714242 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.730489 10196 pending_rounds.cc:107] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:16:03.753958 10196 raft_consensus.cc:2889] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:03.731160 10168 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:03.724341 10020 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.651s (SENT) [suppressed 5 similar messages]
I20260709 12:16:03.739835 10737 raft_consensus.cc:614] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:03.646090 14949 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:03.762171 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.764875 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:03.767066 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 74633.6us
I20260709 12:16:03.768368 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:03.769404 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88902.8us
I20260709 12:16:03.719982 14883 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:03.778766 14933 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:03.779582 14933 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:16:03.780040 14933 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:03.780329 14933 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:03.781164 14933 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.781939 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1016) took 1089 ms. Trace:
W20260709 12:16:03.783725 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.784806 10047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add21891a8334a65adf1e2611b794222"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:03.785470 10047 raft_consensus.cc:606] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.785827 10047 raft_consensus.cc:614] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:03.787525 10080 heartbeater.cc:646] Failed to heartbeat to 127.8.178.254:37497 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.178.254:37497 timed out after 15.000s (SENT)
I20260709 12:16:03.788378 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.789544 10095 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:03.790616 14930 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:03.792101 14930 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:03.792455 14930 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:03.792794 14930 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:03.794602 14846 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:03.795042 14846 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:03.795414 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.795380 14846 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:03.798343 14557 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:03.798900 14557 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.801087 14557 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.803686 14945 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:03.804164 14933 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:03.655555 14960 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.806528 14960 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:03.710137 14421 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:16:03.807696 14421 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:03.808027 14421 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:03.808758 14421 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.810034 14421 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:03.810664 14794 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.811187 14794 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:03.812173 14948 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:03.813325 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:03.739760 14922 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:03.709455 14677 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.748643 14944 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:03.818531 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.819645 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.765817 14877 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:03.782318 10732 rpcz_store.cc:276] 0709 12:16:02.692457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.692579 (+   122us) service_pool.cc:224] Handling call
0709 12:16:02.714418 (+ 21839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:02.827233 (+112815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:02.827268 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:02.839702 (+ 12434us) log.cc:844] Serialized 26 byte log entry
0709 12:16:03.322154 (+482452us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:03.322196 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:03.781527 (+459331us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5400731ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:03.781573 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:03.781623 (+    50us) raft_consensus.cc:1685] finished
0709 12:16:03.781637 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:03.781862 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1862,"raft.queue_time_us":25394,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":67427584,"thread_start_us":241029,"threads_started":1,"wal-append.queue_time_us":542720}
I20260709 12:16:03.801631 14557 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:16:03.815155 14925 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:03.813175 14834 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:16:03.846103 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.752305 14894 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:16:03.847369 10122 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:03.751281 14473 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.822413 14901 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:03.850111  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:03.739528 14937 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:03.863036 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 138735us
I20260709 12:16:03.828661 14699 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:16:03.830962 14846 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:03.856344 14804 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.129s	user 0.011s	sys 0.000s
I20260709 12:16:03.872198 10198 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:03.855325 14834 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:03.872869 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.874408 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:03.860771 14697 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.005s
I20260709 12:16:03.876411 10199 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
W20260709 12:16:03.875556 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.856954 14189 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:03.890947 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:03.893880 10737 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:03.751276 14962 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:03.903225 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.897513 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:03.900940 10051 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:16:03.901746 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.904801 10048 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:03.865926 14626 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.865463 14944 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:03.913743 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.916056 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
W20260709 12:16:03.919924 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 100346us
I20260709 12:16:03.879776 14834 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:03.880707 14960 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.921057 14958 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.891958 14883 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.972240 14891 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.854866 14632 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.880517 14948 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.879689 14804 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.921176 14963 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:03.893009 14697 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:03.972379 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1807) took 1641 ms. Trace:
I20260709 12:16:03.925096 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.929134 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.932240 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.962091 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 879) took 1718 ms. Trace:
I20260709 12:16:03.930173 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.931409 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.941897 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 796) took 1083 ms. Trace:
W20260709 12:16:03.961473 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2411) took 2208 ms (client timeout 1946 ms). Trace:
I20260709 12:16:03.942698 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:03.997553 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:03.926578 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.935262 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:03.926146 10051 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:16:03.976918 14960 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.051770 14837 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:03.941718 14966 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:16:04.057010 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.057401 10048 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:04.057897 10130 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:03.911849 14794 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:04.062309 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 135913us
W20260709 12:16:04.058528 10121 rpcz_store.cc:269] 0709 12:16:01.752537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:01.753512 (+   975us) service_pool.cc:224] Handling call
0709 12:16:03.961203 (+2207691us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:03.961351 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810003328}
W20260709 12:16:04.059638 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:04.064899 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 122287us
I20260709 12:16:04.066234 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.065176 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:04.064450 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 129270us
I20260709 12:16:04.057778  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:03.958112 14942 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260709 12:16:04.068401 10046 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.060079 10733 rpcz_store.cc:276] 0709 12:16:02.243703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.255036 (+ 11333us) service_pool.cc:224] Handling call
0709 12:16:02.255318 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:02.700412 (+445094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:03.961835 (+1261423us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54004ba354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:03.962031 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919149440}
I20260709 12:16:04.068885 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.069336 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.060424 10052 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:04.058959 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.061131 14837 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.061682 14969 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:03.941944 14824 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.120s
I20260709 12:16:03.923686 14965 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:03.923870 14961 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.301s
I20260709 12:16:04.077297 14965 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:03.922281 14626 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:03.967697 14937 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.077695 14965 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.059882 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.063666 10053 raft_consensus.cc:2368] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
W20260709 12:16:04.080009 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.073503 10047 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 10: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.060169 10200 rpcz_store.cc:276] 0709 12:16:02.331176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.332204 (+  1028us) service_pool.cc:224] Handling call
0709 12:16:02.369169 (+ 36965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:02.652346 (+283177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:02.652380 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:02.652419 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:02.652446 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:03.972086 (+1319640us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001d1d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:03.972136 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:03.972316 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650767104}
I20260709 12:16:03.962929 14647 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.075889 14974 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:04.076290 14890 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:04.083194 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.067800 14687 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:04.085251 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:04.086717 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.062588 10128 rpcz_store.cc:276] 0709 12:16:02.858893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.858995 (+   102us) service_pool.cc:224] Handling call
0709 12:16:03.039218 (+180223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:03.378178 (+338960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:03.378217 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:03.378690 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:16:03.441530 (+ 62840us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:03.441569 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:03.941505 (+499936us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400172854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:03.941554 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:03.941605 (+    51us) raft_consensus.cc:1685] finished
0709 12:16:03.941618 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:03.941832 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2859,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3436,"spinlock_wait_cycles":779194496,"thread_start_us":57989,"threads_started":1,"wal-append.queue_time_us":147801}
I20260709 12:16:04.087373 10046 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:04.071316 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:03.941418 14878 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:03.931646 14962 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:03.936843 14473 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.048413 14901 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.053313 14823 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:03.977720 14891 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.090708 10047 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:16:04.091115 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.094275 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.099888 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:03.923237 14956 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 12:16:04.103112 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.081588 14697 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:04.100873 10128 raft_consensus.cc:2368] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12.
I20260709 12:16:04.082186 14899 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.086068 14974 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.069614 14963 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.084965 14890 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:03.977185 14958 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.092008 14823 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:04.057713 14948 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.101437 14962 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:04.104336 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:03.923818 14964 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 12:16:04.119421 10046 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:04.110034 14473 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.096410 14878 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.116426 14697 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:04.137127 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.118676 14677 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.147815 10051 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:04.105693 14554 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.096704 14662 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:16:04.097167 14901 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.104203 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.112557 14974 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:04.117754 14890 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:04.148908 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.115083 14898 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:16:04.132764 14846 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:04.156039 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51948.6us
I20260709 12:16:04.159372 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:04.155385 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 90304.1us
I20260709 12:16:04.157663 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.136163 14473 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.139310 14937 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:04.162807 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.163067 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.147945 14949 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.153754 14962 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:04.169396 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:04.169790 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.172159 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.161972 14554 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:04.123458 14936 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.161192 14826 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:04.162209 14794 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:04.165591 14905 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:04.171043 14899 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.168118 14699 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.167161 14473 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.165859 14626 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.165445 14937 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.168318 14804 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.190382 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.173749 14949 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:04.170909 14882 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:04.180939 14677 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.181514 14962 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:04.193480 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.196111 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.192088 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:04.182379 14846 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:16:04.155859 14823 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.205080 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.186564 14899 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:04.198263 10020 leader_election.cc:400] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12.
I20260709 12:16:04.199186 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.190791 14892 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.117087 14944 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.185101 14794 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:04.203451 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.189939 14969 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:04.206632 10020 leader_election.cc:403] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:16:04.191119 14937 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:04.195096 14554 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:04.193111 14837 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.207871 14899 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.215179 14892 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.218196 14969 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.229519 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 712) took 2148 ms. Trace:
I20260709 12:16:04.196713 14960 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.258270 10055 rpcz_store.cc:276] 0709 12:16:02.081098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.081213 (+   115us) service_pool.cc:224] Handling call
0709 12:16:02.081528 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:02.249515 (+167987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:02.249548 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:02.249954 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:16:02.620896 (+370942us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:02.656087 (+ 35191us) log.cc:844] Serialized 14 byte log entry
0709 12:16:02.656362 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.229063 (+1572701us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400087854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:04.229123 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:04.229173 (+    50us) raft_consensus.cc:1685] finished
0709 12:16:04.229276 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:04.229444 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34932,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":560,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11666,"spinlock_wait_cycles":386755328,"thread_start_us":101711,"threads_started":1,"wal-append.queue_time_us":381817,"wal-append.run_cpu_time_us":2674,"wal-append.run_wall_time_us":1063109}
I20260709 12:16:04.239655 14936 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:04.267423 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 69305us
I20260709 12:16:04.241089 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.270182 14889 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12.
I20260709 12:16:04.270898 14889 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:04.193004 14981 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:16:04.242638 14948 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.243091 14891 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:04.245092 14840 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.246445 14878 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.191035 14699 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.200268 14677 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.205524 14804 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:04.249800 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:04.261180 14970 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:16:04.262264 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.323670 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.296525 14894 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.267032 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.192780 14930 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.271401 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.330346 10124 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:16:04.282414 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.331262 10121 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:16:04.301649 14936 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.246915 14958 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:04.286294 14977 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:16:04.294803 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 122699us
I20260709 12:16:04.214818 14794 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:04.296607 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.297840 10123 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:16:04.341158 10123 pending_rounds.cc:85] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 10
I20260709 12:16:04.341419 10123 pending_rounds.cc:107] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:16:04.341668 10123 raft_consensus.cc:2889] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:04.211047 14961 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:16:04.232615 14554 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.342974 14554 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.343712 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:04.345085 14865 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.264499 14969 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:04.345517 14865 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.345284 14891 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:04.345913 14865 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.349960 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.350662 10195 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:04.350816 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.351930 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.303467 14901 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.303725 14963 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.304795 14877 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:04.201368 14697 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.283710 14885 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.358129 14885 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.360766 14885 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.307590 14677 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.298249 14948 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.313143 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.363901 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.271377 14889 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.321949 14804 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.330396 14981 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.332355 14894 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.249974 14867 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:04.353169 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.377094 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.381950 10124 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:04.365182 10121 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:04.366456 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.366988 14930 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.374750 14699 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.375018 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.414908 10200 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
W20260709 12:16:04.415189 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.376356 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.379549 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.415783 10199 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:04.416249 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.363562 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.418195 10203 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:04.385205 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.346614 14986 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:16:04.419437 10049 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:16:04.419837 10049 pending_rounds.cc:85] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 11
I20260709 12:16:04.311308 14840 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.362736 14948 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.336652 14965 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.396747 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:04.398586 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:04.399307 10054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 718) took 1675 ms (client timeout 1998 ms). Trace:
I20260709 12:16:04.404614 14937 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.395192 14867 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:04.385593 14925 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:16:04.406311 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.380653 14899 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.328294 14974 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.408566 14889 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.352759 14936 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.409596 14722 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:04.412086 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.420044 10049 pending_rounds.cc:107] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 13.12
W20260709 12:16:04.421177 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:04.429682 14933 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 12:16:04.394304 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.438796 10050 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:04.439707 10195 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:04.381357 14804 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:04.425832 10054 rpcz_store.cc:269] 0709 12:16:02.724134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.742971 (+ 18837us) service_pool.cc:224] Handling call
0709 12:16:04.399063 (+1656092us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54002a1f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:04.399218 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679195392}
I20260709 12:16:04.434201 14986 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:04.416110 14922 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.433892 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:04.434633 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89856.3us
I20260709 12:16:04.448832 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.390221 14890 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:04.450663 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:04.409338 14981 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.415839 10730 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:04.438805 10049 raft_consensus.cc:2889] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:04.427853 14842 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:04.395381 14834 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.426988 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.435838 14626 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.442656 10130 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:04.442865 10048 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.444034 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.445405 14781 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.445029 14867 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.435650 10199 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:04.436084 14925 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:04.436682 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.447373 14922 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.450730 10736 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:16:04.442478 14986 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.451911 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.483587 10129 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:04.483916 10737 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:04.455400 14842 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:04.456971 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.459285 14974 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.491189 14834 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.460743 14894 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.463557 10054 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:16:04.492476 14842 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.493856 14842 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.454666 14568 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:04.494455 14568 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.494840 14568 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.497630 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.465335 14677 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.467401 14948 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.428167 14473 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.476925 14993 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.479178 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 859) took 2022 ms. Trace:
I20260709 12:16:04.485013 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.504467 10199 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:16:04.503906 10201 rpcz_store.cc:276] 0709 12:16:02.456698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.460681 (+  3983us) service_pool.cc:224] Handling call
0709 12:16:02.460950 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:02.826562 (+365612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.478928 (+1652366us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400361354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:04.479114 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835332992}
I20260709 12:16:04.486605 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:04.506839 14955 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.510854 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.487381 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.488052 14981 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.489064 14986 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.489673 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.490856 14867 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:04.479662 14990 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.484138 14901 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.457830 14827 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:16:04.530160 10204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 1805) took 2189 ms (client timeout 1847 ms). Trace:
W20260709 12:16:04.530884 10204 rpcz_store.cc:269] 0709 12:16:02.330622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.332117 (+  1495us) service_pool.cc:224] Handling call
0709 12:16:04.519589 (+2187472us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54000eb0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:04.519727 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31707520}
I20260709 12:16:04.534761 10050 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:04.521857 10195 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:04.528555 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.529214 10049 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:04.525615 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.475469 14626 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.536500 10732 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:04.520227 14974 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:04.507508 14955 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.543478 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:04.544431 14672 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:04.544819 14672 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.545202 14672 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.547966 14626 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.548542 14894 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:04.550658 14554 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.563136 14947 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.567144 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.567265 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.527760 14990 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:04.568006 10050 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:04.572553 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.520879 14794 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.575169 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.575855 10049 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
W20260709 12:16:04.566556 14923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.015s	sys 0.016s
I20260709 12:16:04.555991 14974 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.519094 14993 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.556562 14554 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.535867 14901 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.597949 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.572083 14990 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.583073 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.614941 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.562261 14672 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:04.598129 14923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.018s	sys 0.020s
I20260709 12:16:04.601922 14974 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:04.623327 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.611506 14626 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.596820 14955 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.579629 14877 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:16:04.575197 14944 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.571565 14804 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.612914 14840 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.617455 14965 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.563866 14947 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.621058 14625 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:04.628276 14999 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:16:04.635969 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.645439 10733 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:16:04.645702 10046 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.646130 10733 pending_rounds.cc:85] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 10
I20260709 12:16:04.646378 10733 pending_rounds.cc:107] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:16:04.646627 10733 raft_consensus.cc:2889] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:04.646999 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.648478 14672 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.649216 14837 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.649613 14837 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.649964 14837 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.650982 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.651582 10732 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.632551 14890 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.625041 14865 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.656181 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.656746 10049 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:04.629192 14857 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:16:04.634692 14625 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.625514 14626 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.660914 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1022) took 1196 ms. Trace:
I20260709 12:16:04.662257 10735 rpcz_store.cc:276] 0709 12:16:03.464674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.464857 (+   183us) service_pool.cc:224] Handling call
0709 12:16:03.513738 (+ 48881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:03.550203 (+ 36465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.658723 (+1108520us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5400450e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:04.660851 (+  2128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3991296}
I20260709 12:16:04.632342 14944 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.668905 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.658807 14677 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.671804 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.672665 10203 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:04.663261 14625 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:04.645836 14969 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.675804 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.680985 14794 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.669265 14473 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.668044 14922 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.687064 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.693631 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.668943 14901 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.700470 10054 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.699258 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.687512 14722 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:04.694684 14672 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:04.703559 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.697491 14473 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:04.707258 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.686254 14568 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.704187 14792 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:04.708806 14981 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:04.704847 14722 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.712002 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.713963 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.714135 14792 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.717445 14962 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:04.723354 14865 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:04.723513 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.725150 14962 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.725509 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.725695 14962 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:04.726286 10729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1015) took 2034 ms (client timeout 1815 ms). Trace:
I20260709 12:16:04.727461 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.729445 14672 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.713474 14948 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:16:04.730460 10729 rpcz_store.cc:269] 0709 12:16:02.692058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.692168 (+   110us) service_pool.cc:224] Handling call
0709 12:16:04.726089 (+2033921us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54005730d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:04.726212 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224326528}
I20260709 12:16:04.729540 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:04.718479 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.729899 14823 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:04.736022 10732 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:04.706035 14986 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.715024 14981 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:04.737690 14834 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:16:04.730212 14677 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:04.740541 14981 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:04.740880 14948 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:04.741218 14968 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:04.741623 14968 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:04.742153 14677 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:04.716413 14722 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:04.743995 10095 leader_election.cc:400] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
I20260709 12:16:04.748739 10095 leader_election.cc:403] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:04.727840 14962 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.719468 14792 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:04.726615 14626 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.742378 14968 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.737632 14965 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:16:04.748340 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.729971 14672 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.747726 14922 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:04.770406 10124 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:04.764900 14990 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.768059 14672 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.779738 14990 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.780272 14962 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:04.780939 14962 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:04.781884 14962 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.782898 14969 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.786666 14881 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.787297 14568 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.787161 14881 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:04.788852 14892 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.789346 14881 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:04.790248 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.790879 10048 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:04.791669 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.792203 10048 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:04.741750 14948 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.804701 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.806944 10055 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:04.755039 14189 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11.
I20260709 12:16:04.757346 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.811187 10195 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:04.742031 14554 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:04.738454 14993 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.761673 14687 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:04.738912 14901 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:16:04.734546 14804 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.749816 14677 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:04.770849 10050 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:04.772380 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.826645 10199 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:04.753625 14880 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:16:04.812222 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.757043 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.753811 14840 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:16:04.824834 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:04.829269 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60941.4us
I20260709 12:16:04.808374 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:04.830083 10129 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:04.832584 10731 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:04.837946 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.821372 14968 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.840088 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.845878 14937 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.846508 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.853868 10128 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:04.819625 14554 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:04.855199 14554 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.846767 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.848536 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.856683 10731 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:04.849273 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1838) took 1801 ms. Trace:
I20260709 12:16:04.823546 14922 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:04.850759 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.850894 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:04.851084 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2420) took 2305 ms (client timeout 1815 ms). Trace:
I20260709 12:16:04.851577 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:04.837987 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.852016 10050 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:04.852246 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:04.852906 10730 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:04.871784 10050 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:16:04.873198 10050 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:16:04.830534 14993 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:04.875656 10734 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:04.857527 10122 rpcz_store.cc:276] 0709 12:16:03.047754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.184287 (+136533us) service_pool.cc:224] Handling call
0709 12:16:03.184590 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:03.858839 (+674249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.849053 (+990214us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400197dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:04.849216 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523845376}
I20260709 12:16:04.850397 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.876353 10130 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.769593 14974 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.857113 10046 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:04.877630 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.887689 10122 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:04.878239 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.888278 10129 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:04.880546 10128 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:04.871021 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:04.875938 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67655.6us
W20260709 12:16:04.874923 10126 rpcz_store.cc:269] 0709 12:16:02.545768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:02.546217 (+   449us) service_pool.cc:224] Handling call
0709 12:16:04.850901 (+2304684us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003a0554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:04.851023 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2959323520}
I20260709 12:16:04.884655 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.892009 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.894019 10201 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:04.897732 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.898820 10128 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:16:04.899624 10195 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:04.836050 14944 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:04.901903 10048 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:04.903369 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.842098 14899 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:04.896073 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.908334 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.905181 10202 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:04.909114 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.912451 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.830274 14687 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.915136 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:04.920761 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.914224 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.922565 10126 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:04.924492 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.925447 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.893822 14877 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:04.831324 14837 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:04.929277 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:04.936139 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:04.942068 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.839569 14981 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:04.892009 14189 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:04.920737 14944 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:16:04.908509 14881 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:04.963883 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.964078 10046 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:04.966765 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.969576 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:04.971848 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.972668 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.974673 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.975418 10204 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:16:04.945330 10129 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:04.980363 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:04.980603 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 801) took 1279 ms. Trace:
W20260709 12:16:04.971979 15003 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:16:04.981240 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45187.2us
I20260709 12:16:04.982026 10203 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:16:04.996008 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:04.980957 10123 rpcz_store.cc:276] 0709 12:16:03.701097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.728787 (+ 27690us) service_pool.cc:224] Handling call
0709 12:16:03.729083 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:04.342121 (+613038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.980394 (+638273us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54001d5954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:04.980553 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307164416}
I20260709 12:16:04.996651 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.997296 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:04.998027 10123 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:04.972941 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:04.991338 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:04.995005 10046 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:05.002506 10047 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:05.003026 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:05.003566 10046 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:04.941584 14877 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.016324 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:05.017402 10200 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.012138 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.013159 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.014047 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.023587 10128 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:05.024228 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.019150 10201 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:04.943783 14804 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.051055 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.051754 10048 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:05.054613 14947 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:05.055757 14807 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.056293 14807 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.011740 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 803) took 1310 ms. Trace:
W20260709 12:16:04.978804 14982 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:16:04.909657 14722 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.024865 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:05.074043 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.072206 10202 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:05.074735 10123 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:05.022766 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.059252 10127 rpcz_store.cc:276] 0709 12:16:03.701579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.815608 (+114029us) service_pool.cc:224] Handling call
0709 12:16:03.829764 (+ 14156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:03.830072 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:03.830100 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:03.830599 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:16:03.917795 (+ 87196us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:03.918926 (+  1131us) log.cc:844] Serialized 14 byte log entry
0709 12:16:03.919420 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:04.978670 (+1059250us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b540008f820. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e793a02 00007fc17e790dde 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:04.978761 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:04.978820 (+    59us) raft_consensus.cc:1685] finished
0709 12:16:05.011517 (+ 32697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:05.011682 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":31633,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":12448,"spinlock_wait_cycles":2535168,"thread_start_us":57474,"threads_started":1,"wal-append.queue_time_us":67795,"wal-append.run_cpu_time_us":2315,"wal-append.run_wall_time_us":1002346}
I20260709 12:16:04.903249 14993 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.026227 10200 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.082345 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:04.963390 14889 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:16:05.011716 14948 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:05.030684 14801 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.035213 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:05.091073 10052 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:16:05.012158 14899 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:05.062170 14842 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.011646 14834 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.039721 10204 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:05.040015 14877 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.103026 10734 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14.
I20260709 12:16:05.040408 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.044651 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:05.045557 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.046109 14666 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:05.046489 14687 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.046717 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.046945 14922 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:05.047703 14867 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.001s
I20260709 12:16:04.978904 14881 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:04.931892 14878 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:16:05.048820 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.052634 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.068230 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:05.071934 10046 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:05.078827 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:05.080940 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.117058 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:05.117544 10201 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:16:05.118216 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.118537 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.058189 14807 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.028333 14837 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.034240 14833 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.124339 10203 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.020375 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.084662 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.087905 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:05.127533 10130 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:05.092186 10047 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:05.021700 14962 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.133998 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.093405 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:05.063246 14847 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:05.099525 10053 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.011852 14945 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:16:05.101683 10052 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:16:05.072873 15004 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:05.103797 10129 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:05.141316 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1860) took 1060 ms. Trace:
I20260709 12:16:05.106071 10054 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.141809 10052 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.098635 14899 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.113104 10195 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:16:05.113967 10197 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
W20260709 12:16:05.119593 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 70871.8us
I20260709 12:16:05.119948 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.098127 14986 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.119395 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.157370 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.122069 14473 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:05.158329 10095 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:16:05.158654 10095 leader_election.cc:403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:16:05.121520 10049 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:16:05.083750 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.107427 14948 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.105541 14666 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:05.114401 14889 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.135713 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:05.138388 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.138829 10048 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:05.115866 14881 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:05.140386 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:05.106644 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62091.7us
I20260709 12:16:05.141657 10129 rpcz_store.cc:276] 0709 12:16:04.080831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.016761 (+935930us) service_pool.cc:224] Handling call
0709 12:16:05.141257 (+124496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:05.122318 14886 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:05.147907 10128 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:05.147926 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:05.173179 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.173764 10123 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:05.173883 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.163995 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.174922 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.160923 10130 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:05.107882 14834 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.181008 14834 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.165304 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.101660 14842 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.181212 14948 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.182942 14842 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.147401 14958 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:16:05.163964 14840 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:16:05.158354 14837 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.186180 14837 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:05.186578 14837 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:05.162247 14473 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.187649 14473 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.158823 14947 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:16:05.191174 14936 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.192016 10127 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.192896 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.193403 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.193948 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.194695 14794 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:05.195230 14794 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:05.196264 10729 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:05.196103 14794 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.177915 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.198753 14976 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:16:05.199237 15014 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:16:05.199656 14976 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:05.199991 14976 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:05.200500 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.200759 14976 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.201895 14976 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.202903 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.203456 10202 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:05.204598 14801 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:05.205106 14801 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.205973 14801 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.207540 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.164938 14807 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:05.208325 14807 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.208666 14807 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.209003 14937 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:05.191520 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.209829 14886 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:05.209131 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:05.210944 10729 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.211032 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 891) took 1023 ms. Trace:
I20260709 12:16:05.211436 10733 rpcz_store.cc:276] 0709 12:16:04.188126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.188344 (+   218us) service_pool.cc:224] Handling call
0709 12:16:04.188655 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:04.646997 (+458342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.210793 (+563796us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:05.210977 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049678208}
I20260709 12:16:05.142607 14163 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:16:05.212724 14981 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.214876 14837 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.216128 14837 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.216341 14822 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:05.216708 14822 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:05.217590 14822 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.210125 10048 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.143849 15004 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.220679 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.172518 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.222076 10129 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 7.
I20260709 12:16:05.174252 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1865) took 1073 ms. Trace:
I20260709 12:16:05.208618 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.194113 10053 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:05.222389 10048 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:05.230744 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.239488 10053 raft_consensus.cc:2410] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:16:05.223402 10123 rpcz_store.cc:276] 0709 12:16:04.101240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.172947 (+1071707us) service_pool.cc:224] Handling call
0709 12:16:05.174198 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:05.236161 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:05.255905 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.120576 14625 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.262243 10196 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:16:05.262615 14961 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:05.262854 14722 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.263727 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.198700 14626 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:05.265244 14626 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:05.266243 14626 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.268168 14960 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.268744 14960 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.269272 14840 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:05.269745 14840 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:05.270833 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.270696 14840 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.272022 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.271803 14889 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:05.272819 14889 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.271441 14163 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:05.273480 14163 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:05.264545 10123 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:16:05.277789 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.283097 10737 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:05.291561 10129 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:16:05.307288 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 806) took 1589 ms. Trace:
I20260709 12:16:05.307643 10129 rpcz_store.cc:276] 0709 12:16:03.717642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.268471 (+1550829us) service_pool.cc:224] Handling call
0709 12:16:05.268887 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:05.307026 (+ 38139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.307232 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:05.294343 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.299319 10123 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:16:05.308743 10123 pending_rounds.cc:85] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 10
I20260709 12:16:05.309018 10123 pending_rounds.cc:107] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:16:05.309243 10123 raft_consensus.cc:2889] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:05.309500 10202 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:05.214269 14993 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.312275 10052 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:05.317986 10128 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:05.328203 10049 raft_consensus.cc:1217] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:16:05.331316 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.335039 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.167153 14974 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.336944 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.340387 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1856) took 1328 ms. Trace:
I20260709 12:16:05.340838 10123 rpcz_store.cc:276] 0709 12:16:04.011539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.298686 (+1287147us) service_pool.cc:224] Handling call
0709 12:16:05.298993 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:05.340143 (+ 41150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.340331 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:05.342797 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.142554 14847 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.349939 10049 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:16:05.351385 10049 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:05.352667 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:05.353363 10127 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:05.353976 10124 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:16:05.354646 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1870) took 1081 ms. Trace:
I20260709 12:16:05.352193 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.355075 10124 rpcz_store.cc:276] 0709 12:16:04.273041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.334198 (+1061157us) service_pool.cc:224] Handling call
0709 12:16:05.353740 (+ 19542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:05.354378 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.354596 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:05.355396 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:05.356616 10729 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:05.356652 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.357897 10199 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:16:05.358929 10128 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:04.728291  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.292989 14840 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.361078 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1858) took 1349 ms. Trace:
I20260709 12:16:05.361553 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.364950 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:05.364640 10128 rpcz_store.cc:276] 0709 12:16:04.012014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.358196 (+1346182us) service_pool.cc:224] Handling call
0709 12:16:05.358613 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:05.360833 (+  2220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.361022 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:05.363039 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.157169 15012 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.168s
I20260709 12:16:05.369271 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:05.367235 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.374842 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.361759 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:05.363435 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.275997 15004 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.362836 14666 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.432164 14473 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.434728 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.437520 10129 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 10.
I20260709 12:16:05.334512 14925 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:16:05.320464 14842 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.424276 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.436198 10196 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
W20260709 12:16:05.442258 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 80580.9us
I20260709 12:16:05.210840 14886 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.359196 14899 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.305305 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.360415 14891 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:16:05.453601 10195 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:05.360131 14163 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:05.517776 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.478111 10127 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:05.546654 10197 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:16:05.546612 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 464324us
I20260709 12:16:05.484249 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.548543 10050 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.548691 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:05.450652 14857 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:05.542725 14847 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.462155 14625 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.550583 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:05.545163 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 479569us
I20260709 12:16:05.547863 14834 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:05.551795 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:05.552688 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.553320 10127 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:16:05.554446 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:05.544869 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 239657us
I20260709 12:16:05.563160 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:05.526808 14792 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.000s
W20260709 12:16:05.479921 14554 consensus_meta.cc:287] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.012s
I20260709 12:16:05.568760 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.565557 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:05.537024 14189 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.004s
I20260709 12:16:05.566605 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:05.481253 14677 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 12:16:05.474058 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:05.506644 14398 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.581295 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.591817 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:05.580766 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 106775us
I20260709 12:16:05.595441 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.595487 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.596025 10199 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.473851 14473 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.560577 14857 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:05.598493 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.599126 10196 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:05.568467 15012 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:05.622582 10052 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.569476 14163 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:05.569609 14834 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.622748 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:05.457990 14889 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.638056 14867 raft_consensus.cc:2764] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:16:05.638777 14713 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:05.593544 14677 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.639144 14713 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.639914 14713 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.641077 14713 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:05.641940 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:05.642138 14677 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.569648 14554 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.642663 10050 raft_consensus.cc:2368] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:05.639935 10122 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 15 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 12:16:05.474623 14955 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 12:16:05.579306 14847 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.635758 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.636010 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.589818 14421 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:05.598572 14960 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.593267 14948 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:05.623206 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.634892 15012 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:05.656647 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:05.674880 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.621826 14857 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:05.704923 10095 leader_election.cc:400] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:05.705289 10095 leader_election.cc:403] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:16:05.688848 10196 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:05.696893 10199 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:05.599212 15021 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:05.630786 14968 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:05.570092 14792 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.593461 14189 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:16:05.702414 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79294.3us
I20260709 12:16:05.642714 14677 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.643079 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:05.709815 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66814.1us
I20260709 12:16:05.592998 14878 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:16:05.710573 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:05.718789 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:05.630743 14398 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.706794 15012 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.705134 14722 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:05.728542 10046 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:05.734478 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.712214 14847 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:05.716002 14890 raft_consensus.cc:2764] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:16:05.694679 14807 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.738813 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:05.710014 14948 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.764088 14948 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:05.743242 15023 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:16:05.743844 15025 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:16:05.749094 14398 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.752139 14807 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.717139 14881 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.754710 10129 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.728446 14974 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:05.757193 14677 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.742610 15024 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:16:05.741464 10050 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:05.770597 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.778854 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:05.783128 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:05.771368 14877 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.005s
I20260709 12:16:05.784965 14877 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.786011 10202 raft_consensus.cc:2368] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14.
I20260709 12:16:05.787019 10051 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:05.771984 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:05.775234 10121 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:05.737465 14421 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:05.769433 15004 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:05.775774 14837 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 12:16:05.771063 14878 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.788975 10201 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 15. Ops: []
I20260709 12:16:05.786206 14881 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:05.731033 14473 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:16:05.801081 10051 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:16:05.789830 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:05.802790 10051 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:05.806236 10050 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:05.806370 10051 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:05.781068 14974 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.790825 15029 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.801137 14960 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:05.781370 14677 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.777313 14890 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:16:05.798998 14421 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:05.805285 14473 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:16:05.821321 10050 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:05.824226 10047 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:05.813894 14881 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:05.799764 14625 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:16:05.818236 10198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.012s	sys 0.024s
W20260709 12:16:05.852516 10198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.012s	sys 0.024s
I20260709 12:16:05.800800 14878 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:05.856786 14878 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:05.859094 14823 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:05.859586 14823 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:05.860489 14823 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.861824 14823 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:05.844638 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.869966 10130 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:16:05.877496 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157839us
W20260709 12:16:05.878611 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 283215us
I20260709 12:16:05.882329 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:05.885370 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:05.888218  9948 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 14, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.885902 10737 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:05.851998 14881 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:05.889302 10729 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 9.
I20260709 12:16:05.899415 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:05.871116 14625 consensus_queue.cc:1243] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:16:05.841528 15022 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:16:05.871558 14847 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:05.869935 14944 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:05.885813 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:05.886679 14888 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:05.885775 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:05.899292 14925 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:16:05.873054 14554 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:05.904129 10019 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.897249 15021 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.901446 14881 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:05.900731 14792 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:05.903118 15031 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:16:05.910822 14877 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:05.921358 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:05.929045 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.909574 14968 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:05.924705 14804 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:16:05.918710 14962 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.007s
I20260709 12:16:05.877225 14974 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:05.911221 14888 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:05.931526 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:05.928820 14840 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.559s	user 0.003s	sys 0.006s
I20260709 12:16:05.932142 14968 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.934273 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:05.902809  9948 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 2 to 8, term changed from 11 to 15, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to <none>, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:05.938776 15004 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:05.939091  9950 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 286) took 45969 ms (client timeout 15000 ms). Trace:
I20260709 12:16:05.956238 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:05.956480 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:05.956940 10731 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:05.916880 14834 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:16:05.946940 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.959432 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.960947 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.961145 14834 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:05.961704 14847 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:05.962404 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.963195 14847 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:05.963603 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.964387 14847 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:05.965049 14834 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:05.966274 14847 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:05.949946 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:05.938213 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 132705us
I20260709 12:16:05.919214 14922 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:16:05.929809 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.958132 14925 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.969030 14968 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:05.966405 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:05.932803 14792 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:16:05.969096 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:05.967407 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:05.967885 10199 raft_consensus.cc:2368] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
W20260709 12:16:05.988931 15027 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:16:05.939815 14962 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:05.975706 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:05.968315 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:05.916340 14421 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:05.981159 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51453.9us
W20260709 12:16:05.955175  9950 rpcz_store.cc:269] 0709 12:15:19.969530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.975600 (+  6070us) service_pool.cc:224] Handling call
0709 12:16:05.938839 (+45963239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:58.658605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:58.659343 (+   738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:58.659394 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:15:58.659425 (+    31us) tablet.cc:662] Decoding operations
0709 12:15:58.671837 (+ 12412us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:58.671945 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:58.671983 (+    38us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:15:58.902681 (+230698us) tablet.cc:701] Row locks acquired
0709 12:15:58.911700 (+  9019us) write_op.cc:260] PREPARE: finished
0709 12:15:58.937916 (+ 26216us) write_op.cc:270] Start()
0709 12:15:58.958573 (+ 20657us) write_op.cc:276] Timestamp: P: 1783599358932236 usec, L: 0
0709 12:15:58.958623 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:15:58.998228 (+ 39605us) log.cc:844] Serialized 4068 byte log entry
0709 12:15:59.481965 (+483737us) op_driver.cc:464] REPLICATION: finished
0709 12:15:59.644447 (+162482us) write_op.cc:301] APPLY: starting
0709 12:15:59.661945 (+ 17498us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:00.251794 (+589849us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:00.251939 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:00.430007 (+178068us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:00.430305 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:16:00.430368 (+    63us) write_op.cc:312] APPLY: finished
0709 12:16:00.430847 (+   479us) log.cc:844] Serialized 97 byte log entry
0709 12:16:00.431037 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:00.431177 (+   140us) write_op.cc:454] Released schema lock
0709 12:16:00.431238 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:00.431623 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:00.431656 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6763106,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":103781,"apply.run_cpu_time_us":21615,"apply.run_wall_time_us":809513,"cfile_cache_hit":38,"cfile_cache_hit_bytes":39729,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":126906,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":5,"num_ops":10,"prepare.queue_time_us":225171,"prepare.run_cpu_time_us":24159,"prepare.run_wall_time_us":599014,"raft.queue_time_us":103572,"raft.run_cpu_time_us":11085,"raft.run_wall_time_us":70661,"replication_time_us":521439,"spinlock_wait_cycles":1697536,"thread_start_us":358358,"threads_started":4,"wal-append.queue_time_us":249222,"wal-append.run_cpu_time_us":35598,"wal-append.run_wall_time_us":2191908}]]}
I20260709 12:16:05.953864 14804 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:05.970158 15038 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:05.971949  9948 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 10, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 10 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:16:06.019676 14833 consensus_meta.cc:287] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.886s	user 0.020s	sys 0.002s
I20260709 12:16:06.019111  9948 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 5 to 10, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 10 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:06.020217 14833 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.020735 14833 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.020838  9948 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.009724 10050 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:05.989923 14948 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:06.023746 14948 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.024622 14948 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.009202 10198 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:06.027779 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:06.032862 10128 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:16:05.988041 14888 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.034317 10125 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:06.035214 14905 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.035391 14888 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:06.034308 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2450) took 1193 ms. Trace:
I20260709 12:16:06.035997 10128 rpcz_store.cc:276] 0709 12:16:04.840823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.366044 (+525221us) service_pool.cc:224] Handling call
0709 12:16:05.366367 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.032609 (+666242us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b540011f920. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:16:06.033339 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.034047 (+   708us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001900d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:06.034246 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642589824}
I20260709 12:16:06.037086 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2451) took 1182 ms. Trace:
I20260709 12:16:06.037545 14905 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.008252 15004 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:16:06.012805 14877 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:16:06.037226 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.014569 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:06.040810 10128 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:06.015165 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:06.011406 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 91988us
I20260709 12:16:06.016330 14625 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:06.017475 15032 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:16:06.037485 10129 rpcz_store.cc:276] 0709 12:16:04.854903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.455790 (+600887us) service_pool.cc:224] Handling call
0709 12:16:05.456120 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:05.771060 (+314940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.036846 (+265786us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:06.037026 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686229376}
I20260709 12:16:06.041860 10195 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.047930 10128 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:16:06.048321 10128 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 10
I20260709 12:16:06.048552 10128 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 17.11
W20260709 12:16:06.010952 15028 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:16:06.015970 15034 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:16:06.051447 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:06.054730 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.058405 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.048790 10128 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:06.059664 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1887) took 1011 ms. Trace:
I20260709 12:16:06.060014 10128 rpcz_store.cc:276] 0709 12:16:05.048069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.047294 (+999225us) service_pool.cc:224] Handling call
0709 12:16:06.047588 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:06.059388 (+ 11800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.059603 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:06.042604 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 808) took 1607 ms. Trace:
I20260709 12:16:06.061053 10123 rpcz_store.cc:276] 0709 12:16:04.435282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.341600 (+906318us) service_pool.cc:224] Handling call
0709 12:16:05.341963 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:05.358920 (+ 16957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:05.358983 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:05.393735 (+ 34752us) log.cc:844] Serialized 52 byte log entry
0709 12:16:05.792714 (+398979us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:05.792753 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.792835 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:06.042374 (+249539us) raft_consensus.cc:1685] finished
0709 12:16:06.042393 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:06.042550 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8287,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8974,"thread_start_us":318280,"threads_started":1,"wal-append.queue_time_us":444509}
I20260709 12:16:06.002789 14677 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.056466 10196 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:16:06.011461 14794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.012s	sys 0.028s
I20260709 12:16:06.007596 15045 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:05.990470 14925 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.033828  9948 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 11, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 11 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.069788 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2436) took 1517 ms. Trace:
I20260709 12:16:06.070135 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.043005 15038 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.071337 10128 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:06.080060 10199 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:16:06.070156 10130 rpcz_store.cc:276] 0709 12:16:04.552355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.360376 (+808021us) service_pool.cc:224] Handling call
0709 12:16:05.360706 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:05.870715 (+510009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.069553 (+198838us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001e4454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:06.069735 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170505984}
I20260709 12:16:06.073274 14833 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.075223 14925 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.014073 14792 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.086740 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.078047 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.089905 10048 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:06.090696 10053 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:16:06.077333 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2305) took 1154 ms. Trace:
I20260709 12:16:06.046969 14878 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:06.084262 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2443) took 1466 ms. Trace:
W20260709 12:16:06.070554 14794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.012s	sys 0.028s
I20260709 12:16:06.087013 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.087262 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.057747 15022 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.095196 10050 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.087232 10129 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:06.091712 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:06.091753 10122 rpcz_store.cc:276] 0709 12:16:04.618181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.895818 (+277637us) service_pool.cc:224] Handling call
0709 12:16:06.076610 (+1180792us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400232654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.084207 (+  7597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680601344}
I20260709 12:16:06.091475 10047 rpcz_store.cc:276] 0709 12:16:04.923106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.129271 (+206165us) service_pool.cc:224] Handling call
0709 12:16:05.129565 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:05.847578 (+718013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.077116 (+229538us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54002747d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:06.077274 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597112704}
I20260709 12:16:06.089915 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.101153 10052 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.071394 14801 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:06.079392 15024 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:06.104666 14677 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:06.080464 14626 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:06.081037 14713 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:06.106213 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2317) took 1081 ms. Trace:
I20260709 12:16:06.066535 15029 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:16:06.093974 10128 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:06.106892 10051 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.179199 14905 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.180055 14792 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.067066 15040 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:06.108369 10127 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:06.108835 15022 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.184468 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.112687 10050 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:06.108819 10129 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:06.082836 15038 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.187290 10198 raft_consensus.cc:1217] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[11.8-18.11]   Dedup: 11.8->[12.9-18.11]
I20260709 12:16:06.187780 10198 pending_rounds.cc:85] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:06.187994 10198 pending_rounds.cc:107] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:16:06.188213 10198 raft_consensus.cc:2889] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:06.085134 14936 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:06.115283 10195 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:06.188807 10051 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:06.038954 14804 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.191061 14867 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:16:06.156986 15044 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:16:06.191439 14867 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.143249 14625 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:06.192581 14625 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.192942 14625 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.197006 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.197674 10122 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.200495 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.201191 10129 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.201015 14894 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:06.164067 10052 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
W20260709 12:16:06.204125 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1875) took 1741 ms (client timeout 1883 ms). Trace:
W20260709 12:16:06.204538 10121 rpcz_store.cc:269] 0709 12:16:04.462612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.891753 (+429141us) service_pool.cc:224] Handling call
0709 12:16:06.203971 (+1312218us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400230d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.204069 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912372608}
I20260709 12:16:06.205854 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.116894 10054 rpcz_store.cc:276] 0709 12:16:05.024385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.162207 (+137822us) service_pool.cc:224] Handling call
0709 12:16:05.218766 (+ 56559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:05.219154 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:05.219184 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:05.219655 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:16:05.702379 (+482724us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:05.702419 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.703888 (+  1469us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:06.106004 (+402116us) raft_consensus.cc:1685] finished
0709 12:16:06.106026 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:06.106158 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1513,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"thread_start_us":482373,"threads_started":1,"wal-append.queue_time_us":627411}
I20260709 12:16:06.088801 14837 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:16:06.066776 14962 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:16:06.101861 15037 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:06.107553 14801 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.147069 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.088601 14890 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:16:06.115753 14626 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:06.155118 10125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1850) took 2600 ms (client timeout 1768 ms). Trace:
W20260709 12:16:06.266767 10125 rpcz_store.cc:269] 0709 12:16:03.554385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:03.554921 (+   536us) service_pool.cc:224] Handling call
0709 12:16:06.154927 (+2600006us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b5400172d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.155041 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5699633408}
I20260709 12:16:06.169106 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2321) took 1052 ms. Trace:
I20260709 12:16:06.268036 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.169862 14687 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:06.202003 15038 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.172953 14822 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:06.109579 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 143241us
I20260709 12:16:06.184636 15022 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:06.094780 14878 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:06.206893 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 117198us
W20260709 12:16:06.156548 15039 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:16:06.206769 10124 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:16:06.258095 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 111083us
I20260709 12:16:06.260620 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.286922 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.287488 10050 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:06.287927 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:06.263154 10129 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
W20260709 12:16:06.264264 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 179389us
I20260709 12:16:06.289204 10121 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:06.155107  9948 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.264397 14801 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:06.268378 10046 rpcz_store.cc:276] 0709 12:16:05.116991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.123047 (+  6056us) service_pool.cc:224] Handling call
0709 12:16:06.168894 (+1045847us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002756d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.169040 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292456832}
I20260709 12:16:06.280880 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.137568 15012 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.292124 10052 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:16:06.292722 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.310811 10121 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.293133 14888 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:06.294534 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.293816  9948 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 11, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 11 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.306677 15022 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.142539 14857 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.269909 14626 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.269091 14557 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:06.290805 10198 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 2 to 8, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:06.273085 14687 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.178150 14968 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.314975 15022 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.317536 15024 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.330760 10121 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:06.192305 14867 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.338023 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.340729 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2456) took 1448 ms. Trace:
I20260709 12:16:06.351606 10127 rpcz_store.cc:276] 0709 12:16:04.892804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.554752 (+661948us) service_pool.cc:224] Handling call
0709 12:16:05.555064 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:06.183089 (+628025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.340436 (+157347us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400174654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:06.340643 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272095616}
I20260709 12:16:06.347707 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.354861 10121 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:16:06.268646 15037 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.334887 14557 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:06.365442 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 79620.2us
I20260709 12:16:06.395687 14881 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.397995 14881 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:06.398984 15066 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:06.403672 14968 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.406697 10122 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:06.365046 14557 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:06.417186 14625 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.407640 15022 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:06.409639 15055 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:16:06.411157 15037 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:06.411505 14857 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.421118 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:06.393157 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.365159 15056 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:16:06.442095 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67409.8us
I20260709 12:16:06.315408  9948 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:06.444940 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.430558 15059 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.358240 14878 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.447775 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.446652 14890 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:16:06.452315 14878 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.449331 15022 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:06.452911 15022 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.453790 15022 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.443845 14857 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:16:06.455724 15012 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.443442 15056 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:06.450603 15059 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.457909 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.444525 15064 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:06.461544 15064 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.461756 15038 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.461886 15064 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.462646 14837 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:06.460930 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.463194 14837 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.480517 10050 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:06.468463 15012 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:06.470340 15058 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:06.470979 14881 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:06.471347 15038 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:06.471764 15060 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.472388 14801 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:06.473798 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:06.475610 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.475893 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.477272 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.478353 10052 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:16:06.486831 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.446803 15069 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:06.485564 10050 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:16:06.487576 15069 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:06.487792 14801 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.488967 15069 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.489873 15069 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:06.495500 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.433060 14687 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.483947 15038 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:06.459227 15056 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:06.497977 14687 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:06.499045 14625 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.498742 15038 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.499616 14890 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:16:06.500383 14557 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.501492 15059 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.463655 14822 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:06.484368 15058 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.503161 15058 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.504070 14626 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.505146 10125 raft_consensus.cc:2368] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:16:06.506592 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.502652 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.507786 10122 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 15 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 12:16:06.508074 10201 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:06.508453 10048 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
W20260709 12:16:06.502223 15026 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.760s	user 0.001s	sys 0.002s
I20260709 12:16:06.504261  9948 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:16:06.512662 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1873) took 2084 ms (client timeout 2238 ms). Trace:
W20260709 12:16:06.512988 10126 rpcz_store.cc:269] 0709 12:16:04.428775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.966786 (+538011us) service_pool.cc:224] Handling call
0709 12:16:06.512551 (+1545765us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400174154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.512624 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662637952}
I20260709 12:16:06.511514  9948 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:06.515985  9948 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.517575  9948 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.520254 14837 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.508235 15060 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.522807 14960 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:06.522941 15060 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.523322 14960 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.523501 14890 consensus_queue.cc:1243] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:16:06.526335 14945 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:06.526755 14945 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.527534 14945 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.457657 15024 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.528460 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 887) took 1416 ms. Trace:
I20260709 12:16:06.527418 15064 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.528900 10200 rpcz_store.cc:276] 0709 12:16:05.111763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.111917 (+   154us) service_pool.cc:224] Handling call
0709 12:16:05.112236 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:05.115176 (+  2940us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:16:05.115205 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:05.126338 (+ 11133us) log.cc:844] Serialized 26 byte log entry
0709 12:16:05.506932 (+380594us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:05.506977 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:05.507053 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:06.501703 (+994650us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b24002602b8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e209d 00007fc17e31410e 00007fc17e32b88c 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221
0709 12:16:06.528159 (+ 26456us) raft_consensus.cc:1685] finished
0709 12:16:06.528183 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:06.528400 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2183,"raft.queue_time_us":66777,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":3733248,"thread_start_us":341300,"threads_started":1,"wal-append.queue_time_us":568344}
I20260709 12:16:06.531039 15064 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.532187 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2306) took 1201 ms. Trace:
I20260709 12:16:06.533788 14626 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.535252 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 732) took 1366 ms. Trace:
I20260709 12:16:06.555408 10055 rpcz_store.cc:276] 0709 12:16:05.169131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.320887 (+151756us) service_pool.cc:224] Handling call
0709 12:16:05.438305 (+117418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:05.444250 (+  5945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:05.444310 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:05.448343 (+  4033us) log.cc:844] Serialized 52 byte log entry
0709 12:16:05.808636 (+360293us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:05.951370 (+142734us) log.cc:844] Serialized 14 byte log entry
0709 12:16:06.534781 (+583411us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b54000e4820. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e70b733 00007fc17e790dbf 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c
0709 12:16:06.534833 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.534912 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:06.534957 (+    45us) raft_consensus.cc:1685] finished
0709 12:16:06.535048 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:06.535185 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30973,"prepare.queue_time_us":42350,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":26465,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":4150,"spinlock_wait_cycles":18764672,"thread_start_us":436729,"threads_started":2,"wal-append.queue_time_us":407543}
W20260709 12:16:06.558812 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 231238us
I20260709 12:16:06.557353 14557 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:06.563515 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 377831us
I20260709 12:16:06.564225 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2315) took 1225 ms. Trace:
I20260709 12:16:06.564620 10197 rpcz_store.cc:276] 0709 12:16:05.338920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.433454 (+ 94534us) service_pool.cc:224] Handling call
0709 12:16:05.546280 (+112826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:05.547035 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:06.564032 (+1016997us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400360950. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.564171 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253580032}
I20260709 12:16:06.567101 14794 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:06.567538 14794 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:06.568346 14794 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.569509 14794 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.569775 15063 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.537647 15056 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.538784 14867 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:06.539906 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.528774 14945 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.547917 15013 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:06.553380 10202 rpcz_store.cc:276] 0709 12:16:05.330892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.331026 (+   134us) service_pool.cc:224] Handling call
0709 12:16:06.531992 (+1200966us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54000e83d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:06.532119 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038776576}
I20260709 12:16:06.519058  9948 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 7, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 7 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.571651 14974 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:06.585374 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 97858.7us
I20260709 12:16:06.586580 14881 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:06.587035 15024 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:06.587494 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.596561 10737 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:06.597735 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.614639 10051 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.618127 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.618796 10126 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:06.575431 15013 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:06.623055 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.618130 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.618129 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:06.624872 10729 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:06.629555 10051 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:06.590975  9948 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.630699 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.632043 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.631660  9948 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.633100 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:06.583103 14936 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.635082 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:06.633838  9948 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 8, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 8 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.635315 14936 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.636747  9948 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:06.632208 10168 leader_election.cc:400] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14.
I20260709 12:16:06.639204 10168 leader_election.cc:403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:16:06.640067 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.583685 14822 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.570271 15063 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.645345 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.593983 15029 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:06.647428 14687 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14.
I20260709 12:16:06.648166 14687 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:06.648643 14687 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.652153 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:06.652853 10197 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:06.655210 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:06.655799 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.655897 10729 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:06.658473 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:06.660431 10202 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:06.630807 15060 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.626931 14889 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.643492 14881 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.593397 14974 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:06.691990 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.654745 14947 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:06.654218 15012 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.719776 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.639343 14163 consensus_queue.cc:1059] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:16:06.719269 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.717306 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.722525 10126 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:06.682051 15029 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.728247 10197 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:06.675010 15076 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:06.734004 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:06.724153 14828 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.693451 15022 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.672015 14792 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 12:16:06.735952 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 61790.2us
W20260709 12:16:06.801110 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 122390us
W20260709 12:16:06.802533 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 68574.3us
I20260709 12:16:06.804144 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:06.677661 15060 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.805968 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:06.720338 14962 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:16:06.809320 14947 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:06.805146 14936 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:06.801630 15022 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.817423 15094 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:16:06.818588 15083 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:16:06.676537  9948 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:06.742092 14822 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:06.827136 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 107967us
I20260709 12:16:06.746304 15058 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.827637 14888 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:06.743083 15076 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.885622 14960 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.887035 15076 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:06.801424 15071 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:16:06.741590 15084 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:16:06.830309 15060 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.743806 14828 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.728272 15029 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.809088 14473 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:06.830821 15093 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:06.730602 15012 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.720219 14881 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.685501 14889 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.901358 14889 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.785109 14842 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.836917 10020 leader_election.cc:400] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
W20260709 12:16:06.902279 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65522.2us
I20260709 12:16:06.856213 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:06.851577 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.903059 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.856719 10202 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:06.850330 14955 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:06.862740 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:06.906347 14473 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:06.906805 14473 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:06.693630 14687 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:06.907163 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44524us
I20260709 12:16:06.894418 14828 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.907912 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.908432 14828 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:06.909114 14828 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:06.909478 14828 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.909811 14828 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:06.851862 14801 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:06.874881 14947 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.880887 15022 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:06.846885 15080 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:06.881855 14936 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.883584 15056 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:06.884164 14877 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:06.921868 14877 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:06.884611 15063 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.922755 14877 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.887750 14960 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.888669 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.895925 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.902051 14842 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.880249 15058 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:06.910094 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:06.910651 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:06.906684 14666 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:06.895890 14962 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.920010 14936 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.932947 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:06.933820 10052 raft_consensus.cc:2393] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:06.927331 10201 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:06.907214 14473 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.910583 15076 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:06.896203 14937 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:06.930017 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:06.931160 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.943089 10198 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:06.932117 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:06.943846 10195 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.932273 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.932873 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.897378 15095 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.935854 10196 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:16:06.935846 10202 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:06.923962 14877 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:06.936622 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:06.936965 10204 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:16:06.950358 10204 pending_rounds.cc:85] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 9
I20260709 12:16:06.937107 14944 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.939822 14842 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:06.940356 10048 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 12:16:06.914915 14955 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.945811 10050 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:06.946220 10200 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:16:06.919037 14801 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.950556 10046 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:06.950619 10204 pending_rounds.cc:107] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:16:06.951092 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:06.952175 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:06.952821 15094 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:06.955369 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:06.959515 10204 raft_consensus.cc:2889] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:06.961650 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:06.964449 10200 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:16:06.964828 10200 pending_rounds.cc:85] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 11
I20260709 12:16:06.965047 10200 pending_rounds.cc:107] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:16:06.965286 10200 raft_consensus.cc:2889] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:06.949779 15063 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.967833 10195 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:06.942701 15076 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:06.968567 10729 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:06.957177 15095 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.956912 15051 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:06.956362 14713 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:16:06.971282 14801 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.986351 15095 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:06.968930 14888 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:06.956781 14944 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:06.963105 15093 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:06.972412 15063 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.967526 14842 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:06.960354 14955 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:06.973284 14857 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:06.978545 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:06.983697 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:06.958515 15080 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:06.942945 14962 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.954574 14937 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:06.998684 10204 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:07.008138 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.019568 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:06.996066 14842 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.023546 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.024389 10730 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:07.024523 10733 raft_consensus.cc:2410] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:16:07.025910 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.026513 10730 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:07.026798 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.027267 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:06.991724 15081 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:16:06.968123 15094 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.014835 14857 consensus_queue.cc:1243] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:16:07.015010 14894 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:07.030776 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.033473 10732 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:16:07.035060 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.035935 10728 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:07.025144 14842 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:07.035097 15098 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:16:07.028014 15093 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:07.048624 15093 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.048998 15093 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:07.038738 15080 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.042923 15094 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.049963 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:07.055195 10055 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:07.056134 14962 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.020290 15076 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.056785 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:07.035578 14894 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:07.057667 14894 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:07.050375 10052 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:07.061578 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.067008 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.068647 10196 raft_consensus.cc:2410] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:16:07.068434 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.055025 10053 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:16:07.069130 10735 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:07.069831 10195 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:07.016160 15099 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:16:07.059736 10052 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:16:07.071893 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.072429 10196 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:07.074150 10736 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:07.076074 10126 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:07.058151 15051 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.079470 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:07.081596 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.083163 10736 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:07.091982 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:07.095443 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.096460 10055 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:16:07.097225 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.098032 10048 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:07.103235 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.103930 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:07.104193 15038 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:07.106942 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.107323 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:07.109441 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:07.109827 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:07.109330 15094 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:07.117272 15094 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:07.117511 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.117890 15058 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:07.118872 14837 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:07.058188 15063 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.122510 15012 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.118749 15058 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:07.126539 10728 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:07.127125 10702 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:07.142741 10735 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:07.156272 10195 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:16:07.157388 10051 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:16:07.159508 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:07.164623 10126 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:07.128706 15094 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:07.199846 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:07.203521 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44110us
W20260709 12:16:07.204100 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46619.9us
I20260709 12:16:07.127206 15069 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.130686 15058 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:07.155644 14666 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:16:07.126302 14713 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:07.115765 14473 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:07.270951 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47357.6us
I20260709 12:16:07.285900 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:07.109970 15051 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.218225 14936 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:07.203209 14947 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:16:07.157254 15012 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:16:07.284646  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.270880 15069 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.359675 14974 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.363942 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.340692 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1857) took 1330 ms. Trace:
I20260709 12:16:07.366235 10199 rpcz_store.cc:276] 0709 12:16:06.010536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.011446 (+   910us) service_pool.cc:224] Handling call
0709 12:16:06.011732 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:06.080422 (+ 68690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.340387 (+1259965us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b540007ec54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:07.340604 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146850688}
W20260709 12:16:07.369292 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 83460.7us
W20260709 12:16:07.373728 15103 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:16:07.299197 15105 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:16:07.340042 15097 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.285280 14889 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.325001 14792 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.284474 14713 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:07.375393 15106 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:16:07.385344 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2438) took 2815 ms. Trace:
I20260709 12:16:07.400475 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.405990 10734 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:16:07.363750 14936 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.370399 14888 raft_consensus.cc:2764] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:16:07.407207 15080 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:07.407569 14936 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:07.300205 14828 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.326164 15058 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.413496 10124 rpcz_store.cc:276] 0709 12:16:04.569495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:05.365986 (+796491us) service_pool.cc:224] Handling call
0709 12:16:05.879612 (+513626us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:16:06.206510 (+326898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.288972 (+ 82462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.385125 (+1096153us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400230d50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:07.385276 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754508928}
I20260709 12:16:07.405331 14713 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:07.467547 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:07.443718 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.513604 14473 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.527299 10729 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
W20260709 12:16:07.485903 15111 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:16:07.525339 14925 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:07.443251 15053 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.530278 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:07.531361 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.471319 14847 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.467696 15064 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.443604 14905 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:07.441707 14398 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.403934 15097 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.405174 14792 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.534699 10124 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:07.531811 15058 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:07.528805 14823 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:16:07.535606 15120 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:16:07.536463 10128 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:07.537828 10129 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:16:07.538857 15117 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:16:07.532791 14961 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:16:07.498723 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:07.439492 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 1.15863e+06us
I20260709 12:16:07.588374 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.409888 14981 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 12:16:07.404845 14889 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.545471 15094 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.546000 10737 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:07.457370 14794 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:07.572018 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 169810us
I20260709 12:16:07.572623 10126 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:16:07.541702 14944 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.003s
I20260709 12:16:07.589794 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.595458 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.597692 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.600435 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.601960 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:07.603619 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:07.569201 14847 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.603529 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.604943 15099 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:07.600775 14944 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.607542 10202 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:16:07.596529 14925 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:07.606060 10124 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:07.618257 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.581468 15064 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.606493 10094 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 9 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 9. Current term is 10.
I20260709 12:16:07.613421 10204 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:07.621377 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.600867 14473 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:07.591127 15051 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.614675 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.603792 15063 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:07.625015 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:07.629331 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 815) took 2510 ms. Trace:
I20260709 12:16:07.550844 15053 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.629839 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.633549 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.619607 14925 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:07.598234 14962 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:16:07.618064 15099 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.604882 14846 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:07.623324 14823 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:07.608165 14889 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.611989 15094 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.643277 15094 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:16:07.645623 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.631980 15102 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:16:07.646919 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.602154 14794 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.619588 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.613425 14905 raft_consensus.cc:2764] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:16:07.634146 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.625746 14834 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.659857 10128 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:07.660418 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.661787 10094 leader_election.cc:400] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:07.663913 10094 leader_election.cc:400] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14.
I20260709 12:16:07.666177 15064 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.666338 14823 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:07.666677 14794 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.667297 14961 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:07.668548 14944 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.640692 15099 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:07.669570 15123 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:07.670501 14834 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.672566 14834 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.633001 10130 rpcz_store.cc:276] 0709 12:16:05.118838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.082941 (+964103us) service_pool.cc:224] Handling call
0709 12:16:06.083183 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:06.083352 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:06.149325 (+ 65973us) log.cc:844] Serialized 14 byte log entry
0709 12:16:07.425300 (+1275975us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180019d080. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:16:07.628982 (+203682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:07.629040 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:07.629086 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.629151 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:07.629270 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46097,"prepare.queue_time_us":22621,"prepare.run_cpu_time_us":8827,"prepare.run_wall_time_us":22731,"raft.queue_time_us":1167457,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1904,"spinlock_wait_cycles":3635072,"thread_start_us":360012,"threads_started":3,"wal-append.queue_time_us":124339,"wal-append.run_cpu_time_us":1753,"wal-append.run_wall_time_us":1110691}
I20260709 12:16:07.676934 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.677277 10735 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:07.678251 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.680531 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:07.579909 14398 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.624511 14828 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.630666 14968 raft_consensus.cc:2764] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:16:07.650568 10124 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:07.629078 15063 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.657774 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 821) took 1029 ms. Trace:
I20260709 12:16:07.683192 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:07.704061 10125 rpcz_store.cc:276] 0709 12:16:06.628467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.628597 (+   130us) service_pool.cc:224] Handling call
0709 12:16:06.628938 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:07.455477 (+826539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.455509 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:07.455971 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:16:07.614369 (+158398us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:07.614408 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.614490 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:07.657518 (+ 43028us) raft_consensus.cc:1685] finished
0709 12:16:07.657541 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:07.657698 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":826176,"raft.queue_time_us":827906,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":158106,"threads_started":1,"wal-append.queue_time_us":198676}
I20260709 12:16:07.684290 10199 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:16:07.705454 10199 pending_rounds.cc:85] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:07.705715 10199 pending_rounds.cc:107] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:16:07.705960 10199 raft_consensus.cc:2889] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:07.685508 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.683491 10130 raft_consensus.cc:2393] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 10: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:07.703194 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.704865 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:07.694391 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.708678 10202 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:07.709928 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.679419 14834 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:07.711750 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.714726 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.715186 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.715358 10735 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:07.718255 10121 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:16:07.719055 10130 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:16:07.684307 14794 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.682623 14961 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:07.720829 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:07.709719 15063 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:07.718010 14833 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:07.724653 15099 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.725358 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.725997 10198 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:16:07.741451 10201 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:07.729921 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:07.722218 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 90672.2us
I20260709 12:16:07.713231 14823 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:07.709168 15090 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.739176 10196 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:07.728834 15093 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
I20260709 12:16:07.730304 10203 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:07.742710 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2473) took 1145 ms. Trace:
I20260709 12:16:07.718163 14828 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:07.744329 10202 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:16:07.752103 10202 pending_rounds.cc:85] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:07.729583 14962 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.752381 10202 pending_rounds.cc:107] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:16:07.752699 10202 raft_consensus.cc:2889] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:07.717921 15040 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.749894 10127 rpcz_store.cc:276] 0709 12:16:06.597358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.597482 (+   124us) service_pool.cc:224] Handling call
0709 12:16:06.626792 (+ 29310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:07.462929 (+836137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.462964 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:07.463566 (+   602us) log.cc:844] Serialized 52 byte log entry
0709 12:16:07.630918 (+167352us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:07.742126 (+111208us) log.cc:844] Serialized 14 byte log entry
0709 12:16:07.742390 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.742486 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:07.742523 (+    37us) raft_consensus.cc:1685] finished
0709 12:16:07.742533 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:07.742659 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831457,"prepare.queue_time_us":17295,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":832897,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":105,"thread_start_us":216037,"threads_started":2,"wal-append.queue_time_us":187023}
I20260709 12:16:07.762583 10201 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:07.720815 14968 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:16:07.738083 14961 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.766938 14968 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:07.767340 14968 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:07.743767 15123 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:07.768414 14961 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.738317 14833 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.769115 14833 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:07.771741 14881 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.772822 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.773496 10055 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:07.774847 15053 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:07.776445 14894 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.005s
I20260709 12:16:07.776901 14894 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.781756 15099 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.782341 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.783371 15097 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.784032 14398 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.737825 14899 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:07.718808 14834 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.740509 14792 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.783933 10202 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:07.788813 10734 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:07.788950 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.790882 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.744036 14886 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:07.748847 15102 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:07.796413 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.737334 14794 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.719851 14925 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:07.808532 15128 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:16:07.807827 14894 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:07.814738 14847 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.816877 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:07.818146 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:07.818928 14847 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:07.819535 14823 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:07.819994 14823 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.820377 14823 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:07.821211 14842 consensus_meta.cc:287] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.774s	user 0.006s	sys 0.005s
I20260709 12:16:07.754652 15093 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.822188 14842 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.824049 15093 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.754849 15090 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.824841 14713 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.784829 14828 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.826154 14937 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.826761 14937 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:07.784664 15040 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.828197 15090 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:07.828392 14955 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.828891 14925 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:07.830157 10127 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:07.756417 14473 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:07.814095 14846 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:07.757498 14962 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.834501 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.835799 10201 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:07.777787 14936 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.836510 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.837044 10203 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:07.838829 10125 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:07.793238 14899 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.828230 14828 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.824169 14842 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.819940 14834 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.847380 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.799387 15013 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.849525 15013 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:07.853005 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.865048 14962 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.801489 15102 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.867348 15040 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.868283 15102 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.869135 14899 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.869879 14794 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:07.873695 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.873728 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.875873 14993 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:07.876282 14993 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:07.877130 14993 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.879554 14713 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.881603 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:07.863175 14833 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.888445 14936 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.889257 14823 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.890007 14833 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.891479 14823 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:07.902738 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.903571 10202 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:16:07.904390 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.905936 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.906631 10196 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:07.907115 10201 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:07.907464 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.908306 10196 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:16:07.908155 14473 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.905419 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.912319 10202 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:07.913516 10203 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:16:07.891613 15045 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:16:07.868588 14968 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:07.927994 14968 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:07.934885 15069 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.940866 10019 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:16:07.941378 10019 leader_election.cc:403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:16:07.943375 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.943414 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.950675 10202 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:07.951314 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.951960 10201 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:07.952792 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.953743 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.945323 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.954865 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.955178 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:07.955866 10203 raft_consensus.cc:2393] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:07.956602 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:07.956808 14936 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:07.960456 10202 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:07.964452 14936 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14.
I20260709 12:16:07.965906 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.971633 14801 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:07.972030 14801 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:07.972071 14713 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:07.972432 14801 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:07.973256 15063 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:07.975433 15063 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:07.977015 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.978184 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.915046 10702 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
W20260709 12:16:07.979050 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 64113.7us
I20260709 12:16:07.980412 10055 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:07.972373 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.986537 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.973194 14713 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:07.989394 10736 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:16:07.991564 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.989470 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:07.993486 10050 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:07.993261 10048 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:07.985131 15063 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:07.983099 14557 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:08.005965 14557 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:08.006374 14557 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:07.999698 14948 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:07.988845 15081 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:08.010947 14948 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:07.999310 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.999935 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:08.013087 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:07.979533 15045 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:08.002549 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:07.992383 14823 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.015609 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:08.021718 10203 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:08.020646 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.024453 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:07.992319 14713 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:08.025802 14823 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.026741 14713 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.027884 14713 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:08.029251 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.001679 15063 consensus_queue.cc:1243] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 14.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:16:08.028061 14823 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.031441 15134 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.031977 15134 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.033124 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:08.033699 10202 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:08.033969 15134 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.022545 14847 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:08.035213 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.035576 14847 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.037581 14847 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.038054 15040 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.038534 15040 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.040431 15040 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.041497 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.042711 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.043181 10736 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:08.048202 14801 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.054685 10736 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:08.056568 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.057236 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.058665 10048 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:08.056010 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:08.010962 15081 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:08.090183 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.023870 14834 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.088110 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.100389 10203 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:08.102667 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:08.104538 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 762) took 1520 ms. Trace:
I20260709 12:16:08.104982 10731 rpcz_store.cc:276] 0709 12:16:06.583704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.583935 (+   231us) service_pool.cc:224] Handling call
0709 12:16:06.584282 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.594804 (+ 10522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:06.594841 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:06.595334 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:16:07.784284 (+1188950us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18003ef440. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:16:08.059945 (+275661us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:08.059989 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.060065 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.104221 (+ 44156us) raft_consensus.cc:1685] finished
0709 12:16:08.104241 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.104477 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16801,"raft.queue_time_us":35268,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22814,"spinlock_wait_cycles":11524480,"thread_start_us":275478,"threads_started":1,"wal-append.queue_time_us":1476744}
W20260709 12:16:08.106583 15104 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.823s	user 0.003s	sys 0.000s
I20260709 12:16:08.107079 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:08.104709 15112 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.830s	user 0.002s	sys 0.002s
I20260709 12:16:08.060145 15056 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:08.108572 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:08.086906 14925 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.088780 14955 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:16:08.111613 10203 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:08.089722 14398 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:08.113667 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:08.113839 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.094312 15081 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:08.110775 14801 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.115492 10736 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:08.112769 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:08.011861 14948 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.114924 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:08.132153 10203 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:08.111111 15134 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:08.130352 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.131582 10055 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:08.138963 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.139757 10130 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:08.108050 14834 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.121403 14398 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:08.140643 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.143728 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.113118 14557 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.146449 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.147063 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.147603 14557 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.130628 14955 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:08.153424 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.145557 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:08.154600 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.155478 10048 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:08.116257 14925 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.109673 15045 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.163758 10203 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:08.150182 14473 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.149120 15134 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:08.167440 10736 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:08.168476 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:08.172019 10203 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:08.154063 14955 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.177507 10126 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:08.168923 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:08.179953 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.180187 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.186170 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.186878 10733 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:08.180833 10048 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:08.187867 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.188555 10048 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:08.191506 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.192226 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2597) took 1591 ms. Trace:
I20260709 12:16:08.192966 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.193840 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:08.194649 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.194980 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:08.184283 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:08.192612 10047 rpcz_store.cc:276] 0709 12:16:06.601095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.601266 (+   171us) service_pool.cc:224] Handling call
0709 12:16:06.601643 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.639814 (+ 38171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:06.639842 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:06.640297 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:16:08.191671 (+1551374us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b18002458c0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1
0709 12:16:08.191834 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:08.191870 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.191935 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.191980 (+    45us) raft_consensus.cc:1685] finished
0709 12:16:08.191991 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.192169 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46899,"raft.queue_time_us":65844,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12514,"spinlock_wait_cycles":71982464,"thread_start_us":48793,"threads_started":1,"wal-append.queue_time_us":104023,"wal-append.run_cpu_time_us":1580,"wal-append.run_wall_time_us":1048892}
I20260709 12:16:08.178565 10203 raft_consensus.cc:1217] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Deduplicated request from leader. Original: 9.4->[12.5-17.7]   Dedup: 12.5->[15.6-17.7]
I20260709 12:16:08.198923 10203 pending_rounds.cc:85] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 5
I20260709 12:16:08.199575 10203 pending_rounds.cc:107] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 12:16:08.177574 15045 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:08.176757 14473 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.199908 10203 raft_consensus.cc:2889] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:08.236675 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.282145 10047 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:08.210336 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:08.286573 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.202749 14947 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:08.189510 14955 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:08.293661 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.291029 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:08.294368 10197 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:08.295063 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:08.288335 10732 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:08.290457 14947 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:08.296641 14947 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:08.198724 14881 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.300520 14881 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:08.301467 15144 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:16:08.301815 10199 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:08.302690 14881 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:08.291994 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:08.223269 14834 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.207122 14936 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.340755 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.342109 10732 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:16:08.199769 14842 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:08.259545 14886 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:08.335366 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.198243 15063 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:08.344833 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.220359 14925 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:08.337256 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45310.2us
W20260709 12:16:08.366696 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.491732 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.389600 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.492025 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:08.340675 14828 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:08.336544 15040 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:08.404307 14473 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.346364 14976 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:16:08.349287 14936 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.343763 14677 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:16:08.198417 14398 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.395795 14881 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:08.610610 14473 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.610591 14960 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.449540 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.627282 14960 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.628539 10737 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:08.629390 14960 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.452350 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.454617 14886 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:08.456141 15152 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.233s	user 0.000s	sys 0.003s
I20260709 12:16:08.610389 14828 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:08.457017 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1039) took 1434 ms. Trace:
I20260709 12:16:08.632138 14886 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.631916 14828 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.631609 10729 rpcz_store.cc:276] 0709 12:16:07.022834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.022982 (+   148us) service_pool.cc:224] Handling call
0709 12:16:07.026270 (+  3288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:07.529365 (+503095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.456708 (+927343us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400570dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:08.456950 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151832448}
I20260709 12:16:08.458660 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.458756 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2586) took 2174 ms. Trace:
I20260709 12:16:08.634923 10054 rpcz_store.cc:276] 0709 12:16:06.284430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.289011 (+  4581us) service_pool.cc:224] Handling call
0709 12:16:06.289306 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.570628 (+281322us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:06.570886 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 12:16:06.662748 (+ 91862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:06.886338 (+223590us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b180045aa20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:08.119577 (+1233239us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b2c000014c8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:08.119974 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:16:08.206411 (+ 86437us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:08.206470 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.206543 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.458529 (+251986us) raft_consensus.cc:1685] finished
0709 12:16:08.458555 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.458694 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":367190,"prepare.queue_time_us":2770,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":52,"raft.queue_time_us":367892,"raft.run_cpu_time_us":2465,"raft.run_wall_time_us":60882,"spinlock_wait_cycles":33053312,"thread_start_us":103519,"threads_started":2,"wal-append.queue_time_us":346873,"wal-append.run_cpu_time_us":1131,"wal-append.run_wall_time_us":1002921}
I20260709 12:16:08.459884 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.637897 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.460618 10130 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:16:08.640241 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.218559 15134 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.458961 10128 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:08.641398 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.459818 10125 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:16:08.641940 10130 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:08.641815 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.469614 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2599) took 1578 ms. Trace:
I20260709 12:16:08.642678 10051 rpcz_store.cc:276] 0709 12:16:06.890803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.890931 (+   128us) service_pool.cc:224] Handling call
0709 12:16:06.891290 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:07.157784 (+266494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.469369 (+1311585us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54001315d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:08.469559 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611361152}
I20260709 12:16:08.473465 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:08.630082 15084 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:16:08.644228 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 170864us
I20260709 12:16:08.643322 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.644730 15051 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:08.644940 10125 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:08.645265 15051 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:08.645852 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.475162 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:08.646145 15051 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.646848 10734 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:08.477241 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:08.645787 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.480055 10126 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:08.647526 10125 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:08.480985 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.648595 10127 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:08.483580 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.650089 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.650935 10122 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:16:08.487365 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:08.488934 15150 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:16:08.488303 15081 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:08.489382 15115 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.114s	user 0.001s	sys 0.001s
I20260709 12:16:08.496517 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:08.498701 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.593456 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:08.609877 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 265895us
I20260709 12:16:08.674849 10122 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:16:08.495507 14722 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.440299 15076 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:08.638984 15080 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:08.652110 10124 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:08.647701 10733 raft_consensus.cc:2410] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:16:08.678318 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.679322 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:08.642683 10128 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:08.639118 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.680526 10129 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
W20260709 12:16:08.679297 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 182841us
I20260709 12:16:08.660485 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:08.630411 10737 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 7. Current term is 8. Ops: []
I20260709 12:16:08.675663 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:08.490559 15063 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:08.593542 15013 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:08.593286 14888 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:08.605034 14925 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:08.450273 14947 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.685525 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:08.701941 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:08.687058 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:08.684602 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:08.694577 10728 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:16:08.696506 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:08.706107 10729 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:08.700245 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:08.702827 10127 raft_consensus.cc:1240] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:08.677883 15040 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:08.706354 10050 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:08.678153 15058 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:08.678617 15090 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:08.626658 14881 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.687084 14557 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:08.647665 14473 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.708083 14834 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:08.684372 14722 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.701025 14677 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:08.694061 15080 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.705603 15069 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:08.692112 15060 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:16:08.693439 14976 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:16:08.710227 15040 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:08.731180 10197 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:16:08.705484 14847 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:16:08.722860 15140 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.056s	sys 0.134s
I20260709 12:16:08.733136 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 826) took 1659 ms. Trace:
I20260709 12:16:08.697752 10125 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:08.706108 15013 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.726578 15090 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:08.727715 14886 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:08.726476 14834 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:08.719712 15058 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.746282 10123 rpcz_store.cc:276] 0709 12:16:07.074170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.074519 (+   349us) service_pool.cc:224] Handling call
0709 12:16:07.074829 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:07.075043 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.075069 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:07.080953 (+  5884us) log.cc:844] Serialized 26 byte log entry
0709 12:16:07.166674 (+ 85721us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:07.166718 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.166795 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.488717 (+1321922us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:08.729020 (+240303us) raft_consensus.cc:1685] finished
0709 12:16:08.729045 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.733057 (+  4012us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5617024,"thread_start_us":60070,"threads_started":1,"wal-append.queue_time_us":224502}
I20260709 12:16:08.736407 14677 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:08.747421 15140 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.056s	sys 0.135s
I20260709 12:16:08.737169 15045 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:08.758520 14834 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:08.762610 14886 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:08.770008 15145 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:16:08.746265 15063 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:08.767858 15045 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.761905 15040 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.806557 14947 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:08.807257 14886 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:08.809875 15081 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:08.818912 15155 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:16:08.837525 15113 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.501s	user 0.000s	sys 0.012s
W20260709 12:16:08.845438 15110 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.477s	user 0.005s	sys 0.008s
W20260709 12:16:08.847393 15118 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.263s	user 0.006s	sys 0.000s
W20260709 12:16:08.854523 15153 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.558s	user 0.002s	sys 0.000s
I20260709 12:16:08.857096 15093 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:08.857517 15093 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:08.862923 15114 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.462s	user 0.018s	sys 0.000s
I20260709 12:16:08.842168 15080 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.858333 15093 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.011593 14993 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:09.012771 15093 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:08.905104 10048 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:08.906919 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2590) took 2621 ms. Trace:
W20260709 12:16:08.911363 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.001s
W20260709 12:16:08.911984 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.006s
W20260709 12:16:08.912817 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 289694us
I20260709 12:16:08.722081 10130 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:08.917375 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1886) took 1016 ms. Trace:
I20260709 12:16:08.919783 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1875) took 1858 ms. Trace:
I20260709 12:16:08.832437 14842 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:08.985005 14473 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:08.985286 15013 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.810016 14677 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:08.988140 15056 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:08.990926 14881 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.061177 14881 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.061921 14881 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.064626 14881 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.831629 14886 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.068661 14886 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:08.995502 14804 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:16:09.001713 14936 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.000993 14722 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.059366 10195 rpcz_store.cc:276] 0709 12:16:07.900881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.909001 (+  8120us) service_pool.cc:224] Handling call
0709 12:16:07.909312 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:07.909671 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.909701 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:07.910143 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:16:08.163287 (+253144us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:08.163327 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.163388 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.916635 (+753247us) raft_consensus.cc:1685] finished
0709 12:16:08.916682 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.917081 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1601,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":252783,"threads_started":1,"wal-append.queue_time_us":430732}
I20260709 12:16:09.003880 10122 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:09.060308 15056 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.072912 15056 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:09.086215 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.001s
I20260709 12:16:08.836776 15040 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:09.104925 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.001s	sys 0.006s
I20260709 12:16:09.098001 15045 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.109850 14804 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:16:09.119712 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 784143us
I20260709 12:16:09.115173 14804 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:09.059468 10200 rpcz_store.cc:276] 0709 12:16:07.061583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.061709 (+   126us) service_pool.cc:224] Handling call
0709 12:16:07.062044 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:07.062415 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.062460 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:07.068894 (+  6434us) log.cc:844] Serialized 26 byte log entry
0709 12:16:07.269753 (+200859us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:07.269800 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:07.269888 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.824540 (+1554652us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:08.918981 (+ 94441us) raft_consensus.cc:1685] finished
0709 12:16:08.919035 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.919539 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4425,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2996,"spinlock_wait_cycles":5912960,"thread_start_us":161984,"threads_started":1,"wal-append.queue_time_us":309602}
W20260709 12:16:09.171139 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.018s
W20260709 12:16:09.175418 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.012s	sys 0.019s
I20260709 12:16:09.023960 10049 rpcz_store.cc:276] 0709 12:16:06.285714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:06.292447 (+  6733us) service_pool.cc:224] Handling call
0709 12:16:06.292725 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:06.571376 (+278651us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:06.571653 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:16:06.727168 (+155515us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:06.887266 (+160098us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b1800462580. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:08.193483 (+1306217us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b2c000014c8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:08.193901 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:16:08.493171 (+299270us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:08.493206 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:08.493289 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:08.906047 (+412758us) raft_consensus.cc:1685] finished
0709 12:16:08.906110 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:08.906645 (+   535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347059,"prepare.queue_time_us":3069,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":18099,"raft.queue_time_us":338149,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5782,"spinlock_wait_cycles":24813184,"thread_start_us":417140,"threads_started":3,"wal-append.queue_time_us":638367,"wal-append.run_cpu_time_us":2106,"wal-append.run_wall_time_us":1180785}
W20260709 12:16:09.190829 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.193593 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:09.185259 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 2.197s (SENT) [suppressed 7 similar messages]
I20260709 12:16:09.195310 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:09.202962 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.196816 14804 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.212847 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:09.213994 10737 raft_consensus.cc:2410] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:16:09.219286 14804 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.222903 15069 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:09.223430 15069 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.223773 15069 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:09.204619 15013 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.225744 15013 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.207309 15045 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.227037 15045 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.228084 15013 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.233788 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.229254 15045 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.229451 14842 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.228646 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:09.235621 14888 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.018s
W20260709 12:16:09.219730 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 519451us
W20260709 12:16:09.248226 15130 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.032s	sys 0.040s
W20260709 12:16:09.250147 15097 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.027s	sys 0.036s
I20260709 12:16:09.203197 15058 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:09.265028 10203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.024s	sys 0.021s
I20260709 12:16:09.271692 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:09.274974 15130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.033s	sys 0.040s
W20260709 12:16:09.275982 15097 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.028s	sys 0.036s
W20260709 12:16:09.279861 14955 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.942s	user 0.016s	sys 0.005s
I20260709 12:16:09.280345 14955 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.281407 14936 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.282132 14936 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.285058 14936 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.285564 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.285416 15056 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:09.275174 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1894) took 1323 ms. Trace:
W20260709 12:16:09.282230 15076 consensus_meta.cc:287] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.005s
W20260709 12:16:09.300827 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:09.302716 10203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.024s	sys 0.022s
I20260709 12:16:09.254949 14888 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:09.327354 15169 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:16:09.328003 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 95120.2us
W20260709 12:16:09.328336 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.033s
W20260709 12:16:09.328687 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.034s
W20260709 12:16:09.329756 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 642737us
I20260709 12:16:09.330578 15160 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:16:09.332212 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:09.332888 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 63728.1us
I20260709 12:16:09.334939 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.341260 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:09.344887 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.345741 10049 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:09.294608 10196 rpcz_store.cc:276] 0709 12:16:07.942727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.943484 (+   757us) service_pool.cc:224] Handling call
0709 12:16:07.943749 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:07.943937 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:16:08.117143 (+173206us) log.cc:844] Serialized 14 byte log entry
0709 12:16:08.120090 (+  2947us) log.cc:844] Serialized 14 byte log entry
0709 12:16:08.625241 (+505151us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b1800357fa0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6712a6 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1
0709 12:16:08.712947 (+ 87706us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b1800357fa0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:08.940270 (+227323us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b1800357fa0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17e346d70 00007fc17e33a293 00007fc17e32fcea 00007fc17e33023a 00007fc17e79aa2a 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:16:09.212141 (+271871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:09.238679 (+ 26538us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:09.252666 (+ 13987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.259664 (+  6998us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.265927 (+  6263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139,"prepare.queue_time_us":69482,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":127879,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":43748,"spinlock_wait_cycles":15819904,"thread_start_us":433029,"threads_started":2}
I20260709 12:16:09.347287 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:09.349423 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:09.351117 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 649114us
I20260709 12:16:09.352182 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.355042 14955 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.327234 14847 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.356528 14847 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.358697 15179 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:09.347019 10195 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:09.360496 10048 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:09.359133 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.372681 10055 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:09.401959 10049 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:16:09.402139 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50065us
I20260709 12:16:09.403144 10094 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.403788 15160 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:09.404909 14823 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:09.405107 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.405393 14823 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.405754 14823 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:09.328184 15134 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:16:09.406729 14677 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:09.402341 15173 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:16:09.402009 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 67271.9us
I20260709 12:16:09.411074 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.412112 14955 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:09.412920 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.413902 14955 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:09.405959 15069 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.413893 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:09.414913 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:09.415505 15165 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:16:09.416311 14881 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:09.417017 14881 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.418228 15013 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:09.419005 15013 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:09.411059 14834 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.625s	user 0.013s	sys 0.001s
I20260709 12:16:09.419924 14834 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.421280 15013 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.421948 14834 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.420243 14847 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.424575 15174 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:09.425526 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66625.5us
I20260709 12:16:09.426548 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.423554 14834 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:16:09.428349 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.419400 14881 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.429576 14881 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:09.429976 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.435897 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.436965 14847 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:09.437983 10197 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:16:09.438277 15076 consensus_queue.cc:1059] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:09.439051 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:09.439725 15069 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.440189 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.441854 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.457034 10730 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:09.457829 14894 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.458349 14894 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.442224 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.442457 10055 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:16:09.442816 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.452989 14847 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:09.452713 15013 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:09.462842 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:09.399950 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 789) took 1185 ms. Trace:
I20260709 12:16:09.449309 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:09.375216 14828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.003s	sys 0.017s
W20260709 12:16:09.416980 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 131574us
I20260709 12:16:09.455528 15076 consensus_queue.cc:1243] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:16:09.450451 10197 pending_rounds.cc:85] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 6
I20260709 12:16:09.456208 10196 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:09.467687 10126 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:09.465402 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:09.467453 10197 pending_rounds.cc:107] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 12:16:09.469424 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.469807 10197 raft_consensus.cc:2889] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:09.425158 15174 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:09.476447 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1047) took 2445 ms (client timeout 2197 ms). Trace:
I20260709 12:16:09.464241 10732 rpcz_store.cc:276] 0709 12:16:08.128248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.639891 (+511643us) service_pool.cc:224] Handling call
0709 12:16:08.640180 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:08.640514 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:08.640542 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:08.650016 (+  9474us) log.cc:844] Serialized 26 byte log entry
0709 12:16:09.277177 (+627161us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:09.268425 (+ -8752us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:09.290059 (+ 21634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.299540 (+  9481us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:09.306279 (+  6739us) raft_consensus.cc:1685] finished
0709 12:16:09.306561 (+   282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.313812 (+  7251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1641,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":25671424,"thread_start_us":477076,"threads_started":1,"wal-append.queue_time_us":538762}
I20260709 12:16:09.461339 14894 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:09.474407 14828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.003s	sys 0.018s
W20260709 12:16:09.493444 10730 rpcz_store.cc:269] 0709 12:16:07.026752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.027063 (+   311us) service_pool.cc:224] Handling call
0709 12:16:09.463694 (+2436631us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400453154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:09.471727 (+  8033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5248387328}
I20260709 12:16:09.463162 15013 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.475987 15174 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.508945 10054 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:09.510807 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.510768 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:09.511067 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:09.496778 15134 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:09.516569 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:09.501328 15058 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:09.510798 10050 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:09.462565 14847 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.523094 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.508181 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:09.533299 10129 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:16:09.537863 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 352778us
W20260709 12:16:09.538790 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:09.539191 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:09.528990 15093 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.008s
I20260709 12:16:09.517869 15179 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:09.542124 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:09.543843 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 115775us
I20260709 12:16:09.540493 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:09.546491 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 76838us
I20260709 12:16:09.544679 10054 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:09.531212 14881 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:09.541749 15040 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.542500 15058 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:09.556739 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1902) took 1520 ms. Trace:
I20260709 12:16:09.560808 10130 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.560408 14881 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.564623 14881 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.565315 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2324) took 1852 ms. Trace:
I20260709 12:16:09.567130 15168 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:09.567381 14993 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.001s
I20260709 12:16:09.564917 10736 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:09.568238 10731 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:09.568828 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.570804 14677 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.573537 14677 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.574523 14888 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:09.575026 14888 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:09.575883 14677 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.576175 14888 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.577001 15040 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.577945 14888 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:09.579372 15040 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.580011 10122 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:09.547933 15045 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:09.588666 14834 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:09.591434 14834 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.591831 14834 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:09.594610 15173 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:09.595450 15173 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:09.597529 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 173244us
I20260709 12:16:09.598487 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.584326 14847 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:09.586853 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.610951 15076 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:09.605690 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:09.596400 15058 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.619590 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.621070 10124 pending_rounds.cc:85] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 11
I20260709 12:16:09.621474 10124 pending_rounds.cc:107] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:16:09.621716 10124 raft_consensus.cc:2889] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:09.623063 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 68860.9us
I20260709 12:16:09.624183 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.626556 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:09.626767 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56805.7us
I20260709 12:16:09.627605 15164 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:09.627812 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55889.5us
I20260709 12:16:09.628144 14677 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:09.628322 15164 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.629034 14677 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:16:09.629427 14677 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:09.629817 14677 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:16:09.631114 14955 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:09.633056 14955 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:09.634542 10195 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:09.559525 10203 rpcz_store.cc:276] 0709 12:16:08.036221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.177822 (+141601us) service_pool.cc:224] Handling call
0709 12:16:08.178262 (+   440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:08.289791 (+111529us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:16:08.344707 (+ 54916us) log.cc:844] Serialized 14 byte log entry
0709 12:16:09.442570 (+1097863us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:09.443283 (+   713us) log.cc:844] Serialized 52 byte log entry
0709 12:16:09.443455 (+   172us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:09.536111 (+ 92656us) log.cc:844] Serialized 14 byte log entry
0709 12:16:09.536324 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.547992 (+ 11668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:09.548035 (+    43us) raft_consensus.cc:1685] finished
0709 12:16:09.548046 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.556684 (+  8638us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150886,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2472,"raft.queue_time_us":22941,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":40609,"thread_start_us":906945,"threads_started":2,"wal-append.queue_time_us":870251}
I20260709 12:16:09.615119 10196 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:09.666072 10050 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:09.662134 14881 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:09.583983 14823 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.565697 10204 rpcz_store.cc:276] 0709 12:16:07.672639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:07.672878 (+   239us) service_pool.cc:224] Handling call
0709 12:16:07.673226 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:07.673586 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:07.673617 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:07.674122 (+   505us) log.cc:844] Serialized 52 byte log entry
0709 12:16:07.737186 (+ 63064us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:08.922728 (+1185542us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800370960. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf
0709 12:16:08.923054 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 12:16:09.451286 (+528232us) log.cc:844] Serialized 14 byte log entry
0709 12:16:09.502617 (+ 51331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:09.512213 (+  9596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:09.520812 (+  8599us) raft_consensus.cc:1685] finished
0709 12:16:09.520828 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:09.524481 (+  3653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3798,"prepare.queue_time_us":436985,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":57677,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":24903,"spinlock_wait_cycles":4618112,"thread_start_us":535227,"threads_started":4,"wal-append.queue_time_us":640370,"wal-append.run_cpu_time_us":1837,"wal-append.run_wall_time_us":1058876}
W20260709 12:16:09.679677 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60179.2us
W20260709 12:16:09.680478 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 94364.4us
I20260709 12:16:09.680646 15171 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:09.682626 15179 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:09.684751 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:09.688318 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.690493 15160 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:16:09.691355 15193 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.144s	user 0.003s	sys 0.000s
I20260709 12:16:09.635017 15076 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.714609 15174 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.715538 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.673082 15040 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:09.718941 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:09.719681 15170 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:09.703639 15168 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:09.720304 15170 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.718870 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:09.722914 10129 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:09.714751 14881 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:09.726035 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.721958 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.730275 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:09.705757 15157 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:09.736951 10732 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:09.760159 10199 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:09.762252 10736 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:16:09.723343 15076 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:09.767688 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:09.719004 15040 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.778658 14823 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.780227 15040 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:09.762923 14993 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:09.767096 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.778542 14713 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:09.769711 15013 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:09.795665 10050 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:09.800428 10197 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:09.784945 14993 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:09.796463 14823 raft_consensus.cc:2764] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:16:09.794936 15069 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:09.813107 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.794804 15040 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.815378 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:09.802337 15171 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:16:09.818792 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65442.6us
W20260709 12:16:09.819484 15196 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:16:09.820806 15167 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:16:09.821496 15158 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:16:09.822093 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:09.771662 15097 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:16:09.799808 15170 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:09.822654 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 114249us
I20260709 12:16:09.833060 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:09.835858 15171 consensus_queue.cc:1243] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:09.836454 15171 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:09.836799 15171 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:09.809441 14993 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.839773 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:09.814796 14834 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.846513 14713 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.846735 15122 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:09.847577 14804 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:09.847275 14713 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:09.850605 15045 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:09.851027 14713 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:09.851233 15013 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:09.851051 15045 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:09.852005 15045 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:09.854729 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:09.861920 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48897.1us
I20260709 12:16:09.816375 15168 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.877756 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:09.876999 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68857.8us
I20260709 12:16:09.837857 15171 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.907994 14823 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.865953 14834 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:09.963773 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 133603us
W20260709 12:16:09.927778 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48908us
I20260709 12:16:09.992280 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.028328 10048 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:10.023954 15171 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:09.990072 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:10.023170 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 66916.1us
I20260709 12:16:09.925197 14947 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:09.991596 10051 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:09.920795 15168 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.981192 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:09.881693 14713 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.881388 15134 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:09.972182 15209 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:09.970721 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.037686 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.039913 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:09.956380 14677 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:09.881844 15069 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:09.957605 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:09.980978 10731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 920) took 1938 ms (client timeout 1725 ms). Trace:
I20260709 12:16:10.054741 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:09.880097 15122 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:09.982172 15164 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:09.980069 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:09.972146 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 132529us
I20260709 12:16:09.970547 15180 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:09.963340 14823 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.021833 15045 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.019459 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.012987 14993 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.029990 15170 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:10.033926 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:09.943560 15206 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:10.042243 10046 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:10.035518 14713 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.038208 14947 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:10.055223 10731 rpcz_store.cc:269] 0709 12:16:08.042579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.106818 (+ 64239us) service_pool.cc:224] Handling call
0709 12:16:09.980692 (+1873874us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400600254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:09.980887 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3358556416}
I20260709 12:16:10.053076 15013 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:10.049454 15211 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.084072 15211 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.085073 14713 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.069833 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:10.087154 10129 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:10.087447 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.088181 15164 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:10.088933 15164 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:10.089408 15164 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:10.092206 15179 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:10.073429 15206 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:10.094617 10124 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:16:10.090312 15164 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.096803 14677 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.098592 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.099324 10046 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:10.099058 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:10.100669 15179 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:10.101619 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.103018 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:10.103765 10728 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:10.105109 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.105974 10733 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:10.107088 10733 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:10.108417 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.109958 10735 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:10.111841 15168 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.112236 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:10.113343 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.112957 14947 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.114184 10124 raft_consensus.cc:2410] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:16:10.112982 10129 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:10.117336 10127 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:10.118487 15206 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.119777 15206 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:10.120031 10201 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:16:10.121207 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.121876 10124 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:10.122691 10130 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:16:10.123210 10129 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:10.124090 15158 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:10.050328 14834 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:10.061901 15040 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.049896 15209 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.081487 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:10.082782 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:10.083200 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52606.9us
I20260709 12:16:10.083431 15157 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:10.121762 10199 raft_consensus.cc:1275] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:10.128552 10048 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:16:10.121796 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:10.139235 10197 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:16:10.139706 10048 pending_rounds.cc:85] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 6
I20260709 12:16:10.140089 10048 pending_rounds.cc:107] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:16:10.140341 10048 raft_consensus.cc:2889] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:10.141186 10737 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:10.141918 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.143857 10047 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:10.141278 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 72949.8us
I20260709 12:16:10.147706 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:10.107028 15211 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.150702 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.151793 10049 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:10.152495 10129 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:10.153198 15180 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:10.150661 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.154738 10196 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:10.156219 10121 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:10.157078 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:10.158166 10122 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:10.163638 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.166965 15173 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.168115 15205 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.168669 15205 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.169164 14976 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:10.169564 14976 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:10.170647 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:10.171909 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.163141 15069 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.163856 15211 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:16:10.163719 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:10.076357 15122 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.156667 14834 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.187364 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:10.146732 15167 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:16:10.139278 15040 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.189018 10126 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:16:10.187754 15207 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:16:10.190485 15045 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.203361 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.190088 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.190696 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.192997 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:10.193138 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:10.193392 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.193676 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.164084 14713 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:10.201826 10126 pending_rounds.cc:85] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:16:10.234706 10126 pending_rounds.cc:107] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:16:10.235003 10126 raft_consensus.cc:2889] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:10.206414 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:10.194768 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.234467 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:10.204759 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.195842 15173 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:16:10.233917 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 85241.6us
I20260709 12:16:10.238972 10735 raft_consensus.cc:2410] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:16:10.241981 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:10.238055 10203 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:10.243459 10129 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.7-17.7]
W20260709 12:16:10.241391 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77735.4us
W20260709 12:16:10.238554 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 45638.5us
I20260709 12:16:10.246034 10200 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:10.262405 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:10.204025 15168 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:10.267344 10728 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 8: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:10.204409 14823 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.237973 15157 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:10.237772 15179 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:10.305688 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.241542 14847 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:10.259833 15174 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.186092 15180 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.261843 14713 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:10.326058 10046 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:10.307688 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:10.311443 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 64761.1us
I20260709 12:16:10.258843 15158 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:10.276357 15168 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.205597 15076 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.355294 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:10.357961 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.353278 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.368590 10126 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:10.360383 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.357388 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.364117 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.379786 10129 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:10.379701 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:10.178390 14976 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.387024 10204 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:10.327509 15179 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.386051 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.412349 10049 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:10.417933 10200 raft_consensus.cc:2410] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:16:10.370810 15168 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:10.428563 10730 raft_consensus.cc:2393] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:10.449995 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.447971 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:10.448611 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:10.440272 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 200363us
I20260709 12:16:10.408041 14828 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.474344 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.477000 10200 raft_consensus.cc:1240] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:16:10.390499 15158 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:10.415961 15179 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:16:10.479558 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 217454us
I20260709 12:16:10.474905 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.418700 15174 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:10.491063 15174 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:10.491555 15174 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:10.499208 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44592.8us
I20260709 12:16:10.411818 15130 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:16:10.427564 14677 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:10.432086 14993 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.386031 14847 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.426673 14881 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.487653 14976 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:10.510807 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:10.515357 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:10.515580 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.539148 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:10.503924 14677 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.505498 15093 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.506157 15208 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:10.500607 15233 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:10.580468 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 69279.9us
W20260709 12:16:10.580945 15220 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:16:10.581308 15157 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:16:10.581676 15226 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:16:10.585065 15222 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:16:10.587051 15229 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:16:10.589701 15173 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.514972 14881 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:10.590723 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 85164.5us
I20260709 12:16:10.621336 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:10.541213 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.499980 14828 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.544772 14834 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.614670 10728 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:16:10.616374 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.617605 10729 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:16:10.615510 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.599090 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.636703 10128 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:10.546995 15211 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:10.545284 14677 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:10.639245 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:10.606696 15157 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:10.635915 10729 pending_rounds.cc:85] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 13
I20260709 12:16:10.546769 14974 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.280s
I20260709 12:16:10.516603 15209 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.662480 10729 pending_rounds.cc:107] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:16:10.649935 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:10.663734 10729 raft_consensus.cc:2889] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:10.612762 15040 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.581012 15093 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.672519 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:10.648617 15206 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:16:10.609800 15169 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:16:10.673314 10049 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:10.628409 15205 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.644248 15211 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.665443 15157 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:10.516297 14713 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.698259 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:10.707140 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:10.710906 15235 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:10.699754 15211 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:10.718528 15225 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:16:10.722919 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:16:10.723709 10204 raft_consensus.cc:606] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.724076 10204 raft_consensus.cc:614] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:10.628186 15158 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.727573 15063 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:10.728137 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.728958 15174 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.729794 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:10.731102 15237 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:16:10.730989 15207 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:10.732366 15167 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:10.626310 15233 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.732657 15207 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:10.734549 15233 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.734702 15205 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:10.735172 15205 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:10.735554 15205 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:10.727555 15211 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.746613 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:10.749111 15207 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:10.751577 14881 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.753249 15207 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:10.753783 15211 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.767540 14828 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.768242 14828 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.768770 14828 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.687525 15090 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:10.770846 15090 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.773046 15090 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:10.770174 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 170597us
W20260709 12:16:10.780890 10202 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.000s
I20260709 12:16:10.781628 10202 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 8.
I20260709 12:16:10.783241 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:10.784572 10128 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:10.645637 15173 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.693212 15097 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:10.694796 15209 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.694720 15040 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:10.799429 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.709131 15180 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.704325 15076 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:10.812508 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 454072us
I20260709 12:16:10.793962 15207 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:10.825700 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.843333 10128 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:10.799103 15097 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:10.844908 10051 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:10.849762 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:10.816144 15058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.012s	sys 0.017s
I20260709 12:16:10.845976 15207 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.799965 15205 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.873891 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.849154 15134 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:16:10.858114 15058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.017s
I20260709 12:16:10.891754 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.892625 10732 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:10.864161 14847 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.818547 15209 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.895681 15099 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:10.907140 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 51094.8us
I20260709 12:16:10.879431 15207 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:10.903947 10121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.027s
W20260709 12:16:10.909816 10121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.028s
I20260709 12:16:10.912456 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.915421 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:10.919111 10203 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.001s
I20260709 12:16:10.919857 10203 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 18 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:16:10.909070 15099 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.927055 15099 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:10.932029 15209 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.913550 15058 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:10.933789 15058 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.934769 14828 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.936223 15058 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.937789 15179 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.939157 10195 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:10.939494 15205 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:10.934185 15173 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.896160 15097 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:10.941190 10198 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
W20260709 12:16:10.921525 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 228955us
I20260709 12:16:10.909389 15174 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.944135 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.940682 15093 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.946831 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:10.944108 15134 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:10.954900 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:10.956075 10128 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:10.959587 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:10.962212 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49711.2us
I20260709 12:16:10.965066 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:10.963857 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:10.957712 15097 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:10.976013 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:10.977907 15040 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.978567 15233 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.977578 14847 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:10.982934 14847 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:10.984853 15254 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:10.988435 15179 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:10.981115 15040 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:10.991550 15190 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.318s	user 0.007s	sys 0.022s
I20260709 12:16:10.992672 15040 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:10.963418 15134 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:10.969193 15174 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:10.969441 15173 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:10.995779 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:10.999291 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:10.999553 15257 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:16:10.998687 15040 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.019928 15160 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:11.020653 15040 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.022542 15253 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:11.023159 15253 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.024052 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:11.001820 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:10.979597 15233 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.027585 14847 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.028779 15233 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.029685 15134 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.024266 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.024255 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:10.998498 15168 consensus_meta.cc:287] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.002s
I20260709 12:16:11.034204 10054 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:11.025978 15160 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:11.037511 15168 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.042261 15168 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.058717 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:11.059041 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 925) took 1340 ms. Trace:
I20260709 12:16:11.059481 10730 rpcz_store.cc:276] 0709 12:16:09.718184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.718698 (+   514us) service_pool.cc:224] Handling call
0709 12:16:11.058825 (+1340127us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400453154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:11.058976 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620045568}
I20260709 12:16:11.062263 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:11.067188 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:11.059448 10728 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:11.077535 15233 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:16:11.063036 10126 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:11.077987 10094 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.042160 15253 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.078862 15168 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:11.079311 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.078033 15233 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:11.073786 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:11.080096 10731 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:11.080470 15233 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.080953 15168 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:11.080416 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:11.078850 10126 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:11.085271 14847 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:11.085716 14847 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.086058 14847 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:11.113911 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.116235 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.117172 10201 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
W20260709 12:16:11.116163 15250 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:16:11.117424 10202 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:11.127422 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:11.135960 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 111773us
I20260709 12:16:11.136497 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.140008 15134 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:11.141271 15134 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:16:11.141917 15164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.001s	sys 0.003s
I20260709 12:16:11.142640 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:11.143203 10730 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:11.075059 15246 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:11.076617 15205 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.147521 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.092703 15168 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:11.142328 15164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.001s	sys 0.003s
I20260709 12:16:11.151520 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:11.153023 10202 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:11.069373 15063 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:16:11.062314 15099 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.152278 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:11.142261 14974 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:11.146091 14823 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:11.146752 15246 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:11.156404 14976 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.003s
I20260709 12:16:11.166733 10730 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:11.169869 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:11.168339 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 144154us
I20260709 12:16:11.173506 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.138866 14847 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.177220 15264 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:11.176066 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.166497 14823 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:11.167366 15246 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:11.193635 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:11.254769 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 77419us
I20260709 12:16:11.255646 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.157518 15205 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:11.259104 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66630.6us
I20260709 12:16:11.257877 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1946) took 1083 ms. Trace:
W20260709 12:16:11.197805 15269 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:11.166497 15207 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.259883 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.193135 15164 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:11.196265 14823 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:11.266322 15265 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:16:11.266657 15134 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:16:11.266993 15260 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:16:11.267272 15063 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:11.267520 15258 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:16:11.267755 15207 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:11.268246 15266 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:16:11.268615 15262 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:11.269387 10203 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:11.272564 14847 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.253528 14955 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:11.252195 14976 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:11.260634 15264 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:16:11.304857 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.257447 15206 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:11.304313 15256 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.259806 10121 rpcz_store.cc:276] 0709 12:16:10.168086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.185604 (+ 17518us) service_pool.cc:224] Handling call
0709 12:16:10.233147 (+ 47543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.241764 (+  8617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.241793 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.274292 (+ 32499us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.913091 (+638799us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:10.913133 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:10.913202 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.115490 (+202288us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:11.193443 (+ 77953us) raft_consensus.cc:1685] finished
0709 12:16:11.193465 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.251662 (+ 58197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8212,"raft.queue_time_us":12199,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5920,"spinlock_wait_cycles":4765568,"thread_start_us":528346,"threads_started":1,"wal-append.queue_time_us":630591}
I20260709 12:16:11.284897 15179 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:11.334270 15256 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.335052 15179 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.337216 15179 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.306736 15063 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:11.337939 15063 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:11.339552 15256 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.276196 14804 consensus_queue.cc:1048] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:16:11.309019 15058 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.343008 15058 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.344265 10195 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:11.345225 15208 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.345708 15208 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:11.350337 15217 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.253s	user 0.003s	sys 0.000s
I20260709 12:16:11.354502 14976 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:11.354945 15219 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.259s	user 0.005s	sys 0.004s
I20260709 12:16:11.355568 14976 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.299726 15164 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.363785 15273 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:11.311843 15262 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:11.332556 15270 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:11.369902 15206 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.345420 15058 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.328487 15168 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:11.399358 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:11.400130 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:11.410995 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.415938 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.396682 15179 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.418671 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.419389 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.419538 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.419823 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:11.420598 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1067) took 1533 ms. Trace:
I20260709 12:16:11.427099 15040 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.421347 15174 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:11.430568 15168 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:11.438606 15267 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
W20260709 12:16:11.440925 15157 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.001s
I20260709 12:16:11.444298 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.445344 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.467787 10048 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:11.446444 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:11.468595 10732 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:16:11.447213 15205 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.448696 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.469951 10052 raft_consensus.cc:2410] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:16:11.447158 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:11.470674 10730 raft_consensus.cc:2410] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 12:16:11.451785 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:11.420027 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:11.452696 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:11.446332 14677 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.005s
I20260709 12:16:11.454586 15179 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.444365 15206 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.479526 15167 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.477468 15099 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.476691 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.522790 10054 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:11.525642 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.526311 10202 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 8.
I20260709 12:16:11.521766 15063 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.422767 10736 rpcz_store.cc:276] 0709 12:16:09.879991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:09.880140 (+   149us) service_pool.cc:224] Handling call
0709 12:16:09.914542 (+ 34402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:09.924738 (+ 10196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:09.924771 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:09.925284 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.051494 (+126210us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:10.051532 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:10.051597 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.354076 (+1302479us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:11.356794 (+  2718us) raft_consensus.cc:1685] finished
0709 12:16:11.356829 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.412858 (+ 56029us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5999,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12312,"spinlock_wait_cycles":69092608,"thread_start_us":125794,"threads_started":1,"wal-append.queue_time_us":152689}
I20260709 12:16:11.475961 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:11.448038 15262 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.491993 14677 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:11.466154 15174 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.545086 15174 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.509397 15180 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.516630 10201 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:16:11.468946 15157 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.568276 15164 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.568882 15157 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.526796 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.571416 10199 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:16:11.527369 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.527889 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:11.477950 10053 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:16:11.537515 10054 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:11.548419 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:11.549186 15208 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.553421 10048 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
W20260709 12:16:11.533385 15223 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.027s	user 0.002s	sys 0.000s
I20260709 12:16:11.553946 10732 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:11.555506 15179 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.479317 14823 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.556946 14955 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:11.557994 15262 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:11.476454 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 171461us
I20260709 12:16:11.559722 14677 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.542762 15206 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:11.560092 15130 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:11.560359 15097 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:11.542402 15167 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.561082 15168 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.555401 15063 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.562378 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2496) took 1046 ms. Trace:
I20260709 12:16:11.566746 15180 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.603657 15164 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:11.633230 10126 rpcz_store.cc:276] 0709 12:16:10.516114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:11.084101 (+567987us) service_pool.cc:224] Handling call
0709 12:16:11.084479 (+   378us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:11.093398 (+  8919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:11.093435 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:11.094178 (+   743us) log.cc:844] Serialized 78 byte log entry
0709 12:16:11.165943 (+ 71765us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:11.165982 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.166050 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.562124 (+396074us) raft_consensus.cc:1685] finished
0709 12:16:11.562145 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.562318 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8222,"raft.queue_time_us":8534,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"thread_start_us":71329,"threads_started":1,"wal-append.queue_time_us":207810}
I20260709 12:16:11.653060 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:11.653795 10126 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:11.654805 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:11.660006 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 794) took 1560 ms. Trace:
I20260709 12:16:11.660476 10737 rpcz_store.cc:276] 0709 12:16:10.099311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.099455 (+   144us) service_pool.cc:224] Handling call
0709 12:16:10.099754 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:10.147125 (+ 47371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.659456 (+1512331us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:11.659943 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67416320}
I20260709 12:16:11.612905 15206 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.679894 14842 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:11.671976 15279 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.634681 15097 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.686024 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.696201 10054 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:11.630400 15130 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:11.695218 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:11.692914 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2500) took 1043 ms. Trace:
I20260709 12:16:11.698797 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.699688 10053 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:11.703322 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.702000 10126 rpcz_store.cc:276] 0709 12:16:10.649978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:11.662759 (+1012781us) service_pool.cc:224] Handling call
0709 12:16:11.663048 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:11.691897 (+ 28849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:11.691925 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:11.691997 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:11.692223 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.692487 (+   264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.692854 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:11.704113 10049 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:11.705484 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.683794 15256 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:11.683957 15265 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:11.715340 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 295578us
I20260709 12:16:11.718999 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.720382 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1939) took 1602 ms. Trace:
W20260709 12:16:11.722962 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 195126us
I20260709 12:16:11.726534 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.725742 10052 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:11.725728 15040 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:11.732319 15206 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.732921 15206 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.733230 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.733647 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1944) took 1570 ms. Trace:
I20260709 12:16:11.733412 15206 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.732987 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1949) took 1563 ms. Trace:
I20260709 12:16:11.734964 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1942) took 1610 ms. Trace:
I20260709 12:16:11.734826 10123 rpcz_store.cc:276] 0709 12:16:10.169055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.237161 (+ 68106us) service_pool.cc:224] Handling call
0709 12:16:10.307075 (+ 69914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.411386 (+104311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.411419 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.430066 (+ 18647us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.690333 (+260267us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:11.646370 (+956037us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.732622 (+ 86252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.732686 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.732722 (+    36us) raft_consensus.cc:1685] finished
0709 12:16:11.732732 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.732836 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":938993,"prepare.queue_time_us":827048,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":151772,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4754,"spinlock_wait_cycles":436480,"thread_start_us":365374,"threads_started":2,"wal-append.queue_time_us":455318}
I20260709 12:16:11.736163 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.737282 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.734006 10124 rpcz_store.cc:276] 0709 12:16:10.163610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.164226 (+   616us) service_pool.cc:224] Handling call
0709 12:16:10.186721 (+ 22495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.454836 (+268115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.454870 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.510613 (+ 55743us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.947550 (+436937us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:11.648234 (+700684us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.733375 (+ 85141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.733446 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.733482 (+    36us) raft_consensus.cc:1685] finished
0709 12:16:11.733493 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.733597 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601009,"prepare.queue_time_us":570034,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":143940,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":4704,"thread_start_us":709133,"threads_started":3,"wal-append.queue_time_us":394410}
I20260709 12:16:11.730556 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.735436 10130 rpcz_store.cc:276] 0709 12:16:10.124594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.125050 (+   456us) service_pool.cc:224] Handling call
0709 12:16:10.125358 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.134989 (+  9631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.135022 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.170666 (+ 35644us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.384847 (+214181us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:11.617221 (+1232374us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.734684 (+117463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.734757 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.734793 (+    36us) raft_consensus.cc:1685] finished
0709 12:16:11.734804 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.734915 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1082101,"prepare.queue_time_us":1070265,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":116,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10346,"thread_start_us":455215,"threads_started":3,"wal-append.queue_time_us":313269,"wal-append.run_cpu_time_us":1961,"wal-append.run_wall_time_us":1107052}
I20260709 12:16:11.743781 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.700919 15279 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.689214 15157 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:16:11.752772 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:11.753929 10053 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:11.754676 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:11.747599 15282 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:16:11.757296 15174 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:11.757745 15174 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.758131 15174 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:11.732388 14677 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:11.758831 14677 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.759197 14677 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:11.760834 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.719777 15170 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:11.761890 10199 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:11.775342 15040 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:11.777352 15040 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:11.778658 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77593.4us
W20260709 12:16:11.781081 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43887.7us
I20260709 12:16:11.782068 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:11.740054 15164 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:11.756904 15254 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:16:11.752328 14847 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:11.711318 15246 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.794538 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:11.795590 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:11.722625 15256 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.786448 14881 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.804840 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2490) took 1373 ms. Trace:
I20260709 12:16:11.787240 14842 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:11.790280 15208 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.794564 15233 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:11.803391 15278 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:11.823506 14842 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.827209 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2497) took 1283 ms. Trace:
I20260709 12:16:11.810307 10128 rpcz_store.cc:276] 0709 12:16:10.425369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.979350 (+553981us) service_pool.cc:224] Handling call
0709 12:16:10.998085 (+ 18735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:11.022899 (+ 24814us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:11.713491 (+690592us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.797917 (+ 84426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:11.797980 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:11.798027 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.798104 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.798229 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457616,"prepare.queue_time_us":494846,"raft.queue_time_us":6540,"spinlock_wait_cycles":28936576,"thread_start_us":245189,"threads_started":2}
I20260709 12:16:11.799976 15164 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.806645 14823 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.726015 15265 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.831190 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1945) took 1663 ms. Trace:
W20260709 12:16:11.824257 15281 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:16:11.803102 15264 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:11.844616 10121 rpcz_store.cc:276] 0709 12:16:10.543953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:11.335481 (+791528us) service_pool.cc:224] Handling call
0709 12:16:11.335837 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:11.336192 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:11.336222 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:11.336695 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:16:11.593659 (+256964us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:11.593699 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.593768 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.826993 (+233225us) raft_consensus.cc:1685] finished
0709 12:16:11.827014 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.827146 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1131,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":256559,"threads_started":1,"wal-append.queue_time_us":321129}
I20260709 12:16:11.849043 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.863432 10199 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:11.869634 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.831142 15167 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.840732 15180 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.822225 14881 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.844910 15278 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:11.880798 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:11.863970 10122 rpcz_store.cc:276] 0709 12:16:10.167737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.185479 (+ 17742us) service_pool.cc:224] Handling call
0709 12:16:10.191073 (+  5594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.191508 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.191544 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.192038 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.453755 (+261717us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:11.630825 (+1177070us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.830569 (+199744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.830824 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.830909 (+    85us) raft_consensus.cc:1685] finished
0709 12:16:11.830923 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.831130 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1030269,"prepare.queue_time_us":1063317,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":32074,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"spinlock_wait_cycles":19468160,"thread_start_us":570530,"threads_started":4,"wal-append.queue_time_us":512922,"wal-append.run_cpu_time_us":1814,"wal-append.run_wall_time_us":1014574}
I20260709 12:16:11.885957 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1937) took 1010 ms. Trace:
I20260709 12:16:11.905628 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:11.900807 10204 rpcz_store.cc:276] 0709 12:16:10.875373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.875485 (+   112us) service_pool.cc:224] Handling call
0709 12:16:10.888625 (+ 13140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:10.928534 (+ 39909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.928563 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:10.929049 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:16:10.981104 (+ 52055us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:10.981142 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.875528 (+894386us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b540003cad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:11.875574 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.875615 (+    41us) raft_consensus.cc:1685] finished
0709 12:16:11.875627 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.885865 (+ 10238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1029,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":77057152,"thread_start_us":50760,"threads_started":1,"wal-append.queue_time_us":50518}
I20260709 12:16:11.905278 15130 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.878376 15097 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:11.923305 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74829.8us
I20260709 12:16:11.901666 15278 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:11.924383 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:11.930663 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:11.932309 15305 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:11.933442 15058 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:11.933925 15058 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.934290 15058 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:11.938369 14842 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.942862 15290 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:11.944099 15290 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:11.944480 15290 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:11.945382 15290 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.923668 15206 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:11.950866 15279 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.951421 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:11.952498 10198 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:11.953616 15246 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:11.954245 15209 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:11.957517 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:11.970968 15301 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.971640 15301 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:11.974234 15301 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:11.954799 15209 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:11.976130 15288 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 12:16:11.979707 15298 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:16:11.977602 15290 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:11.998373 15307 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:16:11.998826 15296 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:16:12.003886 15256 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.007230 14881 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.009691 15265 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.016371 10198 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:16:12.022684 15164 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:12.024874 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.026031 15174 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:12.016124 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 255380us
I20260709 12:16:12.020460 10049 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:12.028829 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.030028 15058 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.031698 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.036206 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.039520 15058 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:12.037003 10202 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:12.043665 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.048583 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.017448 14677 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.044623 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.051056 10195 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:12.053151 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:12.062563 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:12.064690 15209 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.066135 10198 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:12.052016 14823 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.050571 15168 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.071100 15168 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.071434 14677 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.073367 15168 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.074031 15265 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.074659 15265 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.076718 15265 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.083072 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.083727 15122 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.085646 10737 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:12.044698 15174 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.032155 15278 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.088635 15278 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.088551 14993 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.089439 14993 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.090385 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:12.091531 14993 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.093163 15253 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:12.093722 15253 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:12.093921 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 871) took 1514 ms. Trace:
I20260709 12:16:12.095136 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.096668 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.094545 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.099558 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.094326 10129 rpcz_store.cc:276] 0709 12:16:10.579739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:11.412045 (+832306us) service_pool.cc:224] Handling call
0709 12:16:11.424544 (+ 12499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:11.546004 (+121460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:11.546040 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:11.546094 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:11.546125 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.093703 (+547578us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400172854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:12.093748 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:12.093865 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278864128}
I20260709 12:16:12.107712 10202 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:16:12.100203 10052 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:12.109658 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:12.111482 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.112849 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.070122 14823 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.119805 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.120059 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.120468 10195 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:12.121387 14823 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.113559 14677 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:12.122511 15253 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.126096 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:12.126794 10049 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:12.127902 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.128484 10129 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:12.129885 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.126243 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:12.133459 10199 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:12.136782 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.137426 10734 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:12.138311 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.138651 15290 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.138871 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:12.139369 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.139235 15290 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.139989 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.140563 10731 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:12.139964 10734 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:12.141767 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.142123 10729 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:12.143227 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.143762 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.144323 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.144794 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.145001 10129 raft_consensus.cc:2368] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 16.
I20260709 12:16:12.145483 10130 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:12.141449 15290 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.146651 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.143180 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.147342 10122 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:12.147519 10736 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:12.141450 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.145807 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.149682 10728 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:12.149791 10129 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:12.147246 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:12.074753 15257 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:12.130589 10126 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:12.158601 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.134313 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:12.146227 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.154690 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.155349 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.160823 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.161034 10130 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
W20260709 12:16:12.124657 15309 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 12:16:12.159250 10126 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:12.164845 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.216024 10202 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:12.215850 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.165828 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.217926 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.218540 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:12.217948 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.219162 10200 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:12.219234 10737 raft_consensus.cc:606] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:12.202858 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:12.220386 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 56909us
I20260709 12:16:12.155813 14823 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:12.165591 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.222107 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.226085 10122 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:12.226500 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.227018 10129 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:12.227814 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:12.230597 15168 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.231122 15168 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.233668 15168 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.234436 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.223438 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.223737 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.166567 15254 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:12.199679 15208 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:12.122478 14677 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.253515 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2366) took 1181 ms. Trace:
I20260709 12:16:12.253535 14677 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.253950 10203 rpcz_store.cc:276] 0709 12:16:11.071655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:11.071776 (+   121us) service_pool.cc:224] Handling call
0709 12:16:11.072135 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:11.312076 (+239941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.253268 (+941192us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:12.253451 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453169536}
W20260709 12:16:12.256222 15292 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
I20260709 12:16:12.257753 14804 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:12.258708 15254 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.259162 15254 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.234517 15303 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.161517 15174 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:12.218510 15233 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:12.237804 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.238654 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.238835 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.267300 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.281073 10053 raft_consensus.cc:2410] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:12.156514 15257 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:12.295487 15257 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.296609 15257 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:12.298614 15174 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:12.299644 15174 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:11.722961 10127 rpcz_store.cc:276] 0709 12:16:10.118357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:10.118490 (+   133us) service_pool.cc:224] Handling call
0709 12:16:10.118817 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:10.119218 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:10.119246 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:10.119848 (+   602us) log.cc:844] Serialized 52 byte log entry
0709 12:16:10.337463 (+217615us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:10.363016 (+ 25553us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.023485 (+660469us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b180023ed20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:11.416256 (+392771us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b180023ed20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:16:11.420980 (+  4724us) log.cc:844] Serialized 14 byte log entry
0709 12:16:11.714799 (+293819us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b180023ed20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:16:11.715027 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:11.715115 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:11.715156 (+    41us) raft_consensus.cc:1685] finished
0709 12:16:11.715167 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:11.720328 (+  5161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1045196,"prepare.queue_time_us":1194935,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":311707,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":7693,"spinlock_wait_cycles":90879104,"thread_start_us":216537,"threads_started":1,"wal-append.queue_time_us":416587}
I20260709 12:16:12.278357 15130 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:16:12.304001 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.221699 14834 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:12.304967 14834 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.307314 14834 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.307755 10128 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:12.166687 15265 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:16:12.258160 14804 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:12.261107 14823 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:12.266664 15250 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:16:12.287269 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.288551 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.288234 15254 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:12.303162 15314 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:16:12.166814 15097 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:16:12.288136 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.344022 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.265377 10049 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:12.321389 15278 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:16:12.356133 10200 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:12.281275 10122 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:12.215204 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:12.326538 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.321072 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:12.338320 10123 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:12.341439 14804 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.356779 15254 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.367354 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:12.364326 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.373132 10124 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:12.375200 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.240270 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.392438 14804 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:12.393247 10729 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:16:12.393711 15090 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:12.394163 15090 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:12.319212 15303 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.395087 15090 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.396203 15090 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:12.396821 15303 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.404157 10049 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:16:12.411753 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.414335 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.415134 10052 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:12.417524 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.418509 10124 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:12.420336 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:12.422183 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 101168us
W20260709 12:16:12.425320 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 210186us
W20260709 12:16:12.372383 15316 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:16:12.427358 15051 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:12.427668 15291 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.367s	user 0.003s	sys 0.000s
I20260709 12:16:12.427927 15051 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.421499 15290 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:12.428901 15290 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.429302 15290 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:12.432974 14834 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.433531 14834 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.434577 15173 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.435056 15173 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.436298 15208 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:12.437124 15173 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.437359 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.438016 10122 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:12.438488 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.438923 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.439945 15179 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:12.440003 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.440456 15179 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:12.440675 10122 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:12.441505 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.442021 10122 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:12.442744 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.443392 10054 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:12.445470 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:12.447247 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.425820 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:12.448727 10048 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:12.437592 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:12.427520 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:12.430055 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.461350 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.461546 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:12.448041 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48140.5us
I20260709 12:16:12.425827 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.465011 10124 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:12.466377 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.446661 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.469463 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:12.470224 10128 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:12.357594 15279 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:16:12.422183 15233 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:16:12.427587 15317 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:16:12.472128 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:12.478164 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.478271 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.476122 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:12.480214 10124 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:12.481647 10124 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:16:12.483448 10124 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:16:12.430119 15051 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:12.467694 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47440.9us
I20260709 12:16:12.426349 15063 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:12.489686 15063 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.490129 15063 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.490340 15294 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:12.472481 15173 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:12.476343 15209 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:12.500505 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.504174 10049 raft_consensus.cc:2368] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17.
W20260709 12:16:12.502168 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 347274us
I20260709 12:16:12.478014 15296 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:12.507496 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:12.505954 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.510821 10048 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:12.511756 15164 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:12.512212 15164 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:12.512567 15164 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:12.517490 15063 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.519941  9952 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:12.477874 15207 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:16:12.485558 15097 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:12.529686 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.535526 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.529088 10168 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:12.539023 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.540275 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.540371 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.541030 10201 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:12.541838 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.540418 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.542698 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:12.543186 10196 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:12.540634 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.505115 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:12.546180 10195 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:16:12.547245 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.443063 14823 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.547271 10128 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:12.550532 10124 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.7-17.7]
I20260709 12:16:12.552948 10124 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:16:12.554590 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:12.555449 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.555989 10121 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:12.556401 10198 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 12:16:12.558240 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 70385.7us
I20260709 12:16:12.559624 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:12.575312 10122 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:12.575383 10204 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:12.554090 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65259.6us
I20260709 12:16:12.590322 10095 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.509789 15296 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:12.577744 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:12.654580 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 94851.3us
W20260709 12:16:12.656639 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110068us
W20260709 12:16:12.659518 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69279.8us
I20260709 12:16:12.660384 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.661782 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.663537 10128 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:12.542508 15273 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:12.679543 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.681253 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:12.666374 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 88715.8us
I20260709 12:16:12.682875 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:12.669085 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:12.696096 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:12.709242 10169 leader_election.cc:400] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 16.
I20260709 12:16:12.709640 10169 leader_election.cc:403] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:16:12.710321 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54939.1us
I20260709 12:16:12.711617 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:12.544574 15294 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:16:12.557387 15076 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:12.574939 15207 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:12.723682 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:12.725205 10048 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:16:12.731972 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50801.2us
I20260709 12:16:12.722954 10129 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:12.719481 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:12.732872 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:12.653165 15254 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:12.665773 15296 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:12.656483 15206 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:12.735503 10121 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:16:12.724020 14677 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:12.656452 15208 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:16:12.678885 15209 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:12.666137 15170 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:12.708570 15168 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:12.746023 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.774518 10049 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:12.728818 15157 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:12.748030 15256 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:12.724393 15313 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:12.728384 15051 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:12.730926 15207 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:12.678654 15273 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:12.764279 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 342434us
I20260709 12:16:12.803211 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:12.804456 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.805369 10054 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:16:12.807173 15093 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:16:12.807663 15093 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:12.808000 15093 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:12.764108 15303 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:12.809931 15256 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:12.737735 15233 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:12.746798 15299 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:12.810885 15256 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.811834 10054 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:12.753850 15294 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 16.
I20260709 12:16:12.736145 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:12.766024 15209 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:12.818043 15209 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:12.734999 15076 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.810900 15233 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.837186 15296 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.838349 15233 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.839434 15296 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:12.773185 14834 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:12.773658 15206 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:12.766646 14677 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:12.777740 15170 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:12.796612 15168 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:12.831799 10197 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:16:12.834735 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.836409 15076 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:12.800077 15207 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:12.784020 10055 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:16:12.871140 10055 pending_rounds.cc:85] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 9
I20260709 12:16:12.871407 10055 pending_rounds.cc:107] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:16:12.871641 10055 raft_consensus.cc:2889] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:12.737818 10124 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:16:12.803339 15322 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:16:12.797043 15051 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:12.879119 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.862748 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.867792 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:12.886719 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:12.887411 10204 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:12.885334 10019 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:12.793565 15157 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:12.868006 10732 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.012s
W20260709 12:16:12.869552 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 386547us
I20260709 12:16:12.850101 15056 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:12.845153 14976 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:16:12.896127 10732 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.012s	sys 0.013s
I20260709 12:16:12.850240 15206 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:12.874909 10702 leader_election.cc:400] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17.
I20260709 12:16:12.899664 10702 leader_election.cc:403] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:16:12.980445 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 83695.1us
I20260709 12:16:12.981506 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:12.889932 15051 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:13.045902 15323 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 12:16:13.017481 15056 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.050621 14677 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:12.893265 15122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.015s	sys 0.023s
I20260709 12:16:13.045233 14804 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:16:13.110070 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 235306us
I20260709 12:16:12.902412 15063 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:13.182220 10735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.016s
W20260709 12:16:13.208282 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.000s	sys 0.017s
W20260709 12:16:13.166131 15130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.017s	sys 0.037s
W20260709 12:16:13.191598 15164 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
W20260709 12:16:13.106846 15122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.024s
I20260709 12:16:12.903890 14881 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:12.904176 15093 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:12.903198 15206 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:13.278175 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1955) took 1166 ms. Trace:
I20260709 12:16:13.179380 14804 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:13.149278 10046 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.009s	sys 0.007s
W20260709 12:16:13.329670 10046 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.009s	sys 0.008s
I20260709 12:16:13.135515 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.143133 14888 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17.
I20260709 12:16:12.898510 14976 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:13.276449 15290 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.000s
I20260709 12:16:13.326035 10125 rpcz_store.cc:276] 0709 12:16:12.111365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.112669 (+  1304us) service_pool.cc:224] Handling call
0709 12:16:12.134901 (+ 22232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.148880 (+ 13979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.148911 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.166342 (+ 17431us) log.cc:844] Serialized 26 byte log entry
0709 12:16:12.476971 (+310629us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:12.508638 (+ 31667us) log.cc:844] Serialized 14 byte log entry
0709 12:16:12.554550 (+ 45912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.554627 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:13.277943 (+723316us) raft_consensus.cc:1685] finished
0709 12:16:13.277965 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.278109 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101268,"prepare.queue_time_us":24078,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":67427,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":118417,"thread_start_us":188591,"threads_started":1,"wal-append.queue_time_us":294978}
W20260709 12:16:13.291069 15130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.017s	sys 0.037s
W20260709 12:16:13.331302 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 195843us
I20260709 12:16:13.273138 15279 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:12.894639 15273 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.292963 15063 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.357682 15290 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.366886 15170 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:13.367674 15324 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:16:13.367698 14804 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.366735 15090 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:13.374459 15063 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.377523 15063 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.331138 15164 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.361560 15169 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:13.334295 14881 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.358170 15279 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:13.369872 15051 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.393987 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:13.409452 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.023s	sys 0.020s
W20260709 12:16:13.409905 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.023s	sys 0.020s
W20260709 12:16:13.410183 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 855614us
W20260709 12:16:13.415606 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.023s	sys 0.037s
W20260709 12:16:13.416091 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.023s	sys 0.037s
W20260709 12:16:13.416723 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 683902us
I20260709 12:16:13.417572 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:13.438262 10203 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:16:13.415082 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.010s	sys 0.026s
W20260709 12:16:13.440448 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.026s
W20260709 12:16:13.441138 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 758291us
I20260709 12:16:13.440765 10168 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:13.411108 15253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.041s	sys 0.082s
W20260709 12:16:13.448086 10200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.002s	sys 0.012s
W20260709 12:16:13.450915 10200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.003s	sys 0.012s
I20260709 12:16:13.394579 15279 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:13.445907 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:13.452229 15253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.042s	sys 0.082s
W20260709 12:16:13.456889 10729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.008s
W20260709 12:16:13.457458 10198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.008s	sys 0.007s
I20260709 12:16:13.439754 15170 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:13.443241 14888 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:13.439059 15278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.007s	sys 0.037s
I20260709 12:16:13.446619 15169 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:16:13.451033 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:13.451462 14823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.006s	sys 0.009s
W20260709 12:16:13.448261 10734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.008s	sys 0.007s
W20260709 12:16:13.492857 10734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.008s	sys 0.007s
W20260709 12:16:13.449788 15256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.008s	sys 0.008s
W20260709 12:16:13.464318 10198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.008s
W20260709 12:16:13.463894 10729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.007s	sys 0.008s
W20260709 12:16:13.463137 10701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.009s
W20260709 12:16:13.456704 15160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.012s	sys 0.004s
W20260709 12:16:13.474143 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.000s	sys 0.041s
I20260709 12:16:13.487373 10728 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: []
W20260709 12:16:13.488269 15327 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:16:13.488461 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 806) took 1125 ms. Trace:
W20260709 12:16:13.488936 15330 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:16:13.489102 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:13.466244 14888 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.450776 14976 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.461086 15157 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:13.469645 15278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.007s	sys 0.038s
W20260709 12:16:13.451609 15058 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.000s	sys 0.015s
I20260709 12:16:13.474385 15170 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:13.497107 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.000s	sys 0.041s
W20260709 12:16:13.533543 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 821924us
I20260709 12:16:13.534308 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:13.497179 10701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.010s
W20260709 12:16:13.535813 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 732638us
I20260709 12:16:13.537390 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:13.537882 15207 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.648s	user 0.003s	sys 0.004s
I20260709 12:16:13.538655 15331 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:13.539258 15051 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:13.492615 14823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.006s	sys 0.010s
W20260709 12:16:13.502313 15329 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:16:13.504441 15093 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:13.503621 15164 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:13.505290 15256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.009s	sys 0.008s
W20260709 12:16:13.517478 15058 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.000s	sys 0.015s
W20260709 12:16:13.542250 15313 consensus_queue.cc:1175] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 15 status { last_received { term: 12 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [14.7-14.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:13.553429 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.554709 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:13.539989 15051 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:13.519709 14976 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:13.519994 15290 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.506352 10735 rpcz_store.cc:276] 0709 12:16:12.363293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.363407 (+   114us) service_pool.cc:224] Handling call
0709 12:16:12.363710 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.415975 (+ 52265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.416009 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.468339 (+ 52330us) log.cc:844] Serialized 26 byte log entry
0709 12:16:13.208785 (+740446us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:13.208827 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.208898 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:13.488208 (+279310us) raft_consensus.cc:1685] finished
0709 12:16:13.488235 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.488394 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48752,"raft.queue_time_us":59695,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":16486,"thread_start_us":718100,"threads_started":1,"wal-append.queue_time_us":979365}
W20260709 12:16:13.524838 10204 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.002s
I20260709 12:16:13.531100 15179 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:13.544255 15209 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.726s	user 0.005s	sys 0.003s
I20260709 12:16:13.570644 15209 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.572860 15209 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.517650 14888 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:13.574290 15056 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:13.574779 15340 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:13.575208 15340 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:13.494477 15253 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:13.576027 15179 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:13.577821 10735 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:16:13.568331 10204 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
W20260709 12:16:13.460227 15174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.011s
W20260709 12:16:13.505535 15160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.012s	sys 0.004s
I20260709 12:16:13.562348 15256 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:13.569849 14842 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:13.575574 15340 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:13.563225 15173 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:13.538348 15207 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.596077 10204 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:13.541723 14881 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:13.560516 15164 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.591933 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:13.592008 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:13.608966 10096 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.035s	sys 0.024s
I20260709 12:16:13.609565 10197 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:13.589402 15174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.005s	sys 0.012s
W20260709 12:16:13.593158 10201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.011s	sys 0.022s
I20260709 12:16:13.575943 15253 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:13.615123 10201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.023s
I20260709 12:16:13.564196 15170 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 12:16:13.598333 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 147381us
W20260709 12:16:13.609978 10096 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.036s	sys 0.025s
W20260709 12:16:13.594035 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.007s	sys 0.023s
W20260709 12:16:13.618620 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.007s	sys 0.023s
I20260709 12:16:13.592937 14842 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:13.563992 15058 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:16:13.619472 15058 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:13.619844 15058 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:13.619596 14842 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:13.618907 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 637472us
I20260709 12:16:13.620635 15058 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.621877 15058 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:13.622016 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.618887 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:13.617601 10199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.011s	sys 0.033s
W20260709 12:16:13.629758 10199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.011s	sys 0.033s
I20260709 12:16:13.590886 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:13.639047 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48264.8us
I20260709 12:16:13.651986 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.657936 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:13.643450 10196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.021s	sys 0.022s
W20260709 12:16:13.664609 10196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.021s	sys 0.022s
W20260709 12:16:13.669205 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.672091 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:13.617437 15341 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:13.720122 10048 raft_consensus.cc:606] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:13.633683 15278 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.645949 14713 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:13.720623 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 101879us
W20260709 12:16:13.743003 10127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 877) took 1510 ms (client timeout 1801 ms). Trace:
I20260709 12:16:13.776322 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:13.613924 15173 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.616362 15164 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.653808 15130 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:13.645666 15180 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:13.788396 10732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.012s	sys 0.020s
W20260709 12:16:13.790495 10732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.013s	sys 0.021s
W20260709 12:16:13.741540 15333 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:16:13.725589 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:13.683090 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.720945 15303 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:13.723357 15342 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:13.776664 10127 rpcz_store.cc:269] 0709 12:16:12.232154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.303706 (+ 71552us) service_pool.cc:224] Handling call
0709 12:16:13.742731 (+1439025us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001d6354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:13.742896 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849721088}
I20260709 12:16:13.748524 15160 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:13.730518 14823 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:13.794860 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 942) took 1499 ms. Trace:
I20260709 12:16:13.721448 15170 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:13.797303 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 127223us
I20260709 12:16:13.773900 10048 raft_consensus.cc:614] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:13.796499 10195 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:13.774770 15341 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:13.724117 15207 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.745657 15344 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:13.630390 15279 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.815577 15279 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.785060 15334 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:13.816947 10195 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:16:13.819711 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:13.820572 10735 raft_consensus.cc:2368] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16.
I20260709 12:16:13.785211 15063 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:16:13.802757 10204 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:16:13.787076 15157 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:13.744133 14888 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.807811 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:13.801615 15338 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:13.731050 10197 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:13.805347 10732 rpcz_store.cc:276] 0709 12:16:12.295093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.296559 (+  1466us) service_pool.cc:224] Handling call
0709 12:16:12.296862 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.297065 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:12.899298 (+602233us) log.cc:844] Serialized 14 byte log entry
0709 12:16:13.794529 (+895231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:13.794582 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:13.794623 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.794683 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.794801 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57970,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1564,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4043,"thread_start_us":1495161,"threads_started":2}
I20260709 12:16:13.817862 15170 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.806720 15174 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.830827 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:13.833033 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:13.833930 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.806658 14823 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:13.786062 15278 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.786996 14713 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.812659 15341 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:13.731045 15253 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.812634 15122 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.828613 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:13.823267 15331 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:13.838272 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 430266us
I20260709 12:16:13.803284 15303 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.838655 14804 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:13.842959 15122 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.844060 14976 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:16:13.844269 15097 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:13.846947 15345 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:16:13.850704 15253 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:13.851503 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1966) took 1042 ms. Trace:
I20260709 12:16:13.902779 10201 rpcz_store.cc:276] 0709 12:16:12.808776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.811954 (+  3178us) service_pool.cc:224] Handling call
0709 12:16:12.812253 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.820077 (+  7824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.820106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.867393 (+ 47287us) log.cc:844] Serialized 26 byte log entry
0709 12:16:13.615570 (+748177us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:13.615614 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.615690 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:13.851251 (+235561us) raft_consensus.cc:1685] finished
0709 12:16:13.851273 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.851439 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7433,"raft.queue_time_us":27549,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":589904,"threads_started":1,"wal-append.queue_time_us":949518}
I20260709 12:16:13.852797 15338 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.906818 15338 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.909108 15338 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.909627 15338 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:13.911187 15164 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.915145 15173 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.916282 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:13.916515 15340 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.919528 15170 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:13.920243 15356 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:13.920809 15356 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.837363 15174 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.924144 15174 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:13.822388 15344 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:13.926735 15344 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:13.853314 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:13.837983 14823 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:13.806902 15160 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.804510 15342 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.840409 15157 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:13.837594 15334 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:13.882647 15097 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.883175 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:13.972280 10048 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:13.874729 14804 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:13.887497 14976 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:16:13.889487 15346 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:16:13.890726 15350 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:16:13.991763 15160 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.993481 15303 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.994215 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 807) took 1630 ms. Trace:
I20260709 12:16:13.887547 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 937) took 1358 ms. Trace:
I20260709 12:16:13.900475 15278 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.902107 14713 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:13.928249 10046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.022s	sys 0.032s
W20260709 12:16:13.995537 10046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.022s	sys 0.032s
I20260709 12:16:13.971998 15340 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:13.932904 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 492200us
W20260709 12:16:13.997098 15206 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.003s
I20260709 12:16:13.997519 15206 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.999951 15341 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:13.910101 15338 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:13.975257 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 122143us
I20260709 12:16:13.983820 14804 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:14.028324 10170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.035s
W20260709 12:16:14.028970 10170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.035s
I20260709 12:16:13.985517 15097 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:13.994894 15157 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:13.974653 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.004s	sys 0.028s
W20260709 12:16:14.033943 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.004s	sys 0.028s
W20260709 12:16:14.035302 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:13.872233 15331 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.036890 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1969) took 1215 ms. Trace:
I20260709 12:16:13.993741 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 934) took 1469 ms. Trace:
I20260709 12:16:14.005669 10203 rpcz_store.cc:276] 0709 12:16:12.529037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.530239 (+  1202us) service_pool.cc:224] Handling call
0709 12:16:12.544881 (+ 14642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:13.438767 (+893886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.887271 (+448504us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54003142d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:13.887479 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054104320}
I20260709 12:16:13.981978 15180 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:14.027860 15338 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.029747 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.032848 14713 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:14.030671 10198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.022s
W20260709 12:16:14.049676 10198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.024s	sys 0.023s
W20260709 12:16:14.032040 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:14.031005 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 496750us
I20260709 12:16:13.994622 10734 rpcz_store.cc:276] 0709 12:16:12.363577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.363677 (+   100us) service_pool.cc:224] Handling call
0709 12:16:12.392405 (+ 28728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.423534 (+ 31129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.423563 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.424043 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:16:13.494664 (+1070621us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:13.494706 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.494778 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:13.888858 (+394080us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:13.993932 (+105074us) raft_consensus.cc:1685] finished
0709 12:16:13.993961 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.994157 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23221,"raft.queue_time_us":32264,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":89500032,"thread_start_us":1001024,"threads_started":1,"wal-append.queue_time_us":1158876}
I20260709 12:16:14.003643 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.026824 15341 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:14.052507 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48921.5us
W20260709 12:16:14.053231 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 277014us
I20260709 12:16:14.049067 15303 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:14.053854 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1965) took 1245 ms. Trace:
I20260709 12:16:14.053308 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.064323 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.037348 10199 rpcz_store.cc:276] 0709 12:16:12.821226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.880601 (+ 59375us) service_pool.cc:224] Handling call
0709 12:16:12.880918 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.881120 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:13.631222 (+750102us) log.cc:844] Serialized 14 byte log entry
0709 12:16:14.036350 (+405128us) log.cc:844] Serialized 14 byte log entry
0709 12:16:14.036559 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:14.036604 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:14.036651 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.036711 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:14.036834 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":843213,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":2393,"thread_start_us":1134178,"threads_started":2}
I20260709 12:16:13.981751 15334 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:14.037439 10200 rpcz_store.cc:276] 0709 12:16:12.524865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.527379 (+  2514us) service_pool.cc:224] Handling call
0709 12:16:12.527761 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.653281 (+125520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:12.653310 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.736169 (+ 82859us) log.cc:844] Serialized 26 byte log entry
0709 12:16:13.451314 (+715145us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:13.900215 (+448901us) log.cc:844] Serialized 14 byte log entry
0709 12:16:13.922909 (+ 22694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.993345 (+ 70436us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400360954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:13.993396 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:13.993442 (+    46us) raft_consensus.cc:1685] finished
0709 12:16:13.993542 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:13.993683 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273362,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":21347,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":288134016,"thread_start_us":1129092,"threads_started":2,"wal-append.queue_time_us":858815}
I20260709 12:16:14.040902 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.041512 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.070452 10737 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:14.028599 15130 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:14.030315 14677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.038s	sys 0.011s
W20260709 12:16:14.052241 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.057652 15256 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:14.067517 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.065382 10198 rpcz_store.cc:276] 0709 12:16:12.808486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.811048 (+  2562us) service_pool.cc:224] Handling call
0709 12:16:12.811303 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.811495 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:16:13.495394 (+683899us) log.cc:844] Serialized 14 byte log entry
0709 12:16:14.053522 (+558128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:14.053575 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:14.053616 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.053681 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:14.053797 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3236,"prepare.queue_time_us":912616,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5794,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4314,"thread_start_us":1237972,"threads_started":2}
I20260709 12:16:14.078787 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:14.079443 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.084209 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1968) took 1274 ms. Trace:
I20260709 12:16:14.072954 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.080853 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.058259 15313 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.059603 15342 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.085191 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:14.083423 14677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.038s	sys 0.011s
W20260709 12:16:14.051270 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 393385us
I20260709 12:16:14.052985 15173 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:14.053241 15174 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:16:14.083005 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:14.087008 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.128898 10199 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:14.113920 10734 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:14.088428 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.094096 10125 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:14.062947 15371 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:14.117646 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.134800 10203 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 19 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:16:14.118350 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:14.118108 15051 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.052403 14713 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.070894 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.143364 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.148861 10204 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:16:14.115141 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.151021 10122 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:14.056702 15170 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:16:14.116773 10126 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:14.123770 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.088671 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.073196 15341 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:14.123270 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:14.080387 15093 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.094898 15209 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:14.085259 15340 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:14.156340 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.156448 10121 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:14.119974 15299 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:14.160094 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:14.166148 10198 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:16:14.164377 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81444.9us
I20260709 12:16:14.168193 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:14.168486 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 139189us
I20260709 12:16:14.128532 15256 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:14.160817 15093 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.154228 15344 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:14.174845 10204 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:14.176973 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.082173 15130 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:14.174117 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 95405.4us
I20260709 12:16:14.176312 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.177563 10735 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:14.135296 15338 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:16:14.177942 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:14.163662 15364 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:16:14.178444 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.163379 14804 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:14.179788 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 96233us
W20260709 12:16:14.206229 10019 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.507s (SENT) [suppressed 11 similar messages]
I20260709 12:16:14.177551 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.181823 10732 raft_consensus.cc:2410] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:16:14.183180 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.183772 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.123495 15313 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.134900 15173 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.185012 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.216982 10737 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:14.214067 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.157869 15051 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.167017 14881 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:14.208784 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:14.184230 15206 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.207989 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.214123 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.215946 10198 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 9.
I20260709 12:16:14.217501 10737 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9.
I20260709 12:16:14.179615 15367 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:14.230578 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.159458 15371 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.213487 15347 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:16:14.231781 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.232538 10123 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:14.232954 15058 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:16:14.233218 15363 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:16:14.205492 14804 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:14.222122 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.212433 15379 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:14.179078 15344 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.227639 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.221246 14881 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:14.229597 15051 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.225502 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.232441 15347 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:14.233536 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.219328 15341 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:14.234241 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.218628 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.220044 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.268577 10731 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:14.269310 10732 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.231760 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.237844 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.238150 10735 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:14.240383 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.182379 15160 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:16:14.271103 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.204849 15334 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.217741 15369 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:14.241511 15374 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:14.271087 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.185910 15340 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.271998 15369 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:14.272395 15340 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.273144 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:14.274823 15294 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:14.272090 15374 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:14.275493 15374 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.274222 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.272459 15369 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:14.277556 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.255733 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.275101 15296 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:14.242590 10737 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 9: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:14.278810 10728 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:14.279034 15179 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:14.279484 15179 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.173746 15366 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:16:14.279737 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:14.280349 10728 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.259323 10128 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:14.271554 15367 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:14.280586 15366 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:14.281095 15367 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.281213 15366 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:14.278108 15294 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:14.260919 10122 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:14.281486 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.279853 15179 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.282275 10128 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:14.282112 15366 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.280670 10728 raft_consensus.cc:614] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:14.282797 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.259701 10123 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:14.284154 10122 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:14.284391 10728 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:14.284653 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.285059 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.278847 15296 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.285753 15296 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.281562 15367 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:14.288187 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.289381 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.285688 10728 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:16:14.248492 15344 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:14.271622 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.221998 15158 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:14.232807 15371 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.279853 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.181345 15256 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.294982 10737 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:14.296525 10128 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:14.274747 15340 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:14.223588 15331 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:14.242380 14804 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.267168 14881 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:14.250236 15361 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:16:14.257423 15352 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.533s	user 0.014s	sys 0.033s
I20260709 12:16:14.301469 10128 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:14.302140 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 97935.9us
I20260709 12:16:14.283352 15366 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:14.239581 15058 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.248384 15342 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:14.258618 15206 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:14.256568 15209 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.250499 15381 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.311728 15130 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.312863 15246 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:16:14.307240 15357 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:16:14.257318 14823 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:14.294061 15370 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:16:14.251959 15173 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.267995 15341 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.307010 15380 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:14.292140 15180 consensus_queue.cc:1175] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a29bed9eb81541dba9ec7a447986e01e" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 12:16:14.253222 15313 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.316210 15256 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:14.316751 10735 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
W20260709 12:16:14.318769 15377 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:16:14.260239 15347 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:14.241752 15063 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:16:14.280745 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.323439 10126 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:14.323244 10732 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
W20260709 12:16:14.370340 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 89657.9us
I20260709 12:16:14.370836 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1970) took 1549 ms. Trace:
W20260709 12:16:14.326843 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 91520.1us
I20260709 12:16:14.339305 14993 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:16:14.248406 15360 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:16:14.287773 15369 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.341846 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.389650 10054 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:14.389814 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48042.4us
I20260709 12:16:14.352229 10128 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:14.334331 15174 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.389281 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:14.307396 15158 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.336606 15342 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:14.346598 15209 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.351147 15246 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:14.365152 15375 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.360357 15341 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.387841 14713 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.330981 10730 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:14.352275 15381 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.407405 15246 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.408037  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:14.408685 15381 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.410089 10123 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:14.351420 15379 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:16:14.362805 15130 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.410959 15130 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.412286 14677 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:14.412737 10203 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:14.412966 15130 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.390472 15294 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:16:14.394793 15093 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.397248 14804 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.418648 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2648) took 2403 ms. Trace:
I20260709 12:16:14.419100 10046 rpcz_store.cc:276] 0709 12:16:12.015216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.015394 (+   178us) service_pool.cc:224] Handling call
0709 12:16:12.020404 (+  5010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.398647 (+378243us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:16:13.330269 (+931622us) log.cc:844] Serialized 14 byte log entry
0709 12:16:13.996173 (+665904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:13.996218 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:13.996257 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.418391 (+422134us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002486d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:14.418463 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:14.418588 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29506,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":71,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":890874368,"thread_start_us":1569837,"threads_started":2,"wal-append.queue_time_us":733237}
I20260709 12:16:14.420428 14804 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.420984 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.421708 15303 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:14.423069 15339 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.943s	user 0.004s	sys 0.000s
I20260709 12:16:14.424957 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.426043 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.421197 10733 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:16:14.391260 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:14.336334 15058 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:14.371610 15122 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.395556 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:14.376904 15340 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:14.366321 15380 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.389297 15254 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:16:14.371241 10202 rpcz_store.cc:276] 0709 12:16:12.821498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:13.108203 (+286705us) service_pool.cc:224] Handling call
0709 12:16:13.108592 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:13.148389 (+ 39797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:13.169771 (+ 21382us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:13.294037 (+124266us) log.cc:844] Serialized 26 byte log entry
0709 12:16:13.793946 (+499909us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:13.794009 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:13.794087 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:14.370648 (+576561us) raft_consensus.cc:1685] finished
0709 12:16:14.370671 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:14.370782 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":437364,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":437065,"threads_started":1,"wal-append.queue_time_us":754294}
I20260709 12:16:14.402815 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:14.393970 15331 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:14.401841 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.395992 15383 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:14.402624 15373 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.188s	user 0.001s	sys 0.002s
I20260709 12:16:14.429733 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.427503 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.396899 15342 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:14.380591 15371 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:16:14.451222 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:14.439152 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48513.5us
I20260709 12:16:14.440769 10202 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:16:14.426297 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:14.454218 10197 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:14.408699 15246 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:14.447865 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.456873 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.463739 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.466642 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.396797 15334 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:16:14.412654 14677 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:14.438657 15093 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:14.478996 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.396042 15174 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.482306 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:14.487025 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:14.439983 15254 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:14.487632 10053 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:14.412596 15374 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:14.472379 15387 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:16:14.447240 15331 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:14.492774 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:14.506835 10051 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:14.451249 15313 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:14.473119 15379 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:14.504948 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.511493 10128 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:14.405675 15375 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.500450 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:14.504058 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.506276 10019 leader_election.cc:400] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16.
I20260709 12:16:14.507723 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:14.478807 15338 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:14.511618 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 108174us
I20260709 12:16:14.489048 14993 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:16:14.513904 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:14.516053 10049 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:14.520030 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:14.521070 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.479084 15173 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:16:14.522794 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4935027050000826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 12:16:14.523026 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:14.523224 15388 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:14.524325 10019 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.522830 15395 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:14.537794 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.525121 15265 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:14.525827 15206 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:16:14.511178 15372 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:16:14.510169 15369 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:14.529713 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3144027050000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:16:14.527763 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:14.520614 15130 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:14.526587 15253 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:14.517580 15338 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:14.546358 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.505657 15296 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:14.550305 10169 connection.cc:256] RPC call timeout handler was delayed by -1.058316017999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:16:14.447078 15383 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.526718 15294 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:14.527174 14993 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:14.555429 10731 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:14.556969 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:14.564934 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.540385 15051 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:14.447407 15347 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.574150 15380 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.540230 15158 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.575058 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:14.567466 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:14.576894 10728 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:14.538074 15395 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:14.580871 10051 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:14.571844 14993 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.573009 15383 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.573374 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.583248 10128 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.551812 15122 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.573803 15051 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:14.570884 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.525830 15160 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:16:14.578233 10052 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:14.551873 15130 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:14.556097 14804 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:16:14.543058 14823 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.584107 10204 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:14.566637 15388 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:14.556332 15206 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:14.570531 15369 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:14.585072 15051 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.562001 15338 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:14.559986 15400 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.687613 15160 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:14.688072 15160 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:14.688871 15160 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.693229 15209 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.693925 15051 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.708254 15209 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.539772 14677 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.710419 15338 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.713013 15367 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.581893 14881 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.748631 14881 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:14.774104 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:14.714850 15375 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.715373 15369 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:14.583853 15331 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.717998 15296 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:14.718914 15174 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.720427 15206 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.587625 15130 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:14.680151 15396 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:14.723762 15400 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.736487 15179 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.821414 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:14.823983 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 286252us
I20260709 12:16:14.593994 15173 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.722890 15388 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.891764 10198 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:14.679323 15393 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:14.697769 15395 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.918231 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:14.923883 10197 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:14.921160 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:14.926522 14713 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:14.927057 14713 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:14.929507 14713 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:14.888772 15253 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:14.954964 10128 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:14.956216 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:14.956940 10128 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:14.992296 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:14.990236 10130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2513) took 2848 ms (client timeout 1691 ms). Trace:
W20260709 12:16:14.995362 10130 rpcz_store.cc:269] 0709 12:16:12.135225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.167135 (+ 31910us) service_pool.cc:224] Handling call
0709 12:16:14.983758 (+2816623us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400408154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:14.983910 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3141580160}
I20260709 12:16:14.996820 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:14.986056 15379 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:14.917309 15374 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:14.985558 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 778) took 2235 ms. Trace:
I20260709 12:16:14.940919 15393 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:15.001534 10055 rpcz_store.cc:276] 0709 12:16:12.750055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.750176 (+   121us) service_pool.cc:224] Handling call
0709 12:16:12.764546 (+ 14370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.883523 (+118977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.985250 (+2101727us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54003f1954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:14.985496 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32505216}
I20260709 12:16:14.916653 15173 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:14.992966 15395 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:15.014348 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 449452us
I20260709 12:16:14.998905 15379 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:15.013219 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.017163 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:15.027503 14881 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:15.028347 15294 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:15.028728 15294 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:15.029536 15294 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.030700 15294 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.033478 15173 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.038964 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.006537 15369 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.042673 15406 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:15.045095 15400 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.045852 15393 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.047910 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:15.050015 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:14.986878 15253 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.048755 10128 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:15.022150 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:15.055529 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.077839 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:15.078905 10129 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:15.079809 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.080901 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.084017 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.048234 15122 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:15.085242 10129 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:15.088836 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.090875 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:15.051550 15294 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:15.093873 10128 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:15.052131 15400 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:16:15.101321 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 179101us
I20260709 12:16:15.101837 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:15.103506 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.102835 10129 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:15.108353 10128 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:15.111644 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:15.100530 15058 consensus_meta.cc:287] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 12:16:15.112732 10128 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
W20260709 12:16:15.101106 15341 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.000s
I20260709 12:16:15.117403 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.119217 10128 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:15.120005 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.120683 10128 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:15.109892 15246 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.004s
I20260709 12:16:15.124469 10047 raft_consensus.cc:2410] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:16:15.121289 15341 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.103204 15400 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:15.126159 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:15.127357 10129 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:15.128450 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:15.129304 10129 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:15.129973 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.118132 15367 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.130604 10128 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:15.136296 10122 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:15.112591 15366 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:16:15.129030 15206 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.166350 15396 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:15.148715 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:15.167140 14842 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:15.121307 15379 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.166769 15206 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.169624 15206 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:15.158128 15344 consensus_meta.cc:287] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.000s
I20260709 12:16:15.118031 15058 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.178000 15051 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.179911 15058 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.181373 14888 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.138156 10129 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:15.182797 10129 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:15.161942 15400 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.185825 10203 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:15.151392 15279 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:15.151651 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.187547 10197 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:15.187799 10128 raft_consensus.cc:2410] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:16:15.154312 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:15.155349 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1975) took 2756 ms. Trace:
I20260709 12:16:15.188393 10121 rpcz_store.cc:276] 0709 12:16:12.398777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.744936 (+346159us) service_pool.cc:224] Handling call
0709 12:16:12.745157 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:14.163581 (+1418424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.155086 (+991505us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400230854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.155263 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3245231360}
W20260709 12:16:15.156960 15362 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.036s	user 0.003s	sys 0.008s
I20260709 12:16:15.158413 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.162884 10728 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:15.164192 15253 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.129254 15179 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.126500 15405 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:14.120251 10196 rpcz_store.cc:276] 0709 12:16:12.809373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.870938 (+ 61565us) service_pool.cc:224] Handling call
0709 12:16:12.896541 (+ 25603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.896751 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:16:13.667706 (+770955us) log.cc:844] Serialized 14 byte log entry
0709 12:16:14.083742 (+416036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:14.083881 (+   139us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:14.083922 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.084042 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:14.084157 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16950,"prepare.queue_time_us":827764,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":15209,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":36976,"thread_start_us":1011407,"threads_started":2}
W20260709 12:16:15.171550 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.194255 10200 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:15.195142 10019 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9.
I20260709 12:16:15.195814 10128 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:15.176457 15342 consensus_meta.cc:287] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:16:15.205348 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.206033 10197 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:15.206569 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:15.202953 15157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.008s	sys 0.014s
I20260709 12:16:15.209210 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:15.212898 10123 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 12:16:15.213599 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.187193 15279 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.212414 15388 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:15.217316 15388 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:15.217798 15388 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:15.208719 15405 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.222580 15122 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:16:15.211028 15157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.008s	sys 0.014s
I20260709 12:16:15.224010 15405 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.229923 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.230036 15279 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.230749 10196 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:15.236073 15257 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:15.236545 15257 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.236888 15257 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:15.238790 15354 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.504s	user 0.006s	sys 0.006s
I20260709 12:16:15.210904 15342 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.240865 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 821) took 1037 ms. Trace:
I20260709 12:16:15.241024 10732 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:15.241315 15342 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:15.243062 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.245213 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.245823 10046 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
W20260709 12:16:15.216028 15408 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:16:15.187330 15344 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.248905 15344 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.210884 15130 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.251217 15130 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.251466 15388 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.253626 15388 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.255060 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1986) took 1013 ms. Trace:
I20260709 12:16:15.255452 10122 rpcz_store.cc:276] 0709 12:16:14.241192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.290205 (+ 49013us) service_pool.cc:224] Handling call
0709 12:16:14.290510 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.140653 (+850143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.254797 (+114144us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54001e3a54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.254998 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932742528}
I20260709 12:16:15.258153 10126 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:15.216768 15341 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.262811 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.263460 10201 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:15.264325 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.270000 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.271082 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.271862 10053 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:15.272888 15332 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.881s	user 0.008s	sys 0.003s
I20260709 12:16:15.274166 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 804) took 2912 ms. Trace:
I20260709 12:16:15.274904 10046 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:16:15.270056 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:15.241272 10735 rpcz_store.cc:276] 0709 12:16:14.203018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.270836 (+ 67818us) service_pool.cc:224] Handling call
0709 12:16:15.240641 (+969805us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54006121d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:15.240763 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93569792}
I20260709 12:16:15.281893 10123 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
W20260709 12:16:15.285939 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 50582us
I20260709 12:16:15.287758 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.289635 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.274549 10736 rpcz_store.cc:276] 0709 12:16:12.361942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.362076 (+   134us) service_pool.cc:224] Handling call
0709 12:16:12.362389 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:12.414323 (+ 51934us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:12.414356 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:12.414858 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:16:12.849903 (+435045us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:12.849966 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:12.850261 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:15.272327 (+2422066us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:15.273903 (+  1576us) raft_consensus.cc:1685] finished
0709 12:16:15.273921 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.274091 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7673,"raft.queue_time_us":60818,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":17286,"spinlock_wait_cycles":3122432,"thread_start_us":405855,"threads_started":1,"wal-append.queue_time_us":918592}
I20260709 12:16:15.293326 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.297147 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.297673 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:15.310351 15405 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:15.311057 15405 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.313793 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.314832 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.331681 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.332019 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:15.333395 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.235495 15279 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.336200 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.339143 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.336596 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:15.341449 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.352079 14842 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:15.352602 14842 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.352927 14842 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:15.354729 15401 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.355254 15401 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.296876 15374 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:16:15.356197 15405 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.306471 15158 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:15.358836 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.363458 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.366863 10046 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:15.335748 15388 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:15.339331 15342 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.339141 15341 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:15.342262 15122 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:15.389297 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.365530 15157 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:15.386674 15341 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.386516 15388 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.398373 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2659) took 1020 ms. Trace:
I20260709 12:16:15.419081 10047 rpcz_store.cc:276] 0709 12:16:14.378286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.378655 (+   369us) service_pool.cc:224] Handling call
0709 12:16:15.398143 (+1019488us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540019e454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:15.398306 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602649984}
I20260709 12:16:15.398743 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.419559 15388 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.420694 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.420567  9952 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 9 to 10, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 10 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.421840 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.399268 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2660) took 1004 ms. Trace:
I20260709 12:16:15.404031 15356 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:15.405519 15349 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.670s	user 0.010s	sys 0.008s
I20260709 12:16:15.384545 15342 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.422564 10052 rpcz_store.cc:276] 0709 12:16:14.395131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.395288 (+   157us) service_pool.cc:224] Handling call
0709 12:16:15.399107 (+1003819us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400086e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:15.399212 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339892992}
I20260709 12:16:15.423754 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.424502 15342 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.410799 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1980) took 1238 ms. Trace:
I20260709 12:16:15.424783 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.425386 10052 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:15.416029 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.416668  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.427233  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.428750 15401 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.429013 10204 rpcz_store.cc:276] 0709 12:16:14.171886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.293280 (+121394us) service_pool.cc:224] Handling call
0709 12:16:14.300680 (+  7400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:14.586628 (+285948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.410530 (+823902us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000e9cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.410734 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651363072}
I20260709 12:16:15.399924 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1081) took 2741 ms. Trace:
W20260709 12:16:15.420111 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.426262 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.430341 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2532) took 1052 ms. Trace:
I20260709 12:16:15.448042 10129 rpcz_store.cc:276] 0709 12:16:14.377733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.183475 (+805742us) service_pool.cc:224] Handling call
0709 12:16:15.183729 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.183911 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:15.296927 (+113016us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.429855 (+132928us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b1800419140. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a
0709 12:16:15.430026 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:15.430076 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:15.430121 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.430179 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.430290 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161473,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3129,"spinlock_wait_cycles":87681792,"thread_start_us":201709,"threads_started":2}
I20260709 12:16:15.430568 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.462984 10055 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:15.433267 10052 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
W20260709 12:16:15.469772 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.384006 14804 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:15.477411 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:15.482496 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.469384 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:15.485227 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.485414 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:15.486661 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:15.487237 15344 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:15.483109 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.430557 10729 rpcz_store.cc:276] 0709 12:16:12.658355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:12.658512 (+   157us) service_pool.cc:224] Handling call
0709 12:16:12.728189 (+ 69677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:12.835409 (+107220us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:12.835739 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:16:13.496167 (+660428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:13.496223 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:13.496275 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.399699 (+1903424us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005d2354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.399746 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.399868 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":79,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12628,"spinlock_wait_cycles":298605184,"thread_start_us":660018,"threads_started":1,"wal-append.queue_time_us":818358}
I20260709 12:16:15.492937 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.495172 14842 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.499086 15405 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.502707 15173 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:15.507604 15208 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:15.425258 15338 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.510454 10055 raft_consensus.cc:2410] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:16:15.519547 15405 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.523586 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.509855 15344 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.533013 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.538018 10196 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:15.524349 15208 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.527058 15170 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:15.545552 15374 consensus_queue.cc:1243] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:16:15.556949 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 220417us
I20260709 12:16:15.547083 15344 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:15.558938 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.560581 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.552781 15208 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:15.562315 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1989) took 1044 ms. Trace:
I20260709 12:16:15.567798 10201 rpcz_store.cc:276] 0709 12:16:14.518073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.265948 (+747875us) service_pool.cc:224] Handling call
0709 12:16:15.266200 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.266371 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:15.383714 (+117343us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.561946 (+178232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:15.562007 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:15.562053 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.562119 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.562254 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118778,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":459,"thread_start_us":287159,"threads_started":2}
W20260709 12:16:15.553812 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 214697us
I20260709 12:16:15.580140 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:15.601401 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.601920 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:15.602562 15338 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:15.604450 15419 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.197s	user 0.002s	sys 0.001s
I20260709 12:16:15.606690 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1994) took 1075 ms. Trace:
I20260709 12:16:15.607836 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.618515 15340 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:15.639627 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2535) took 1241 ms. Trace:
I20260709 12:16:15.621028 10197 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:16:15.606998 14842 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.626494 10195 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:15.630726 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 955) took 1212 ms. Trace:
I20260709 12:16:15.633982 15405 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.590888 10196 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:15.601943 15257 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.637351 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:15.642804 10202 rpcz_store.cc:276] 0709 12:16:14.531720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.605806 (+1074086us) service_pool.cc:224] Handling call
0709 12:16:15.606199 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.606374 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.606398 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:15.606461 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:15.606490 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.606541 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.606636 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:15.643503 10201 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:16:15.646303 10732 rpcz_store.cc:276] 0709 12:16:14.418352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.418816 (+   464us) service_pool.cc:224] Handling call
0709 12:16:15.240790 (+821974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.241556 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.630506 (+388950us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54006121d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:15.630658 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889613184}
I20260709 12:16:15.643450 10121 rpcz_store.cc:276] 0709 12:16:14.398680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.189410 (+790730us) service_pool.cc:224] Handling call
0709 12:16:15.189711 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.189928 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:15.368167 (+178239us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.523669 (+155502us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.639050 (+115381us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.639282 (+   232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:15.639330 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:15.639377 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.639451 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.639568 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196921,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1057,"raft.queue_time_us":34196,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12603,"spinlock_wait_cycles":21011200,"thread_start_us":429912,"threads_started":3,"wal-append.queue_time_us":188262}
I20260709 12:16:15.650743 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:15.645931 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 159353us
W20260709 12:16:15.638556 15425 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 12:16:15.638650 15403 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:15.642997 15063 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:15.686741 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.638764 15338 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:15.688596 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:15.643744 15340 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:15.694406 10051 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:15.695210 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:15.645341 15173 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.645190 15429 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:15.698990 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:15.703240 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.720539 10196 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:15.697571 15388 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:16:15.691706 15063 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:15.730978 15063 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:15.731232 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 903) took 1293 ms. Trace:
I20260709 12:16:15.731657 10122 rpcz_store.cc:276] 0709 12:16:14.438332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.256314 (+817982us) service_pool.cc:224] Handling call
0709 12:16:15.256677 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:15.257060 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.257088 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:15.257587 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:16:15.484152 (+226565us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:15.484190 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.484249 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:15.731026 (+246777us) raft_consensus.cc:1685] finished
0709 12:16:15.731046 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.731176 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1889,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":3456,"thread_start_us":226237,"threads_started":1,"wal-append.queue_time_us":357330}
I20260709 12:16:15.688095 15270 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.733933 10202 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:15.736634 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:15.688774 14842 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:15.731732 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1994) took 1204 ms. Trace:
I20260709 12:16:15.696844 15338 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:15.742969 15436 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:16:15.737847 10125 rpcz_store.cc:276] 0709 12:16:14.527198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.275623 (+748425us) service_pool.cc:224] Handling call
0709 12:16:15.330798 (+ 55175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:15.331177 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.331205 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:15.331663 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:16:15.482023 (+150360us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:15.482059 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.482117 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:15.731534 (+249417us) raft_consensus.cc:1685] finished
0709 12:16:15.731553 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.731678 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":687,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6953,"thread_start_us":112662,"threads_started":1,"wal-append.queue_time_us":212497}
I20260709 12:16:15.739789 15208 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.748312 15208 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.739665 15340 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:15.750501 15340 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:15.739198 14842 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.751976 14842 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.702380 15431 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:16:15.754877 15442 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:15.698098 15303 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:15.690990 15380 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:16:15.740927 15257 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:15.757081 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.757717 15341 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:15.754902 15208 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:15.761536 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:15.762825 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:15.767364 15437 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:16:15.769297 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:15.771137 15270 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:15.701437 15403 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.780054 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.696204 15440 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:16:15.781960 10195 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:15.780629 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 57415us
I20260709 12:16:15.785956 10052 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:15.701206 15374 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:16:15.788471 10052 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:15.788956 10052 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.795414 10047 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:15.791627 10052 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.801201 10052 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.794605 15090 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:16:15.822377 15278 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:15.822876 15278 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.823652 15278 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.825007 15278 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:15.833606 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 134688us
I20260709 12:16:15.826805 15431 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:16:15.838596 15431 consensus_queue.cc:1243] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:16:15.839370 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:15.842288 15063 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.845549 15063 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.843346 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:15.829391 15344 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.839255 15090 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:16:15.849812 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.842167 15443 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:15.849319 15090 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:15.852234 15090 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.857957 15443 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.862764 15443 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:15.863219 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:15.864091 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.864506 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.867043 15273 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:15.870800 10052 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:16:15.871115 10052 pending_rounds.cc:85] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 12
I20260709 12:16:15.871315 10052 pending_rounds.cc:107] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:16:15.871520 10052 raft_consensus.cc:2889] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:15.851308 15380 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:15.846252 14842 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:15.876302 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 116910us
I20260709 12:16:15.877913 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.879807 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.880331 10052 raft_consensus.cc:2368] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20.
I20260709 12:16:15.880877 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.881507 10195 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:15.869717 15404 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:15.888940 15353 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 2.166s	user 0.013s	sys 0.014s
I20260709 12:16:15.876639 15157 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:15.888347 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.895411 10195 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:15.890699 10732 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:16:15.874264 15431 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:16:15.891947 10204 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:15.892324 10729 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:16:15.874666 15380 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:15.840306 15403 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.899619 10204 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:15.901654 10195 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:15.902948 10195 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:15.907577 14842 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.878445 15338 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.913921 10204 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:15.915163 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:15.917405 10195 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:15.898847 15380 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:15.894587 15404 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.923702 15404 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.924932 15173 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:15.925222 10195 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:15.931939 15371 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:15.918145 15340 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:16:15.937201 15431 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:15.938871 15431 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.940357 15254 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.941633 15254 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:16:15.942448 15338 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.943486 15344 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:15.945055 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.945792 10053 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:15.946689 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.947680 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.948645 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.949569 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:15.950618 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:15.952802 15428 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.544s	user 0.001s	sys 0.001s
I20260709 12:16:15.941025 15431 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:15.956151 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 902) took 1525 ms. Trace:
I20260709 12:16:15.956492 14804 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:15.956975 14804 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:15.958881 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:15.959051 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:15.960064 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:15.961282 15246 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:15.961645 15246 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:15.956525 10128 rpcz_store.cc:276] 0709 12:16:14.431102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.209739 (+778637us) service_pool.cc:224] Handling call
0709 12:16:15.210108 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:15.210342 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.210370 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:15.214146 (+  3776us) log.cc:844] Serialized 26 byte log entry
0709 12:16:15.385581 (+171435us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:15.385623 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.385695 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:15.952232 (+566537us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:15.955849 (+  3617us) raft_consensus.cc:1685] finished
0709 12:16:15.955869 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:15.956092 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51145984,"thread_start_us":71609,"threads_started":1,"wal-append.queue_time_us":172688}
I20260709 12:16:15.962728 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:15.964129 15246 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:15.966123 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.966894 10201 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:15.945782 10169 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.531s (SENT)
I20260709 12:16:15.967478 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:15.967677 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.971750 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:15.972282 15400 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:15.976176 15208 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:15.976560 15208 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:15.977360 15208 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:15.979866 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1979) took 1808 ms. Trace:
I20260709 12:16:15.980206 10198 rpcz_store.cc:276] 0709 12:16:14.171643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.283259 (+111616us) service_pool.cc:224] Handling call
0709 12:16:14.283549 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:14.905907 (+622358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.979648 (+1073741us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54000eb0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.979811 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398333696}
W20260709 12:16:15.986673 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:15.986955 15347 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:15.989781 15421 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.582s	user 0.003s	sys 0.000s
I20260709 12:16:15.993934 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:15.996208 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2539) took 1562 ms. Trace:
I20260709 12:16:15.996605 10123 rpcz_store.cc:276] 0709 12:16:14.434155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.213688 (+779533us) service_pool.cc:224] Handling call
0709 12:16:15.234842 (+ 21154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.295326 (+ 60484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.995940 (+700614us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400409554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:15.996145 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107700608}
I20260709 12:16:15.998174 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:16.002863 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:16.003904 15429 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:16.004405 15429 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:16.004863 10047 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:16.005678 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:16.008867 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:16.009486 10055 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:16.011688 10047 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:16:16.013708 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 1982) took 1841 ms. Trace:
W20260709 12:16:16.016007 15130 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:16:16.018082 15384 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.468s	user 0.004s	sys 0.013s
I20260709 12:16:16.019904 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 948) took 1892 ms. Trace:
I20260709 12:16:16.021091 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:16.022418 10053 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:16.020588 10047 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:16.027464 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:16.028884 15246 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:16.029456 15208 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:16.030257 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:16.030926 10730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 815) took 2209 ms (client timeout 1645 ms). Trace:
I20260709 12:16:16.031705 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:16.033020 10732 raft_consensus.cc:1217] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Deduplicated request from leader. Original: 12.11->[14.12-15.13]   Dedup: 14.12->[15.13-15.13]
I20260709 12:16:16.033506 10732 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 12:16:16.034286 15090 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:16:16.035800 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 90047.8us
I20260709 12:16:15.972332 10195 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:16.077286 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:16.078728 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:16.014068 10203 rpcz_store.cc:276] 0709 12:16:14.172377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.413468 (+241091us) service_pool.cc:224] Handling call
0709 12:16:14.413741 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:15.186262 (+772521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:16.013499 (+827237us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540007d854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:16.013654 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775179520}
I20260709 12:16:16.048319 10733 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:16.047447 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:16.031302 10730 rpcz_store.cc:269] 0709 12:16:13.821558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:13.821659 (+   101us) service_pool.cc:224] Handling call
0709 12:16:16.030738 (+2209079us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540029e0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:16.030861 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959742848}
I20260709 12:16:16.059790 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:16.080178 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:16.044379 15441 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
W20260709 12:16:16.043203 15424 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.400s	user 0.002s	sys 0.000s
I20260709 12:16:16.048933 14677 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:16.060644 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 421235us
I20260709 12:16:16.087558 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:16.088219 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:16.058002 10051 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:16:16.088547 10204 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:16.054883 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:16.091826 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:16.064265 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74832.1us
I20260709 12:16:16.020228 10199 rpcz_store.cc:276] 0709 12:16:14.127526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.147004 (+ 19478us) service_pool.cc:224] Handling call
0709 12:16:14.147339 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:14.159420 (+ 12081us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:14.175698 (+ 16278us) log.cc:844] Serialized 14 byte log entry
0709 12:16:14.479528 (+303830us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:14.489699 (+ 10171us) log.cc:844] Serialized 52 byte log entry
0709 12:16:14.489836 (+   137us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:14.489866 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:14.489924 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:16.017580 (+1527656us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:16.019595 (+  2015us) raft_consensus.cc:1685] finished
0709 12:16:16.019710 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:16.019849 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11629,"prepare.queue_time_us":11255,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":61722,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":7180,"spinlock_wait_cycles":34442112,"thread_start_us":266144,"threads_started":1,"wal-append.queue_time_us":325042}
I20260709 12:16:16.059073 15160 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:16.066912 15173 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:16.078948 10728 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:16.081141 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:16.078320 10055 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:16.095623 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:16.096735 10055 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:16.085701 10052 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:16.037722  9952 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 4 to 9, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 9 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:16.086556 15265 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:16.088336 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:16.099679 10055 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:16:16.104023 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:16.101092 10052 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 12:16:16.103065 10051 pending_rounds.cc:85] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 7
I20260709 12:16:16.104956 10051 pending_rounds.cc:107] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:16:16.105234 10051 raft_consensus.cc:2889] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:16.105995 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:16.106909 10199 raft_consensus.cc:2410] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:16:16.108968 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:16.113682 10052 pending_rounds.cc:85] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 15
I20260709 12:16:16.113489 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:16.115617 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:16.115818 10053 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:16:16.114009 10052 pending_rounds.cc:107] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 12:16:16.117853 10052 raft_consensus.cc:2889] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:16.118585 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.119204 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.119575 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.120093 10125 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:16.119221 10124 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:16.117404 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:16.124151 15431 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:16.124547 15431 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:16.124909 15431 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:16.126605 15256 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:16.127779 15382 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:16.128141 15382 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:16.129005 15382 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.132200 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.137759 15366 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:16.138844 15056 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:16.138927 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.139267 15056 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:16.140115 15056 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.142789 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.143172 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.143538 10129 raft_consensus.cc:2368] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20.
I20260709 12:16:16.140534 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.142216 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.144722 10122 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:16.146170 10125 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:16.112118 15090 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:16.103364 15158 raft_consensus.cc:2764] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:16:16.156490 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.157646 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:16.159430 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.160359 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 62906.3us
I20260709 12:16:16.162065 10125 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:16:16.164898 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49370.4us
I20260709 12:16:16.166801 10124 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:16.163905 15391 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:16.169482  9948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 274) took 27024 ms (client timeout 15000 ms). Trace:
I20260709 12:16:16.170130 15388 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:16.171064 10127 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:16:16.170814 15279 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:16.171526 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.171403 15157 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:16.154944 15130 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:16:16.115094 15404 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:16:16.154985 15338 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:16.176258 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:16.176613 15303 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:16.181213 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:16.158299 10121 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:16.256384 10204 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:16.186131 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 82185us
I20260709 12:16:16.186872 10203 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:16:16.113866 15169 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:16.150416 15090 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.153226 15443 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.102643 14976 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:16.176151 14804 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.177837 15270 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:16:16.163439 15344 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:16.254462 15157 consensus_queue.cc:1243] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:16.188530 15403 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:16.216663 10050 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 19 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:16:16.116302 15331 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:16:16.155923 15265 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:16.188789 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.223024 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.189394 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:16.199052 10129 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:16:16.205595 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 904) took 1765 ms. Trace:
I20260709 12:16:16.278537 10204 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:16:16.211576 10200 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:16.278960 10204 pending_rounds.cc:85] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:16.279276 10204 pending_rounds.cc:107] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.11
W20260709 12:16:16.189625 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.190169 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.279505 10204 raft_consensus.cc:2889] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:16.226457 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 117564us
I20260709 12:16:16.210708  9952 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 10 to 11, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 11 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:16.228506 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 152627us
I20260709 12:16:16.230396 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:16.234290 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 333306us
I20260709 12:16:16.233584 10123 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:16.278685 10126 rpcz_store.cc:276] 0709 12:16:14.440225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.259532 (+819307us) service_pool.cc:224] Handling call
0709 12:16:15.259876 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:15.260254 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:15.260283 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:15.260856 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 12:16:15.437983 (+177127us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:15.508776 (+ 70793us) log.cc:844] Serialized 14 byte log entry
0709 12:16:15.508991 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:15.509068 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:16.042613 (+533545us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:16.205262 (+162649us) raft_consensus.cc:1685] finished
0709 12:16:16.205367 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:16.205518 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51845,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":5591,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":33726,"spinlock_wait_cycles":6037248,"thread_start_us":176706,"threads_started":1,"wal-append.queue_time_us":294021}
W20260709 12:16:16.287438 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.215909 15429 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:16.252521 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.184176 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 70753.7us
I20260709 12:16:16.257629 10199 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:16:16.256474 10197 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:16.268042 15338 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:16.258291 15380 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.203717 15342 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:16.193975 15401 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.263067 10737 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:16.206555 15438 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:16.266774 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.232967 15173 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:16.194172 15253 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:16:16.264261 15090 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:16.278369 10195 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 13: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:16.283373  9952 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:16.282241 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:16.286854 15331 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:16.270164 14976 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.296108 15403 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:16.267586 15303 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:16.259709 10122 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:16.390141 10049 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:16.390982 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.391718 10122 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:16.204267 15376 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.299815 10169 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:16.275017 14713 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.349524 10125 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:16.353578 10731 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:16:16.253026 15391 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:16.355616 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54987.2us
I20260709 12:16:16.362298 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.350636 15342 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:16.364172 10197 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:16.293589 15440 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.382591 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:16.293493 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.383576 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 101404us
I20260709 12:16:16.407063 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:16.373636 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:16.394343 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 94609us
I20260709 12:16:16.394806 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:16.355548 15270 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:16.354954 15257 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.398679 10127 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:16.399416 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.425930 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.427091 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:16.376924 15451 log.cc:927] Time spent T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:16:16.408412 10169 leader_election.cc:400] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20.
I20260709 12:16:16.427896 10169 leader_election.cc:403] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:16.408243 10125 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:16.397856 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:16.433650 10128 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:16.437968 10122 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:16.350976 15347 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:16:16.438546 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:16.378410 15331 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:16.441411 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2413) took 1133 ms. Trace:
I20260709 12:16:16.390648 15173 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:16.391223 15386 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.441804 10050 rpcz_store.cc:276] 0709 12:16:15.296616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.296896 (+   280us) service_pool.cc:224] Handling call
0709 12:16:16.427294 (+1130398us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54003f1454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:16.430342 (+  3048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112678784}
I20260709 12:16:16.450006 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.361287 15401 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.380359 15278 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:16:16.450831 10125 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:16.451484 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53702us
I20260709 12:16:16.397245 15400 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:16.453554 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:16.460532 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52290.2us
I20260709 12:16:16.461746 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2422) took 1069 ms. Trace:
I20260709 12:16:16.462167 10049 rpcz_store.cc:276] 0709 12:16:15.392748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.415680 (+ 22932us) service_pool.cc:224] Handling call
0709 12:16:16.461543 (+1045863us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54002774d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:16.461679 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216109440}
I20260709 12:16:16.462819 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:16.463765 10125 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:16:16.464165 10125 pending_rounds.cc:85] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 8
I20260709 12:16:16.464365 10125 pending_rounds.cc:107] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:16:16.465883 10125 raft_consensus.cc:2889] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:16.464620  9952 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 7 to 9, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 9 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:16.460570 10129 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:16.464723 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1088) took 2028 ms (client timeout 1801 ms). Trace:
W20260709 12:16:16.470842 10737 rpcz_store.cc:269] 0709 12:16:14.436606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:14.436741 (+   135us) service_pool.cc:224] Handling call
0709 12:16:16.464555 (+2027814us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54005efbd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:16.464661 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4063886080}
W20260709 12:16:16.474648 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 123847us
I20260709 12:16:16.484457 10121 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:16.447180 15344 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:16.493937 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:16.404695 15376 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.456959 15365 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:16.496549 10121 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:16.455750 15463 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.456768 15360 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:16.445818 15257 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.416855 14713 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.447784 15340 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 12:16:16.518971 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.431795 15440 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.506088 10129 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:16:16.619318 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.620635 10121 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:16.567351 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 73479.9us
W20260709 12:16:16.591485 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.403887 15265 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.639001 10129 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:16.495975 15253 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.498687 15256 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:16.504730 15164 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:16.650883 10125 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:16.499133 15208 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:16.445663 15270 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.519820 15360 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.650061 15334 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.567888 15341 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:16.687384 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 65946.7us
I20260709 12:16:16.453027 15338 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.654647 15256 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:16.454875 15386 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:16.647915 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 72030.2us
I20260709 12:16:16.520120 15469 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20.
W20260709 12:16:16.727255 15461 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:16:16.728801 15440 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.729773 10123 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:16.705741 15462 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:16.734033 15429 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.684574 15164 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:16.679737 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 216981us
I20260709 12:16:16.682308 14804 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.489902 15342 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.691315 15360 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:16.745921 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 307447us
W20260709 12:16:16.762982 15449 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 12:16:16.690411 15443 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:16.516182 15303 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.568068 15463 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.778815 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:16.515988 15403 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:16.851435 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 72721.6us
I20260709 12:16:16.852411 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:16.684077 15253 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.800307 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:16.803423 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 77829.2us
I20260709 12:16:16.825214 15273 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:16.826545 15056 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:16.829375 15170 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:16.830740 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.832789 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.701783 15341 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.679498 15382 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:16.847170 10729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.009s
W20260709 12:16:16.911597 10729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.009s
I20260709 12:16:16.697391 15279 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:16:16.698705 15334 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.791294 15340 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.872915 10203 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:16.735776 15063 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:16.935690 15063 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:16.936085 15270 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.936617 15063 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.936908 15170 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:16.937824 15063 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:16.897279 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 97066.5us
I20260709 12:16:16.938982 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:16.519517 15331 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.940953 15340 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.942677 10195 pending_rounds.cc:85] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:16.942960 10195 pending_rounds.cc:107] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:16:16.943186 10195 raft_consensus.cc:2889] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:16.944280 15471 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.793758 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:16.897923 15380 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.838486 15164 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:16.952133 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 158438us
I20260709 12:16:16.863338 15374 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:16:16.901139 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.897660 15273 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:16.911348 10196 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:16:16.906466 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54123.7us
I20260709 12:16:16.961771 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:16.910606 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:16.903736 10050 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:16.962932 10121 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:16.922446 10202 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:16.910126 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:16.925489 15467 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:16:16.231160  9948 rpcz_store.cc:269] 0709 12:15:49.145002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.146272 (+  1270us) service_pool.cc:224] Handling call
0709 12:16:16.169241 (+27022969us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:07.273284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:07.373529 (+100245us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:07.373563 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:16:07.373581 (+    18us) tablet.cc:662] Decoding operations
0709 12:16:07.482849 (+109268us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:07.485497 (+  2648us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:07.486945 (+  1448us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:16:07.539876 (+ 52931us) tablet.cc:701] Row locks acquired
0709 12:16:07.539897 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:16:07.540065 (+   168us) write_op.cc:270] Start()
0709 12:16:07.540183 (+   118us) write_op.cc:276] Timestamp: P: 1783599367540012 usec, L: 0
0709 12:16:07.540202 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:16:07.540900 (+   698us) log.cc:844] Serialized 7520 byte log entry
0709 12:16:08.200413 (+659513us) op_driver.cc:464] REPLICATION: finished
0709 12:16:08.848054 (+647641us) write_op.cc:301] APPLY: starting
0709 12:16:08.848144 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:08.872153 (+ 24009us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:08.872268 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:09.272201 (+399933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:09.272553 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 12:16:09.272607 (+    54us) write_op.cc:312] APPLY: finished
0709 12:16:09.273269 (+   662us) log.cc:844] Serialized 172 byte log entry
0709 12:16:09.502550 (+229281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:09.570597 (+ 68047us) write_op.cc:454] Released schema lock
0709 12:16:09.572433 (+  1836us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:09.572970 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:09.573001 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4216541,"reported_tablets":50,"spinlock_wait_cycles":15744,"child_traces":[["op",{"apply.queue_time_us":641048,"apply.run_cpu_time_us":53118,"apply.run_wall_time_us":724870,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":196515,"prepare.run_cpu_time_us":38287,"prepare.run_wall_time_us":481906,"raft.queue_time_us":349675,"raft.run_cpu_time_us":192176,"raft.run_wall_time_us":600854,"replication_time_us":638515,"thread_start_us":1207672,"threads_started":5,"wal-append.queue_time_us":450927,"wal-append.run_cpu_time_us":35199,"wal-append.run_wall_time_us":2464719}]]}
I20260709 12:16:16.900617 15462 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:16:16.902765 14976 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.849071 15344 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.900821 10129 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
W20260709 12:16:16.958184 15431 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.001s
I20260709 12:16:16.901598 10123 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:16.939210 15170 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:16.945657 15391 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:16.951438 15472 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:16:17.001538 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 276545us
W20260709 12:16:16.982372 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.008198 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:17.008983 10737 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:17.009506 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:17.009390 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:16.980032 15401 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:16.981726 15444 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.972100 14804 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:16:16.987485 14677 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.003s
I20260709 12:16:17.001893 15431 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:16.900501 15470 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 12:16:17.070080 10728 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:16.987965 15380 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:17.074906 10130 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:16.986330 15097 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:17.064263 10729 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:16:16.962446 15469 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:16:16.998572 15170 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:16.996224 15464 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:16.995012 15344 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:17.059221 15474 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.997949 15440 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:17.072691 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:16.949074 15471 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.062217 15443 raft_consensus.cc:2764] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:16:17.071072 15431 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:16.967700 15256 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.104302 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:17.090060 15477 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:17.083976 15376 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.086325 15254 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.119078 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.120038 10049 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 19 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 12:16:17.093614 14804 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:17.123994 10048 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
W20260709 12:16:17.128154 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 189256us
I20260709 12:16:17.118585 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:17.061698 15273 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.109834 15462 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.067585 15472 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:16:17.130409 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.115880 15469 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:17.136603 15469 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:17.137476 15469 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.139940 15344 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.127295 15477 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.140754 15477 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.089255 15097 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.072355 15444 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.110755 15340 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.102849 15440 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:17.134174 15169 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 12:16:17.155048 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:17.135684 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 173999us
I20260709 12:16:17.126873 14804 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:17.160763 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:17.166239 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.100174 15464 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:17.173761 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.126335 15254 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.160951 15273 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:17.184185  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.107434 15474 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.167631 15169 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:17.174978 15376 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:17.162891 15482 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:17.162550 15340 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:17.168414 15341 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:17.199996 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 289943us
I20260709 12:16:17.161685 15469 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:17.203435 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.184878 15170 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.171386 15481 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:16:17.142680 15462 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:17.207543 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.191256 15158 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:17.210754 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:17.212292 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.210853 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.188556 15380 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:17.215859 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.175516 15279 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:16:17.192201 15334 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.209664 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:17.218617 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.215598 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.212332 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.196915 15463 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.222479 10201 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:17.259922 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.260304 15462 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.260730 10201 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:16:17.233706 15478 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:17.203934 14804 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.262853 14804 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:17.233103 15380 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.274756 15380 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.277917 15471 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.279703 15097 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:17.282151 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69883us
I20260709 12:16:17.223781 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.283282 10198 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:17.223059 10196 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:17.228904 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.286458 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.286830 10049 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:17.187529 15265 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:16:17.288098 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.233762 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:17.289135 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55464.9us
I20260709 12:16:17.205873 15483 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:17.228205 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.289922 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.238415 10054 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:16:17.219482 15344 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.249627 10123 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:17.221697 15158 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:17.222021 15170 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.213121 15376 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.254112 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.297832 10199 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:17.257819 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.204007 15477 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.298488 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.291052 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.299671 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.300275 10123 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:17.300575 15491 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:17.301019 15491 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.301342 15491 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:17.303678 15090 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.000s
I20260709 12:16:17.303961 15440 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.304092 15090 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.291944 15334 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:17.293913 15476 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:17.306035 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.295140 15483 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.307591 15253 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.308702 15483 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.294107 15164 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.310652 15254 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.311177 15254 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.311650 15254 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.297103 15344 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.314841 15386 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.315374 15344 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.316403 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.317010 10729 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:17.317931 15164 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.298857 10197 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:17.320029 15474 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.321523 15464 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.314284 15090 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.291808 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.296525 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.251161 15444 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.324119 10053 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:17.289845 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.313640 15254 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.322616 10121 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:17.217697 15340 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.296422 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.329946 15340 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.301203 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.318171 10129 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:17.330840 10123 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:17.332130 10123 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:17.305759 15158 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.289043 15499 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:17.327095 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.327427 15482 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:17.335667 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:17.335779 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.343436 10195 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:17.343580 10046 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:17.325353 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.338791 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.344502 10201 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:17.345391 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.335908 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:17.299608 15380 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:17.340051 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.346454 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:17.336885 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.346959 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.348582 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.293274 15471 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:16:17.339663 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.326596 15164 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.366312 15164 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:17.368474 15164 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.349934 15380 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:17.351622 15475 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:17.343127 15482 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.394711 15491 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.352219 10736 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:17.352308 15501 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:17.397423 15501 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.397843 15501 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:17.394761 15482 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:17.402594 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:17.405898 15257 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.408262 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2551) took 1267 ms. Trace:
I20260709 12:16:17.408704 10128 rpcz_store.cc:276] 0709 12:16:16.141293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.141980 (+   687us) service_pool.cc:224] Handling call
0709 12:16:17.408075 (+1266095us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54003a0554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:17.408195 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663680768}
I20260709 12:16:17.417384 10195 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:17.419005 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.420032 10195 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:17.352101 10201 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:17.353156 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.421399 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:17.342530 15273 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:16:17.355430 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.357928 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.359130 15403 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:17.425098 15403 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.425488 15403 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:17.360133 15342 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:17.364308 15279 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:17.434660 15279 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:17.435160 15279 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:17.344317 15246 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:17.438566 15246 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.439033 15246 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:17.370901 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.362193 15278 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:17.334571 15170 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.374919 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.375629 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.442835 10737 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:16:17.381248 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.377012 15173 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.325945 15386 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:16:17.352705 15477 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:16:17.421655 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:17.446880 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 487222us
I20260709 12:16:17.393041 15462 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:17.450661 15164 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:17.451754 15496 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:17.452137 15496 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:17.452978 15496 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.377504 15475 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.458146 15475 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:17.459085 10130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2536) took 3025 ms (client timeout 1757 ms). Trace:
W20260709 12:16:17.459523 10130 rpcz_store.cc:269] 0709 12:16:14.433288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.001449 (+568161us) service_pool.cc:224] Handling call
0709 12:16:17.458847 (+2457398us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400408154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:17.459011 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4719008640}
I20260709 12:16:17.460934 10127 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:16:17.461318 10127 pending_rounds.cc:85] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 10
I20260709 12:16:17.461547 10127 pending_rounds.cc:107] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:16:17.461791 10127 raft_consensus.cc:2889] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:17.445995 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.463152 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2557) took 1305 ms. Trace:
W20260709 12:16:17.463761 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.463502 10127 rpcz_store.cc:276] 0709 12:16:16.157424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.430490 (+273066us) service_pool.cc:224] Handling call
0709 12:16:17.460581 (+1030091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.462200 (+  1619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:17.462972 (+   772us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400408150. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:17.463100 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353145088}
I20260709 12:16:17.465400 15256 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:17.469435 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:17.470188 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.470856 15056 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:17.471483 15056 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.373694 15090 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:16:17.347456 15483 consensus_queue.cc:1175] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:16:17.473783 15090 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.474227 15090 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:17.449410 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:17.483273 10195 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:17.483217 15478 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:16:17.423883 15491 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.376628 15380 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:17.449791 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.450182 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.487439 10200 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:17.376817 15382 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.473783 10124 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:16:17.488507 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:17.489024 10121 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:17.490188 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.377305 15470 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:17.393414 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.470974 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 911) took 1303 ms. Trace:
I20260709 12:16:17.495349 10125 rpcz_store.cc:276] 0709 12:16:16.167370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.466673 (+299303us) service_pool.cc:224] Handling call
0709 12:16:16.496261 (+ 29588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:16.680716 (+184455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:17.470736 (+790020us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001d5954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:17.470914 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330753408}
W20260709 12:16:17.479132 15360 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 12:16:17.477792 10053 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:17.445758 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:17.481930 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:17.482662 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:17.491093 10731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
W20260709 12:16:17.497270 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51609.1us
I20260709 12:16:17.497700 10731 raft_consensus.cc:606] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.491631 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.498106 10731 raft_consensus.cc:614] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:17.498721 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.492287 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.497336 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.453439 14713 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.491894 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.492342 10195 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:17.504588 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.505544 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.479873 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:17.488044 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.442790 15278 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:17.507457 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.413030 15501 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.528090 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.528839 10737 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:17.506461 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.500298 10200 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:17.508219 10127 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:17.509208 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.509582 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.506312 10128 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:17.533870 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.537439 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.538231 10200 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:17.543237 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.540831 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.545804 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:17.546725 14713 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:17.547603 14713 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:17.547987 14713 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.547890 15444 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:17.548666 15444 consensus_queue.cc:1243] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:16:17.548491 14713 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:17.549108 15400 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:17.549607 15400 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:17.549584 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53814.9us
W20260709 12:16:17.548564 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.550594 15400 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:17.551474 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.551819 15400 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:17.555195 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:17.556707 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.557483 10050 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:17.558538 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:17.559826 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.562980 14713 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.566970 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:17.567955 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.569595 14713 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:17.570982 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5979719669999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 12:16:17.571624 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:17.572546 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5583719670000846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 12:16:17.562136 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:17.576398 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:17.577006 10128 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:17.572956 10169 connection.cc:256] RPC call timeout handler was delayed by -1.5574719670000832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:16:17.587744 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:17.588125 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4683719669999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:16:17.588551 10169 connection.cc:256] RPC call timeout handler was delayed by -1.417971967000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:16:17.588820 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4161719670000821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:16:17.589069 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3810719670000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:16:17.589586 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3387719669999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:16:17.589874 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:17.590998 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57219.6us
I20260709 12:16:17.591404 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.591785 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:17.592587 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.590492 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:17.593179 10200 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:17.595851 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.598151 10121 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:17.600665 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.602010 10048 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
W20260709 12:16:17.603165 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:17.603587 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.603016 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:17.502714 15463 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:17.509891 15466 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:16:17.606140 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63026.9us
I20260709 12:16:17.525246 15443 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:17.450006 15173 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.608011 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.570973 15478 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:17.502930 15445 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.096s
I20260709 12:16:17.599541 15499 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:17.541172 15253 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:17.541004 15170 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:17.538314 15486 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:17.494288 15340 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 12:16:17.538992 15273 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:17.617708 10127 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:17.625023 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:17.497560 15382 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.539667 15371 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:17.593552 15056 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.620893 10128 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:17.612385 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.599532 15444 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.632192 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:17.620229 15063 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 12:16:17.607942 15464 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:17.501921 15470 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.509665 15360 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.649444 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 906) took 1491 ms. Trace:
I20260709 12:16:17.819166 10122 rpcz_store.cc:276] 0709 12:16:16.157924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.438904 (+280980us) service_pool.cc:224] Handling call
0709 12:16:17.408535 (+969631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.408723 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:17.408747 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:17.408787 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:17.408817 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:17.408867 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:17.649259 (+240392us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54003a0550. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:17.649378 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229203712}
I20260709 12:16:17.820927 10122 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:16:17.615670 15480 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:17.762326 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.610726 15474 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:17.628508 15431 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:17.767372 10202 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:17.625139 15338 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:17.767905 10200 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:17.647814 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:17.628036 15509 log.cc:927] Time spent T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:17.627692 15466 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:17.800252 10048 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:17.827363 10129 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:17.650192 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.638124 15469 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:16:17.605463 15482 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.804488 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.699918 14804 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.651437 15170 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.620446 15463 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.807852 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:17.842509 10127 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:17.809429 10729 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:17.632318 15506 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:16:17.823814 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:17.806409 15490 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:16:17.828871 10128 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 12:16:17.832157 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:17.632869 15279 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.630808 15478 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.810145 15376 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.808632 15208 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.835892 10046 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:17.628768 15278 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.800710 15253 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:16:17.845376 10128 pending_rounds.cc:85] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 6
I20260709 12:16:17.845619 10734 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:17.845009 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 244395us
I20260709 12:16:17.805119 15444 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.799681 15371 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.805003 15403 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.837523 15431 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:17.862478 10200 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:17.889093 10128 pending_rounds.cc:107] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:16:17.859193 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.843379 15170 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:17.934540 10054 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:17.934725 10128 raft_consensus.cc:2889] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:17.855707 15506 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:17.934931 10202 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:17.830205 15480 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.889664 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:17.833669 15246 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:17.939043 10200 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:16:17.941138 10200 pending_rounds.cc:85] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:16:17.941411 10200 pending_rounds.cc:107] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:16:17.941517 10195 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:17.941715 10200 raft_consensus.cc:2889] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:17.892423 15376 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.843029 14804 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.892165 15090 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.933434 15445 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:17.950549 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60951.2us
I20260709 12:16:17.955041 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:17.959331 15496 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:17.960389 15371 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:17.963469 15517 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:16:17.964401 15507 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:16:17.858568 15208 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.953061 15279 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.957324 15340 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:17.967803 15444 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:17.969026 15475 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.002s
I20260709 12:16:17.969480 15475 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:17.970650 10052 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:17.971396 15482 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:17.972229 15504 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:16:17.973690 15090 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.974517 10731 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 12: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:17.952016 15508 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:16:17.975188 15331 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:17.952867 15489 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:17.977429 15489 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:17.969020 15208 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:17.974517 15256 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.007s
I20260709 12:16:17.953846 15376 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.980083 15173 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:17.981256 15510 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:16:17.981760 15376 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:17.942828 15511 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:16:17.973691 15382 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.984434 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:17.984207 15431 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.984989 10197 raft_consensus.cc:2376] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18. Re-sending same reply.
W20260709 12:16:17.989823 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:17.990954 10127 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:17.993194 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:17.994464 15519 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:17.994962 15519 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:17.995059 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 392124us
I20260709 12:16:17.995236 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.995982 10728 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:17.995890 15519 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:17.995436 15400 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.997498 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:17.997304 15400 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.000831 10094 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:18.001533 15400 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.000985 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:18.005472 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:18.012087 15340 raft_consensus.cc:2764] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:16:18.012586 15382 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:18.012359 15523 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:16:18.009706 15173 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:18.009790 15376 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:17.991780 15501 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.011710 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.019738 15480 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.020823 15480 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:18.021636 15279 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:18.022177 15279 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.023195 15463 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.024704 15279 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.024725 15475 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.025635 15501 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.026152 15501 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.028215 15463 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:18.028644 15170 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.029336 15480 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:18.029670 15480 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:18.029773 15376 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.030313 15376 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.030505 15480 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.030966 15470 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.031597 15360 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:17.986972 15445 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.032452 15480 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.034066 15445 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:17.947003 15466 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.032318 15376 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.039343 10197 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:18.039810 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.040436 10125 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:18.041746 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:18.046136 15180 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.046685 15180 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.048287 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.049036 10198 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:18.002985 15130 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.061275 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.049928 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:18.057873 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.060137 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:18.062281 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.064388 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.067286 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.067328 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.068063 10731 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:18.028198 15501 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.069144 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.075536 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:18.076102 10121 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:18.079098 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:18.079326 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.080427 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.080785 10048 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:18.081101 10197 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:18.068913 10198 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:18.013681 15465 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:18.084134 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.003679 15371 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:18.084872 10127 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:18.085487 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:18.085790 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.086261 10052 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:18.013727 15443 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:18.086383 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:18.088635 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.089434 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.086735 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.091488 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.095211 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:18.095561 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.092238 10121 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:18.087788 15170 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.097739 15462 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:18.097440 15506 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.088251 15465 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:18.096314 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:18.098008 15488 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:16:18.100113 15488 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:18.051229 15173 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:18.101845 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.091145 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:18.101071 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.093917 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.092360 10198 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:18.090610 10125 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:18.103000 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.072300 15208 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:18.098939 15465 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.107013 15208 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.107234 15478 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:17.978300 15489 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.107474 15465 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:18.108011 15489 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.074443 15376 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:18.080013 15331 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:18.120344 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.110482 10702 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.112267 10734 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:18.126119 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.114143 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.111667 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.103191 15445 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:16:18.093818 15501 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:18.118814 15365 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:18.072631 15130 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.104667 15273 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:18.088826 15371 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.100456 15488 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:18.147791 15480 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.127625 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.148981 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.152380 15501 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.113847 15208 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:18.089715 15279 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:16:18.113433 15376 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.119258 15528 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.122567 15472 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:18.126549 15338 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:18.113356 15270 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:16:18.129467 15340 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:18.126781 10734 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:18.161896 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.152014 15173 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:18.178015 10050 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:16:18.161144 15273 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.160972 15371 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:18.203320 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:18.130405 15331 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.161445 15365 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:18.184580 15530 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.185082 15529 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.180269 15501 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.187546 15170 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.187820 15376 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.191875 15338 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:18.192652 15488 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.155985 15466 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:18.149322 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:18.209640 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.178146 15482 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:18.151496 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.214265 10127 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:16:18.218763 15380 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.000s
I20260709 12:16:18.215688 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:18.171474 15480 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.272609 10121 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:18.275228 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.216099 15443 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:18.273772 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 122331us
W20260709 12:16:18.270588 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 121936us
I20260709 12:16:18.276721 10169 leader_election.cc:400] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20.
I20260709 12:16:18.278738 10734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:18.250614 15529 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.279629 10734 raft_consensus.cc:606] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.281556 15331 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:18.283314 15512 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.343s	user 0.001s	sys 0.002s
I20260709 12:16:18.279704 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:18.217037 15173 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.294901 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.221508 15344 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:18.299969 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:18.273805 15340 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:18.326037 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:18.289633 15482 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:18.293172 15474 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:18.340097 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.278788 15443 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.287879 15431 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:18.328264 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:18.336061 15173 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.330991 15365 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.331168 15400 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:18.326352 15344 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.334522 10121 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:18.277408 15380 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.288450 15466 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:18.340781 10734 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:18.341665 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.186638 15528 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.303311 15488 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.340355 15472 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:16:18.337761 15440 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.322472 15445 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:18.383953 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.387337 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:18.749840 10121 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:18.255237 15170 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.465178 15340 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:18.322696 15506 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:16:18.340838 15519 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:16:18.491828 15534 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:16:18.491246 15535 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:16:18.386986 15338 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.439635 10130 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:18.762949 15480 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:18.414309 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.224288 15530 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.765637 15530 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:18.486303 15538 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:16:18.382700 15270 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:16:18.457367 15130 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.476928 15529 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.744401 15400 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:18.395251 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:18.777832 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:18.778208 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.341665 15443 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.454499 15482 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.595757 15208 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.798324 15208 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.799793 14804 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.598099 15380 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.598299 15158 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:18.600108 15466 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.374683 15431 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.804117 15431 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:18.613759 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.597777 15273 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.492511 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.808005 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.809221 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.810205 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:18.810748 15487 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.628021 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:18.404353 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.388540 15344 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:18.811538 10203 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:18.811365 15487 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.743242 10053 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:18.742448 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:18.698410 15462 consensus_meta.cc:287] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 12:16:18.813073 15462 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:18.740110 15486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.010s	sys 0.033s
W20260709 12:16:18.813763 15486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.010s	sys 0.034s
I20260709 12:16:18.813923 10737 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:18.814119 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2685) took 1250 ms. Trace:
I20260709 12:16:18.746809 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:18.768759 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.819278 10203 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
W20260709 12:16:18.769495 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.340433 15474 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.819717 15344 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.820317 15474 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:18.821861 15344 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.775245 10121 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:18.824762 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 916) took 1346 ms. Trace:
I20260709 12:16:18.825139 10130 rpcz_store.cc:276] 0709 12:16:17.478643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.491919 (+ 13276us) service_pool.cc:224] Handling call
0709 12:16:17.534981 (+ 43062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:18.762658 (+1227677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.824532 (+ 61874us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400212854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:18.824703 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079947520}
I20260709 12:16:18.826622 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2011) took 2542 ms. Trace:
I20260709 12:16:18.827323 15487 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.753213 15472 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:18.831552 15472 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.833660 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2680) took 1281 ms. Trace:
I20260709 12:16:18.751767 15440 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.834534 15474 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.836627 15440 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.834127 15431 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.836651 15474 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.839300 15431 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:18.841703 15371 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.001s
I20260709 12:16:18.843742 15528 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.846796 15246 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:18.848595 15501 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.000s
I20260709 12:16:18.849067 15501 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.850306 10127 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:18.852077 15170 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:18.857666 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 849) took 1848 ms (client timeout 2100 ms). Trace:
W20260709 12:16:18.858144 10736 rpcz_store.cc:269] 0709 12:16:17.008818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.009133 (+   315us) service_pool.cc:224] Handling call
0709 12:16:18.857447 (+1848314us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54006491d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:18.857592 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786261376}
W20260709 12:16:18.861613 15376 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.590s	user 0.003s	sys 0.006s
I20260709 12:16:18.862102 15376 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.866354 15469 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:18.866968 15469 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:18.868110 10729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 969) took 1420 ms (client timeout 1607 ms). Trace:
W20260709 12:16:18.868551 10729 rpcz_store.cc:269] 0709 12:16:17.447816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.447939 (+   123us) service_pool.cc:224] Handling call
0709 12:16:18.867906 (+1419967us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54004ba354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:18.868042 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710142848}
I20260709 12:16:18.869732 10730 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:16:18.869721 15469 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:18.826996 10124 rpcz_store.cc:276] 0709 12:16:16.284545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:16.566219 (+281674us) service_pool.cc:224] Handling call
0709 12:16:17.473446 (+907227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.488452 (+ 15006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.826399 (+1337947us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001d5950. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:18.826565 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955999488}
I20260709 12:16:18.834040 10054 rpcz_store.cc:276] 0709 12:16:17.552705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.552864 (+   159us) service_pool.cc:224] Handling call
0709 12:16:17.553166 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:17.938871 (+385705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.833360 (+894489us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003d0254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:18.833570 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781082880}
I20260709 12:16:18.879822 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2688) took 1310 ms. Trace:
I20260709 12:16:18.774022 15340 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:18.881541 15340 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.884553 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.780133 15547 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.885926 15547 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.870926 15469 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.888126 15547 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.789191 15403 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:18.814585 10046 rpcz_store.cc:276] 0709 12:16:17.563356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.566704 (+  3348us) service_pool.cc:224] Handling call
0709 12:16:18.813941 (+1247237us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002a1554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:18.814065 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616589696}
I20260709 12:16:18.888278 15469 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.817911 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:18.889535 10126 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:18.889940 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2559) took 1316 ms. Trace:
W20260709 12:16:18.884724 15465 consensus_meta.cc:287] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.004s
I20260709 12:16:18.779421 15445 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.880270 10055 rpcz_store.cc:276] 0709 12:16:17.569420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.569578 (+   158us) service_pool.cc:224] Handling call
0709 12:16:17.569921 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:17.807229 (+237308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:17.807261 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:17.826160 (+ 18899us) log.cc:844] Serialized 52 byte log entry
0709 12:16:18.104451 (+278291us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:18.104491 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.879372 (+774881us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400131fd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:18.879424 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:18.879479 (+    55us) raft_consensus.cc:1685] finished
0709 12:16:18.879494 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:18.879749 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37168,"raft.queue_time_us":41652,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10517,"spinlock_wait_cycles":445244800,"thread_start_us":253227,"threads_started":1,"wal-append.queue_time_us":342321}
I20260709 12:16:18.890244 10126 rpcz_store.cc:276] 0709 12:16:17.573432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.575975 (+  2543us) service_pool.cc:224] Handling call
0709 12:16:18.817762 (+1241787us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:16:18.889882 (+ 72120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3701504}
I20260709 12:16:18.890805 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.897192 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.897442 10204 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:18.897703 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.892527 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.898494 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.899631 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:18.888408 15532 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.727s	user 0.003s	sys 0.010s
I20260709 12:16:18.759446 15519 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.870982 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2028) took 1499 ms. Trace:
I20260709 12:16:18.894590 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.894907 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.902104 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:18.895188 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.900612 10198 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:18.867492 15365 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:18.864288 15376 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:18.893081 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.024s	sys 0.055s
W20260709 12:16:18.909365 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.024s	sys 0.056s
W20260709 12:16:18.909909 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 581678us
I20260709 12:16:18.910568 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:18.842182 15371 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:18.902577 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:18.914907 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.903661 10200 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:18.916049 10201 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:16:18.902381 10195 rpcz_store.cc:276] 0709 12:16:17.371918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.530194 (+158276us) service_pool.cc:224] Handling call
0709 12:16:18.870769 (+1340575us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400361354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:18.870886 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812020864}
I20260709 12:16:18.902870 10199 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
W20260709 12:16:18.904963 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.907130 10046 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:18.900616 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.908015 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:18.918027 10203 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:18.907092 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.911671 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:18.919890 10204 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:18.914633 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:18.922331 10199 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:18.923377 10200 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:18.890327 15469 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:18.928723 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.923029 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.904636 15519 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.918720 15246 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.908921 15523 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:18.936932 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.937657 10055 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:18.933005 15521 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:18.920954 15270 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.940238 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.925303 15360 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.925132 15547 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:18.926903 15470 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:18.949612 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:18.900386 15445 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.953567 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.954011 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.954720 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:18.959221 10199 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:18.939700 15469 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:18.973073 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:18.968861 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.980337 10055 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:16:18.987948 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:18.978521 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:18.989800 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:18.995877 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:18.997866 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 969) took 1498 ms. Trace:
I20260709 12:16:18.956332 15470 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:18.998311 10202 rpcz_store.cc:276] 0709 12:16:17.499775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.977416 (+477641us) service_pool.cc:224] Handling call
0709 12:16:17.977735 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:17.985095 (+  7360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:17.985127 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:17.985565 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:16:18.059180 (+ 73615us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:18.059500 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:16:18.059694 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:18.059755 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:18.887873 (+828118us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:18.992484 (+104611us) raft_consensus.cc:1685] finished
0709 12:16:18.997641 (+  5157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:18.997799 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":1046,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":187,"spinlock_wait_cycles":9477504,"thread_start_us":73308,"threads_started":1,"wal-append.queue_time_us":163398}
I20260709 12:16:19.009135 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:18.966863 15547 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.008941 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:18.991654 14842 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.970400 15469 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:18.934916 15246 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:19.023164 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44977.2us
I20260709 12:16:19.002192 15523 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:19.011037 15470 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:18.958416 15360 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.957634 15270 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:18.963280 15400 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:19.031370 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110891us
I20260709 12:16:19.026607 15469 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:19.033370 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:18.992484 15506 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:16:19.024824 15486 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:19.021672 15253 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:19.042301 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:19.004375 15338 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.030743 15401 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:19.027187 15273 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.016026 15487 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:16:19.030763 15523 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.051017 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:19.026841 14842 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.030885 14804 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:16:19.044401 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.070663 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.070972 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.071395 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.030958 15386 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.077303 15386 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.079457 15386 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.079346 15443 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.062398 10053 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:19.024158 15480 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:16:19.081422 15443 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.064421 10196 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:19.072438 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.082847 10048 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:19.083278 10202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:16:19.083887 10202 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.085073 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.062556 15547 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.051169 15501 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.075696 10200 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:19.076305 15496 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:19.062135 15338 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.098357 15270 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.098976 15270 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:19.099530 15338 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.072924 10047 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 11.
I20260709 12:16:19.101441 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.102532 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.102699 15470 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.089358 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.105384 15470 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.106678 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.106945 15519 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.053175 15486 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:19.106716 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.107937 15486 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:19.109094 14842 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.113566 15253 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.094648 15444 raft_consensus.cc:2764] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:16:19.094659 15554 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:19.114144 15253 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.114763 15554 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.115736 15554 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.095840 15371 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.116613 15253 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.092672 15273 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:19.117722 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.118400 15273 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.118769 10199 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:19.118873 15273 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:19.119830 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.120205 15360 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.120548 15253 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:19.120947 15253 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.121254 15253 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.067842 15523 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.097404 15386 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:19.097724 15496 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:19.107445 15548 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:16:19.090377 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.048801 15462 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:16:19.049552 15498 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:16:19.150600 15386 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:19.151721 15496 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.155042 15445 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.155445 15465 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.156594 15246 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:19.160224 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69907.7us
I20260709 12:16:19.183676 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.162379 10204 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:19.158582 15273 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:19.192001 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 270477us
W20260709 12:16:19.201637 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.180130 15523 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.162000 15444 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.207564 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.218509 15273 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.211365 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.220615 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.202782 15557 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:19.222290 10728 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:19.211702 15401 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:19.228734 10047 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:19.210274 15496 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:19.227015 10053 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:19.187325 15465 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.232244 15371 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.203989 15445 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:16:19.226810 15559 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:19.231946 15506 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:19.240469 15521 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:19.238890 15371 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.257382 15371 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.258118 15486 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.260344 15486 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.261341 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.266634 15401 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.235239 15386 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:19.271831 15487 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.245003 15559 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:19.272367 15487 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.274055 10198 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:19.275316 15559 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.272446 15253 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.280412 15253 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.276276 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.288365 15567 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:19.283234 15519 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.278394 15469 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:19.322981 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.389513 15164 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:19.325050 10049 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:19.325580 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.293512 15523 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.290907 15567 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:19.275630 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 63099.6us
I20260709 12:16:19.339450 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2457) took 1286 ms. Trace:
I20260709 12:16:19.339249 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.346266 15462 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.350993 10203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
W20260709 12:16:19.379820 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.380251 15519 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:19.352999 15487 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.387650 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:19.324563 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 238445us
I20260709 12:16:19.439519 10203 raft_consensus.cc:606] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.440021 10203 raft_consensus.cc:614] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:19.391965 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.378042 15469 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.445714 10204 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 11.
I20260709 12:16:19.394584 15180 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.355458 15444 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:19.448457 15550 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
I20260709 12:16:19.450060 15386 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:19.451321 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2451) took 1456 ms. Trace:
I20260709 12:16:19.451941 15270 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:19.452474 15270 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:19.453943 15270 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.455883 15462 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.457266 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 856) took 1958 ms. Trace:
I20260709 12:16:19.457648 10730 rpcz_store.cc:276] 0709 12:16:17.498824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.499374 (+   550us) service_pool.cc:224] Handling call
0709 12:16:18.869467 (+1370093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:18.870262 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.456854 (+586592us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004ba350. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:19.457058 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3053961984}
I20260709 12:16:19.459336 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.460523 10202 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.461977 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:19.456542 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.465588 15471 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.466564 15471 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.468955 15562 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:19.473282 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.473799 15170 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:19.474419 15170 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:19.400908 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.402683 15463 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:19.475262 15463 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:19.405326 10047 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:16:19.406246 15465 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.397325 15278 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:19.416870 15164 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:16:19.416960 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 674457us
I20260709 12:16:19.421309 15431 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:19.435822 10050 rpcz_store.cc:276] 0709 12:16:18.052883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.053039 (+   156us) service_pool.cc:224] Handling call
0709 12:16:18.053322 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:18.200230 (+146908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.338805 (+1138575us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002f76d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:19.339243 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270283008}
I20260709 12:16:19.474076 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.483382 10126 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:19.483567 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.484907 10127 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:19.348279 10198 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:19.487145 10198 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.487731 15462 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.488448 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.488263 10198 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.489559 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.489981 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.493569 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.482643 15170 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.494474 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.451736 10197 rpcz_store.cc:276] 0709 12:16:17.994702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.106358 (+111656us) service_pool.cc:224] Handling call
0709 12:16:19.449936 (+1343578us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:16:19.450310 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.450807 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:19.450832 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:19.450903 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:19.450931 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.450981 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.451120 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326784}
I20260709 12:16:19.490916 10121 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:19.466586 15567 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.491854 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:19.492906 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 57548.5us
I20260709 12:16:19.490698 15472 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:19.490659 10200 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:19.489892 10198 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:19.494772 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.497790 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.495412 15164 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.499388 10195 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:19.500046 15164 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.500978 10197 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:19.497058 15472 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.501649 15164 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:19.498868 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.501514 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.503489 10128 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:19.504801 15472 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.505331 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.506353 15279 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:19.506556 15472 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.506889 15279 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:19.504717 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.507458 15279 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:19.508774 10732 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:19.510263 15270 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.489732 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:19.513087 10094 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.607s (SENT) [suppressed 9 similar messages]
I20260709 12:16:19.492782 15340 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:19.516376 15340 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:19.516762 15557 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:19.517207 15557 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:19.515408 15400 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.515597 10199 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:19.522683 15557 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.526654 15557 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:19.527205 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2043) took 2033 ms. Trace:
I20260709 12:16:19.527587 10196 rpcz_store.cc:276] 0709 12:16:17.493682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:17.976479 (+482797us) service_pool.cc:224] Handling call
0709 12:16:18.816934 (+840455us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800164498. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:16:18.817107 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:19.082255 (+265148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.526781 (+444526us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54000eb0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:19.527053 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571192832}
I20260709 12:16:19.496169 10203 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:19.486503 15471 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.566829 10121 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:19.568245 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.568838 15270 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.569753 15270 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.570401 15562 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:16:19.571728 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 70424.5us
I20260709 12:16:19.572104 15270 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.573088 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.577159 15160 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:19.578514 15270 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:19.579101 15270 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:19.579968 15552 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
I20260709 12:16:19.564162 10730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:19.580644 15270 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.582132 15270 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:19.583931 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:19.584364 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.585165 15573 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:19.585829 15573 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.588114 15573 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.588606 15573 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:19.589213 15573 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.590569 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.591336 10729 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:16:19.577221 15279 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.595634 10730 raft_consensus.cc:606] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.596078 10730 raft_consensus.cc:614] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:19.597579 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.603979 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.604053 15463 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.505300 15559 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.606187 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.619827 10128 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 12:16:19.620326 15463 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:19.621960 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.624346 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.625231 10128 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:19.630167 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 117109us
I20260709 12:16:19.629222 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.631927 10127 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:19.637601 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.637785 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.643472 10729 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:19.640614 10047 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:19.649875 10196 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:19.653730 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 925) took 1563 ms. Trace:
I20260709 12:16:19.654115 15519 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.666664 15270 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.663684 15444 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.667097 15173 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.667508 15270 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.668113 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.668296 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.668113 15444 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.669627 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:19.670337 10123 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:19.670171 15270 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.671690 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.672343 10049 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:19.668557 15173 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.667490 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:19.663612 15471 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.674619 15173 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.675207 15173 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:19.654918 15519 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.675077 15471 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.676648 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.677273 15519 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.666745 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:19.667627 10128 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:16:19.680405 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.677217 15471 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.686551 10124 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:16:19.697494 10125 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:19.698761 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.701268 10129 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:16:19.707090 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.709729  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:19.709673 10168 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.709882 10130 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:16:19.714148 15401 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.714938 15401 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.717306 15386 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.717882 15386 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.719835 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.720100 15386 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.720607 10196 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:19.722525 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.723852 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.724529 10196 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:19.726145 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.729187 15546 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:19.729072 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.730531 10732 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:19.731851 10126 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:19.733355 10126 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:19.734475 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.737530 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.718631 15401 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:19.738554 15347 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:16:19.739846 15347 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:19.740247 15347 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:19.741374 15347 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.744205  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:19.745944 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.747097 10121 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
W20260709 12:16:19.748509 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.748941  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:19.749394 10054 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:19.750072 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.750917 10204 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:19.751179 15519 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:19.652460 15567 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.654173 10122 rpcz_store.cc:276] 0709 12:16:18.090485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.090619 (+   134us) service_pool.cc:224] Handling call
0709 12:16:18.090918 (+   299us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:18.101808 (+ 10890us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:18.130248 (+ 28440us) log.cc:844] Serialized 14 byte log entry
0709 12:16:18.842452 (+712204us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800378ee0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a 00007fc17e79aa2a
0709 12:16:19.560526 (+718074us) log.cc:844] Serialized 14 byte log entry
0709 12:16:19.574755 (+ 14229us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:19.615986 (+ 41231us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:19.626520 (+ 10534us) log.cc:844] Serialized 52 byte log entry
0709 12:16:19.626670 (+   150us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:19.629616 (+  2946us) log.cc:844] Serialized 14 byte log entry
0709 12:16:19.629925 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:19.642912 (+ 12987us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:19.642962 (+    50us) raft_consensus.cc:1685] finished
0709 12:16:19.642976 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:19.653532 (+ 10556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382675,"prepare.queue_time_us":21216,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":376220,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":2846,"spinlock_wait_cycles":88880512,"thread_start_us":339474,"threads_started":3,"wal-append.queue_time_us":941596}
I20260709 12:16:19.757828 10125 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:19.757957 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:19.729555 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.671012 15444 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.798362 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.775283 10053 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:19.801399 10049 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:19.803043 10202 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:19.806550 15559 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.809267 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.809792 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.810120 10048 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:19.810787 10122 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:19.811168 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.811497 15347 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:19.811838 10048 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:19.813578 15470 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.814174 15470 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:19.814908 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 134651us
I20260709 12:16:19.816318 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.816560 15470 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:19.816962 10121 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:19.776525 15279 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.818723 15465 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.819341 15465 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.820330 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:19.821033 10122 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:19.821641 15465 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.819703 10125 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:19.817932 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:19.824453 15170 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.824596 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.826385 10128 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:19.826654 15465 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:19.827041 15465 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.827376 15465 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:19.818886 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:19.834148 10198 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:16:19.836192 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.756779 15471 raft_consensus.cc:2764] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:16:19.843351 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:19.834578 10198 pending_rounds.cc:85] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:19.850936 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.801779 15472 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:19.855125 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.852725 10123 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:19.844401 10198 pending_rounds.cc:107] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:16:19.856067 10198 raft_consensus.cc:2889] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:19.858091 10127 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:19.838984 15400 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:19.859129 10130 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:19.852380 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.861867 10730 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:19.863466 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:19.867282 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.868364 10124 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:16:19.868907 10204 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:19.870005 10128 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:19.866276 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:19.839998 15567 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:19.894742 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65566.2us
I20260709 12:16:19.899998 10202 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:19.881879 15573 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.904970 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:19.889423 15170 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:19.905180 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:19.912180 15257 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.912760 15257 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:19.913940 10052 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:19.914558 15270 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:19.915035 15270 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.915375 15270 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:19.918756 10197 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:19.921412 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.922777 10203 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:19.907871 15386 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.928125 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:19.935889 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75554.2us
I20260709 12:16:19.903766 15400 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:19.927014 15386 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:19.953084 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.935431 15472 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:19.949872 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:19.938550 15180 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:19.957604 10197 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:19.966346 10049 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
W20260709 12:16:19.968391 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:19.968638 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 63903.8us
I20260709 12:16:19.970749 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:19.974982 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:19.977843 10198 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:19.977516 15400 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:19.987723 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 115525us
I20260709 12:16:19.986030 10053 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:19.967564 15444 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:19.992204 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:19.992803 10729 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:19.994655 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:19.976886 15279 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:19.967710 15573 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.004469 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.005921 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:20.007294 15462 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:20.000952 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:20.011685 10046 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:20.012848 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:20.013963 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 127682us
W20260709 12:16:20.014724 15587 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:16:20.016777 15463 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:20.017438 15170 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.017841 15431 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:20.017942 15170 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.020202 15170 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.020881 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:20.021534 10199 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:20.023030 15567 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.023717 10197 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:19.997172 15528 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:16:19.984469 15180 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:20.026548 15573 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.027217 15180 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.028577 15573 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.030045 15400 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:20.030485 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.031404 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:19.999665 15279 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.032516 15279 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.017609 15580 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:20.035126 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52785.9us
I20260709 12:16:20.035283 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.035892 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:16:20.036032 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.036564 15472 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.037083 15472 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:20.030164 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.022388 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:20.045277 15386 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.045708 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.047259 15401 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:20.047646 15401 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.047999 15401 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:20.049036 15562 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:20.050483 15278 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:20.050782 15386 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:20.052263 15173 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.052719 15173 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.053268 15170 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.053826 15170 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.054840 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.055611 10125 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:20.055898 15170 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.052165 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.057070 10127 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:20.057303 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.057947 10121 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.038568 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:20.058966 10195 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:20.059635 10127 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:16:20.059949 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.060578 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.061208 10125 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:20.060580 10126 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
W20260709 12:16:20.063830 15164 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.562s	user 0.003s	sys 0.007s
I20260709 12:16:20.045451 10048 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:20.044322 10199 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:20.067085 10198 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:20.068956 10047 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:20.072283 10204 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:20.073207 10122 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:20.068784 15559 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:20.074368 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.074626 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.075812 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.034112 15580 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.078338 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.079530 10046 raft_consensus.cc:2393] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:20.066289 15278 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.087980 10094 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.097553 15173 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.089059 15278 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:20.121955 10051 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:16:20.121146 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 105345us
I20260709 12:16:20.126387 15562 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:20.127739 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77347.2us
I20260709 12:16:20.128748 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.138674 10126 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 11. Current term is 12. Ops: []
I20260709 12:16:20.145934 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:20.149075 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:20.152590 10728 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:16:20.168238 10730 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:20.127123 15562 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.176397 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.177364 10121 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:20.164821 15462 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:20.178149 15545 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:20.167989 15431 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:16:20.182909 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 113841us
I20260709 12:16:20.139423 15472 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:20.190649 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 152254us
I20260709 12:16:20.184386 15557 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:20.183898 15431 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.200672 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.200049 15431 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:20.213853 15173 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.216471 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.204360 15599 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:20.212136 15545 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:20.221361 10126 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:20.225337 10048 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:20.203586 15465 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.221520 15599 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.227959 15173 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:20.228688 15592 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:16:20.216163 15580 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.233193 15173 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.238960 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:20.239794 15164 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:20.240177 15164 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.240269 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.241055 15573 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:20.241593 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.241694 15164 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:20.242517 15591 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:16:20.243598 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52088.4us
I20260709 12:16:20.244369 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:20.245594 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.235530 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.249570 10126 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:20.247062 15472 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.230691 15599 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.282996 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.272074 15573 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:20.231557 15279 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.233207 15270 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.291405 15170 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:20.268839 15557 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.279448 15580 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:20.293373 10094 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.278877 15545 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:20.290671 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 49172.7us
I20260709 12:16:20.301465 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.302157 10126 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:20.309892 10049 raft_consensus.cc:2368] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18.
I20260709 12:16:20.309190 15173 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:20.298954 15557 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.302765 15580 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.322101 15347 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:20.301268 15545 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.332175 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:20.344153 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.346925 10126 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:20.326836 15580 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:20.305920 15562 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.352250 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.355345 15444 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:16:20.355788 15400 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:20.330515 15545 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.353158 10702 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.359786 15597 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:20.362831 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.363613 15547 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:16:20.365183 15270 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.365319 15164 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.366712 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.405923 10130 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:16:20.406984 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.407140 15164 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.366869 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:20.369760 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 76474.7us
I20260709 12:16:20.348155 15470 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.371661 10126 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:20.372002 15597 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:20.368700 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.372349 15431 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.376394 10201 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:20.377816 15257 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.379669 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.387454 15279 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.388651 15465 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.353626 15472 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:16:20.395119 15471 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:20.395895 15278 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.397215 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.400772 15559 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:16:20.408937 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 280237us
W20260709 12:16:20.365410  9952 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 175) took 47718 ms (client timeout 15000 ms). Trace:
I20260709 12:16:20.411315 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.412616 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.414975 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.424234 10130 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:20.412611 10129 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:20.415956 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.421392 10122 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.427712 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.429129 10053 raft_consensus.cc:2368] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16.
I20260709 12:16:20.430447 10127 raft_consensus.cc:2410] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:20.431111 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.428349 10126 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:20.432945 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.431720 10124 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:20.416983 15528 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:20.430799 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51327.3us
I20260709 12:16:20.435341 10123 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:20.436769 15173 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:20.441048 10128 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
W20260709 12:16:20.441337 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 110570us
I20260709 12:16:20.443068 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.444254 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.445308 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:20.446609 15347 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:20.446697 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.447031 15347 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.447449 15567 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:20.447862 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.448640 10130 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:20.449463 15567 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:20.449892 15567 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.447444 15347 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:20.458972 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.462674 15160 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:20.463174 15160 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.463523 15160 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:20.450222 15567 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.468964 10123 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:20.449398 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.470984 10129 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:20.472247 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:20.487110 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 154006us
I20260709 12:16:20.436666 15547 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:20.497618 15580 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.489675 15400 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:16:20.503525 15431 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.505086 15278 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.505976 15386 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:20.506568 15471 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:20.508080 15559 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:20.511646 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.521786 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:20.526304 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.433813 15470 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:20.545800 10052 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2465) took 2446 ms (client timeout 1982 ms). Trace:
I20260709 12:16:20.546038 15470 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.530452 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.546977 10053 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:20.490195 15597 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.548691 15597 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.530324 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.534773 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.538923 15528 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:20.535399 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.537976 10050 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:16:20.531657 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.552923 10125 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:20.541597 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.536629 15386 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:20.554745 15386 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.532229 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.557103 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:20.569502 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76847.2us
I20260709 12:16:20.468245 15257 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 12:16:20.570962 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59402.2us
I20260709 12:16:20.571826 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:20.557330 10052 rpcz_store.cc:269] 0709 12:16:18.087492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:18.089231 (+  1739us) service_pool.cc:224] Handling call
0709 12:16:20.512768 (+2423537us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400309b54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:20.533801 (+ 21033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4192295296}
I20260709 12:16:20.572059 10128 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:16:20.514050 15401 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.542654 15164 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.582963 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:20.600456 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 155203us
I20260709 12:16:20.528008 15599 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.575651 15547 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:20.579674 15279 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:20.572747 15559 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:20.611084 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:20.619827 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 191006us
I20260709 12:16:20.618480 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.601823 15386 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:20.580372 15606 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:20.579970 15431 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:16:20.605451 15173 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:20.661725 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.609722 15528 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:20.610697 15547 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:20.683715 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43782.4us
I20260709 12:16:20.627964 15622 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:20.612054 15279 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:20.629349 15471 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:20.642632 15606 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:20.700642 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 163039us
I20260709 12:16:20.694340 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:20.422963  9952 rpcz_store.cc:269] 0709 12:15:32.647142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.647316 (+   174us) service_pool.cc:224] Handling call
0709 12:16:20.365169 (+47717853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:17.160757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:17.278913 (+118156us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:17.278962 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:16:17.278975 (+    13us) tablet.cc:662] Decoding operations
0709 12:16:17.279815 (+   840us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:17.279900 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:17.279928 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:16:17.280492 (+   564us) tablet.cc:701] Row locks acquired
0709 12:16:17.280552 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:16:17.280732 (+   180us) write_op.cc:270] Start()
0709 12:16:17.280918 (+   186us) write_op.cc:276] Timestamp: P: 1783599377280662 usec, L: 0
0709 12:16:17.280938 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:16:17.341461 (+ 60523us) log.cc:844] Serialized 2448 byte log entry
0709 12:16:17.977609 (+636148us) op_driver.cc:464] REPLICATION: finished
0709 12:16:18.160552 (+182943us) write_op.cc:301] APPLY: starting
0709 12:16:18.160661 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:18.282639 (+121978us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:18.282807 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:18.328786 (+ 45979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:18.332297 (+  3511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:16:18.332350 (+    53us) write_op.cc:312] APPLY: finished
0709 12:16:18.334959 (+  2609us) log.cc:844] Serialized 65 byte log entry
0709 12:16:18.335137 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:18.335238 (+   101us) write_op.cc:454] Released schema lock
0709 12:16:18.335282 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:18.335646 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:18.335672 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3936862,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":182651,"apply.run_cpu_time_us":10360,"apply.run_wall_time_us":175081,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":360336,"prepare.run_cpu_time_us":34205,"prepare.run_wall_time_us":568852,"raft.queue_time_us":135488,"raft.run_cpu_time_us":10681,"raft.run_wall_time_us":85502,"replication_time_us":696514,"thread_start_us":600253,"threads_started":4,"wal-append.queue_time_us":421213,"wal-append.run_cpu_time_us":73238,"wal-append.run_wall_time_us":1539987}]]}
I20260709 12:16:20.637746 15164 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.690809 15547 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.691864 15279 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:20.728940 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.732419 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:20.642917 15545 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.738507 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:20.702243 15465 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:20.707571 15622 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:20.705387 15606 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.704020 15180 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:16:20.744844 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58080.5us
I20260709 12:16:20.702011 15624 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:20.744179 15603 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:20.695420 15347 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:20.779273 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46951.9us
W20260709 12:16:20.764796 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 57704.2us
I20260709 12:16:20.763660 15431 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:20.782976 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 139961us
I20260709 12:16:20.743950 15559 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.773844 15624 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:20.773054 15580 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.760046 15608 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:20.773941 15173 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.776244 15573 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:20.783901 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.794092 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:20.796119 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:20.777606 15618 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:20.800561 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:20.796937 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:20.797821 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:20.784953 15431 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.813422 10125 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 12: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:20.823253 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:20.787544 15401 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.830804 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:20.804797 15612 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:20.830159 10201 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:20.847117 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.847965 10048 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:20.805701 15270 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:20.803859 15164 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:20.811118 15618 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.810717 15599 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:20.803350 15573 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:20.815346 15431 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:20.852594 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:20.869796 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 75790.7us
W20260709 12:16:20.861557 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 77733.8us
I20260709 12:16:20.866958 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.824199 15465 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:20.829825 15463 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:20.778254 15528 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.869728 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.875871 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:20.877108 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 79367.6us
I20260709 12:16:20.878719 10736 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:20.880873 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.880928 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.881789 10051 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:20.881460 10049 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:20.880509 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:20.866608 15270 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:20.790271 15471 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:20.886051 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:20.889377 10052 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:20.792769 15603 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.873270 15164 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.868413 15618 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:20.897037 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 336977us
W20260709 12:16:20.899169 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:20.876227 15612 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:20.897287 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44812.8us
I20260709 12:16:20.845592 15608 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.913038 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:20.916628 10052 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:20.893872 15463 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:20.917652 10169 leader_election.cc:400] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16.
I20260709 12:16:20.935806 10169 leader_election.cc:403] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:16:20.900689 15599 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:20.907609 15610 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 12:16:20.907830 15619 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.954643 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:20.884361 15622 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.935024 15545 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:20.966303 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 94351.5us
W20260709 12:16:20.952440 15605 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:16:20.965447 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:20.968003 15462 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:16:20.979815 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 93831.8us
I20260709 12:16:20.957497 15180 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:20.934801 15164 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.938655 15567 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.971755 15628 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:20.993988 15614 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:16:20.997509 10702 leader_election.cc:400] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18.
I20260709 12:16:20.999879 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.000790 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.000025 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.001338 10124 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:21.001792 10126 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.002173 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.001399 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.003851 10123 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.002241 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.007355 10124 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:21.008188 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.008587 10124 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:21.012724 10124 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:20.989586 15462 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:21.016917 10126 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:20.990058 15623 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:21.019496 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.019603 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:21.020099 10203 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.020617 10051 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:16:21.018311 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:21.018580 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.021266 10204 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.020817 10728 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:21.021858 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:21.020265 10049 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:21.022240 10123 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:21.022418 10053 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
W20260709 12:16:21.022960 15611 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:16:20.995882 15180 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:21.024281 15164 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:20.957140 15573 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.027336 10204 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:21.023936 15180 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.024884 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:20.902002 15624 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:21.025612 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 71066.8us
I20260709 12:16:20.957650 15619 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.055115 10199 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:21.015241 15628 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:21.056881 15557 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.001s
I20260709 12:16:21.020541 15463 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:20.987663 15465 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.100049 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:21.100384 10199 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:20.965950 15612 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.063120 10201 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:21.050583 15640 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:16:21.064544 10048 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:21.068416 10052 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:21.026767 15347 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.019586 15462 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:21.088394 15633 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:16:21.058647 15573 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:21.114051 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119518us
I20260709 12:16:21.064517 10736 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:21.102733 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.115500 10053 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
W20260709 12:16:21.093719 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 124992us
I20260709 12:16:21.118770 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:21.124686 10203 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
W20260709 12:16:21.128938 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 231155us
I20260709 12:16:21.015177 15270 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.129663 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.132114 10049 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:16:21.129931 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.091344 15472 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 12:16:21.147339 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.100279 15557 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.130865 15603 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.134083 15401 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:21.130225 15638 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:21.160825 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.161365 10123 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:16:21.164983 15562 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:21.165513 15557 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.163481 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2707) took 1568 ms. Trace:
I20260709 12:16:21.159431 15279 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.172618 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.175789 10123 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:21.154878 15164 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:21.176262 15164 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:21.176441 15279 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.178669 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.165490 15562 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:21.182936 15641 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:21.183691 15637 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:21.183391 15562 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.168730  9946 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 17, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.174635 10050 rpcz_store.cc:276] 0709 12:16:19.594812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:19.594930 (+   118us) service_pool.cc:224] Handling call
0709 12:16:20.525831 (+930901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.552454 (+ 26623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.160629 (+608175us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400309b50. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:21.163424 (+  2795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139976448}
I20260709 12:16:21.184660 10123 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:21.171526 15567 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.174525 15643 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:21.184159 15637 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.158387 15401 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:21.162472 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.190169 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:21.224551 10736 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 12.
I20260709 12:16:21.188086 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.225550 10130 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:21.213515 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60066.5us
I20260709 12:16:21.230963 15472 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.231580 15472 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.197597 15628 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:21.187196 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 51617.5us
I20260709 12:16:21.233634 15472 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.231978 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.234663 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:21.240744 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.241446 10201 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:21.237257 15598 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:21.246973 15598 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:21.247449 15598 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:21.248309 15598 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.253078 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:21.253810 10736 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
W20260709 12:16:21.255345 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 92961.5us
W20260709 12:16:21.193267 15635 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 12:16:21.191113 15646 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:16:21.187772 15164 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:21.191493 15160 consensus_meta.cc:287] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 12:16:21.192489 15608 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.258854 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:21.262108 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.264406 10204 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:21.192173 15619 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.190498 15625 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.189100 15386 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 12:16:21.251664 15640 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.253259 15401 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:21.223583 15637 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.269363 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.190443 15642 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16.
I20260709 12:16:21.271668 10047 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:16:21.271871 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 269746us
I20260709 12:16:21.284930 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:21.190358 15647 consensus_queue.cc:1175] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b3390fbbe574de7bf154b5a6cc35677" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 11 } }
I20260709 12:16:21.259706 15472 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:21.172108 15547 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.276443 10168 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.277352 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.279122 10702 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
I20260709 12:16:21.193130 15606 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.282861 10199 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:21.285797 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.273123 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.223179 15643 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.188865 15638 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.285085 15627 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:21.292680 10130 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:21.288203 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:21.539362 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 251211us
I20260709 12:16:21.540104 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:21.283185 15597 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.000s
W20260709 12:16:21.285581 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 390735us
I20260709 12:16:21.305120 10702 leader_election.cc:403] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:16:21.277705 15619 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.281987 15400 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:16:21.281755 15628 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:21.306931 10124 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:21.292142 10201 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:21.269351 15160 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:21.383040 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:21.281595 15608 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 12:16:21.421492 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 136625us
I20260709 12:16:21.556347 10054 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:21.378412 15654 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:21.419939  9946 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.281909 15640 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.437474 15629 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:21.423322 15472 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.544072 10020 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.545933 10199 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
W20260709 12:16:21.547106 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:21.618198 15659 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.126s	user 0.003s	sys 0.002s
I20260709 12:16:21.556172 15619 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.541158 15557 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:16:21.599001 15627 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.548461 15444 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.551291 15628 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.562841 15606 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.560619 15465 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:21.564548 15401 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.548403 15559 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:21.547909 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 268897us
I20260709 12:16:21.558142 10095 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.565816 15654 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.279731 15625 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.604877 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.550729 15462 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.530265 15386 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:21.548890 15400 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.559759 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:21.634876 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76799.4us
I20260709 12:16:21.556584 15278 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:21.565658 15347 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13.
I20260709 12:16:21.632750 10052 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:21.635758 10204 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:21.651086 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:21.644222 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 103379us
I20260709 12:16:21.668776 15173 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:21.669229 15173 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.669615 15173 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:21.618829 15547 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.627002 15639 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:21.629592 15628 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:21.629012 15627 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:21.618659 15629 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.631465 15640 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.625592 15170 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.705935 15170 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.634085 15401 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.687008 10050 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:21.706543 15617 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:21.639334 15160 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.707089 15617 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.707727 15160 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:21.709208 15617 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.637825 15462 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.629257 15444 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.631856 15465 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:21.635146 15636 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:21.630066 15606 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:16:21.661985 15608 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:21.641582  9946 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 15, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:21.703963 15665 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.108s	user 0.000s	sys 0.005s
I20260709 12:16:21.686323 15639 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:21.704658 15660 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.710570 15170 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.660562 15400 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:21.700006 10204 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:21.618331 15472 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:21.712553 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 168669us
I20260709 12:16:21.635196 15654 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:21.634393 15559 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.701056 15629 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:21.717569 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157876us
I20260709 12:16:21.723909 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:21.725461 15573 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 12:16:21.710510 15278 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:21.730105 10124 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:21.678369 15386 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.711478 15557 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.733188 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 67149.5us
I20260709 12:16:21.727982 15623 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.729563 15636 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:21.743600 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.745994 15636 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.757616 15629 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.764499 15639 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.765767 15639 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:16:21.746915 15669 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:16:21.747334 15675 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:16:21.748123  9946 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 12 to 15, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 15 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:21.722972 15612 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:16:21.750753 15472 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.768724 15444 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.769625 15612 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:21.770000 15612 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.770583 15650 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:21.770313 15173 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.770982 15650 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:21.771899 15559 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.771862 15650 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.772497 15173 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:21.751847 15431 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.007s
I20260709 12:16:21.764016 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:21.775333 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.777756 10130 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:21.778707 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.776546 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.774197 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.778254 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.783766 15278 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:21.729645 15608 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.786731 15608 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.733731 15660 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.790169 15660 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.763964 15465 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:21.791977 15663 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 12:16:21.774351 15164 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.004s
I20260709 12:16:21.815158 10020 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.810511 15664 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:21.811167 15278 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:21.812534 15173 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:21.812999 15401 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:16:21.819785 15618 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.914s	user 0.006s	sys 0.005s
I20260709 12:16:21.773965 15623 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.814873 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.820858 10123 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:21.781241 15557 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:21.770329 15612 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:21.823057 15557 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.780078 15638 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.822162 15623 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.829521 15627 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.830724 15612 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.833040 15612 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.807816 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.834690 15638 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:21.835079 15638 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.835510 15638 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:21.836503 15643 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.837543 15677 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:21.816402 15679 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:16:21.838696 15386 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.839393 15557 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:21.816947 15660 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:16:21.818837 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.840021 15557 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.842278 15557 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.842793 15557 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.843235 15557 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.844957 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.845609 10123 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:21.782096 15559 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:21.819057 15164 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.819402 15629 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.817236 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.793756 15650 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:21.845294 15631 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.955s	user 0.009s	sys 0.000s
W20260709 12:16:21.855466 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 91558.4us
W20260709 12:16:21.858178 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 47946.4us
I20260709 12:16:21.816059 15606 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:21.861109 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.861493 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.857657 15401 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:21.862329 15648 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:21.865011 15648 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:21.865901 15648 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.867256 15648 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:21.867448 15619 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:21.868228 15278 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.868238 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 943) took 1073 ms. Trace:
I20260709 12:16:21.870900 10122 rpcz_store.cc:276] 0709 12:16:20.795001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.795156 (+   155us) service_pool.cc:224] Handling call
0709 12:16:20.795480 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:20.795855 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.795886 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:20.796361 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:16:20.875596 (+ 79235us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:20.894793 (+ 19197us) log.cc:844] Serialized 14 byte log entry
0709 12:16:21.194298 (+299505us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b1800476200. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:16:21.194506 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:21.194579 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:21.865422 (+670843us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b1800476200. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:21.868019 (+  2597us) raft_consensus.cc:1685] finished
0709 12:16:21.868041 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:21.868177 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65938,"prepare.queue_time_us":19589,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":355021,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":55667,"spinlock_wait_cycles":19211776,"thread_start_us":78859,"threads_started":1,"wal-append.queue_time_us":83554}
I20260709 12:16:21.873001 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.873881 15660 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:21.874454 15660 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.874876 15640 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:21.875149 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:21.875712 10199 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:21.876572 15660 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.878818 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:21.879595 10204 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:16:21.879937 15613 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:21.880353 15613 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.880684 15613 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:21.881645 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:21.883087 15547 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.883755 15653 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:21.883599 15547 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.879419 10048 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:21.891168 10199 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:21.899492 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:21.895782 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:21.794754 15431 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.764034 15400 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:21.910017 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:21.909723 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.925150 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.970322 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:21.974195 10048 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:21.975155 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:21.863052 15606 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.982583 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.985164 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:21.980633 15557 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:21.910352  9946 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 5 to 13, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 13 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:21.981914 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.883087 15164 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.994411 15606 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:22.014117 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.014878 10195 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:21.976078 15567 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:21.901638 15679 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:21.997987 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.998309 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:21.998672 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:21.895867 15653 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:21.820210 15618 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.019791 10122 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:22.020390 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:22.021693 10049 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:22.000502 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 104499us
I20260709 12:16:22.022306 15618 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:21.856992 15559 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.023623 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:22.024471 15559 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.000440 10128 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:22.004401 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.025347 10201 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 13: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:21.973265 15386 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:21.972751 15617 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:22.009313 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.026403 15617 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:22.027935 15617 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.029039 10049 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:22.030077 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.026753 10055 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:22.031342 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.031534 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.032251 10055 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:22.032480 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.033052 10049 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:22.033207 10055 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:22.034158 10049 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:16:22.026988 15636 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:21.904156 15660 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:22.011099 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:21.909575 15640 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:22.038350 15640 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.024809 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:21.973073 15180 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:16:22.021283 10732 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:22.040580 15612 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:21.899171 15573 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.046360 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.053898 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:22.051548 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2591) took 1532 ms. Trace:
I20260709 12:16:22.007431 15643 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:22.058271 10123 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:22.059109 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.054986 10127 rpcz_store.cc:276] 0709 12:16:20.519258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.540190 (+ 20932us) service_pool.cc:224] Handling call
0709 12:16:20.574180 (+ 33990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:20.733837 (+159657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.733866 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:20.743860 (+  9994us) log.cc:844] Serialized 52 byte log entry
0709 12:16:20.783839 (+ 39979us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:16:20.783876 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:20.783941 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:21.844646 (+1060705us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:22.046694 (+202048us) raft_consensus.cc:1685] finished
0709 12:16:22.046715 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.051485 (+  4770us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49055,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"spinlock_wait_cycles":10574208,"thread_start_us":175279,"threads_started":2,"wal-append.queue_time_us":86040}
I20260709 12:16:22.061972 15547 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.054853 15386 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:22.064756 15386 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.065820 15638 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.056742 15679 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:22.055279 15567 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.120483 15679 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.121611 15567 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:22.070817 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:22.072394 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.074218 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.123510 10201 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:22.123965 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.124434 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.125065 10201 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:22.125363 15638 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.125480 10195 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:16:22.076444 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.129012 10195 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:22.079661 15653 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:22.080302 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.129999 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:22.080575 15649 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:22.081734 15627 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.084147 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.076565 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.058130 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.148557 10055 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 21: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:22.088020 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.090114 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:22.095973 10048 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:22.150494 10201 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:22.133685 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:22.137159  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:22.138141 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:22.154937 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.149425 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.045046 15573 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.169658 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:22.171949 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.174567 10129 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:22.143183 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 238798us
I20260709 12:16:22.176122 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.179409 15628 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.180428 15400 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.180496 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:22.181162 10055 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:22.181586 15628 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.182687 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.183946 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.185011 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.186003 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.187397 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 997) took 1406 ms. Trace:
I20260709 12:16:22.187757 15465 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:22.150188 15567 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:16:22.158373 15649 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:22.192626 15681 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:16:22.193011 15649 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.193928 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.194550 10123 raft_consensus.cc:2376] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16. Re-sending same reply.
I20260709 12:16:22.197225 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:22.190248 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.175118 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:22.200055 10053 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:22.188858 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2495) took 1187 ms. Trace:
I20260709 12:16:22.147831 15638 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:22.091738 15643 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.200577 10054 rpcz_store.cc:276] 0709 12:16:21.001835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.003542 (+  1707us) service_pool.cc:224] Handling call
0709 12:16:21.003806 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:21.598874 (+595068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.188651 (+589777us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:22.188807 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270304000}
I20260709 12:16:22.170683 15547 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:22.202488 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.208808 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.210475 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.213382 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.204900 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:22.212457 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 70776.4us
I20260709 12:16:22.214305 10048 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:22.217751 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:22.202812 15637 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.000s
I20260709 12:16:22.197237 15618 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:22.223868 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.220187 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.221623 10737 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:22.222512 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.187777 10200 rpcz_store.cc:276] 0709 12:16:20.781338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.781453 (+   115us) service_pool.cc:224] Handling call
0709 12:16:20.788253 (+  6800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:20.891504 (+103251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.892358 (+   854us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:20.894945 (+  2587us) log.cc:844] Serialized 26 byte log entry
0709 12:16:22.186866 (+1291921us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b180043afe0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1
0709 12:16:22.187019 (+   153us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:22.187054 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.187114 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:22.187159 (+    45us) raft_consensus.cc:1685] finished
0709 12:16:22.187169 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.187347 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72348,"raft.queue_time_us":182853,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7507,"spinlock_wait_cycles":11402112,"thread_start_us":129961,"threads_started":2,"wal-append.queue_time_us":154390}
I20260709 12:16:22.226605 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.227459 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.210134 15630 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:22.211990 15638 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.211812 15612 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:22.244408 10125 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:22.244858 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.245415 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.233618 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.210106 15567 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:22.213326 15547 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.247000 15547 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:22.240020 10126 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:16:22.235102 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:22.243499 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.244071 10197 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:22.247260 10202 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:22.053370  9946 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.251262 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:22.251103 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.230786 15528 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:22.254990 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.228381 15628 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:22.250262 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.259318 10195 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:22.254808 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:22.260306 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 45617.4us
I20260709 12:16:22.261070 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.261327 10199 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:16:22.235023 15630 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.263248 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:22.262756 10196 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:16:22.265931 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.241053 15400 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:22.240316 15618 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:22.251783 15567 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:22.246598 15638 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:22.336978 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71098.2us
I20260709 12:16:22.257277 15431 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.254761 15598 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.223053 15613 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.267772 15641 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:22.338552 10200 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:22.350613 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.292750 15630 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:22.357779 10048 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:22.354728 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.227684 15637 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.354763 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.359112 10051 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:22.361074 10735 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:22.361294 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.352433 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.256402 15606 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.363274 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.364390 15557 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:22.364602 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:22.369954 10049 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:22.366927 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:22.350559 15628 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:22.336524 15653 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:22.368264 10055 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:22.351166 15567 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:22.338308 15689 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:22.378932 10731 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:22.378823 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:22.358573 15641 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.388034 10050 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:22.385883 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.396667 10048 raft_consensus.cc:2368] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:16:22.397393 10196 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:22.377538 15684 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:16:22.400869 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.365844 15164 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:22.442194 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.383281 15636 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:22.446008 15687 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:16:22.360625 15598 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.447190 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.447871 15703 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:16:22.387941 15660 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:22.395782 15641 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:22.467278 10195 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:16:22.469514 15694 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:16:22.470641 15700 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:16:22.470922 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.395532 15653 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.476545 15637 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.477135 15653 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:22.481405 15648 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.001s
I20260709 12:16:22.482972 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:22.483459 15654 consensus_meta.cc:287] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.000s
I20260709 12:16:22.483841 15654 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.484241 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.485379 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.485610 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.486680 10204 raft_consensus.cc:2368] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 14. Current term is 15.
W20260709 12:16:22.487145 15691 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:16:22.487047 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.487767 10197 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:22.489751 15612 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:22.463519 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.493153 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.494809 10197 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
W20260709 12:16:22.495005 15702 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:16:22.494617  9946 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 14, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:22.495744 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.496861 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.496271  9946 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 16, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.497731 10197 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:22.469623 15573 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.475033 15643 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:22.499455 15606 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.494323 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.503998 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.504539 10122 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:22.474735 15678 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:22.506642 15639 consensus_meta.cc:287] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.001s
I20260709 12:16:22.507319 15180 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.507632 10049 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:16:22.509023 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:22.509188 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.509888 10126 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:22.510074 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:22.511189 15547 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:22.511792 15598 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.512215 10122 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:22.512393 10199 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:16:22.512876 15678 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.513861 15629 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:22.515013 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.515902 10195 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:22.484143 15567 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.517122 10733 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:22.518808 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.580924 10202 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:22.519291 15618 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.507790 15180 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.583966 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 835) took 1465 ms. Trace:
I20260709 12:16:22.526705 10129 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:22.498502 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:22.531668 10735 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:22.485992 15654 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:22.572623 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 309425us
W20260709 12:16:22.526491 15650 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.000s
I20260709 12:16:22.468079 15660 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.579509 10200 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:22.521072 15613 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:22.600455 10200 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:22.575835 15629 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:22.502559 15636 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.498312  9946 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 14, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:22.609114  9946 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 15, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 15 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:22.613093 15628 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:22.614198 10123 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:22.614779 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:22.615458 10195 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:22.617022 10728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 876) took 1825 ms (client timeout 1803 ms). Trace:
W20260709 12:16:22.617441 10728 rpcz_store.cc:269] 0709 12:16:20.792003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.792132 (+   129us) service_pool.cc:224] Handling call
0709 12:16:22.616785 (+1824653us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400731254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:22.616926 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447501184}
I20260709 12:16:22.620563 10054 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:16:22.576094 15656 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:16:22.597878 15660 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:22.587706 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:22.602401 15462 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:16:22.633249 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 170460us
I20260709 12:16:22.634756 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:22.584362 10052 rpcz_store.cc:276] 0709 12:16:21.118443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.118732 (+   289us) service_pool.cc:224] Handling call
0709 12:16:21.135139 (+ 16407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:21.665313 (+530174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.583760 (+918447us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54002a1f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:22.583912 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144020864}
I20260709 12:16:22.641180 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.631178 15643 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.642234 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:22.642859 15386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.006s
I20260709 12:16:22.623023 15567 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:22.641760 15462 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:22.690680 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:22.693354 10053 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:22.649384 15628 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:22.692056 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 49919.8us
I20260709 12:16:22.694876 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:22.649760 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 278960us
W20260709 12:16:22.688650 15386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.006s
I20260709 12:16:22.688735 15650 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:22.726023 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.730170 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.695859 15528 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:22.765681 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:22.770124 15678 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:22.770954 15638 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.773082 15638 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.773793 15400 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:22.687371 15629 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.780800 15629 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:22.781293 15637 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:22.788692 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.689841 15643 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.792045 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 874) took 2018 ms. Trace:
I20260709 12:16:22.792404 10730 rpcz_store.cc:276] 0709 12:16:20.773429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.778169 (+  4740us) service_pool.cc:224] Handling call
0709 12:16:20.778485 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:20.966026 (+187541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:20.966063 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:20.966108 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:20.966140 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:22.791797 (+1825657us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540029e0d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:22.791845 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:22.791988 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403199360}
I20260709 12:16:22.793780 10195 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:22.796712 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:22.828112 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:22.847801 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 313135us
W20260709 12:16:22.851595 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54973.7us
I20260709 12:16:22.852886 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.851882 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:22.860553 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.861001 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:22.839591 15632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.023s	sys 0.016s
I20260709 12:16:22.863819 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:22.864445 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:22.864800 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:22.870622 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 96269us
I20260709 12:16:22.873811 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:22.869647 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:22.724013 15628 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.791800 15717 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:22.839735 15400 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:22.877207 15278 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:22.847491 15638 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:22.763229 15650 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:22.791443 15257 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 12:16:22.870110 15632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.024s	sys 0.016s
I20260709 12:16:22.850347 15679 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:16:23.006064 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 110223us
W20260709 12:16:23.017923 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.007525 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:22.870180 15470 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:22.863899 15606 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:22.858777 15547 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:22.791193 15462 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:22.870133 15528 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 12:16:23.016234 15567 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.069281 15729 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:23.074764 15636 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.075546 15636 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:23.077004 15660 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.077723 15528 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:23.016352 15642 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:23.078315 15528 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:23.078718 15642 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.041774 15706 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:23.041756 15400 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.045202 15180 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.051923 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:22.653365  9946 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 11, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 11 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.878393 15613 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:22.845846 15678 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
W20260709 12:16:23.051959 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44501.4us
I20260709 12:16:22.890614 15717 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:23.015333 15654 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:23.062747 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:23.125214 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:23.107169 15462 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:23.126579 10733 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:16:23.115015 15676 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:16:23.055931 15638 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.130340 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:23.131637 15628 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.115568 15463 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:23.132315 15463 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:23.132836 15714 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
W20260709 12:16:23.134019 15630 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 12:16:23.134438 15630 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.079348 15528 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.085204 15729 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:16:23.138782 15734 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:23.142772 10197 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:23.144059 15630 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.091094 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:23.106747 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54911.3us
I20260709 12:16:23.061587 15639 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:23.149999 15639 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.117600 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:23.151149 15723 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:16:23.042135 15608 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:16:23.150065 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.145929 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:23.152340 15639 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.132658 15710 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.153060 15710 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.154060 10122 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:23.155337 15710 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:23.104336 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 240580us
I20260709 12:16:23.156194 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.132725 15463 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:23.163893 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:23.165246 10195 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:23.165812 10122 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:23.166567 10737 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:23.167179 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:23.119251 15717 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:23.170219 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.173453 15638 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.173695 15710 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:23.134337 15720 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:16:23.183744 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.184540 10734 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:23.176326 15547 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:23.178951 15679 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:23.180402 15606 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:23.180608 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:23.191210 10121 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:23.129007 15654 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:23.174649 15400 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.181119 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.188215 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.126147 15613 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:23.169904 15678 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.200767 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.202682 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.190336 15679 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:23.200562 15641 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 12:16:23.211962 15716 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.214596 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.217945 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.201092 15547 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:23.218959 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.207509 15629 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:23.186604 15180 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:16:23.215734 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:23.224586 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.227131 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2104) took 1673 ms. Trace:
I20260709 12:16:23.227252 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 1001) took 1341 ms. Trace:
I20260709 12:16:23.227633 10204 rpcz_store.cc:276] 0709 12:16:21.885579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.885702 (+   123us) service_pool.cc:224] Handling call
0709 12:16:23.227043 (+1341341us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001036d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:23.227172 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174230400}
I20260709 12:16:23.202099 15724 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:23.226257 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:23.227576 10198 rpcz_store.cc:276] 0709 12:16:21.553719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.554493 (+   774us) service_pool.cc:224] Handling call
0709 12:16:21.604515 (+ 50022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:21.772635 (+168120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:21.772669 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:21.772709 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:21.772737 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.226883 (+1454146us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540003cad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.226931 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.227060 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386187136}
I20260709 12:16:23.210928 15660 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.214560 15643 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:23.236212 10127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.008s
I20260709 12:16:23.228138 15400 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.238704 10127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.008s
I20260709 12:16:23.234813 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:23.236992 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.009s
W20260709 12:16:23.239964 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.007s	sys 0.009s
W20260709 12:16:23.240234 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 543421us
I20260709 12:16:23.241494 10168 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.223380 15728 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:16:23.199934 15678 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.243952 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.219261 15641 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.216228 15654 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.233295  9946 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 18 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.247453 15638 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:23.246390 15660 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:23.295161 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.312853 10053 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:23.312229  9946 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 11 to 14, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:23.312248 15735 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:16:23.314095 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.250356 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:23.316004 10198 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:23.315824 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71961.5us
I20260709 12:16:23.261220 10204 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:23.316202 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:23.315356 10053 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:23.325470 10202 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:16:23.319101 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:23.286767 15732 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:16:23.289450 15708 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:23.238658 15630 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:23.332374 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.289204 15733 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:23.279968 15710 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:23.336558 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88173.7us
I20260709 12:16:23.292738 15737 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.306638 15642 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.311110 15444 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:23.337940 10200 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 12:16:23.334496 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 116629us
I20260709 12:16:23.246281 15400 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.270362 15650 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:23.342721 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.344615 10731 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:23.314101  9946 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.289573 15712 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:16:23.400821 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:23.386377 15622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.014s	sys 0.011s
I20260709 12:16:23.337149 15718 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:16:23.332677 15738 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:23.243206 15613 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.343910 15708 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:23.387848 10204 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:23.400406 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:23.242763 15716 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 12:16:23.403111 15622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.699s	user 0.014s	sys 0.011s
I20260709 12:16:23.397598 15599 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.397773 15618 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.335350 15627 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:16:23.269507 15547 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.338939 15628 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:23.401561 10122 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:23.248656 15679 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.419515 15642 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.399526 15711 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:23.463250 15739 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:16:23.384050 15630 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
W20260709 12:16:23.424436 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 85820.1us
I20260709 12:16:23.418162 15728 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:23.343166 15701 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:16:23.462659 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 128039us
I20260709 12:16:23.399906 15737 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:23.475711 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:23.485898 10122 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:23.482645 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 82316.4us
I20260709 12:16:23.486789 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.466856 15628 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.490617 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.490903 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.485200 15622 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:16:23.488641 15742 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:16:23.501688 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.489168 15678 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.465989 15599 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.503060 15716 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:23.508643 15708 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.511866 15463 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.513135 15641 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.513257 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2506) took 1149 ms. Trace:
I20260709 12:16:23.491381 15737 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.515412 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1013) took 1028 ms. Trace:
I20260709 12:16:23.535434 10200 rpcz_store.cc:276] 0709 12:16:22.487407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.628658 (+141251us) service_pool.cc:224] Handling call
0709 12:16:22.628993 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:23.385894 (+756901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.515179 (+129285us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000627d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.515357 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629914880}
I20260709 12:16:23.511765 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.519270 10122 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:23.467186 15618 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.524632 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:23.476521 15642 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.532869 10048 rpcz_store.cc:276] 0709 12:16:22.364214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.364363 (+   149us) service_pool.cc:224] Handling call
0709 12:16:23.513057 (+1148694us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400275bd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:23.513180 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60577664}
I20260709 12:16:23.545050 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.517963 15622 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:23.539204 10122 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:23.495025 15628 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:23.551370 10121 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:16:23.551838 15737 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:23.486014 15711 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.530491 15627 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:23.542982 10204 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:23.548439 10122 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:23.549417 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:23.562268 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.541561 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:23.565984 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2097) took 1188 ms. Trace:
I20260709 12:16:23.593974 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:23.596621 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.597910 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:23.599949 10729 raft_consensus.cc:2410] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:16:23.486869 15728 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.573012 10127 rpcz_store.cc:276] 0709 12:16:22.377734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.378061 (+   327us) service_pool.cc:224] Handling call
0709 12:16:22.378386 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:22.399653 (+ 21267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:22.399689 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:22.400177 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:16:22.595598 (+195421us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18002bba00. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:16:23.244558 (+648960us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:23.244599 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.244670 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:23.558937 (+314267us) raft_consensus.cc:1685] finished
0709 12:16:23.558966 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.565904 (+  6938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476,"raft.queue_time_us":144,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12333,"spinlock_wait_cycles":10124672,"thread_start_us":648770,"threads_started":1,"wal-append.queue_time_us":832735}
I20260709 12:16:23.604909 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2491) took 2717 ms. Trace:
I20260709 12:16:23.544054 15751 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:23.609004 15751 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:23.609874 15751 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:23.569047 15737 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:23.611020 15737 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.613412 15737 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:23.534837 15735 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:16:23.606760 10047 rpcz_store.cc:276] 0709 12:16:20.881515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.881767 (+   252us) service_pool.cc:224] Handling call
0709 12:16:20.882048 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:21.284665 (+402617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.598747 (+2314082us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54002f76d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.598955 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895398656}
I20260709 12:16:23.624166 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.627486 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.629585 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.630175 10047 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:23.635722 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.643066 10052 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:23.650384 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 159554us
I20260709 12:16:23.650763 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.653532 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.657270 15618 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.659088 15599 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:23.659983 15628 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.661980 15628 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.663216 15642 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.664186 15711 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:23.665436 15462 consensus_meta.cc:287] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.005s
I20260709 12:16:23.494304  9946 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 13 to 16, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:23.668916 10047 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:23.670454 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.671250 10047 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:23.672207 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.672550 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.672900 10047 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:23.675773 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.675647 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:23.665262 15463 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:23.691146 10094 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.607s (SENT)
I20260709 12:16:23.691701 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:23.693863 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.622107 15717 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.694729 10052 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:23.706709 10047 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:23.708221 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.669508 15749 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:23.683095 15642 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:23.694020 15628 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:23.717187 10047 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:23.727403 10128 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:23.728439 10052 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:16:23.694888 15735 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:23.693863 15599 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:16:23.693581 15711 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:16:23.702492 15462 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:16:23.715758 15630 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:16:23.743542 10732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 878) took 2912 ms (client timeout 1862 ms). Trace:
W20260709 12:16:23.743983 10732 rpcz_store.cc:269] 0709 12:16:20.829658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:20.830523 (+   865us) service_pool.cc:224] Handling call
0709 12:16:23.741577 (+2911054us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006efd54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:23.741720 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2735928576}
W20260709 12:16:23.748437 15671 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 2.128s	user 0.004s	sys 0.006s
I20260709 12:16:23.651160 15622 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.752622 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2483) took 1266 ms. Trace:
I20260709 12:16:23.753044 10197 rpcz_store.cc:276] 0709 12:16:22.486221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.598919 (+112698us) service_pool.cc:224] Handling call
0709 12:16:22.599218 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.143223 (+544005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.752358 (+609135us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000e9cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.752550 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249631104}
I20260709 12:16:23.754181 15756 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.754722 15756 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.755086 15632 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:23.755527 15632 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:23.756359 15632 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.757642 15632 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:23.761642 15627 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:23.762869 15728 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:23.766834 15750 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 12:16:23.768215 15629 consensus_meta.cc:287] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
W20260709 12:16:23.772173 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.773087 15706 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:23.775362 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2475) took 1423 ms. Trace:
I20260709 12:16:23.756973  9946 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:23.779873 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2474) took 1486 ms. Trace:
I20260709 12:16:23.808950 10196 rpcz_store.cc:276] 0709 12:16:22.293997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.336752 (+ 42755us) service_pool.cc:224] Handling call
0709 12:16:22.355282 (+ 18530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.408801 (+ 53519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.777929 (+1369128us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5400203d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.779808 (+  1879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91219328}
I20260709 12:16:23.777307 15465 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:23.732134 15628 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:23.785658 15597 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:23.802685 10053 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:23.841094 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2744) took 1014 ms. Trace:
I20260709 12:16:23.807000 10199 rpcz_store.cc:276] 0709 12:16:22.352383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.353970 (+  1587us) service_pool.cc:224] Handling call
0709 12:16:23.775135 (+1421165us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540007d854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:23.775292 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336507136}
I20260709 12:16:23.780831 15630 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:23.797133 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 143274us
I20260709 12:16:23.841471 10053 rpcz_store.cc:276] 0709 12:16:22.826878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.313840 (+486962us) service_pool.cc:224] Handling call
0709 12:16:23.841031 (+527191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:23.775563 15716 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.845341 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:23.840637 15597 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:23.806809 15706 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:23.810801 15629 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:23.839041 15627 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.852624 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.810891 15465 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:23.851804 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.854771 10121 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:23.840689 15625 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:23.858031 10122 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:23.859922 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:23.862232 10127 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
W20260709 12:16:23.862371 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 80671.7us
I20260709 12:16:23.861783 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:23.863559 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:23.853760 15718 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:23.855818 15708 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:16:23.871812 15632 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:16:23.887938 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 360871us
I20260709 12:16:23.861785 15627 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:23.914659 15760 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:16:23.887504 15654 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.918397 15764 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:16:23.942780 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.885295 15718 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:23.909507 15632 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:23.947268 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1003) took 2048 ms. Trace:
I20260709 12:16:23.951359 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.950945 10203 rpcz_store.cc:276] 0709 12:16:21.898392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.898572 (+   180us) service_pool.cc:224] Handling call
0709 12:16:21.982327 (+ 83755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.196596 (+214269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:22.196628 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:22.196674 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:22.196702 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:23.947036 (+1750334us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400262fd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:23.947085 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:23.947210 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492282240}
I20260709 12:16:23.974596 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.977705 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.980284 10196 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:23.980772 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:23.981945 10047 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:23.983161 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:23.984731 10197 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:23.984355 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:23.984357 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:23.952080 15654 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.986390 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:23.986835 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:23.987962 15654 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:23.885200 15628 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.989367 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:23.990466 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:23.888271 15597 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.974201 15689 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:23.953470 15632 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:23.998569 15597 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:24.000418 15751 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:24.000837 15751 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:24.001667 15751 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:23.952942 15664 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:16:23.916821 15706 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:23.915503 15630 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.004482 15627 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.005429 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.006361 10199 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:16:23.993518 10053 pending_rounds.cc:85] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 11
I20260709 12:16:23.908191 15465 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:23.983144 15712 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:24.009393 10053 pending_rounds.cc:107] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:16:24.022589 10053 raft_consensus.cc:2889] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:24.025357 10204 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:16:23.992041 15618 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:23.971297 15431 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:16:23.979120 15613 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.983456 15695 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:16:24.029089 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.029579 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 962) took 1525 ms. Trace:
I20260709 12:16:24.018143 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:24.031417 10050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2500) took 2256 ms (client timeout 2737 ms). Trace:
I20260709 12:16:23.995653 15599 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:23.993086 15743 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:23.992436 15758 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:24.038978 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:24.035033 10126 rpcz_store.cc:276] 0709 12:16:22.504494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.511405 (+  6911us) service_pool.cc:224] Handling call
0709 12:16:22.511670 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:22.642094 (+130424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:22.642124 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:22.642164 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:22.642193 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.029331 (+1387138us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540009a6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:24.029374 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:24.029516 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299525888}
I20260709 12:16:23.887682  9946 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 6 to 14, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 14 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:24.037002 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.010548 15689 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:24.026779 15622 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:24.030786 15751 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:24.035493 10050 rpcz_store.cc:269] 0709 12:16:21.775031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:21.775499 (+   468us) service_pool.cc:224] Handling call
0709 12:16:24.031199 (+2255700us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003f1954. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:24.031351 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380911360}
I20260709 12:16:24.032249 15618 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:24.034170 15465 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:24.054586 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.038017 15743 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.055598 10204 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:24.058804 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.038995 15777 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:24.075353 10201 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:24.077194 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.078606 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:24.050549 15641 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.078500 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.052788 15599 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:24.050261 15749 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.082702 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:24.066757 15270 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:24.085139 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:24.085448 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:24.090123 10728 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:24.054526 15618 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:24.072851 15621 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.086858 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:24.056192 15743 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:24.047428 15627 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:16:24.076675 15777 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.093055 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:24.087285 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.052647 15716 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:16:24.105257 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.105867 10201 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:24.031813 15712 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.052907 15695 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:16:24.033778 15718 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.054868 15622 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.107220 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:24.091030 15547 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:24.095568 15630 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:24.118251 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.123247 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.123747 10054 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 21: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:24.094450 15749 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.125936 10130 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:24.126538 15749 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.126667 15737 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:24.127347 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.127168 15737 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.129190 15737 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.089686 15641 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.131551 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.148790 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.149430 10130 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:24.104233 15777 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:24.126556 10050 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:24.140122 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:24.150720 10201 raft_consensus.cc:2368] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:24.156656 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.157927 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.097332 15621 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.159828 10050 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:24.160910 15747 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:24.160817 15621 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.161350 15747 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.162231 15747 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.163285 15747 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:24.163872 15641 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:24.175935 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44464.2us
I20260709 12:16:24.176985 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.177747 10054 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:24.180773 10094 leader_election.cc:400] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:24.181145 10094 leader_election.cc:403] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:16:24.148340 15627 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:16:24.184260 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 147313us
I20260709 12:16:24.185662 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:24.175601 15739 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:16:24.186813 10054 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:16:24.192647 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.182163 15771 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:16:24.113571 15782 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:16:24.181218 15621 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:24.185676 15627 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:24.192354 15716 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:24.203766 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.210108 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.211197 10055 raft_consensus.cc:2368] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:16:24.202258 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.194327 15699 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:24.114195 15689 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.181627 15632 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.199661 15758 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.213021 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.218116 15712 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.209630 15677 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:24.223205 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.224867 15613 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:24.225078 15653 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:24.225307 15613 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:24.225701 15653 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.226673 15735 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.227155 15735 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.227955 15653 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.229146 15735 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.198998 15733 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:16:24.231182 15629 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:24.231592 15629 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.231724 15733 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:24.232095 15733 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.232455 15629 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.232825 15733 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.233460 15629 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:24.235368 15622 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.218075 15758 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.237600 15612 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:24.237998 15612 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.208312 15627 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:24.238168 15758 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.239737 15612 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.240736 15612 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:24.107232  9946 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 17, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.243060 15721 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:24.243479 15721 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:24.243871 15632 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.208537 10201 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:24.216351 10019 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:24.252274 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.254349 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.256362 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.257750 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:24.259133 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.263751 10728 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:24.253127 10054 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:24.273542 10053 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:24.266680 15758 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:16:24.274812 15708 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:24.275427 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.278023 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:24.287904 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.279312 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.288941 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 885) took 1180 ms. Trace:
I20260709 12:16:24.289309 10731 rpcz_store.cc:276] 0709 12:16:23.108323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.108571 (+   248us) service_pool.cc:224] Handling call
0709 12:16:23.108860 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.388739 (+279879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.275961 (+887222us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54006491d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:24.288887 (+ 12926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541753728}
I20260709 12:16:24.295931 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.263377 15632 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:24.262801 15715 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:24.244398 15721 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.303877 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.304603 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.307312 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:24.312556 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.313172 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:24.314047 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.290997 15639 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.293746 15728 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.317173 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:24.294711 15735 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:24.316979 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:24.332787 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 199587us
W20260709 12:16:24.333102 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.302093 15632 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.335115 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:24.337961 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.338689 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.355646 10201 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:24.356832 15795 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:24.357465 15795 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.360348 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.306507 15733 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:24.305630 15789 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.362965 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.371659 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:24.263262 15677 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.363154 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.373050 10053 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:24.312181 15630 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:24.367982 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.373909 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:24.374389 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.371595 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.295744 15708 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.359891 15795 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.334261 15782 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:24.342578 15270 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:24.354215 15735 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:24.384016 10130 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:16:24.384819 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.338821 15647 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:24.382440 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.383538 10732 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:24.386102 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.334648 15580 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:24.362126 15632 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:24.387612 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.363246 15641 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.412303 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.416738 15798 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:24.417290 15798 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:24.417654 15798 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:24.422667 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.424741 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.334492 15639 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.427253 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.243881  9946 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 14, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:24.360512 15728 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.391335 15270 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:24.435088 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55141.4us
I20260709 12:16:24.400661 15647 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.437680 10124 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:16:24.432331 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 388765us
I20260709 12:16:24.438220 10124 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.397195 15735 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:24.436520 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.386067 15782 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:24.441735 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 85571.1us
I20260709 12:16:24.440543 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:24.442585 10735 raft_consensus.cc:2376] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14. Re-sending same reply.
I20260709 12:16:24.446910 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.448022 10201 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 9.
I20260709 12:16:24.448961 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:24.449450 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.450639 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:24.450691 10124 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.384466 15789 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.450023 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.457592 10201 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:24.396827 15597 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:16:24.461373 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.460958 10124 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:24.462631 10126 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:24.464735 10123 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:16:24.437937 15270 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:24.440006 15647 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:24.475291 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.476166 10735 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:24.428056 15580 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.447479 15622 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.433277 15704 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:16:24.478609 10201 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:24.482816 10046 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:24.426441 15641 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.485126 10730 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:24.435652 15625 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:16:24.491894 10201 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:16:24.493415 10201 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:24.499238 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:24.416043 15777 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.501844 10201 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:16:24.509546 10201 pending_rounds.cc:85] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:24.510201 10201 pending_rounds.cc:107] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:16:24.510689 10201 raft_consensus.cc:2889] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:24.490275 15622 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.521310 10730 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:16:24.529170 10201 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:24.529878 10734 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:24.535269 10124 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:16:24.535766 10124 pending_rounds.cc:85] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:16:24.536093 10124 pending_rounds.cc:107] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:16:24.536399 10124 raft_consensus.cc:2889] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:24.541159 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.543064 10201 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:24.551890 15639 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.554512 10124 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:24.552232 15641 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:24.573104 15801 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:16:24.575676 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.584867 10095 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 2.737s (SENT) [suppressed 10 similar messages]
I20260709 12:16:24.524801 15618 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.545408 15401 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:16:24.499559 15782 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.611882 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:24.618881 10128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2620) took 1788 ms (client timeout 1598 ms). Trace:
I20260709 12:16:24.509128  9946 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:24.601796 15728 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:24.619378 10128 rpcz_store.cc:269] 0709 12:16:22.826220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:22.860639 (+ 34419us) service_pool.cc:224] Handling call
0709 12:16:24.614474 (+1753835us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:24.614606 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990691584}
I20260709 12:16:24.620232 15756 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.622685 15465 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.643142 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.623100 15708 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.643929 10128 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:24.646663 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.647274 10201 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:16:24.626946 15782 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:24.654690 15580 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.651325 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:24.655740 15715 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:24.644120 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 153214us
I20260709 12:16:24.657965 15759 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:24.686544 15465 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.686005 15715 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.689186 15715 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.689422 15465 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.659162  9946 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 12, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 12 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:24.690824  9946 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 11 to 16, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.692986 15630 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:24.693395 15618 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.693599 15630 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.694036 15749 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:24.694511 15749 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.694846 15749 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:24.695187 15641 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.695652 15641 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.695760 15630 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.697656 15641 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.662508 15735 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.682086 15770 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:16:24.687057 15759 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:24.664497 15627 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:24.653294 15743 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:16:24.671437 15716 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:24.706363 15803 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:16:24.711326 10128 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:24.712896 15717 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.717854 15270 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.720822 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:24.721299 15751 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
W20260709 12:16:24.704532 15799 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:16:24.724136 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:24.724924 15747 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 12:16:24.725472 10124 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:24.722297 15270 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.727510 15776 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:24.705093 15770 consensus_queue.cc:1243] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:16:24.671650 15798 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.705363 15743 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.732534 15743 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:24.733122 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.735010 15735 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.735054 10730 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:24.736413 15759 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.737428 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:24.737947 10730 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:24.738405 15270 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.757603 15647 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.740561 15627 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:24.741328 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.763882 15270 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.737435 15759 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:24.725371 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.765512 15462 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:16:24.765872 15622 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.766090 15270 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:24.770910 15743 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:24.710347 15777 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.733232 10728 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:24.772221 15743 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.773288 10201 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:24.774466 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.775259 10201 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:24.776422 10201 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:16:24.778935 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.779196 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.779795 15621 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.780305 15621 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:24.780694 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.746781  9946 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:24.751641 15624 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:16:24.755851 10195 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:16:24.782353 15621 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.783005 15621 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.738927 15613 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:24.764566 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:24.784584 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.757333 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:24.786290 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.786379 15160 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.787168 15160 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.787429 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:24.788502 15400 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.783700 15621 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:24.788959 10122 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:16:24.758874 10125 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:24.789345 15160 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.790537 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.791105 15621 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:24.762616 10129 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:24.803694 10129 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:24.763725 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:24.719269 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:24.722175 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:24.741762 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:24.744881 15629 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 12:16:24.739071 15798 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:24.791366 10204 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:16:24.780194 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.759740 10202 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:16:24.779626 10053 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:24.789338 10122 pending_rounds.cc:85] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 9
I20260709 12:16:24.790867 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2127) took 1264 ms. Trace:
I20260709 12:16:24.873476 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.850220 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:24.804065 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:24.920909 10122 pending_rounds.cc:107] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 16.10
W20260709 12:16:24.921295 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 127549us
I20260709 12:16:24.918093 10200 rpcz_store.cc:276] 0709 12:16:23.526103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.536280 (+ 10177us) service_pool.cc:224] Handling call
0709 12:16:23.536557 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:23.605384 (+ 68827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:23.605419 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:23.632071 (+ 26652us) log.cc:844] Serialized 26 byte log entry
0709 12:16:23.727941 (+ 95870us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:23.727982 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:24.790524 (+1062542us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b54003138d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:24.790568 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:24.790610 (+    42us) raft_consensus.cc:1685] finished
0709 12:16:24.790626 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:24.790814 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8868,"raft.queue_time_us":9496,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":15214,"spinlock_wait_cycles":136870272,"thread_start_us":61634,"threads_started":1,"wal-append.queue_time_us":94092,"wal-append.run_cpu_time_us":1467,"wal-append.run_wall_time_us":1001962}
W20260709 12:16:24.844281 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 259428us
I20260709 12:16:24.910508 15706 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:25.030546 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.021009 10127 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:24.804780 10195 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:25.021978 10201 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:25.022368 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.035137 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:25.039836 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:25.040009 10123 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:25.040489 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:24.911445 10050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.005s	sys 0.021s
I20260709 12:16:25.040921 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:25.041308 10050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.024s
I20260709 12:16:24.850220 10129 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:25.036428 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.031046 10124 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:16:25.036717 10122 raft_consensus.cc:2889] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:25.020224 10048 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:25.042398 10129 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:25.042410 10124 pending_rounds.cc:85] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 8
I20260709 12:16:25.036966 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.043699 10124 pending_rounds.cc:107] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:16:25.044155 10124 raft_consensus.cc:2889] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:25.022636 10052 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:25.045143 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.045859 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.047736 10051 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:25.047761 10054 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:25.056881 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:25.057083 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:25.063740 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:25.087119 10198 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:25.095281 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:25.096979 10202 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:25.097514 10202 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9.
I20260709 12:16:25.100432 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:25.102466 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:24.751677 15632 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:25.104383 15802 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:25.113353 15814 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:25.064556 15743 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:25.104653 15625 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.125547 15625 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:25.056344 15160 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:16:24.961063 15788 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:16:25.118563 15802 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:25.044756 15621 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.086735 15745 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:25.107088 15654 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:25.148288 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.084965 15751 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:16:25.085062 15749 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:25.104913 15637 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:16:25.139066 15814 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:25.327832 10048 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
W20260709 12:16:25.271819 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.288091 10128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.034s	sys 0.019s
W20260709 12:16:25.154896 10701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.019s
W20260709 12:16:25.408469 10701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.009s	sys 0.030s
W20260709 12:16:25.188452 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.409252 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.407819 10128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.035s	sys 0.020s
W20260709 12:16:25.215246 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.018s	sys 0.005s
W20260709 12:16:25.411103 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.018s	sys 0.010s
W20260709 12:16:25.411278 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 716467us
I20260709 12:16:25.227519 10197 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:25.165162 10053 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:25.220690 10129 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:16:25.056576  9946 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 12, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 12 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.412608 10129 pending_rounds.cc:85] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 7
I20260709 12:16:25.464881 10129 pending_rounds.cc:107] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:16:25.465298 10129 raft_consensus.cc:2889] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:25.412963 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:25.154805 10130 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.008s	sys 0.019s
W20260709 12:16:25.466038 10130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.012s	sys 0.023s
I20260709 12:16:25.147703 10127 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:25.370201 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:25.389346 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 286958us
I20260709 12:16:25.491835 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:25.490273 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2107) took 2088 ms. Trace:
W20260709 12:16:25.185158 15718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.009s	sys 0.020s
W20260709 12:16:25.351258 15809 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:16:25.146814 15654 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:25.332438 15712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.015s	sys 0.007s
I20260709 12:16:25.147897 15621 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:25.548439 10121 rpcz_store.cc:276] 0709 12:16:23.401913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.552185 (+150272us) service_pool.cc:224] Handling call
0709 12:16:23.552442 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:23.857663 (+305221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.488440 (+1630777us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001e3f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:25.490201 (+  1761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694842240}
W20260709 12:16:25.800403 10201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.023s	sys 0.018s
W20260709 12:16:25.729233 10196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.011s	sys 0.036s
W20260709 12:16:25.956964 10201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.023s	sys 0.018s
W20260709 12:16:25.957273 10196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.024s	sys 0.040s
W20260709 12:16:25.958806 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.959227 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.959601 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.959887 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.960170 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:25.960510 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:25.822170 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.798784 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.962826 10053 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:25.712033 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2100) took 2146 ms. Trace:
W20260709 12:16:25.876008 10167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.013s	sys 0.027s
W20260709 12:16:25.964385 10167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.013s	sys 0.028s
W20260709 12:16:25.969885 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 478080us
I20260709 12:16:25.970667 10127 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:25.971333 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2642) took 1209 ms. Trace:
I20260709 12:16:25.971652 10127 rpcz_store.cc:276] 0709 12:16:24.761639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.801637 (+1039998us) service_pool.cc:224] Handling call
0709 12:16:25.970300 (+168663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.971076 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.971281 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:25.419373 15776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.004s	sys 0.018s
I20260709 12:16:25.972945 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:25.973501 10126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.004s	sys 0.037s
W20260709 12:16:25.997749 10126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.005s	sys 0.037s
W20260709 12:16:25.410799 15777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.014s
I20260709 12:16:25.998813 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2643) took 1237 ms. Trace:
W20260709 12:16:26.007243 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.007709 15802 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:25.972597 15712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.017s	sys 0.015s
W20260709 12:16:25.777990 15806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.035s	sys 0.023s
W20260709 12:16:25.710737 15740 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:16:25.963632 10129 rpcz_store.cc:276] 0709 12:16:23.400090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:23.400715 (+   625us) service_pool.cc:224] Handling call
0709 12:16:23.400987 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.762521 (+1361534us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54001b4a20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:16:25.546533 (+784012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.546840 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27667200}
I20260709 12:16:25.999756 10730 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:25.954231 15718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.544s	user 0.013s	sys 0.030s
I20260709 12:16:26.006201 10121 rpcz_store.cc:276] 0709 12:16:24.761870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.981347 (+1219477us) service_pool.cc:224] Handling call
0709 12:16:25.998187 (+ 16840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.998454 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:25.998481 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:25.998526 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:25.998556 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.998618 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:25.998753 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:25.982712 15654 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:26.010267 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:25.495510 15745 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:25.953915 15679 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:25.981516 15817 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.193s	user 0.000s	sys 0.009s
W20260709 12:16:26.020133 10125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.017s	sys 0.033s
I20260709 12:16:26.017153 10200 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:26.030895 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.009646 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:25.999758 15776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.011s	sys 0.025s
I20260709 12:16:26.027868 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2644) took 1265 ms. Trace:
I20260709 12:16:26.036893 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:26.014686 15810 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.908s	user 0.020s	sys 0.024s
W20260709 12:16:26.015197 15777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.002s	sys 0.022s
I20260709 12:16:26.129017 10127 rpcz_store.cc:276] 0709 12:16:24.762116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.988855 (+1226739us) service_pool.cc:224] Handling call
0709 12:16:26.026386 (+ 37531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.027378 (+   992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.027437 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.027503 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:26.027562 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.027637 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.027807 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:26.129746 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:26.018262 15629 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:26.042995 10129 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:26.133561 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 987) took 1219 ms. Trace:
I20260709 12:16:26.133993 10129 rpcz_store.cc:276] 0709 12:16:24.913990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.042414 (+1128424us) service_pool.cc:224] Handling call
0709 12:16:26.042822 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.133277 (+ 90455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.133502 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:26.022662 15806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.035s	sys 0.041s
W20260709 12:16:26.128408 10125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.017s	sys 0.037s
I20260709 12:16:26.231618 15677 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.016742 15630 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.120s
I20260709 12:16:26.199277 15749 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.201359 15400 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.097941 15632 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.217959 15621 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.291138 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 984) took 1551 ms. Trace:
I20260709 12:16:26.009400 15822 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.135s
W20260709 12:16:26.232170 15706 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.175s	user 0.013s	sys 0.004s
I20260709 12:16:26.145167 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.132525 15745 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.328704 10049 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:16:26.329118 10049 pending_rounds.cc:85] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 9
I20260709 12:16:26.329337 10049 pending_rounds.cc:107] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:16:26.329552 10049 raft_consensus.cc:2889] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:26.130651 15809 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:16:26.143530 15629 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.116182 15718 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:26.184162 15738 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:16:26.032857 15647 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.141769 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:26.045312  9946 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 10, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 10 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.143760 15431 consensus_queue.cc:1059] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
W20260709 12:16:26.257997 10197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.013s
W20260709 12:16:26.334976 10197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.014s
W20260709 12:16:26.258512 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.017s	sys 0.043s
W20260709 12:16:26.144586 10130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.001s	sys 0.011s
W20260709 12:16:26.335122 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 193457us
W20260709 12:16:26.259397 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.007s	sys 0.011s
I20260709 12:16:26.335850 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:26.336066 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.008s	sys 0.012s
W20260709 12:16:26.336598 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 966415us
I20260709 12:16:26.293977 15400 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:26.276904 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:26.279148 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2522) took 1950 ms (client timeout 1735 ms). Trace:
I20260709 12:16:26.278126 15624 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:26.277771 15759 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 1.513s	user 0.011s	sys 0.000s
I20260709 12:16:26.294302 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2154) took 1381 ms. Trace:
I20260709 12:16:26.292011 10125 rpcz_store.cc:276] 0709 12:16:24.739870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.791357 (+ 51487us) service_pool.cc:224] Handling call
0709 12:16:24.909941 (+118584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:24.910332 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:24.910358 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:24.910840 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:16:26.269670 (+1358830us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:26.269717 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.269795 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:26.290556 (+ 20761us) raft_consensus.cc:1685] finished
0709 12:16:26.290578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.291061 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":474,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":1358414,"threads_started":1,"wal-append.queue_time_us":1376400}
W20260709 12:16:26.340276 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.017s	sys 0.043s
I20260709 12:16:26.340837 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 977) took 1961 ms. Trace:
I20260709 12:16:26.344138 10047 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
W20260709 12:16:26.339615 10046 rpcz_store.cc:269] 0709 12:16:24.328302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.328547 (+   245us) service_pool.cc:224] Handling call
0709 12:16:26.278910 (+1950363us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002774d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.279070 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280019328}
I20260709 12:16:26.342567 10195 rpcz_store.cc:276] 0709 12:16:24.912744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.293417 (+1380673us) service_pool.cc:224] Handling call
0709 12:16:26.293760 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.293967 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.293994 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.294040 (+    46us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:26.294071 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.294125 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.294246 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:26.339684 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.346716 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2155) took 1433 ms. Trace:
I20260709 12:16:26.347092 10195 rpcz_store.cc:276] 0709 12:16:24.912948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.345914 (+1432966us) service_pool.cc:224] Handling call
0709 12:16:26.346210 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.346384 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.346411 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.346474 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:26.346503 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.346552 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.346653 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:26.331893 15806 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.332432 15718 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.373667 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.340090 15793 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:26.341253 10126 rpcz_store.cc:276] 0709 12:16:24.379397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.471753 (+ 92356us) service_pool.cc:224] Handling call
0709 12:16:24.472021 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.472208 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:24.801463 (+329255us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.340125 (+1538662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.340179 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:26.340224 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.340324 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.340436 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271547,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":196596,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2410,"spinlock_wait_cycles":2718976,"thread_start_us":1815046,"threads_started":3,"wal-append.queue_time_us":1431541}
I20260709 12:16:26.343503 15788 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:26.332607 15629 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.399580 10046 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:26.403337 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2773) took 1262 ms. Trace:
I20260709 12:16:26.403663 10046 rpcz_store.cc:276] 0709 12:16:25.141346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.351769 (+1210423us) service_pool.cc:224] Handling call
0709 12:16:26.395776 (+ 44007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.403060 (+  7284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.403282 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:26.400050 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 404446us
I20260709 12:16:26.340641 15650 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.349244 15822 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.348940 15647 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.353214 15718 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:26.345504 15624 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.377291 15836 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.408209 15650 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.409734 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.377125 15828 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.377532 15431 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:26.399665 15813 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:26.416643 10046 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:26.395833 15749 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.418501 10046 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:26.401165 15630 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.372346 15806 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.408946 15802 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:16:26.419871 10046 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.410733 15777 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:16:26.438237 10046 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:26.429630 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:26.442018 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2766) took 1410 ms. Trace:
I20260709 12:16:26.442451 10052 rpcz_store.cc:276] 0709 12:16:25.031698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.085378 (+ 53680us) service_pool.cc:224] Handling call
0709 12:16:26.429454 (+1344076us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:16:26.441951 (+ 12497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14455168}
I20260709 12:16:26.453927 15721 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:26.456959 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2123) took 2152 ms. Trace:
W20260709 12:16:26.430318 15834 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:16:26.413611 15647 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.417605 15828 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:26.460114 10198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2145) took 2131 ms (client timeout 1805 ms). Trace:
I20260709 12:16:26.470151 10046 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:16:26.472774 10046 pending_rounds.cc:85] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 10
I20260709 12:16:26.435825 15829 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:16:26.451058 15825 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:16:26.472700 10198 rpcz_store.cc:269] 0709 12:16:24.306164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.337650 (+ 31486us) service_pool.cc:224] Handling call
0709 12:16:26.437179 (+2099529us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54000631d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.437368 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682896640}
I20260709 12:16:26.426887 15837 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.457369 10130 rpcz_store.cc:276] 0709 12:16:24.304274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.437452 (+133178us) service_pool.cc:224] Handling call
0709 12:16:24.439951 (+  2499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.440156 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:25.466498 (+1026342us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.335741 (+869243us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.456165 (+120424us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800476620. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:16:26.456414 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.456569 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.456617 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:26.456657 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.456719 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.456902 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1362,"prepare.queue_time_us":305045,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":183406,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":142,"spinlock_wait_cycles":2835712,"thread_start_us":1791197,"threads_started":2,"wal-append.queue_time_us":747866}
I20260709 12:16:26.473654 10046 pending_rounds.cc:107] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:16:26.412554 15822 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.478844 15847 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.479903 15844 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:26.428519 15838 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.430694 15839 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.427989 15833 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 12:16:26.488850 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 79204us
I20260709 12:16:26.421218 15749 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.475123 15829 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:26.485222 10046 raft_consensus.cc:2889] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:26.518144 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2774) took 1292 ms. Trace:
I20260709 12:16:26.424896 15630 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.427682 15840 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:16:26.498750 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 159497us
I20260709 12:16:26.567297 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:26.504038 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.421778 15836 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.568800 15843 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.569317 15843 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.569878 15836 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.570407 15836 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.570834 15836 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.523309 10046 rpcz_store.cc:276] 0709 12:16:25.226017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.407044 (+1181027us) service_pool.cc:224] Handling call
0709 12:16:26.416535 (+  9491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.517868 (+101333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.518085 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:26.488322 15745 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.486527 15788 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:26.552500 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 148483us
I20260709 12:16:26.559926 15647 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.573326 15855 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:16:26.561172 15806 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:26.573988 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70879.3us
I20260709 12:16:26.573830 15855 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.578197 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2153) took 1665 ms. Trace:
I20260709 12:16:26.578598 10197 rpcz_store.cc:276] 0709 12:16:24.912529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.412624 (+500095us) service_pool.cc:224] Handling call
0709 12:16:25.412923 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.413132 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:26.340600 (+927468us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.577872 (+237272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.577928 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:26.577971 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.578034 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.578139 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":988800,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":94960,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":867331,"threads_started":3,"wal-append.queue_time_us":139163}
I20260709 12:16:26.581207 15400 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.573751 15788 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.582159 15829 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.583599 15829 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:26.594736 10095 leader_election.cc:400] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:16:26.595101 10095 leader_election.cc:403] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:16:26.596161 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:26.576961 15834 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:16:26.581115 15845 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.101s	user 0.000s	sys 0.003s
I20260709 12:16:26.633749 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:26.582094 15630 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.640877 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:26.573784 15647 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.575724 15855 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:26.573236 15849 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:16:26.654686 15624 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.655311 15624 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:16:26.655903 15849 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:26.656445 15624 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:26.656839 15624 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.657207 15624 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:26.642081 15400 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.498107 15847 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.658941 15400 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.660612 15847 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.660992 15400 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.499739 15838 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.661702 15843 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:26.663869 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 96646.9us
I20260709 12:16:26.665796 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.667464 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:26.667768 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:26.669088 15630 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:26.669515 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:26.670780 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:26.671150 15855 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.671515 15630 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:26.672061 15630 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.672431 15630 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:26.673254 15855 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.677806 15853 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:26.501574 15839 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.492465 15837 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.684311 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.711721 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:26.713310 15837 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.440703  9946 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 13, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 13 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.685209 15855 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:26.715814 15839 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.690054 15843 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:26.716702 15857 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:26.717491 15843 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.718128 15843 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:26.694684 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.717460 15857 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:26.719161 10732 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:26.719702 15854 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.694883 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:26.720403 15843 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.696949 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:26.691568 15749 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:26.697687 10094 connection.cc:256] RPC call timeout handler was delayed by -1.9457093989999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:16:26.721863 10094 connection.cc:256] RPC call timeout handler was delayed by -1.2837693199999194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 12:16:26.698776 15822 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:26.703578 15679 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.005s
I20260709 12:16:26.705387 15836 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.706342 15829 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.687549 15833 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:26.715901  9946 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.727727 15855 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.731863 15855 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.732317  9946 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:26.720175 15854 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.729496 15859 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.733700 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2499) took 2662 ms. Trace:
I20260709 12:16:26.734969 15854 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.695755 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.735230 15855 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:26.735791 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.721728 15737 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.724368 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:26.722136 15843 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.721777 15857 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.747946 15857 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:26.676909 15400 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:26.753737 15400 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.754231 15400 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.757167 15814 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:26.757555 15814 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:26.758379 15814 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.759582 15814 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:26.760308 15624 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.729043 10048 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:26.664176 15647 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.730625 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.731112 15833 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.763454 15833 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:26.763968 10048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2770) took 1658 ms (client timeout 1779 ms). Trace:
I20260709 12:16:26.764077 15647 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.739360 15847 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.765599 15847 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.734094 10204 rpcz_store.cc:276] 0709 12:16:24.071113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.654394 (+583281us) service_pool.cc:224] Handling call
0709 12:16:24.791125 (+136731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:24.931672 (+140547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.733524 (+1801852us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003138d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.733646 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313472768}
I20260709 12:16:26.749858 15843 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.733186 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 999) took 2372 ms. Trace:
I20260709 12:16:26.686077 15629 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.738189 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2634) took 2196 ms. Trace:
I20260709 12:16:26.767648 10728 rpcz_store.cc:276] 0709 12:16:24.361128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.361238 (+   110us) service_pool.cc:224] Handling call
0709 12:16:24.361507 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:24.771933 (+410426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.732915 (+1960982us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54006121d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:26.733104 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854482688}
I20260709 12:16:26.731454 15829 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.699915 15828 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:26.728657 15654 consensus_meta.cc:287] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.656s	user 0.003s	sys 0.008s
I20260709 12:16:26.740904 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.741909 15854 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:26.772655 15854 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:26.773104 15854 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:26.773389 15838 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.774224 15829 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.749670 15737 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.775067 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:26.775662 10737 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:26.776782 15737 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.665462 15782 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.779079 15612 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:26.781421 15823 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.726s	user 0.004s	sys 0.004s
I20260709 12:16:26.752004 15789 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.770090 15400 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.784734 15843 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.786751 15847 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:26.764364 10048 rpcz_store.cc:269] 0709 12:16:25.105403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.491731 (+386328us) service_pool.cc:224] Handling call
0709 12:16:26.763818 (+1272087us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002f9c54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.763915 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664229632}
I20260709 12:16:26.768594 10124 rpcz_store.cc:276] 0709 12:16:24.541547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.726789 (+185242us) service_pool.cc:224] Handling call
0709 12:16:24.727134 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.046412 (+319278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.737977 (+1691565us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400210054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:26.738133 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470643072}
I20260709 12:16:26.733692 15859 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:26.788471 15818 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.779s	user 0.001s	sys 0.001s
I20260709 12:16:26.788005  9946 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 11, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 11 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.789281 15859 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.742358 15855 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:16:26.794008 15830 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.560s	user 0.000s	sys 0.001s
I20260709 12:16:26.794291 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:26.796010 15629 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.796499 15629 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.797574 15612 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.798113 15612 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.799386 15629 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.799937 15629 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:26.800629 15629 consensus_queue.cc:1243] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:16:26.800717 15836 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:26.778764 15782 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.801986 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 868) took 1790 ms. Trace:
I20260709 12:16:26.802356 10055 rpcz_store.cc:276] 0709 12:16:25.012273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.047436 (+ 35163us) service_pool.cc:224] Handling call
0709 12:16:25.047696 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:25.047884 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:16:25.185214 (+137330us) log.cc:844] Serialized 14 byte log entry
0709 12:16:25.194955 (+  9741us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.801456 (+1606501us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b180049ace0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:16:26.801619 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.801673 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:26.801720 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.801791 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.801923 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93058,"prepare.queue_time_us":289690,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":9832,"raft.queue_time_us":8575,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":9016,"spinlock_wait_cycles":69377920}
I20260709 12:16:26.803156 15654 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.804314 10195 raft_consensus.cc:1240] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:16:26.750553 15721 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:26.805455 15721 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.807122 15160 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.807507 15721 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.807773 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2764) took 1860 ms. Trace:
I20260709 12:16:26.808017 10731 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
W20260709 12:16:26.809427 10731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 998) took 2448 ms (client timeout 2102 ms). Trace:
I20260709 12:16:26.807657 15160 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.808923 10054 rpcz_store.cc:276] 0709 12:16:24.947270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.085975 (+138705us) service_pool.cc:224] Handling call
0709 12:16:26.807112 (+1721137us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:16:26.807290 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.807459 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.807483 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.807525 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:16:26.807561 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.807614 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.807719 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2768640}
I20260709 12:16:26.777554 15624 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.811311 15160 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.800150 15612 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.801175 15836 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.769855 15840 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.811926 15836 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:26.812216 15840 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.814457 15621 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:16:26.810694 10200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2156) took 1897 ms (client timeout 2167 ms). Trace:
W20260709 12:16:26.815191 10200 rpcz_store.cc:269] 0709 12:16:24.913178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.056837 (+143659us) service_pool.cc:224] Handling call
0709 12:16:26.810531 (+1753694us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b5400203d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.810636 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206363392}
I20260709 12:16:26.816542 15782 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.814854 15621 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:26.817216 15613 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:26.817552 15621 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.814224 15840 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.820547 15654 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:26.801198 15629 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:26.822206 15718 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.823033 15629 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:26.789800  9946 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 11, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 11 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.823931 15629 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:26.809788 10731 rpcz_store.cc:269] 0709 12:16:24.360814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.371360 (+ 10546us) service_pool.cc:224] Handling call
0709 12:16:26.809263 (+2437903us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400533254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.809363 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5595270016}
I20260709 12:16:26.824314  9946 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.827593 15625 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:26.828184 15629 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:26.830681 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:26.831267 10130 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:26.831575 15637 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:26.832306 15751 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:26.832854 15751 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.834697 15766 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:26.797719 15855 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:26.834873 15854 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.800643 10051 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:26.836222 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2769) took 1778 ms. Trace:
I20260709 12:16:26.835994 15766 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.836342 10122 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:26.837093 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2776) took 1486 ms. Trace:
I20260709 12:16:26.837581 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:26.837788 15770 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.838307 15770 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.839571 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:26.839730 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.836010 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2772) took 1697 ms. Trace:
I20260709 12:16:26.840112 10731 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:26.840575 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:26.841400 15751 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.837447 10052 rpcz_store.cc:276] 0709 12:16:25.350217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.443253 (+1093036us) service_pool.cc:224] Handling call
0709 12:16:26.473727 (+ 30474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.836791 (+363064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.836817 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.836856 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:26.836885 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.836940 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.837044 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":362736,"raft.queue_time_us":362897,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69}
I20260709 12:16:26.841955 10053 rpcz_store.cc:276] 0709 12:16:25.138400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.137128 (+998728us) service_pool.cc:224] Handling call
0709 12:16:26.137468 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.835683 (+698215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.835715 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:26.835759 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:26.835789 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.835847 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.835960 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":697849,"raft.queue_time_us":698428,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107}
W20260709 12:16:26.840560 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 882810us
I20260709 12:16:26.840705 15759 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.846700 15759 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.848330 10731 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:26.848673 15759 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.840490 15278 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.849535 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:26.842406 10126 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:26.849371 15278 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:26.850723 15854 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.835640 15637 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:26.852515 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:26.840247 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:26.855664 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:26.850376 15737 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:26.825934  9946 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 8 to 11, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 11 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.866008 10130 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:26.836575 10051 rpcz_store.cc:276] 0709 12:16:25.085560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.085738 (+   178us) service_pool.cc:224] Handling call
0709 12:16:26.800083 (+1714345us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b5800002798. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:16:26.800286 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.835976 (+ 35690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.836167 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14046080}
I20260709 12:16:26.941236 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 862) took 2229 ms. Trace:
I20260709 12:16:26.832218 15718 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.986618 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.460762 10049 rpcz_store.cc:276] 0709 12:16:24.711906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.712072 (+   166us) service_pool.cc:224] Handling call
0709 12:16:24.712390 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:26.329981 (+1617591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.940939 (+610958us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400130454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:26.941164 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3716215680}
W20260709 12:16:27.421892 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.405992 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2147) took 3015 ms. Trace:
I20260709 12:16:27.464879 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:26.940428 15821 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.751s	user 0.000s	sys 0.002s
I20260709 12:16:27.348685 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:27.311102 10170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.010s	sys 0.030s
W20260709 12:16:27.047214 15826 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.840s	user 0.001s	sys 0.001s
W20260709 12:16:27.201054 10169 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.048s	sys 0.053s
W20260709 12:16:27.472679 10169 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.061s	sys 0.059s
I20260709 12:16:27.147323 15745 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:27.100412 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:26.938589 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.475926 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:27.476516 10122 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:27.099035 15654 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:27.420749 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.001892 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:26.750218 15630 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.421353 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:26.950225 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2775) took 1600 ms. Trace:
I20260709 12:16:27.481642 10047 rpcz_store.cc:276] 0709 12:16:25.349908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.129467 (+779559us) service_pool.cc:224] Handling call
0709 12:16:26.950001 (+820534us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54002486d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:26.950147 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488083200}
I20260709 12:16:27.463094 10201 rpcz_store.cc:276] 0709 12:16:24.390891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.128271 (+737380us) service_pool.cc:224] Handling call
0709 12:16:25.152338 (+ 24067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:25.983783 (+831445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:25.994763 (+ 10980us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:26.011168 (+ 16405us) log.cc:844] Serialized 26 byte log entry
0709 12:16:26.344858 (+333690us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:26.596021 (+251163us) log.cc:844] Serialized 14 byte log entry
0709 12:16:26.596285 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.596361 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:27.402593 (+806232us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b18003cfac0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:27.405630 (+  3037us) raft_consensus.cc:1685] finished
0709 12:16:27.405748 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:27.405907 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78004,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":195934,"raft.run_cpu_time_us":9067,"raft.run_wall_time_us":447846,"spinlock_wait_cycles":8291072,"thread_start_us":1215480,"threads_started":3,"wal-append.queue_time_us":330343}
I20260709 12:16:27.482967 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.483542 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.454756 10121 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:27.090533 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:27.484862 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:27.485661 10126 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:26.991230 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.486924 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.392648 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:27.468338 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.487632 10055 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
W20260709 12:16:27.159467 15788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.052s	sys 0.034s
W20260709 12:16:27.030896 15844 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
I20260709 12:16:27.469684 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.503769 10123 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:27.024652 15833 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:27.405274 15827 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.216s	user 0.005s	sys 0.006s
W20260709 12:16:27.470721 10170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.013s	sys 0.034s
I20260709 12:16:27.507225 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:27.508824 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:26.840277 15770 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.471235 15777 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.303646 15751 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.394533 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:27.502988 15788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.063s	sys 0.048s
I20260709 12:16:26.839818 15766 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:27.472965 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 798428us
I20260709 12:16:27.292925 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:27.403223 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.526065 10052 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:26.835532 15855 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.477780 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.535296 10049 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:27.201145 15650 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:26.943019 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2516) took 2747 ms. Trace:
I20260709 12:16:27.506529 15844 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:27.465656 10051 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:27.487692 10046 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:27.487962 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.465287 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.550334 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.550803 10130 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:27.474680 15745 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:27.489101 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:27.489468 15824 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.372s	user 0.008s	sys 0.003s
I20260709 12:16:27.489360 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:26.840785 15703 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.641s
I20260709 12:16:27.485553 15278 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:27.048341 15836 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.464599 15737 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:27.500735 10094 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.046s
I20260709 12:16:27.556095 10122 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:27.233109 15857 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.504889 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.559283 10123 raft_consensus.cc:2410] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:27.540663 10050 rpcz_store.cc:276] 0709 12:16:24.195531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.195707 (+   176us) service_pool.cc:224] Handling call
0709 12:16:24.203245 (+  7538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:24.274948 (+ 71703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:24.274979 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:24.275468 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:16:25.041816 (+766348us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:25.041858 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:26.942598 (+1900740us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5400131354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:26.942657 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:26.942714 (+    57us) raft_consensus.cc:1685] finished
0709 12:16:26.942727 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:26.942958 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7541,"raft.queue_time_us":8954,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4590,"spinlock_wait_cycles":146611456,"thread_start_us":765978,"threads_started":1,"wal-append.queue_time_us":953383,"wal-append.run_cpu_time_us":20679,"wal-append.run_wall_time_us":1931200}
I20260709 12:16:27.560145 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.510035 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.510848 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.509523 10202 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:27.561702 10195 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:27.562101 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.562615 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.523953 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.563329 10201 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:27.563758 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.521456 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.536317 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.564640 10197 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:27.565028 10203 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
W20260709 12:16:27.487174 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.543515 10095 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:27.566933 10124 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:27.527037 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.545737 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.568182 10198 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:16:27.568272 10204 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:27.512745 15738 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:27.550381 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:27.566591 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:27.485989 15654 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.553980 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.577620 10046 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:27.514914 15743 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:27.554920 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.034s	sys 0.064s
W20260709 12:16:27.578557 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.034s	sys 0.064s
I20260709 12:16:27.539294 15766 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:27.553715 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2137) took 3350 ms. Trace:
I20260709 12:16:27.555361 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.555550 10051 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:27.501768 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:27.556617 10094 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.007s	sys 0.046s
I20260709 12:16:27.582729 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:27.582966 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 685312us
I20260709 12:16:27.557415 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.557585 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:27.562850 10202 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:27.538609 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:27.585165 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.585776 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:27.585853 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47352.5us
I20260709 12:16:27.579394 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:27.586786 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:27.552857 15770 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.583374 10200 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:27.589710 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.590864 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.591413 10195 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:27.584615 15628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.023s	sys 0.082s
I20260709 12:16:27.582229 10196 rpcz_store.cc:276] 0709 12:16:24.203753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.687600 (+483847us) service_pool.cc:224] Handling call
0709 12:16:24.687962 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:24.688167 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:24.688190 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:24.688683 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:16:25.957698 (+1269015us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:25.957739 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.957801 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:26.939714 (+981913us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:27.544977 (+605263us) raft_consensus.cc:1685] finished
0709 12:16:27.545004 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:27.553648 (+  8644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113942912,"thread_start_us":1268645,"threads_started":1,"wal-append.queue_time_us":1469882}
I20260709 12:16:27.593048 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.600020 10202 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:27.597882 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.603659 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.570060 15278 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.594831 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.595878 10127 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
W20260709 12:16:27.595893 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:27.598019 10125 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:27.597882 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.522444 15777 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.528612 15751 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.615070 10196 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:16:27.594082 15718 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:27.606813 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.605060 10200 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:27.609284 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.571188 15738 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:27.606570 15628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.023s	sys 0.082s
I20260709 12:16:27.581947 15629 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:27.581642 15703 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:27.612149 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:27.610598 10019 connection.cc:256] RPC call timeout handler was delayed by -1.698911679000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 12:16:27.615996 10197 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:27.618166 10198 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 10.
I20260709 12:16:27.618561 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.618970 10049 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 12:16:27.594110 10201 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:27.622913 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.624243 10195 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:27.597352 15766 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.587850 15844 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:27.611131 10050 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:27.638119 10199 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:16:27.637984 10121 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:27.609274 15864 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:27.595790 15743 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.637136 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.639912 10126 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:27.640157 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.632404 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.668053 10196 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:27.631119 15865 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:27.641120 10054 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:27.630861 15718 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:27.643282 10124 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:27.643901 10202 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:16:27.643847 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.674783 10195 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:27.642508 15637 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.599151 15770 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:27.639390 10019 connection.cc:256] RPC call timeout handler was delayed by -1.1902514999999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:16:27.627914 15738 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:27.668813 10198 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:27.640854 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.619513 15852 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:16:27.614041 15745 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.631040 15703 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:27.630326 15629 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:27.674252 10048 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:27.675434 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.645002 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.619342 15278 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.665164 15844 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:27.678812 10019 connection.cc:256] RPC call timeout handler was delayed by -1.0354515000001356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 12:16:27.693570 10201 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:27.684895 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 979) took 3205 ms. Trace:
I20260709 12:16:27.690850 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.685534 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.624591 10122 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:27.572109  9946 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.695135 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.670742 15865 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:27.685382 10197 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:16:27.694496 10128 rpcz_store.cc:276] 0709 12:16:24.479830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.715238 (+235408us) service_pool.cc:224] Handling call
0709 12:16:24.715539 (+   301us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:24.719110 (+  3571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:24.719140 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:24.719910 (+   770us) log.cc:844] Serialized 78 byte log entry
0709 12:16:25.410950 (+691040us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:25.410993 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:25.411142 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:27.478877 (+2067735us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:27.676944 (+198067us) raft_consensus.cc:1685] finished
0709 12:16:27.676964 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:27.684825 (+  7861us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2881,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":244219648,"thread_start_us":690653,"threads_started":1,"wal-append.queue_time_us":1334068}
I20260709 12:16:27.697054 10046 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:27.697494 10125 raft_consensus.cc:2393] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 13: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:27.698333 10053 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:27.683506 15637 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.698737 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:27.698285 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.696126 10203 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:27.701936 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.711750 10053 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:27.641675 15737 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.690989 15703 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:27.727337 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:27.698720 15860 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:16:27.696794 15629 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:27.730911 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:27.731341 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.732172 10197 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:27.699810 15844 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:27.735386 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:27.737893 10046 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:27.701259 15630 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:27.723484 15855 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.741532 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.755924 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.757166 10201 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:27.762923 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.763770 10201 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:27.772557 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.775805 10203 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:27.777314 10122 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:27.770061 10126 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:27.779711 10048 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:27.783586 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:27.771373 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.784667 10125 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:27.724624 15637 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.752410 15836 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.792752 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.800000 10731 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:27.794138 15814 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.798470 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.766947 15621 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:27.800558 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:27.804492 10127 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:27.804955 10127 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 10.
I20260709 12:16:27.761457 15855 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:27.754369 15833 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:27.807053 10126 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:27.757649 15777 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:27.761608 15857 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:27.802528 10200 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:27.809074 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.811177 10737 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:27.770653 15751 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.816768 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.788412 15788 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:27.789227 15654 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:27.819525 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.825577 10728 raft_consensus.cc:2410] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:16:27.826334 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:27.751984 15718 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.832530 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:27.840368 10126 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:16:27.811174 15855 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:27.758455 15865 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:27.852948 15637 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:27.855623 15770 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:27.833750 15777 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:27.847078 15863 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:16:27.813534 15814 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.831147 15788 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:27.844429 15855 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:27.841109 15743 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:27.870798 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:27.846696 15766 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.889082 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1020) took 3852 ms. Trace:
I20260709 12:16:27.889565 10199 rpcz_store.cc:276] 0709 12:16:24.037129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.042011 (+  4882us) service_pool.cc:224] Handling call
0709 12:16:24.049569 (+  7558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:27.654723 (+3605154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:27.888766 (+234043us) spinlock_profiling.cc:243] Waited 3.59 s on lock 0x7b54000622d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:27.889011 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8252293376}
I20260709 12:16:27.900714 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1019) took 1175 ms. Trace:
I20260709 12:16:27.901168 10734 rpcz_store.cc:276] 0709 12:16:26.725421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:26.726192 (+   771us) service_pool.cc:224] Handling call
0709 12:16:26.726558 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:26.726891 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:26.726918 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:26.732705 (+  5787us) log.cc:844] Serialized 26 byte log entry
0709 12:16:27.186401 (+453696us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:27.186468 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:27.186550 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:27.900487 (+713937us) raft_consensus.cc:1685] finished
0709 12:16:27.900516 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:27.900655 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1172,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6551,"thread_start_us":425894,"threads_started":1,"wal-append.queue_time_us":893723}
I20260709 12:16:27.851799 15867 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:16:27.900424 15745 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:27.887883 15865 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:27.900417 15777 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:27.926645 15777 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:27.927109 15777 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:27.898221 15743 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 12:16:27.940024 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:27.949157 15613 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 1.131s	user 0.010s	sys 0.005s
I20260709 12:16:27.841331  9946 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 10 to 13, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 13 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.959331 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:27.960711 15613 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:27.960150 15278 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:27.971966 15806 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:28.001128 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:28.008104 10129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.016s	sys 0.006s
W20260709 12:16:28.008513 10129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.006s
W20260709 12:16:28.027403 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 1001) took 3665 ms (client timeout 2084 ms). Trace:
I20260709 12:16:27.988194 15806 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:28.027876 10736 rpcz_store.cc:269] 0709 12:16:24.362235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:24.362342 (+   107us) service_pool.cc:224] Handling call
0709 12:16:28.027166 (+3664824us) spinlock_profiling.cc:243] Waited 3.59 s on lock 0x7b54004b9454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:28.027319 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8250329472}
W20260709 12:16:28.035315 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 446415us
I20260709 12:16:28.039562 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:27.986683 15613 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.007577 15621 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:28.036079 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.021s	sys 0.034s
W20260709 12:16:28.053926 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.021s	sys 0.034s
W20260709 12:16:28.054515 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 633208us
I20260709 12:16:28.055516 15278 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:28.032423 15814 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:28.062573 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 483219us
I20260709 12:16:28.034978 15788 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:28.067375 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.005s
I20260709 12:16:28.063238 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:27.983589 15629 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.071581 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2133) took 1217 ms. Trace:
I20260709 12:16:28.072095 10129 rpcz_store.cc:276] 0709 12:16:26.854542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.456707 (+602165us) service_pool.cc:224] Handling call
0709 12:16:27.457049 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:27.457390 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:27.457415 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:27.457822 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.008885 (+551063us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:28.008931 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.009013 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.071358 (+ 62345us) raft_consensus.cc:1685] finished
0709 12:16:28.071376 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.071507 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4093,"thread_start_us":550727,"threads_started":1,"wal-append.queue_time_us":612103}
I20260709 12:16:28.059160 15630 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:16:28.064973 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.074474 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.064509 15814 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.078298 10130 raft_consensus.cc:2393] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:28.078737 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 360954us
I20260709 12:16:28.083792 15637 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:28.060680 10018 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.009s	sys 0.007s
W20260709 12:16:28.068256 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.005s	sys 0.005s
I20260709 12:16:28.084247 15637 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.059919 15621 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:28.084054 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.062657 15278 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:16:28.085668 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 253188us
I20260709 12:16:28.086179 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.084380 15654 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:16:28.076109 15864 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:28.093314 15788 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.094054 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.083946 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:28.077085 15650 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:28.068011 15875 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:16:28.099843 10129 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
W20260709 12:16:28.088513 10018 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.007s
I20260709 12:16:28.101222 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:28.106702 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.099434 15872 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.098537 15637 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:28.115886 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.102459 15751 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.104769 15650 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.130848 15650 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.108701 15788 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.123198 15873 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:28.101368 15777 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.098800 15814 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:28.125916 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 63363.4us
I20260709 12:16:28.167018 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:28.167948 10734 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 14: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:28.207207 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:28.129669 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:28.102741 15844 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.134821 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:28.199855 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:28.121178 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.127281 10019 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9.
I20260709 12:16:28.121682 15766 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:28.217085 10730 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:28.135604 15278 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.133004 15865 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.176793 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:28.175637 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.206869 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:28.216776 10736 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
W20260709 12:16:28.217727 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 96633.7us
I20260709 12:16:28.245497 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.246446 15745 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:28.138084 15873 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:28.137090 15629 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:28.246119 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.175596 10127 raft_consensus.cc:1240] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:28.118590 15879 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:28.247514 10050 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:28.215926 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.137398 15885 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:28.247462 10204 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.259500 10123 raft_consensus.cc:2368] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:28.136435 15770 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:28.247983 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:28.206336 15738 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:16:28.249830 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:28.246236 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 69532.5us
I20260709 12:16:28.246045 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.206511 15833 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:28.271552 10048 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.215385 15875 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:16:28.249082 15278 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.276495 15629 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:28.258219 15871 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:16:28.277302 15871 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:28.278105 15871 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.279325 15871 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:16:28.281495 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.253775 15864 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:28.282701 10054 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:28.283315 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:28.282092 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.282168 10204 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:28.226715 15766 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:28.164731 15751 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.294661 15844 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.295526 15751 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:28.251379 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.296650 15898 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:28.297071 10053 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
W20260709 12:16:28.230998 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 104488us
I20260709 12:16:28.249086 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.217614 10019 leader_election.cc:403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:28.268746 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:28.139606 15777 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.118818 15872 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.252600 15879 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:28.137735 15613 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.316493 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.327208 10127 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:28.328122 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.329121 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.230335 15874 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:28.273252 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:28.325959 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.328670 10127 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 11.
I20260709 12:16:28.274087 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.137603 15621 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:28.138331 15788 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:28.286849 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 179327us
I20260709 12:16:28.277055 15629 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:28.131899 15703 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.246872 15745 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.298592 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:28.298708 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 171554us
I20260709 12:16:28.300277 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:28.359634 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.300627 10048 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:28.258999 15814 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:28.313846 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.315501 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.323702 15751 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:16:28.319120 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.320060 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.260495 15873 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:28.282842 15864 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:28.336366 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.273718 15833 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.341061 10050 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:28.341274 10730 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:28.341528 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.229440 15718 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 12:16:28.342161 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 93136.3us
I20260709 12:16:28.284678 15885 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:28.372753 15885 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.351418 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.257448 15855 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:28.376297 15855 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.326656 15737 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:28.378660 10128 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:28.343212 15770 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.353317 10736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:28.324259 15879 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:28.344895 15278 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.337998 15874 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.356724 15650 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.303648 15844 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.399518 15844 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.399829 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.359839 10053 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:28.361685 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.363351 15745 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:28.318094 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.403816 10129 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:28.365023 10055 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:28.365972 10046 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:28.362843 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.369396 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:28.404323 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 131177us
I20260709 12:16:28.370927 15718 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:28.371742 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.379531 10124 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:28.380573 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:28.383092 10736 raft_consensus.cc:606] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:28.422132 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50473.1us
I20260709 12:16:28.422529 10736 raft_consensus.cc:614] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:28.344503 15867 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.423647 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.393431 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.275619 15738 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.395798 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.323501 15871 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:16:28.351359 15891 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:28.434340 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.401767 10051 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:28.435012 10055 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.435499 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.268224 15865 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.401865 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.401023 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.437590 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.438112 10050 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:28.302789 15882 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:16:28.402933 10123 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:28.367218 15833 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.401087 15650 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.424731 10052 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:28.426514 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.402520 15874 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:28.396725 15898 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:28.455794 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 152997us
I20260709 12:16:28.431602 10054 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.383797 15788 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:16:28.431082 15621 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:28.436483 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:28.440284 10048 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:28.491246 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.439754 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:28.495244 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55564.8us
I20260709 12:16:28.495899 10169 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.496685 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:28.442847 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.443317 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:28.422118 15743 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:28.420785 15844 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.450280 15806 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:28.421862 15855 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:28.484946 15903 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:28.440707 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:28.456254 10055 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:28.397966 15770 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:28.470681 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44290.9us
I20260709 12:16:28.377842 15766 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.445341 15630 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:28.424618 15718 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:28.451257 15891 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:28.455282 15894 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:28.392940 15869 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:16:28.500092 10053 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
W20260709 12:16:28.502102 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65701.7us
I20260709 12:16:28.503456 10048 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 11. Current term is 12. Ops: []
W20260709 12:16:28.504280 15886 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:16:28.434767 15867 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.452260 15278 consensus_queue.cc:1059] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:16:28.483592 15871 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:28.454936 15629 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.512610 10054 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:28.514575 10046 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:28.513224 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.536119 15621 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:28.452742 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 138963us
I20260709 12:16:28.456995 15613 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 12:16:28.547329 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 141803us
I20260709 12:16:28.578660 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:28.514334 15902 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:28.539952 15875 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:28.539722 15852 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:28.570598 15703 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.598948 15891 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:28.558504 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 73196.2us
I20260709 12:16:28.565196 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.603703 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.541460 15654 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:28.541690 15844 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.578444 15766 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:28.574164 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 195865us
I20260709 12:16:28.459729 15864 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:28.587984 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.589665 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:28.557258 15630 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.546509 15628 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 12:16:28.604039 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52382.9us
I20260709 12:16:28.573133 15903 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:28.549417 15855 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.578778 15621 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:28.574842 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:28.655011 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 80258.7us
I20260709 12:16:28.655689 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.611694 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:28.612282 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:28.605755 15654 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:28.629123 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.592924 15852 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:28.591027 15875 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.590258 15902 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.636054 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:28.570767 15637 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.638795 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:28.639045 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:28.604501 15907 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:16:28.614919 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 117293us
I20260709 12:16:28.668995 10050 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:28.638859 15630 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:28.680552 10200 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:28.656507 15650 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:28.679275 10197 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:28.679662 15902 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:28.679670 15909 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:16:28.707357 10122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2143) took 1705 ms. Trace:
I20260709 12:16:28.680490 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.707800 10122 rpcz_store.cc:276] 0709 12:16:27.002467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.796364 (+793897us) service_pool.cc:224] Handling call
0709 12:16:27.801944 (+  5580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:27.813415 (+ 11471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:27.813444 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:27.818599 (+  5155us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.128048 (+309449us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:28.170505 (+ 42457us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.199462 (+ 28957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.199546 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.705588 (+506042us) raft_consensus.cc:1685] finished
0709 12:16:28.705620 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.707291 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28645,"prepare.queue_time_us":264401,"prepare.run_cpu_time_us":3040,"prepare.run_wall_time_us":14485,"raft.queue_time_us":49156,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":11642,"thread_start_us":302207,"threads_started":2,"wal-append.queue_time_us":500870}
W20260709 12:16:28.709137 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.709743 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:28.709949 15628 consensus_queue.cc:1243] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:16:28.707779 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 118187us
I20260709 12:16:28.649852 15903 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.559773 15898 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.681500 10169 leader_election.cc:400] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:28.712042 10169 leader_election.cc:403] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:28.712405 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2141) took 1817 ms. Trace:
I20260709 12:16:28.714592 15878 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:28.715037 15878 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.712975 10125 rpcz_store.cc:276] 0709 12:16:26.894790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.785248 (+890458us) service_pool.cc:224] Handling call
0709 12:16:27.806209 (+ 20961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:27.806411 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:28.235893 (+429482us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.711823 (+475930us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:28.711908 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:28.711978 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.712096 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.712329 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13707,"prepare.queue_time_us":534967,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":39,"raft.queue_time_us":103990,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":28129,"spinlock_wait_cycles":12534912,"thread_start_us":883328,"threads_started":3,"wal-append.queue_time_us":185763}
I20260709 12:16:28.715389 15878 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:28.670342 15278 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:28.673610 15852 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:28.673470 15876 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:28.711140 10020 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 8 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 10.
I20260709 12:16:28.718698 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.719391 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.629505 15718 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.720324 10121 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:16:28.677596 15875 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:28.680853 15908 raft_consensus.cc:2764] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:16:28.722016 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:28.629750 15844 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.746706 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:28.711750 15903 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:28.750941 10124 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:16:28.754801 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:28.758188 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:28.673017 15654 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:28.704464 15894 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:28.705142 15650 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.742666 15278 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:28.766870 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44914.5us
I20260709 12:16:28.737140 15869 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:28.779729 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:28.798357 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.784134 15806 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:28.765367 15901 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:16:28.684482 15907 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:28.764026 15909 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:28.757479 15865 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.813251 15906 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:16:28.813673 15906 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:28.814468 15906 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.815485 15906 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:28.817238 15907 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.814553 15933 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:28.819957 15933 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:28.821343 15900 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.366s	user 0.000s	sys 0.002s
I20260709 12:16:28.821022 15933 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.822180 15933 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:28.830828 15867 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:28.801591 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:28.811180 15916 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:16:28.811815 15912 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:16:28.862926 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:28.797525 15650 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:28.812939 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 869) took 1119 ms. Trace:
I20260709 12:16:28.868083 10049 rpcz_store.cc:276] 0709 12:16:27.693717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.693837 (+   120us) service_pool.cc:224] Handling call
0709 12:16:27.720301 (+ 26464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:28.076879 (+356578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.076912 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:28.102114 (+ 25202us) log.cc:844] Serialized 26 byte log entry
0709 12:16:28.339630 (+237516us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:28.368123 (+ 28493us) log.cc:844] Serialized 14 byte log entry
0709 12:16:28.368459 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:28.368535 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:28.812734 (+444199us) raft_consensus.cc:1685] finished
0709 12:16:28.812753 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:28.812878 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28232,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":139768,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":168,"thread_start_us":553724,"threads_started":2,"wal-append.queue_time_us":320868}
I20260709 12:16:28.824046 15628 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.827260 15855 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:28.800643 15869 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:28.828857 15918 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:28.811556 15844 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:28.812636 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 127285us
I20260709 12:16:28.802830 15806 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.876896 15918 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:28.862977 15872 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.877951 10199 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:16:28.866173 15909 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:28.880782 15718 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:28.798498 15924 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:16:28.832264 15738 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:28.869988 15919 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:28.873621 15770 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:28.875552 15869 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:28.937914 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49965.3us
I20260709 12:16:28.913843 15923 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:28.842546 15891 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:28.942294 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:28.914238 15806 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:28.915787 15926 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:28.941996 15836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.004s
I20260709 12:16:28.935071 15919 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:28.937162 15921 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.942772 15737 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:28.962674 15703 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:16:28.976092 15751 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.009s
I20260709 12:16:28.978820 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:28.986203 15833 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.001s
W20260709 12:16:28.990234 15745 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.565s	user 0.002s	sys 0.006s
W20260709 12:16:29.000412 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 396763us
W20260709 12:16:28.962723 15836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.010s	sys 0.004s
I20260709 12:16:29.063331 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.015867 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:28.960822 15911 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:28.957393 15738 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:28.938004 15628 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:28.965674 15637 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:28.959306 15924 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:29.057243 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.036036 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.071720 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:28.999292 15703 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:28.932066 15278 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.075860 10202 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:29.075414 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 436155us
I20260709 12:16:29.076458 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:29.036275 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:28.996279 15898 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.083384 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.152311 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:29.120877 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.153263 10050 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:29.153560 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.085696 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.107568 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.116757 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.075340 15745 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:29.087280 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 340684us
I20260709 12:16:29.091344 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.031030 15751 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 8. Current term is 9.
I20260709 12:16:29.162151 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.076777 10736 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:29.154008 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77645.8us
I20260709 12:16:29.051119 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.153858 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:29.002698 15770 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:29.157393 10048 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:29.156121 10046 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:29.035760 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:29.127847 15873 consensus_meta.cc:287] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.000s
I20260709 12:16:29.166592 10201 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:29.174713 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.165006 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.164614 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:29.174144 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.291805 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.105022 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:29.300012 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 135470us
I20260709 12:16:29.300190 10047 raft_consensus.cc:2376] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17. Re-sending same reply.
W20260709 12:16:29.195191 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:29.301115 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.283489 10195 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:29.301489 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.275290 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.093374 15876 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:29.166904 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:29.294485 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.156062 15703 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:29.124365 15637 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.093775 15894 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:29.037031 15833 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.954051 15923 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:29.093802 15879 consensus_meta.cc:287] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.007s
I20260709 12:16:29.291097 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.276583 15938 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:29.304502 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.093607 15738 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.003985 15621 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:29.309566 10200 consensus_meta.cc:287] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.002s
W20260709 12:16:29.311067 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 154476us
I20260709 12:16:29.302654 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:29.303185 10052 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:29.313433 10049 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:16:29.361999 10200 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:29.316879 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:29.312595 10731 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:29.320235 10047 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:16:29.320411 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 153589us
W20260709 12:16:29.362964 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60394.8us
I20260709 12:16:29.321883 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.322299 10050 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:16:29.363996 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:29.105324 15836 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.324065 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.363579 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:29.323580 15922 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:29.327620 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:28.966562 15918 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.166199 15931 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:29.157003 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 392083us
I20260709 12:16:29.301407 15871 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:29.003068 15909 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:28.964644 15926 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.352710 15885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.013s	sys 0.006s
W20260709 12:16:29.410763 15885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.013s	sys 0.006s
I20260709 12:16:29.357241 15923 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.357403 15745 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.357736 15879 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.413647 15879 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.358951 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:29.359200 15940 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:16:29.359563 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.414866 10733 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:29.359225 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.311669 15629 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:29.311815 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.362978 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:29.340097 15902 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.000s
I20260709 12:16:29.365747 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:29.363654 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:29.479153 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 115571us
W20260709 12:16:29.479351 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 113692us
I20260709 12:16:29.000141 15921 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.167330 15898 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.369534 10734 raft_consensus.cc:2410] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:29.372457 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.311895 15777 consensus_queue.cc:1059] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:16:29.390509 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.086947 15911 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.371418 15875 consensus_meta.cc:287] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.007s
I20260709 12:16:29.405413 10731 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:29.415762 10729 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:29.291687 15873 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.329322 15637 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.469511 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.390098 15941 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:29.394728 15931 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:29.390183 15899 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:29.394923 15871 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.339130 15894 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.362345 15938 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.547503 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:29.548362 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.475848 15879 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.541450 10735 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:29.471071 15629 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:29.485356 15923 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:29.490736 15922 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:29.417686 15935 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:29.391703 15836 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:29.540894 15887 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:16:29.551539 10737 raft_consensus.cc:2368] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19.
I20260709 12:16:29.467861 15902 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.569936 15903 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 12:16:29.570402 15903 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.570958 15936 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:16:29.571339 15902 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.566826 15938 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:29.572664 15903 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.565302 15628 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.529907 15875 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.549810 15871 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:29.574813 15875 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:29.566780 15945 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:16:29.470146 15876 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.576200 15766 consensus_meta.cc:287] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.004s
I20260709 12:16:29.577590 15637 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.400717 15924 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.567492 15621 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.568007 15894 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.556684 15879 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.580802 15630 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.863s	user 0.012s	sys 0.003s
I20260709 12:16:29.581207 15630 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.582412 15879 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:29.585968 15718 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.001s
I20260709 12:16:29.587486 15873 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.569074 15958 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:29.529378 15951 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:16:29.546558 15899 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:29.543016 15931 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:29.602114 15852 consensus_meta.cc:287] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.859s	user 0.001s	sys 0.006s
I20260709 12:16:29.602769 15921 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:29.602602 15852 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.604723 15852 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:29.605767 15906 consensus_meta.cc:287] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.000s
I20260709 12:16:29.552259 15941 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:29.559593 15930 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:29.605894 15650 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.002s
I20260709 12:16:29.594386 15899 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:29.619419 15911 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:29.591230 15958 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.606328 15922 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:29.634258 15904 raft_consensus.cc:3055] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:29.634811 15904 raft_consensus.cc:740] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:29.635682 15904 consensus_queue.cc:260] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.636973 15904 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:29.639287 15898 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.640553 15907 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:29.645972 15943 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:16:29.648164 15919 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.649451 15919 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:16:29.654069 15878 consensus_meta.cc:287] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.938s	user 0.008s	sys 0.008s
I20260709 12:16:29.729846 15650 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:29.366531 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49745.8us
I20260709 12:16:29.391062 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:29.828590 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:29.828918 10122 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:29.829756 10127 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
W20260709 12:16:29.830636 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 439547us
W20260709 12:16:29.659456 15869 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.000s
W20260709 12:16:29.661851 15874 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 1.186s	user 0.000s	sys 0.018s
I20260709 12:16:29.832293 15959 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.833161 15874 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.833482 15959 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.831048 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:29.835140 10123 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:29.832057 15869 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.729061 10203 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:29.731479 10733 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:29.422482 10046 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:29.837479 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:29.730583 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.718546 10051 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:29.738297 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.722241 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:29.724898 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 243115us
I20260709 12:16:29.739738 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.737200 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:29.724607 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.660367 15922 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.847886 10049 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:29.736507 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.667726 15926 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:29.667732 15927 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.725s	user 0.000s	sys 0.002s
I20260709 12:16:29.618630 15930 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:29.667840 15933 consensus_meta.cc:287] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.838s	user 0.020s	sys 0.012s
I20260709 12:16:29.682896 15941 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:29.665648 15891 consensus_meta.cc:287] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:16:29.743011 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.860944 10732 raft_consensus.cc:2368] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19.
I20260709 12:16:29.624111 15958 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:29.861478 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:29.863078 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.673954 15931 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.838299 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:29.864477 10046 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:29.864784 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:29.865780 15931 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:29.764225 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 401139us
I20260709 12:16:29.867369 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:29.868010 15874 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.764640 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 2151) took 1447 ms. Trace:
I20260709 12:16:29.765568 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2672) took 1046 ms. Trace:
I20260709 12:16:29.771118 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:29.771934 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:29.775326 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:29.776686 10197 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:29.727262 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 2.892s (SENT) [suppressed 19 similar messages]
W20260709 12:16:29.780267 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.863035 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:29.821913 15806 consensus_meta.cc:287] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.002s
W20260709 12:16:29.822564 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.830879 15907 raft_consensus.cc:3060] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:29.838378 10055 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:29.838167 15869 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.855414 15630 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:29.857227 15629 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.859225 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.859604 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.860790 15891 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:29.745434 15836 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.781508 15878 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.870604 10130 rpcz_store.cc:276] 0709 12:16:28.317387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.317495 (+   108us) service_pool.cc:224] Handling call
0709 12:16:29.764074 (+1446579us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54002107d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:29.764380 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826152832}
I20260709 12:16:29.883706 15806 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.910960 10736 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:29.910519 15871 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.832026 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:29.900780 10126 raft_consensus.cc:2410] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 12:16:29.897938 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.893016 10737 raft_consensus.cc:2410] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:16:29.901320 10728 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:29.910100 15806 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.895486 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:29.896261 10729 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:29.894639 10047 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:29.904614 10734 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
W20260709 12:16:29.925554 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.895493 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:29.893564 10052 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:29.930114 10055 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
W20260709 12:16:29.932017 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:29.893285 15872 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:29.901569 15930 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.904110 15650 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:29.891733 15959 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.939554 10048 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:29.906579 15833 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:29.941500 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 109781us
W20260709 12:16:29.941556 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 214504us
I20260709 12:16:29.893321 15926 raft_consensus.cc:2764] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:16:29.936148 15872 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.892570 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:29.956799 10122 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:29.957767 10730 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:29.958448 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 66014.1us
I20260709 12:16:29.958462 15891 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.960825 15891 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.963222 15965 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:29.945726 15872 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:29.967785 15654 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.147s	user 0.018s	sys 0.008s
W20260709 12:16:29.968706 15703 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.008s
I20260709 12:16:29.968336 15654 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.969170 15703 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:29.970635 15650 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:29.971412 15650 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.973959 15650 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.976401 10125 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:29.946475 15871 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:29.979635 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2674) took 1260 ms. Trace:
I20260709 12:16:29.980099 10123 rpcz_store.cc:276] 0709 12:16:28.719649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.743361 (+ 23712us) service_pool.cc:224] Handling call
0709 12:16:28.743682 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.835596 (+1091914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.979332 (+143736us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400243454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:29.979544 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509237504}
I20260709 12:16:29.981365 15878 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.870874 10128 rpcz_store.cc:276] 0709 12:16:28.719164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.720767 (+  1603us) service_pool.cc:224] Handling call
0709 12:16:28.721109 (+   342us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:28.738223 (+ 17114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:28.738255 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:28.743135 (+  4880us) log.cc:844] Serialized 78 byte log entry
0709 12:16:29.074504 (+331369us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:29.123995 (+ 49491us) log.cc:844] Serialized 14 byte log entry
0709 12:16:29.127626 (+  3631us) log.cc:844] Serialized 14 byte log entry
0709 12:16:29.127875 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.127947 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:29.764868 (+636921us) raft_consensus.cc:1685] finished
0709 12:16:29.764910 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:29.765286 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20020,"prepare.queue_time_us":243174,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":161772,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":14251,"thread_start_us":225497,"threads_started":1,"wal-append.queue_time_us":600077}
I20260709 12:16:29.983253 10127 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:16:29.983561 10051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2549) took 1672 ms (client timeout 1876 ms). Trace:
W20260709 12:16:29.983971 10051 rpcz_store.cc:269] 0709 12:16:28.311263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.435283 (+124020us) service_pool.cc:224] Handling call
0709 12:16:29.983351 (+1548068us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003f8ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:29.983485 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936591616}
I20260709 12:16:29.956900 15930 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.985706 15930 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:29.988353 15930 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:29.993839 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:29.994774 10201 raft_consensus.cc:2393] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:29.996013 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:29.996894 10200 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:30.001226 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:29.982157 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1047) took 1368 ms. Trace:
I20260709 12:16:29.960986 15869 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:30.004096 15869 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:30.004463 15869 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.005654 10046 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:30.014778 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.002873 10203 rpcz_store.cc:276] 0709 12:16:28.613862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.613968 (+   106us) service_pool.cc:224] Handling call
0709 12:16:28.629135 (+ 15167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:29.836335 (+1207200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:29.981798 (+145463us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540007f154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:29.982059 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528257408}
I20260709 12:16:29.960728 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.003750 10020 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:30.031523 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.021199 15650 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:30.047793 10049 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
W20260709 12:16:30.050537 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 82614.9us
I20260709 12:16:30.030383 15958 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.051827 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.052802 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.052811 15958 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:30.053843 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.053095 15924 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:30.054527 15924 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:30.054929 15924 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:30.066969 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.054858 15959 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:30.069551 15654 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.084347 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.069870 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.070739 15891 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:30.071348 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 115361us
I20260709 12:16:30.072094 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.071879 15650 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.072909 15918 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:30.074662 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:30.070230 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 109614us
I20260709 12:16:30.080839 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.081626 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.082901 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.083835 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.082348 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.070686 10203 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:16:30.082294 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.087601 10197 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:30.104310 10196 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:30.060315 15930 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:30.094357 15907 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:30.097111 15918 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.130340 10201 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:30.127315 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.126804 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.136273 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.122320 15703 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.140338 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.132011 15918 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:30.144003 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.139211 10198 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:30.154614 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 82644.4us
I20260709 12:16:30.155562 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.156009 15844 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:30.156527 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.156661 15844 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.157052 15923 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:30.157539 15923 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:30.158088 15833 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:30.158582 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.157560 10095 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.160030 15833 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.163107 15806 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.163543 15833 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.163739 15806 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.166134 15806 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.168516 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.169258 15654 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:30.186543 15922 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:30.157936 15923 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:30.186932 10048 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:16:30.191141 15899 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.006s
I20260709 12:16:30.170393 15876 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:30.191854 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.191969 15876 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.192669 10202 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:30.193094 15876 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.186992 15654 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:16:30.172385 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.174710 15878 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:16:30.176399 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 43514.5us
I20260709 12:16:30.200278 15878 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.200729 15878 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:30.201709 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.202243 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 913) took 1167 ms. Trace:
I20260709 12:16:30.203094 15703 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:30.203514 15703 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.203857 15703 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:30.205839 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.206090 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.206676 10047 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:30.206843 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.207607 10046 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:30.207778 15922 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.208317 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.208921 10048 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:30.210014 15922 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.177186 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.194576 15650 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.210845 10049 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:30.211990 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.202626 10730 rpcz_store.cc:276] 0709 12:16:29.035346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:29.035474 (+   128us) service_pool.cc:224] Handling call
0709 12:16:30.202024 (+1166550us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400646254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:30.202174 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674713472}
I20260709 12:16:30.213400 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:30.213590 10168 leader_election.cc:336] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.606s (SENT)
I20260709 12:16:30.214007 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.214731 15864 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:30.215659 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.215756 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.216387 10733 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:30.191658 15899 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.209952 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.219002 15899 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.221320 15958 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:16:30.221508 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53110.7us
I20260709 12:16:30.218942 10048 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:30.222780 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.223467 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.223857 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.224778 10048 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:30.225044 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.225584 10203 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.177784 15907 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:30.226182 10048 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:30.177875 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.194847 15654 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:30.230804 10052 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.232414 15738 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.232913 15864 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:30.170054 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.234241 15864 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:30.234731 10195 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.232498 15654 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.235911 15924 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.236685 15654 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:30.238050 10048 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:16:30.179956 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.239050 10055 raft_consensus.cc:2393] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:30.239661 10048 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:30.240365 10055 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:30.181404 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.182466 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.242367 10050 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:30.224817 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.141566 15959 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.243836 15959 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.244835 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.245266 15869 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.223402 10197 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:30.245700 15899 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:30.171016 15872 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:30.191367 10732 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:16:30.247643 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.248133 15872 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:30.248549 15907 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:30.249239 10053 raft_consensus.cc:2410] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:16:30.196187 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.197307 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.197791 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.198500 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.199599 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.185859 10198 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:30.246392 15899 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.250847 10200 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:30.258842 10201 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:30.157893 15844 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.245913 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:30.266218 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 107900us
I20260709 12:16:30.256826 10049 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:30.261547 10735 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:30.262161 10047 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:30.262979 10204 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:30.263244 10196 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:30.237967 15924 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.264046 10202 raft_consensus.cc:2368] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20.
I20260709 12:16:30.270891 10195 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:30.273980 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.258930 15907 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.230114 15923 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.277654 10052 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:30.263827 15899 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.280568 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.281235 10055 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:30.283785 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.286996 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:30.289839 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 112111us
I20260709 12:16:30.294008 15909 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:30.294790 15924 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:30.295394 15924 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.297340 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:30.297765 15924 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.278213 15907 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:30.298625 15931 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:30.298840 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74115.1us
I20260709 12:16:30.299310 15939 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:30.299950 15939 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.300909 15958 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:30.301949 15958 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:30.302366 15958 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:30.302649 15836 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:30.303061 15836 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:30.303282 15869 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.304369 15918 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.305390 15933 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:30.275295 15864 raft_consensus.cc:2764] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:16:30.307770 15931 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.308907 15958 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.309856 15931 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.300546 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.310564 15836 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.313371 15864 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:30.269506 15650 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:30.314728 15650 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.315626 10047 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:16:30.316342 15923 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.316764 15650 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.317737 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.318739 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.319909 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.320415 10202 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:30.320801 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.324728 10123 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:16:30.325940 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.326613 10127 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.326934 15814 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:30.325855 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.313457 15872 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:30.338575 15703 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.339107 10130 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:30.340764 10200 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:30.341811 10047 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:30.347203 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.310132 15958 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.304889 10095 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.361163 10127 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
W20260709 12:16:30.357883 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51298.5us
I20260709 12:16:30.364578 10702 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:30.367165 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62341.5us
W20260709 12:16:30.369081 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71854.5us
I20260709 12:16:30.370278 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.355665 15918 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.382853 10197 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:30.383116 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.395308 10202 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:30.387259 15874 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.397857 15874 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.400152 15874 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.390581 15629 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:30.391208 15867 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:30.401973 15867 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:30.402359 15867 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:30.391979 10168 leader_election.cc:336] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.680s (SENT)
I20260709 12:16:30.403340 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:30.404644 10168 leader_election.cc:336] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.704s (SENT)
W20260709 12:16:30.405593 10168 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.718s (SENT)
I20260709 12:16:30.405933 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:30.356319 15933 consensus_queue.cc:1059] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:16:30.406774 15654 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:30.407141 15910 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:16:30.407509 15654 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:30.363860 15814 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:30.397119 10203 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:30.386547 15788 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:16:30.376981 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.415138 15613 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:16:30.416229 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 74557us
I20260709 12:16:30.417689 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:30.418586 15874 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:30.419165 10055 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:30.419023 15922 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:30.419766 15922 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:30.420107 10168 leader_election.cc:336] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.782s (SENT)
I20260709 12:16:30.420529 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.418587 15629 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.420652 15922 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.421850 15806 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:30.422616 15806 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:30.422016 15629 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.422950 15806 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:30.423352 15806 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:30.423653 15878 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.425611 15878 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.426729 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:30.427279 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:30.430250 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.433674 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:30.434015 10199 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:30.434413 10203 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:16:30.372949 15939 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.439550 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.440301 10127 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:30.414815 15814 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.442767 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.419114 15874 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.444307 10095 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.426440 15654 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:30.450222 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.450755 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.452105 15766 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.455636 15766 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.456063 15908 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:30.456938 15878 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:30.457409 15878 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:30.457968 15766 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:30.459285 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 213475us
I20260709 12:16:30.467202 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.468082 10127 raft_consensus.cc:2393] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:30.452308 15939 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:16:30.475839 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49182.1us
I20260709 12:16:30.463853 15923 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:30.477541 15613 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:30.507148 10203 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
W20260709 12:16:30.509945 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 48253.3us
I20260709 12:16:30.486375 15939 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.490913 15923 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.458379 15878 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.495972 15613 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:30.539244 15613 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.539980 15788 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:30.540462 15788 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:30.542088 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.545378 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:30.542711 10125 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:30.559077 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:30.541565 15904 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:30.588418 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:30.637753 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 100623us
I20260709 12:16:30.557451 15278 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.641891 15871 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:30.642385 15871 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:30.642623 15931 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.643134 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.541320 15788 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.648857 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:30.649181 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.657989 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.658685 10047 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:30.635982 15904 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.635344 15833 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:30.655730 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:30.660061 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:30.660269 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 85496.2us
W20260709 12:16:30.650373 10168 leader_election.cc:336] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.875s (SENT)
I20260709 12:16:30.661906 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:30.659916 10053 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
W20260709 12:16:30.704016 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 255680us
I20260709 12:16:30.643277 15931 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.534536 15874 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:30.706080 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56547.4us
W20260709 12:16:30.645032 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 190887us
I20260709 12:16:30.707665 10094 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:30.702759 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.713145 10054 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:30.652486 15788 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:30.707929 15978 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:16:30.713245 15864 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:30.726373 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.663086 15904 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.732398 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:30.734369 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 84038.5us
I20260709 12:16:30.732805 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.731947 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.742129 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.658562 15278 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.707332 15876 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:16:30.746213 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.749866 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.655241 15908 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:30.748742 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:30.756289 10168 leader_election.cc:336] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.879s (SENT)
I20260709 12:16:30.756744 15855 raft_consensus.cc:2804] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:30.761534 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.764201 15703 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:30.766300 15994 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:30.708076 15923 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.772359 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.772253 10047 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
W20260709 12:16:30.775312 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46975us
I20260709 12:16:30.775360 10054 raft_consensus.cc:2410] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:16:30.776919 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 69327.2us
I20260709 12:16:30.777403 10127 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:30.780814 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.807600 10736 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:30.783836 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.784224 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:30.784574 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.648630 15867 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.749799 15959 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:30.792984 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47683.6us
I20260709 12:16:30.787920 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.817366 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:30.716400 15939 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.799638 10125 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:30.800042 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.811334 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.809649 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.810011 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:30.810921 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.812378 10196 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:16:30.810395 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.819625 10199 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:30.815841 15910 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:30.817600 10128 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:30.803838 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.827404 10734 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:30.832811 15628 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:30.833410 15628 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.835129 15958 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:30.835404 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.835615 15628 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:30.836352 15867 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:30.837157 15981 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:16:30.837694 15990 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:16:30.835147 15899 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.004s
I20260709 12:16:30.843011 15899 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.844945 15899 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:30.821453 15959 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:30.845824 15959 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.799670 15994 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.740168 15871 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.801445 15629 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:30.855090 10128 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:30.858398 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.812716 15992 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.861490 10201 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:30.847841 15990 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:30.857798 10095 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:30.803237 15855 raft_consensus.cc:697] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:30.788882 15806 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.836366 15628 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:30.863081 10733 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:30.874604 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.848887 15910 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:30.907629 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 151371us
I20260709 12:16:30.875720 10047 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:30.913478 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:30.913800 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56115.5us
I20260709 12:16:30.920015 10731 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:30.873005 15836 consensus_meta.cc:287] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.003s
I20260709 12:16:30.862332 15994 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:30.870909 15629 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:30.926764 10735 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:30.929572 10049 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:16:30.922227 15910 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.938685 10054 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:30.927371 15918 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:30.946761 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.862764 15958 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:30.950505 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 312099us
I20260709 12:16:30.929718 15629 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:30.955235 10049 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:16:30.957648 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 225847us
I20260709 12:16:30.933647 15613 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:30.961383 10168 leader_election.cc:336] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 2.111s (SENT)
I20260709 12:16:30.963750 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:30.962683 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.964190 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:30.963830 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.933995 15738 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:30.947517 15628 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.967039 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:30.963325 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:30.970721 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:30.956725 15871 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:30.957254 15931 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:30.982571 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 198410us
I20260709 12:16:30.978471 10054 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:30.927282 15836 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:30.975045 15907 consensus_meta.cc:287] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.676s	user 0.006s	sys 0.006s
I20260709 12:16:30.995121 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:30.996647 10204 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:30.999460 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.007319 10201 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:31.001104 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.008174 10196 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:30.957114 15650 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:16:31.005010 10728 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:31.013046 10054 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:31.012662 10728 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:31.013900 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.016356 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:30.993120 15654 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:31.024209 16002 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:16:31.024873 15999 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:16:31.016086 15991 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:16:31.039328 10054 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:16:30.907568 15992 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:30.977357 15628 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:30.979076 15613 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:31.052026 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 90691.4us
I20260709 12:16:31.048915 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:31.010354 15931 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:16:31.106562 10730 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:31.106062 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59030.3us
I20260709 12:16:31.033300 15918 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:31.035353 15869 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:31.011705 15907 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.042646 15806 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.121991 10048 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:30.937042 15908 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:31.013636 15996 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.103s
W20260709 12:16:31.124250 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 119899us
I20260709 12:16:31.014019 15738 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.127508 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.129201 10130 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:31.106034 15278 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.048403 15991 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:30.991539 15990 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.138973 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.140136 10047 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:31.140508 10050 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
W20260709 12:16:31.144392 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.008795 15855 consensus_queue.cc:237] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.147073 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.151135 10125 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.154945 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.155921 15613 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:31.157161 15989 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:16:31.158211 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:31.158574 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.163542 15907 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.164091 10729 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:31.166039 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.166922 10126 raft_consensus.cc:2410] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:31.167609 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.167762 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.168197 10129 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:31.168807 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.169667 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.169965 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.171106 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.172024 10054 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:16:31.173103 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:31.173784 10051 raft_consensus.cc:2368] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18.
W20260709 12:16:31.178015 16011 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:16:31.179072 10127 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:31.179411 15628 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:31.145465 15654 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:16:31.180245 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.180620 15654 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:31.181130 15654 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:31.180559 15991 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.182834 15836 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:31.186040 10731 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:31.178200 15278 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.204634 15278 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.186501 10728 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.206846 15278 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.206935 10728 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.211225 16010 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:31.211639 16010 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:31.212049 15833 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.006s
I20260709 12:16:31.212422 16010 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.213593 16010 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:31.215183 10204 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:16:31.215848 15994 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.216254 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:31.216535 16000 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:16:31.217319 10125 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:31.217319 10736 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:31.187796 16007 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.188359 15918 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.227769 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.189292 15958 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:31.189652 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 59713.8us
I20260709 12:16:31.232247 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:31.192497 16008 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 12:16:31.166764 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:31.236568 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.182008 15654 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.197031 10130 raft_consensus.cc:1240] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:31.149874 16006 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:31.238396 15628 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:31.241782 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.242137 15992 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.199504 10124 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:31.242946 10121 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:31.243323 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.243800 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.244475 10121 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:31.245314 15995 log.cc:927] Time spent T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:16:31.245543 10121 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:31.255036 15629 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.218379 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.217481 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.265285 10128 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:31.219038 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 80171.5us
I20260709 12:16:31.217923 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:31.218559 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.220932 10728 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:31.219671 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.223726 10129 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:31.230808 10196 raft_consensus.cc:2393] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:31.236702 10123 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:31.255019 15654 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:31.258693 10735 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:31.281519 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.282369 10203 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:31.194130 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.259397 15994 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:31.260699 16007 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.212446 15833 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:31.296141 10052 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:16:31.299255 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 57535.1us
I20260709 12:16:31.293520 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.286535 15931 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:31.303192 10196 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:16:31.306137 10051 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:31.307632 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.291095 15650 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:31.298108 15904 consensus_meta.cc:287] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
W20260709 12:16:31.312084 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 118015us
I20260709 12:16:31.314860 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.315590 16004 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:31.315917 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.316579 16004 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:31.317226 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.317463 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.318210 10736 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:31.318514 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.319057 16004 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:31.319567 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.319720 16004 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:31.320644 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:31.320621 15993 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:31.322078 15993 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:31.322557 15993 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:31.322767 15766 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:31.323172 15766 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:31.323494 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.310791 15992 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:31.330762 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.323946 15994 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:31.332378 15994 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.335114 10195 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:31.336488 10195 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:31.336190 15910 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.337782 10200 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:16:31.338575 15738 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.336647 15923 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:31.339838 15959 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.341187 10201 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:31.342105 15959 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.337641 15629 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.342888 15994 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.342548 15993 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.339037 10737 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:31.344704 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.345302 10736 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 10.
I20260709 12:16:31.346087 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.346630 10737 raft_consensus.cc:1240] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:16:31.346742 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.347800 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.348104 10729 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:16:31.348385 10737 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:31.349089 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:31.350211 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.351006 10734 raft_consensus.cc:2410] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:16:31.353536 10127 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:31.354315 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.325687 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.355051 10196 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:31.355305 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65627.5us
I20260709 12:16:31.356057 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.322559 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.359290 10204 raft_consensus.cc:2393] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:31.359848 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.360337 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:31.361155 10731 raft_consensus.cc:2410] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:16:31.361769 10123 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:31.362530 15992 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:31.366896 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.367206 10734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:31.367966 10734 raft_consensus.cc:606] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.368140 15766 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.366833 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.311894 15931 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.310742 16006 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:31.367681 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.372444 16007 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.351310 15904 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.374204 10736 raft_consensus.cc:2393] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:31.374593 10203 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:31.375181 15904 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.378943 15931 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.379925 16018 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:16:31.381060 15891 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:16:31.383201 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75673.3us
I20260709 12:16:31.384805 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.368332 10734 raft_consensus.cc:614] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:31.382642 15958 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:16:31.380419 15992 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:31.388641 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:31.389220 10203 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:31.381145 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.338285 15910 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.391831 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:31.391875 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 68459us
I20260709 12:16:31.394230 15992 consensus_queue.cc:1059] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:31.395278 15278 raft_consensus.cc:3055] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:31.395766 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.395637 15278 raft_consensus.cc:740] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:31.390055 15994 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:31.391569 15931 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:31.382274 16018 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:16:31.406792 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.406975 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:31.323719 16004 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:16:31.407394 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.408377 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.411391 10051 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:31.412027 10728 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:31.399821 15922 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.413913 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:31.411916 10048 raft_consensus.cc:2376] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19. Re-sending same reply.
I20260709 12:16:31.418488 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.417812 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.419389 10196 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 10.
I20260709 12:16:31.418738 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.417587 10204 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:31.420091 10201 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:31.421432 10046 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:16:31.418157 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.423267 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.423810 10201 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:31.408418 15994 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.426327 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.426841 10046 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:31.409241 15958 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:31.427935 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.428772 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:31.429639 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:31.427899 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:31.430919 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.432047 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.433712 16007 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:16:31.434083 16003 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.413s	user 0.001s	sys 0.001s
I20260709 12:16:31.434230 16019 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:16:31.434113 16007 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.436257 16007 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:31.438606 16019 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:31.439569 16019 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.440126 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.428287 15910 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:31.429049 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:31.444022 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 62966.7us
I20260709 12:16:31.445544 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.430603 15994 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.451138 10052 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:31.447664 15878 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:31.448261 15910 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:31.472039 15910 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.472482 15910 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:31.463455 15997 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:31.474702 10051 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:31.447860 15958 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:31.476481 15958 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.452672 15996 raft_consensus.cc:2764] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:16:31.446558 15899 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:16:31.450966 15869 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:16:31.465210 16021 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:16:31.462719 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:31.480336 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50738.1us
I20260709 12:16:31.489557 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.490222 10055 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:31.482668 15869 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.493343 15869 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.493959 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:31.449990 16018 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:16:31.497776 10049 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:31.500021 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.495767 10094 leader_election.cc:400] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20.
I20260709 12:16:31.501987 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:31.506639 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.517589 15628 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:31.518189 15628 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:31.514238 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.520071 15996 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:16:31.521255 16023 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:16:31.524386 15806 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:31.524406 15909 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:31.525154 15806 consensus_queue.cc:1243] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:16:31.525538 15909 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.525861 15891 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:31.526377 15891 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:31.527640 15909 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.527398 15891 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.528806 15891 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:31.529465 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 69675.3us
I20260709 12:16:31.519305 15628 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.533895 10051 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:31.530210 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:31.526194 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.539780 10201 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:31.552744 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.539963 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.557323 16028 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:31.559068 10053 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:31.559846 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:31.556995 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 98003.6us
I20260709 12:16:31.562316 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.563174 16006 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:31.563588 16006 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:31.563975 16006 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:31.567937 10124 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:31.565766 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.525883 16018 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:16:31.569164 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 69240.5us
I20260709 12:16:31.572489 10198 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:16:31.573593 10198 pending_rounds.cc:85] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 9
I20260709 12:16:31.558314 16028 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:31.580379 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.575697 10169 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.460822 15278 consensus_queue.cc:260] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.582129 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.568994 15871 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:31.572980 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.570013 15806 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:31.586782 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.553418 15909 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:16:31.587343 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47468us
I20260709 12:16:31.574326 15939 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:31.591325 10124 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:31.577708 15872 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:31.571256 16018 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:31.594050 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.579329 10198 pending_rounds.cc:107] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:16:31.608867 10198 raft_consensus.cc:2889] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:31.609232 10198 pending_rounds.cc:107] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:16:31.609473 10198 raft_consensus.cc:2889] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:31.594134 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:31.595965 10053 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:31.574086 15864 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:31.594699 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:31.599862 10095 leader_election.cc:400] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18.
I20260709 12:16:31.612016 10095 leader_election.cc:403] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:16:31.603577 10049 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:31.604059 10127 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:31.617833 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.607911 15806 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:31.619295 10123 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:31.619606 15806 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.585834 16028 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:31.622370 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.625075 10125 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:31.591226 15628 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:31.622763 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 92647.8us
I20260709 12:16:31.627192 10130 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:31.627358 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.581370 15994 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.621310 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.636066 10129 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:31.625233 10127 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:31.637434 10122 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:16:31.593217 15654 raft_consensus.cc:2804] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:31.635944 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.598996 16007 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.639415 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.622531 15872 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:31.655023 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.616595 15864 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:31.658160 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:31.624742 15650 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18.
W20260709 12:16:31.653954 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 204912us
I20260709 12:16:31.624670 15939 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:31.653187 15923 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:16:31.615823 15918 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:16:31.616082 15910 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:31.667244 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 68210.4us
W20260709 12:16:31.669526 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59264.6us
I20260709 12:16:31.657531 15864 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:31.651925 15959 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:16:31.700464 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.657579 15999 consensus_queue.cc:1059] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:16:31.659096 15738 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:16:31.727653 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 63377.6us
W20260709 12:16:31.718222 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59597.9us
I20260709 12:16:31.730796 10201 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:31.668812 15844 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:31.670957 15904 raft_consensus.cc:3055] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:31.733122 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.733577 10019 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:31.736642 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 142026us
I20260709 12:16:31.769590 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:31.769824 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:31.770891 16032 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:16:31.679385 16026 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:16:31.768603 16005 consensus_queue.cc:1059] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 12:16:31.771363 15872 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:31.785641 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52389.4us
W20260709 12:16:31.793839 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.867547 10094 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:31.863993 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 254980us
I20260709 12:16:31.875483 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.736034 15904 raft_consensus.cc:740] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:31.744939 15958 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:31.878093 15871 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:31.787029 16026 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.888660 16013 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:31.789676 15650 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:16:31.787533 15629 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 12:16:31.787505 15996 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 12:16:31.897360 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.897866 16007 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.794438 15703 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:31.919421 15703 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:31.919837 15703 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:31.670564 16018 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.904116 15924 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:31.901146 16026 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:31.904844 15933 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:31.928674 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.933199 10123 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:31.920681 16013 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:31.936020 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.943780 10197 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:31.942055 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 208998us
I20260709 12:16:31.923401 15613 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:31.945166 15613 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:31.945581 15613 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:31.947140 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:31.948712 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:31.950325 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.924399 15654 raft_consensus.cc:697] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:31.952705 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 219169us
I20260709 12:16:31.914582 15869 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.956403 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.962133 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:31.963946 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:31.913158 15939 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:31.973537 16031 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:16:31.931828 15629 consensus_queue.cc:1243] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 1c0050fa6eee4a0183cbe41a3f72c62b log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:16:31.943125 15994 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.972409 15910 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:31.975188 10123 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:31.953105 15958 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:31.978695 10124 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:31.980855 10047 raft_consensus.cc:2368] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:31.970139 15904 consensus_queue.cc:260] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:31.975670 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:31.976257 16030 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:31.984529 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 117061us
I20260709 12:16:31.988063 10198 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:31.986387 10197 raft_consensus.cc:2468] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:31.990636 10701 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:31.993745 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:31.994534 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:31.980695 15931 raft_consensus.cc:2764] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:16:31.999730 10123 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:32.003961 10199 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:32.003145 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:32.005257 10736 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:31.987178 15908 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:31.982471 15958 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.006312 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:31.990670 16044 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:32.010125 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:32.015642 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:31.996289 15994 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:32.010672 15933 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:16:32.020649 15994 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:32.015249 15959 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:32.019523 15918 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:16:32.013228 15958 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:32.023406 15613 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.021659 15994 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.026535 15654 consensus_queue.cc:237] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.019954 16051 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:32.033856 10728 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: []
I20260709 12:16:32.017700 10198 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:32.019047 16039 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.019234 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.007472 15629 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:16:32.007211 15833 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:16:32.004132 15650 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:32.047195 10204 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:16:32.016431 10735 raft_consensus.cc:2368] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:32.038676 10197 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:31.978350 15871 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.026136 15613 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.008533 15904 raft_consensus.cc:3060] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:32.041918 10200 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:32.042232 10199 raft_consensus.cc:1240] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:32.043463 10196 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:32.039247 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:32.006673 16005 raft_consensus.cc:3055] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:32.045851 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:32.117959 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.049052 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:32.051833 10734 raft_consensus.cc:1275] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:16:32.006193 15923 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:16:32.053277 10195 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:16:32.054383 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:32.120011 10195 pending_rounds.cc:85] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:32.120321 10195 pending_rounds.cc:107] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:16:32.120565 10195 raft_consensus.cc:2889] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:32.123898 10202 raft_consensus.cc:1240] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:32.057150 15869 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.009231 15855 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:16:32.030107 16013 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:32.026191 15922 consensus_meta.cc:287] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.003s
I20260709 12:16:32.039582 15738 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:32.058678 16053 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.059067 16039 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:31.993283 16030 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.036633 16044 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.116590 16005 raft_consensus.cc:740] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:32.035916 15908 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:32.114951 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.185626 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:32.115274 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.119220 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.186791 10196 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:32.129756 10733 raft_consensus.cc:2368] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18.
I20260709 12:16:32.007021 16040 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 12:16:32.188548 16040 consensus_queue.cc:1243] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:32.189111 16040 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:32.189489 16040 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:32.190445 16040 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.191720 16040 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:32.192314 15923 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:32.193051 16042 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:32.193328 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:32.193652 16042 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:32.194926 16052 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:32.195478 16041 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:32.195605 16052 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:32.196023 16041 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:32.136759 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:32.157917 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 377144us
I20260709 12:16:32.159586 10200 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:32.161959 10736 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:16:32.196768 10199 raft_consensus.cc:2393] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:32.164825 10731 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:16:32.166203 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 290772us
I20260709 12:16:32.196691 10200 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:32.198053 10094 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:32.198590 10200 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.199489 15738 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:32.200335 10731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:32.200552 15923 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:16:32.168754 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:32.126966 16049 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.200948 15923 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:32.200909 10731 raft_consensus.cc:606] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:32.201697 10731 raft_consensus.cc:614] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:32.200984 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.202143 15923 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.199540 10200 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:32.203171 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.203577 15923 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:16:32.204087 15613 consensus_queue.cc:1059] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:32.204789 15613 consensus_queue.cc:1243] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:16:32.205231 15613 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.205651 15613 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.206830 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:32.207954 15922 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:32.208118 15996 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:32.136061 10728 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:16:32.196929 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:32.194561 16042 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.211261 15996 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:32.213500 15654 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:32.213848 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:32.221369 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:32.184473 15628 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.549s	user 0.004s	sys 0.004s
I20260709 12:16:32.227499 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:32.218077 16006 consensus_meta.cc:287] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.005s
I20260709 12:16:32.226060 15878 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.233067 10198 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:16:32.233477 10198 pending_rounds.cc:85] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 8
I20260709 12:16:32.233711 10198 pending_rounds.cc:107] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:16:32.233943 10198 raft_consensus.cc:2889] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:32.220942 16048 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.237296 15878 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.245875 10126 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:32.239707 10200 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:16:32.248063 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:32.248075 16063 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:16:32.244284 16026 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.288753 10201 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 11: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:32.236783 15833 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:32.224103 15922 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:16:32.289505 10094 leader_election.cc:400] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18.
I20260709 12:16:32.228340 15650 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:16:32.229529 15918 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:16:32.180747 16053 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.245941 15910 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:32.238782 16064 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:32.240049 15628 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:32.251984 16044 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.246557 15878 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.289165 15806 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:32.235008 16006 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:32.331341 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.288435 16030 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.196864 16041 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:32.333441 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 119658us
I20260709 12:16:32.291946 15833 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:32.290606 15871 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:32.352684 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:32.247694 15994 consensus_queue.cc:1059] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:16:32.201478 16049 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.344228 16006 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:32.274104 16005 consensus_queue.cc:260] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.297153 15959 consensus_queue.cc:1048] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:16:32.356899 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:32.347003 16026 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:32.306770 15874 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:16:32.337034 16064 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.324564 15836 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:16:32.250656 15908 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.353088 15833 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:32.271404 16048 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.341354 15650 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:16:32.374780 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:32.365610 16028 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.001s
I20260709 12:16:32.368993 16061 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.388712 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:32.375991 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 52391.7us
I20260709 12:16:32.397296 16026 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:32.395839 16061 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.361367 15654 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:32.398488 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:32.420655 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.359247 15871 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.423086 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:32.423533 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.405908 15654 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:32.426779 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.431720 15958 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.434111 15958 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:32.434777 10197 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:32.338614 15996 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.418120 15613 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.440915 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:32.429414 15654 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:32.405114 16028 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.420401 16041 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:16:32.418325 16069 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 12:16:32.472064 15703 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.544s	user 0.004s	sys 0.004s
I20260709 12:16:32.472499 15703 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.473516 10055 raft_consensus.cc:1240] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:16:32.474522 16054 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:16:32.475939 10203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:16:32.476464 10203 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:32.477728 10203 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:16:32.440502 16039 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.462073 15628 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:32.555008 10199 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
W20260709 12:16:32.477823 15864 consensus_meta.cc:287] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.749s	user 0.006s	sys 0.003s
I20260709 12:16:32.469246 15958 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:32.556689 15996 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:32.583793 16006 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:32.588562 16070 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.110s
W20260709 12:16:32.590758 16075 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:16:32.595944 16048 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:32.575989 15864 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:32.706396 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:32.554764 15836 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:16:32.578393 15958 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:32.730836 16077 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:16:32.731333 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.732041 10202 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:16:32.733073 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:32.575577 16026 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:16:32.733667 10202 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:32.587127 16053 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:32.577616 15628 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.733635 15958 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:32.767180 16048 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:32.871590 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 430705us
I20260709 12:16:32.858837 16053 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:32.898159 10202 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
W20260709 12:16:32.901575 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 132356us
W20260709 12:16:32.903331 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 169238us
I20260709 12:16:32.907284 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:32.908221 15806 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:16:32.908630 15806 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.908978 15806 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:32.965270 16045 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.965866 16045 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:32.968089 16045 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:32.969954 16084 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:16:32.925963 16053 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.886041 16048 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:32.951484 15869 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:32.954828 15871 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:32.961448 16049 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.018898 16028 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:33.128135 15904 consensus_meta.cc:287] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.998s	user 0.005s	sys 0.005s
I20260709 12:16:33.020279 15869 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.099939 15628 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.148535 15869 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.151387 16013 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.151662 15923 consensus_meta.cc:287] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.948s	user 0.009s	sys 0.001s
I20260709 12:16:33.152158 15923 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:33.152669 15923 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.154930 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:33.155654 15869 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:33.156037 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:33.156819 15869 raft_consensus.cc:2804] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:33.157330 15869 raft_consensus.cc:697] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:33.136564 16080 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 12:16:33.135890 15833 consensus_meta.cc:287] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.730s	user 0.001s	sys 0.008s
I20260709 12:16:33.169145 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:33.177596 15833 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.179826 15833 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:33.157070 16034 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.426s	user 0.003s	sys 0.000s
I20260709 12:16:33.181387 16041 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:33.181881 16041 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:33.182760 16041 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.184067 16041 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:33.187732 16053 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.135124 15864 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.189396 16053 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:33.189953 16053 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.190259 16048 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.192109 16053 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:32.917670 15806 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.197778 16081 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.198629 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:33.197858 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.199769 15869 consensus_queue.cc:237] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.187907 15923 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:33.201231 15654 consensus_meta.cc:287] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.000s
I20260709 12:16:33.218811 15654 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.220830 15654 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:33.207439 16040 consensus_meta.cc:287] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.002s
I20260709 12:16:33.151963 16013 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.224745 16013 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.208340 16061 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.227466 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:33.228195 10731 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:33.229444 10200 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 12:16:33.230548 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:33.231083 10200 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:33.231168 16053 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:33.231640 16053 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.231968 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:33.232082 10196 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 8. (term mismatch)
I20260709 12:16:33.232549 10196 pending_rounds.cc:85] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 7
I20260709 12:16:33.232822 10196 pending_rounds.cc:107] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 18.8
I20260709 12:16:33.233045 10196 raft_consensus.cc:2889] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:33.233719 16096 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.234217 16096 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.234802 16081 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:33.235155 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.236516 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.206419 15958 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.237311 15613 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:33.237694 15613 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:33.238075 15613 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:33.238551 15958 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.232967 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:33.240451 10200 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:16:33.244603 10047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2602) took 1748 ms (client timeout 1879 ms). Trace:
I20260709 12:16:33.246315 16042 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:33.234087 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:33.246800 16042 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:33.246472 10201 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 1070) took 1349 ms (client timeout 1539 ms). Trace:
I20260709 12:16:33.246906 10195 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:16:33.245106 10047 rpcz_store.cc:269] 0709 12:16:31.496161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.496317 (+   156us) service_pool.cc:224] Handling call
0709 12:16:33.244397 (+1748080us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54003e6554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:33.244538 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098766208}
W20260709 12:16:33.250890 10201 rpcz_store.cc:269] 0709 12:16:31.896937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.897095 (+   158us) service_pool.cc:224] Handling call
0709 12:16:33.246250 (+1349155us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54002215d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:33.246381 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852138368}
I20260709 12:16:33.236315 16096 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:33.263927 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.275229 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 76669.2us
I20260709 12:16:33.278012 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:33.278776 10201 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:33.279892 10201 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:33.281635 10019 leader_election.cc:400] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:33.264922 15931 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.260610 16042 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.259404 15833 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:33.265715 15836 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.265527 16013 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.267482 15996 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:16:33.322278 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1053) took 1270 ms. Trace:
W20260709 12:16:33.323945 16059 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.091s	user 0.017s	sys 0.009s
I20260709 12:16:33.336344 10737 rpcz_store.cc:276] 0709 12:16:32.052084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.060962 (+  8878us) service_pool.cc:224] Handling call
0709 12:16:32.212662 (+151700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.221998 (+  9336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.222032 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:32.222072 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:32.222102 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.321953 (+1099851us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b540046f354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.322011 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:33.322178 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20981632}
W20260709 12:16:33.330981 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.339172 16093 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:16:33.289381 16044 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 12:16:33.369117 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2583) took 1154 ms. Trace:
I20260709 12:16:33.332050 15924 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:33.378839 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:33.381911 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 132690us
I20260709 12:16:33.383431 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.384173 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.385295 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.387120 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.397300 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.397976 10049 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:33.299685 15833 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.293660 15931 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.400568 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:33.401371 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.401914 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:33.332571 15836 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.369578 10204 rpcz_store.cc:276] 0709 12:16:32.214663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.214759 (+    96us) service_pool.cc:224] Handling call
0709 12:16:32.215069 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:32.395668 (+180599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:32.395697 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:32.396308 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:16:32.421372 (+ 25064us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:32.555135 (+133763us) log.cc:844] Serialized 14 byte log entry
0709 12:16:32.857964 (+302829us) log.cc:844] Serialized 14 byte log entry
0709 12:16:32.858445 (+   481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.354569 (+496124us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540003b454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.354616 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:33.367548 (+ 12932us) raft_consensus.cc:1685] finished
0709 12:16:33.367569 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:33.369047 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283165,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":6881,"raft.queue_time_us":47374,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":3382,"spinlock_wait_cycles":415155456,"thread_start_us":452664,"threads_started":3,"wal-append.queue_time_us":34877}
I20260709 12:16:33.300469 16013 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.416280 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:33.416446 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.417595 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.418239 10047 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:33.387318 15924 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.423053 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:33.423705 10050 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:33.449561 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.455593 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 76848.2us
I20260709 12:16:33.458398 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:33.457496 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:33.462741 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.463480 10049 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:33.461229 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.468638 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.469066 10049 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:16:33.414086 16004 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:33.470000 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.477609 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2214) took 1265 ms. Trace:
I20260709 12:16:33.425055 15872 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.481022 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:33.481220 16114 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:33.482306 10202 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:33.478029 10199 rpcz_store.cc:276] 0709 12:16:32.212143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.212678 (+   535us) service_pool.cc:224] Handling call
0709 12:16:32.212974 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.576190 (+363216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.477340 (+901150us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54000ea6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.477547 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786270592}
I20260709 12:16:33.473538 16061 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:33.485018 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2217) took 1265 ms. Trace:
I20260709 12:16:33.487246 10203 rpcz_store.cc:276] 0709 12:16:32.219205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.479346 (+260141us) service_pool.cc:224] Handling call
0709 12:16:32.479613 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.904459 (+424846us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:16:32.904816 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:16:33.266185 (+361369us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.266713 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:16:33.266843 (+   130us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:33.266877 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.266937 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:33.484810 (+217873us) raft_consensus.cc:1685] finished
0709 12:16:33.484832 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:33.484960 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2216,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":116753,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":194,"thread_start_us":783097,"threads_started":2,"wal-append.queue_time_us":437788}
I20260709 12:16:33.484556 16111 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:33.470533 16095 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:16:33.473707 15958 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:33.480347 15891 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:33.486243 16119 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.482048 15806 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.486441 16115 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:16:33.483881 16114 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.491191 16061 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.490880 15872 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.512835 10050 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
W20260709 12:16:33.514820 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48576.6us
I20260709 12:16:33.517514 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.490316 16053 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.499055 15891 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:33.478673 16004 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.496263 15958 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.507397 16114 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:33.574940 10050 raft_consensus.cc:1275] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:16:33.576499 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 60111us
I20260709 12:16:33.577514 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:33.579088 16125 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.579675 15836 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.509462 16061 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.589171 10130 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:33.590773 10737 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:16:33.591058 10126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 2170) took 2417 ms (client timeout 2026 ms). Trace:
I20260709 12:16:33.592748 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2606) took 1414 ms. Trace:
W20260709 12:16:33.591424 10126 rpcz_store.cc:269] 0709 12:16:31.167303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.167528 (+   225us) service_pool.cc:224] Handling call
0709 12:16:33.584372 (+2416844us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400230854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:33.584481 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291087744}
I20260709 12:16:33.593133 10055 rpcz_store.cc:276] 0709 12:16:32.170110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.172146 (+  2036us) service_pool.cc:224] Handling call
0709 12:16:32.172468 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.473870 (+301402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.584460 (+1110590us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002a1054. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.584643 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691841792}
I20260709 12:16:33.569482 16053 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.601377 10202 raft_consensus.cc:2468] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
W20260709 12:16:33.604602 16057 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.317s	user 0.008s	sys 0.010s
I20260709 12:16:33.572731 15891 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:33.569269 16040 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.606222 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2579) took 1538 ms. Trace:
I20260709 12:16:33.606343 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:33.616532 10728 raft_consensus.cc:2410] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:16:33.573089 15876 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:33.613060 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:33.582126 15958 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:33.615639 10198 rpcz_store.cc:276] 0709 12:16:32.067918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.118965 (+ 51047us) service_pool.cc:224] Handling call
0709 12:16:32.119289 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.234369 (+115080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.605980 (+1371611us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003133d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.606164 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260782592}
I20260709 12:16:33.527609 16119 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.620476 15876 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.615916 16053 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.621333 16099 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.625579 15931 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.627027 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:33.627234 16004 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.628466 15872 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.634944 16117 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:33.635603 16122 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.635993 16113 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:16:33.598640 16095 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.638826 16121 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:16:33.639623 16105 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:33.526386 16087 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:33.636418 15924 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.619032 16040 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:33.726568 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.663568 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:33.716835 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 423749us
W20260709 12:16:33.788627 16108 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 12:16:33.791846 15613 consensus_meta.cc:287] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
W20260709 12:16:33.785554 16041 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 12:16:33.651496 16125 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:33.816390 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.650727 15833 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.630249 15891 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.699862 16013 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.739029 16053 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.861076 16111 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:33.840574 16119 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.842535 16129 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.894498 16129 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.895901 15703 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.896768 16129 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.898577 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2185) took 2161 ms. Trace:
I20260709 12:16:33.898958 10130 rpcz_store.cc:276] 0709 12:16:31.737112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.971388 (+234276us) service_pool.cc:224] Handling call
0709 12:16:33.584612 (+1613224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.589523 (+  4911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.898343 (+308820us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400230850. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:33.898519 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3709433728}
I20260709 12:16:33.800709 16095 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.901029 16061 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.845451 16005 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:33.904109 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2581) took 1784 ms. Trace:
I20260709 12:16:33.850608 15876 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.850955 16007 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:33.852298 15910 raft_consensus.cc:3055] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:16:33.853382 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:33.856299 15844 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:33.856846 10196 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:33.859223 16040 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:33.861244 15924 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:33.638209 15650 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.171s
I20260709 12:16:33.791827 16105 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:33.891065 16118 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 12:16:33.893553 15891 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:33.906205 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:33.921888 10702 leader_election.cc:336] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.791s (SENT)
I20260709 12:16:33.914152 16045 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:33.803730 16087 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:33.913546 10701 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:33.914263 15844 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:33.912528 15910 raft_consensus.cc:740] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:33.737586 16042 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.922273 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:33.904500 10197 rpcz_store.cc:276] 0709 12:16:32.120075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.127434 (+  7359us) service_pool.cc:224] Handling call
0709 12:16:32.127757 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.435980 (+308223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:33.903844 (+1467864us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54000636d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:33.904049 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705684864}
I20260709 12:16:33.910054 16053 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.918519 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 115167us
I20260709 12:16:33.901654 16095 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:33.838867 15613 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:33.932689 16047 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.804045 16122 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.915944 15806 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:33.914637 15996 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.664494 16099 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:33.933368 16044 raft_consensus.cc:2804] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:16:33.920083 15650 consensus_queue.cc:1243] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:16:33.938669 16092 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.922484 16105 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:34.119283 16026 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.120500 10054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 893) took 2700 ms (client timeout 1791 ms). Trace:
I20260709 12:16:33.939603 16061 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:34.013350 15918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.022s	sys 0.035s
W20260709 12:16:34.121124 10054 rpcz_store.cc:269] 0709 12:16:31.406127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:31.406235 (+   108us) service_pool.cc:224] Handling call
0709 12:16:34.106714 (+2700479us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54002f85d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:34.106897 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690734976}
I20260709 12:16:33.975760 16006 raft_consensus.cc:993] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
W20260709 12:16:34.102473 16010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.014s	sys 0.023s
I20260709 12:16:33.937971 16115 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:34.103173 15806 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:34.140843 15918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.026s	sys 0.039s
I20260709 12:16:34.119261 16044 raft_consensus.cc:697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:33.933568 16045 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.148743 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:34.144074 16010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.015s	sys 0.023s
I20260709 12:16:33.938105 16053 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.014312 15958 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.150378 10054 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:34.152452 16099 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.154688 16064 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:34.121534 16026 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.180212 16026 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:34.155704 16044 consensus_queue.cc:237] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.182291 15958 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.158485 15998 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:34.159211 16042 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.159755 15613 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.187984 15874 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:34.188424 15874 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:34.189242 15874 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.174283 16040 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:34.190932 16040 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.193090 16040 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:34.161278 16114 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.546s	user 0.000s	sys 0.007s
I20260709 12:16:34.143476 16041 raft_consensus.cc:1081] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:16:34.099563 16092 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.167692 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2582) took 2039 ms. Trace:
I20260709 12:16:34.066540 15910 consensus_queue.cc:260] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.196324 10195 rpcz_store.cc:276] 0709 12:16:32.128263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.164284 (+ 36021us) service_pool.cc:224] Handling call
0709 12:16:33.246678 (+1082394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.252957 (+  6279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.167482 (+914525us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002215d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:34.167634 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472852864}
I20260709 12:16:34.175599 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1046) took 2154 ms. Trace:
I20260709 12:16:34.065974 15844 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:34.146214 16047 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.177141 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:34.134577 15996 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.224472 10737 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:34.190347 15874 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:34.184828 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:34.201792 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.203935 10729 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
W20260709 12:16:34.255481 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70757.6us
I20260709 12:16:34.199195 10736 rpcz_store.cc:276] 0709 12:16:32.018807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.018923 (+   116us) service_pool.cc:224] Handling call
0709 12:16:32.019281 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:32.197066 (+177785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.172891 (+1975825us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400159ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:34.173100 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327378304}
W20260709 12:16:34.184141 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.006s
W20260709 12:16:34.256731 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.007s	sys 0.006s
W20260709 12:16:34.257057 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 642578us
W20260709 12:16:34.253113 10204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.005s	sys 0.020s
I20260709 12:16:34.102257 16087 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.257637 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:34.258466 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.286707 10203 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:34.285619 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.257951 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:34.290967 10204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.005s	sys 0.021s
I20260709 12:16:34.224342 15650 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.293326 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:34.298642 10728 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:34.249933 15278 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:34.318778 10733 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:16:34.318703 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:34.254733 15910 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:34.283088 15871 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:34.324676 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.330842 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.331532 10126 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:34.332978 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.334456 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.284121 16092 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.318161 15891 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.293412 15844 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:34.293319 16070 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:34.348058 10203 raft_consensus.cc:2468] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:34.349268 16070 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.349712 16070 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:34.351564 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:34.290709 15997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.002s	sys 0.022s
I20260709 12:16:34.195910 16114 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.342741 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.381255 10122 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:34.167764 16115 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.352301 10195 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13.
I20260709 12:16:34.355270 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.385052 10121 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:34.356091 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.356448 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2595) took 1097 ms. Trace:
I20260709 12:16:34.356652 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.353049 10701 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:34.309919 15650 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.385941 10196 rpcz_store.cc:276] 0709 12:16:33.259258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.283660 (+ 24402us) service_pool.cc:224] Handling call
0709 12:16:33.283988 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.913593 (+629605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.356200 (+442607us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:34.356384 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316623616}
I20260709 12:16:34.360948 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.419127 10203 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:16:34.357118 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1083) took 1108 ms. Trace:
I20260709 12:16:34.386246 10129 raft_consensus.cc:2410] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:16:34.360275 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.420387 10127 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:34.425407 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.425969 10128 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:34.422652 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:34.427206 10054 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:34.420763 10200 rpcz_store.cc:276] 0709 12:16:33.248601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.248902 (+   301us) service_pool.cc:224] Handling call
0709 12:16:33.249166 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.267098 (+ 17932us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:16:33.288932 (+ 21834us) log.cc:844] Serialized 14 byte log entry
0709 12:16:33.371658 (+ 82726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:33.371717 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:33.371769 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.356901 (+985132us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5400221ad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:34.356948 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.357063 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23774,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":391,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":40796032,"thread_start_us":82326,"threads_started":1,"wal-append.queue_time_us":133870}
I20260709 12:16:34.422230 10733 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:34.431754 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.348739 16045 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:34.374214 15997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.003s	sys 0.023s
I20260709 12:16:34.373047 15867 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.435809 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.380555 16041 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:34.436453 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:34.438338 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:34.442034 16114 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.415771 15999 raft_consensus.cc:2804] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:34.382354 16005 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.418656 15766 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:34.443790 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:34.421751 15869 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.448014 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.444053 10130 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:34.439039 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.449999 10728 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:34.442835 16098 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:16:34.415848 15996 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.351009 15871 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.449620 10129 raft_consensus.cc:2410] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:16:34.457492 10735 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:34.350937 15891 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.435577 15958 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.332358 15806 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.459847 10121 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:34.416374 16039 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:16:34.461388 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.438776 16040 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.471828 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:34.471379 10052 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.029s	sys 0.020s
W20260709 12:16:34.483304 10052 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.029s	sys 0.021s
I20260709 12:16:34.483587 10728 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:34.433926 15993 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:16:34.481107 10736 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:34.415483 16131 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:16:34.488428 10122 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:16:34.489537 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:34.485425 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.496345 10126 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:34.453426 16047 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.453562 15999 raft_consensus.cc:697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:34.443372 15867 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.458525 16122 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.502722 10128 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:34.503925 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.506528 10125 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:34.447029 16041 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.453109 16005 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.491854 15939 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.513618 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.011s	sys 0.021s
I20260709 12:16:34.497783 15806 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:34.514523 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.011s	sys 0.022s
I20260709 12:16:34.514784 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.458225 15869 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:34.531194 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:34.532156 15869 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:34.502123 16053 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.481598 15958 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:34.515232 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 1.05856e+06us
I20260709 12:16:34.517100 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.542446 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:34.502548 15836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.011s	sys 0.011s
I20260709 12:16:34.535481 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:34.538736 10734 pending_rounds.cc:85] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 12
I20260709 12:16:34.544128 10734 pending_rounds.cc:107] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:16:34.544425 10734 raft_consensus.cc:2889] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:34.543175 10128 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:34.492404 16040 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.548789 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:34.541888 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:34.551673 10046 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:34.513842 16045 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:34.554304 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.003s
W20260709 12:16:34.554720 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.003s
I20260709 12:16:34.556404 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:34.546286 15836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.012s	sys 0.012s
I20260709 12:16:34.560978 10195 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:34.538233 15923 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.547498 16053 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.565399 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.538046 16064 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.557910 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:34.562505 10200 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:34.553433 15907 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.556152 16122 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:34.558920 16016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.010s	sys 0.014s
I20260709 12:16:34.575196 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.556610 15993 consensus_queue.cc:1243] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:16:34.534974 15939 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.556113 15650 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:34.573879 10053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.005s	sys 0.025s
W20260709 12:16:34.619830 10053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.006s	sys 0.026s
I20260709 12:16:34.581701 10195 raft_consensus.cc:2393] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:34.556502 16116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.000s	sys 0.042s
W20260709 12:16:34.588265 16016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.011s	sys 0.015s
I20260709 12:16:34.579759 15907 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.597246 16115 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:34.597746 15836 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:16:34.598834 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.600010 16005 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.601325 15958 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.603042 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.564860 16098 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:34.694716 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.604326 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:34.579241 10198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.014s	sys 0.008s
W20260709 12:16:34.697350 10198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.014s	sys 0.008s
W20260709 12:16:34.606386 10051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.013s	sys 0.051s
I20260709 12:16:34.697885 10054 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
W20260709 12:16:34.698146 10051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.013s	sys 0.052s
I20260709 12:16:34.698916 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2607) took 1278 ms. Trace:
I20260709 12:16:34.699241 10051 rpcz_store.cc:276] 0709 12:16:33.421026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.421174 (+   148us) service_pool.cc:224] Handling call
0709 12:16:33.421470 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.421676 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:16:33.716162 (+294486us) log.cc:844] Serialized 14 byte log entry
0709 12:16:34.698571 (+982409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:34.698622 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:34.698681 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.698749 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.698865 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1078764,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1232365,"threads_started":2}
W20260709 12:16:34.606637 10048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.004s	sys 0.017s
W20260709 12:16:34.700700 10048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.004s	sys 0.018s
W20260709 12:16:34.588824 10201 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.000s	sys 0.023s
W20260709 12:16:34.701504 10201 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.000s	sys 0.023s
W20260709 12:16:34.607091 10021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.010s	sys 0.018s
W20260709 12:16:34.702265 10021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.011s	sys 0.018s
W20260709 12:16:34.607457 10050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.002s	sys 0.019s
W20260709 12:16:34.703962 10050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.002s	sys 0.019s
I20260709 12:16:34.581207 16122 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.716720 16122 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:34.718614 16135 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:16:34.613396 10128 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:34.613906 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:34.612462 10199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.021s	sys 0.050s
W20260709 12:16:34.720909 10199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.021s	sys 0.050s
I20260709 12:16:34.599900 15871 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.561949 16045 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.601264 15867 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.623836 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.565802 15923 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.624441 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2605) took 2450 ms. Trace:
I20260709 12:16:34.576118 16064 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.575845 16053 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:34.768344 16053 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:34.637429 10200 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:34.627544 16116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.000s	sys 0.043s
I20260709 12:16:34.578063 15999 consensus_queue.cc:237] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.684758 16070 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:34.688210 16041 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:34.692361 10126 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:34.693981 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:34.711127 10055 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
W20260709 12:16:34.822618 10202 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.023s	sys 0.021s
I20260709 12:16:34.724138 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:34.724557 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120316us
I20260709 12:16:34.652021 15836 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.763649 10127 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:34.623914 16105 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:34.775869 10049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.290s	user 0.011s	sys 0.041s
I20260709 12:16:34.808079 15923 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.810544 16045 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:34.769754 16115 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:34.812301 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.814590 16098 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:34.818575 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:34.822861 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:34.714838 16133 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:16:34.967801 10095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.017s	sys 0.140s
W20260709 12:16:34.972591 10095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.018s	sys 0.141s
W20260709 12:16:34.876889 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:34.972302 10202 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.028s	sys 0.036s
I20260709 12:16:34.975980 10203 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 11.
I20260709 12:16:34.763360 10053 rpcz_store.cc:276] 0709 12:16:32.169746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.170546 (+   800us) service_pool.cc:224] Handling call
0709 12:16:32.170859 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:32.171065 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:32.337623 (+166558us) log.cc:844] Serialized 14 byte log entry
0709 12:16:33.583243 (+1245620us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b18004e0d60. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17e3384bc 00007fc17b68648b 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e33023a
0709 12:16:34.620189 (+1036946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:34.620248 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:34.620289 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.620353 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.620470 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202477,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":154386,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":16001792,"thread_start_us":1239351,"threads_started":3,"wal-append.queue_time_us":52190,"wal-append.run_cpu_time_us":1432,"wal-append.run_wall_time_us":1004710}
W20260709 12:16:34.973210 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 1.51477e+06us
I20260709 12:16:34.979100 10095 leader_election.cc:400] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
I20260709 12:16:34.979419 10095 leader_election.cc:403] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:16:34.979717 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1085) took 1520 ms. Trace:
I20260709 12:16:34.980214 10204 rpcz_store.cc:276] 0709 12:16:33.458913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.459459 (+   546us) service_pool.cc:224] Handling call
0709 12:16:33.459793 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.476167 (+ 16374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:33.476198 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.485079 (+  8881us) log.cc:844] Serialized 26 byte log entry
0709 12:16:34.291389 (+806310us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:34.291433 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.291503 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:34.979438 (+687935us) raft_consensus.cc:1685] finished
0709 12:16:34.979460 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.979645 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5663,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3586,"thread_start_us":783690,"threads_started":1,"wal-append.queue_time_us":1110061}
W20260709 12:16:34.981633 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 1.05968e+06us
W20260709 12:16:34.960753 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:34.986343 10049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.013s	sys 0.043s
I20260709 12:16:34.958148 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:34.987466 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2613) took 1504 ms. Trace:
I20260709 12:16:34.995100 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2842) took 1072 ms. Trace:
I20260709 12:16:34.996367 10054 rpcz_store.cc:276] 0709 12:16:33.922650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.758506 (+835856us) service_pool.cc:224] Handling call
0709 12:16:34.995033 (+236527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:34.994867 10050 rpcz_store.cc:276] 0709 12:16:33.482852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.587772 (+104920us) service_pool.cc:224] Handling call
0709 12:16:33.610306 (+ 22534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.641409 (+ 31103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:33.641443 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.648745 (+  7302us) log.cc:844] Serialized 26 byte log entry
0709 12:16:34.987078 (+1338333us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:34.987127 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:34.987202 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:34.987259 (+    57us) raft_consensus.cc:1685] finished
0709 12:16:34.987270 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:34.987403 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23541,"raft.queue_time_us":120366,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":984521,"threads_started":1,"wal-append.queue_time_us":960955}
I20260709 12:16:34.995507 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:34.975505 10195 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 13.
I20260709 12:16:35.013242 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:35.013908 10735 raft_consensus.cc:606] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:35.014287 10735 raft_consensus.cc:614] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:35.014498 16070 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.015821 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.019490 10094 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:35.021615 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:35.022821 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.025604 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:34.875015 16005 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.831054 16053 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:34.977226 16115 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.001495 15836 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:35.047883 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.027154 10195 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:34.874769 16026 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:35.044667 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.070271 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.071091 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.070395 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48115.9us
W20260709 12:16:35.089643 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.090194 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.071475 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 52081.2us
I20260709 12:16:35.067179 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.090399 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:35.079533 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.015832 16041 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:35.020753 16042 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.092978 10203 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:35.094004 10053 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:16:34.974267 16081 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.028769 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.091183 10050 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:35.096549 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.080480 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:35.098093 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.098928 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 906) took 1161 ms. Trace:
I20260709 12:16:35.099352 10053 rpcz_store.cc:276] 0709 12:16:33.937295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.006976 (+1069681us) service_pool.cc:224] Handling call
0709 12:16:35.098860 (+ 91884us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:35.074991 10702 connection.cc:256] RPC call timeout handler was delayed by -1.5757038909998755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 12:16:35.100361 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.101836 10702 connection.cc:256] RPC call timeout handler was delayed by -1.4078968200001327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 12:16:35.102754 10702 connection.cc:256] RPC call timeout handler was delayed by -1.0730968200000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:16:35.103222 10702 connection.cc:256] RPC call timeout handler was delayed by -1.05689682000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:16:35.103546 10702 connection.cc:256] RPC call timeout handler was delayed by -1.0360020460000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 12:16:35.129441 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:35.066754 15844 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:35.070621 15867 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.085391 16115 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:35.200799 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:35.201761 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:35.079125 16045 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.202776 16045 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.024437 16010 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:16:35.146648 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 907) took 1173 ms. Trace:
I20260709 12:16:35.204923 15867 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.205328 10051 rpcz_store.cc:276] 0709 12:16:33.973161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.028516 (+1055355us) service_pool.cc:224] Handling call
0709 12:16:35.146576 (+118060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.206329 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.207217 15867 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.207479 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.208101 10051 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:35.154898 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.204809 10735 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:16:35.209188 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.210196 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:35.211205 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.028586 15997 consensus_queue.cc:1059] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 12:16:35.084759 16005 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.164849 16105 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.125102 16042 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.095824 16026 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.089936 16099 consensus_queue.cc:1048] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:16:35.167284 15939 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.167768 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.232285 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2840) took 1312 ms. Trace:
I20260709 12:16:35.232621 10053 rpcz_store.cc:276] 0709 12:16:33.920092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.127309 (+1207217us) service_pool.cc:224] Handling call
0709 12:16:35.232227 (+104918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.148389 16064 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.168715 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:35.171757 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:35.219301 16144 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.006s
I20260709 12:16:35.176723 16040 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.180963 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.021448 15923 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:16:35.189646 15907 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.108249 16081 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.191654 15891 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.104292 16039 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 12:16:35.125515 16041 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:35.130645 16138 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 12:16:35.130920 15766 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:16:35.079013 15993 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 12:16:35.155598 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:35.092579 16053 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.213088 10054 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:35.220219 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 90816.9us
I20260709 12:16:35.021064 16073 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:35.089308 15874 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:35.224691 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:35.225412 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.226095 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.234830 10195 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:35.230823 16071 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:16:35.226341 15998 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:35.100903 16058 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:35.238396 10200 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:35.226614 16066 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:35.191365 10050 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:35.229398 16109 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:35.233522 16050 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:35.245707 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.233656 16096 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.235536 16105 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:35.243342 16045 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:35.250600 10731 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.050s	sys 0.058s
W20260709 12:16:35.285789 10731 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.380s	user 0.050s	sys 0.058s
I20260709 12:16:35.251552 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.220288 16122 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.252665 10735 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:35.258952 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.250237 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:35.273860 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2844) took 1087 ms. Trace:
I20260709 12:16:35.275362 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:35.275674 10047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.364s	user 0.012s	sys 0.075s
I20260709 12:16:35.249385 15766 consensus_queue.cc:1243] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:16:35.276351 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.292928 10051 raft_consensus.cc:2410] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:16:35.293830 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.288740 10050 rpcz_store.cc:276] 0709 12:16:34.186199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.016658 (+830459us) service_pool.cc:224] Handling call
0709 12:16:35.273802 (+257144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.279201 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.250741 15874 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.282963 10054 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:35.256141 16071 consensus_queue.cc:1243] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:16:35.286789 10196 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:35.277830 16018 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:35.291934 10047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.012s	sys 0.075s
I20260709 12:16:35.327663 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.329119 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2615) took 1841 ms. Trace:
I20260709 12:16:35.330385 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.330708 10051 rpcz_store.cc:276] 0709 12:16:33.488016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.328312 (+1840296us) service_pool.cc:224] Handling call
0709 12:16:35.328628 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.328813 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.328839 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.328883 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:35.328913 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.328963 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.329062 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.330463 10050 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 12:16:35.332059 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2614) took 1847 ms. Trace:
I20260709 12:16:35.332186 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.330317 10126 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:35.332396 10050 rpcz_store.cc:276] 0709 12:16:33.484316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.326291 (+1841975us) service_pool.cc:224] Handling call
0709 12:16:35.326653 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.331798 (+  5145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.332003 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.333622 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.302066 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.335635 10200 raft_consensus.cc:2410] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:16:35.297009 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.336710 10203 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:35.324811 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74655.4us
I20260709 12:16:35.276264 16109 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.287834 16050 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:35.345687 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.340840 10702 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:35.284965 16105 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:35.353381 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.277680 16066 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.358055 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.339303 15874 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:35.329957 16045 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:35.371037 10196 raft_consensus.cc:1240] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
W20260709 12:16:35.342566 10052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.046s	sys 0.041s
W20260709 12:16:35.372126 10052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.046s	sys 0.041s
I20260709 12:16:35.360555 16105 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.343087 16109 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:35.361068 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:35.364308 16115 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.368386 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.360451 10735 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:16:35.375797 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.287453 16096 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.358816 15806 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:35.382558 10196 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:35.382761 10735 pending_rounds.cc:85] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 11
I20260709 12:16:35.388401 10735 pending_rounds.cc:107] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:16:35.388626 10735 raft_consensus.cc:2889] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:35.387305 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:35.382826 10050 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:35.380131 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2837) took 1920 ms. Trace:
I20260709 12:16:35.392102 10052 rpcz_store.cc:276] 0709 12:16:33.459808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.461809 (+  2001us) service_pool.cc:224] Handling call
0709 12:16:33.462093 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.462285 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:34.483661 (+1021376us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.378287 (+894626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.379315 (+  1028us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:35.379375 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.379941 (+   566us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.380071 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4154,"prepare.queue_time_us":1081801,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":429,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":1910744,"threads_started":2}
I20260709 12:16:35.400430 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.407656 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.408370 10735 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:35.409219 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.412667 10729 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:35.413765 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:35.410331 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.417717 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.379505 16137 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:35.385551 16148 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:16:35.420411 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:35.424190 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:35.421455 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.425171 10735 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:35.422168 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.426128 10050 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:35.427722 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.428764 10732 raft_consensus.cc:2393] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 11: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:35.380303 16042 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.381744 16045 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:35.398880 15891 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:35.437322 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.418330 16105 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:35.449065 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.453150 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2223) took 1036 ms. Trace:
I20260709 12:16:35.453576 10196 rpcz_store.cc:276] 0709 12:16:34.416949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.431607 (+1014658us) service_pool.cc:224] Handling call
0709 12:16:35.452630 (+ 21023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.452829 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.452856 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.452900 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:35.452931 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.452981 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.453092 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.423843 16005 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.425521 15806 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:35.386699 15836 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.460383 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:35.430974 15923 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:35.469218 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:35.476919 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.466918 10020 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.040s	sys 0.029s
W20260709 12:16:35.480551 10020 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.040s	sys 0.030s
W20260709 12:16:35.480931 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 918033us
W20260709 12:16:35.481405 10020 connection.cc:256] RPC call timeout handler was delayed by -1.0855098800000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:16:35.431628 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:35.527784 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76855.8us
W20260709 12:16:35.529042 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.528708 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:35.530997 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.533950 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:35.532348 10196 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:35.538887 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2224) took 1121 ms. Trace:
I20260709 12:16:35.539461 10196 rpcz_store.cc:276] 0709 12:16:34.417195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.454635 (+1037440us) service_pool.cc:224] Handling call
0709 12:16:35.532020 (+ 77385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.538640 (+  6620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.538836 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.451661 16026 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:35.542651 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.426573 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.553685 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.430306 16137 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.557010 10129 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12.
I20260709 12:16:35.452443 15997 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:16:35.564939 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.567723 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:35.404713 10702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.539s (SENT) [suppressed 7 similar messages]
I20260709 12:16:35.448626 15891 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.664743 10053 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:35.582744 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.659801 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:35.660861 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 93214us
I20260709 12:16:35.661531 10196 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:35.662460 10737 raft_consensus.cc:1275] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:35.667164 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:35.668080 10126 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:35.671833 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:35.668855 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:35.562299 16139 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:35.673631 15991 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:35.669040 16098 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:35.562930 16053 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.674983 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:35.667191 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2227) took 1249 ms. Trace:
I20260709 12:16:35.680527 10196 rpcz_store.cc:276] 0709 12:16:34.417914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.553373 (+1135459us) service_pool.cc:224] Handling call
0709 12:16:35.661180 (+107807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.666898 (+  5718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.667129 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.657582 16030 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:35.543812 15923 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.674069 16096 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.447546 16050 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.682641 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.689414 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:35.679914 16026 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:35.686463 10050 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:35.686353 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.697010 16026 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.697427 15992 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:35.697793 15992 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:35.697986 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.677047 16139 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.568565 16141 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:35.698969 16026 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.699131 16141 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.701197 16141 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.696218 10730 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:35.698606 10126 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:35.703696 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.698587 15992 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.708698 10053 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:35.712464 10196 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:16:35.713537 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2228) took 1295 ms. Trace:
I20260709 12:16:35.713722 10052 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:16:35.688944 15991 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:35.683820 16030 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:35.714395 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2616) took 2216 ms. Trace:
I20260709 12:16:35.718436 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.667791 16145 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:16:35.702739 16072 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.706959 16139 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:35.713995 10196 rpcz_store.cc:276] 0709 12:16:34.418157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.684776 (+1266619us) service_pool.cc:224] Handling call
0709 12:16:35.711922 (+ 27146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.713262 (+  1340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.713478 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.720304 10128 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16.
I20260709 12:16:35.715649 10126 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:16:35.728999 10126 pending_rounds.cc:85] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 11
I20260709 12:16:35.729382 10126 pending_rounds.cc:107] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:16:35.729682 10126 raft_consensus.cc:2889] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:35.714852 16066 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.719779 10052 rpcz_store.cc:276] 0709 12:16:33.498199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.713118 (+2214919us) service_pool.cc:224] Handling call
0709 12:16:35.713423 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.714162 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.714344 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.715389 16115 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.738664 10052 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:16:35.718817 10734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.009s	sys 0.017s
W20260709 12:16:35.740036 10734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.010s	sys 0.017s
I20260709 12:16:35.743785 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2617) took 2230 ms. Trace:
I20260709 12:16:35.744541 10052 rpcz_store.cc:276] 0709 12:16:33.509037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.735515 (+2226478us) service_pool.cc:224] Handling call
0709 12:16:35.735845 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.739081 (+  3236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.739301 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.750502 10130 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:35.751778 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2608) took 2325 ms. Trace:
I20260709 12:16:35.752182 10047 rpcz_store.cc:276] 0709 12:16:33.426896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.427106 (+   210us) service_pool.cc:224] Handling call
0709 12:16:33.466129 (+ 39023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.640775 (+174646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:33.640801 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.800411 (+159610us) log.cc:844] Serialized 26 byte log entry
0709 12:16:35.334414 (+1534003us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:35.334476 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.334541 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:35.751575 (+417034us) raft_consensus.cc:1685] finished
0709 12:16:35.751596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.751720 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":215679,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":22802,"thread_start_us":1597590,"threads_started":2,"wal-append.queue_time_us":1912603}
I20260709 12:16:35.758598 15998 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:35.759483 10130 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:35.761013 10130 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:16:35.762100 10130 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:35.759200 15998 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.754354 10047 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:35.690292 15806 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.763707 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2619) took 2189 ms. Trace:
I20260709 12:16:35.766124 10047 rpcz_store.cc:276] 0709 12:16:33.574345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.753670 (+2179325us) service_pool.cc:224] Handling call
0709 12:16:35.753999 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.763464 (+  9465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.763659 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.764317 10052 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:16:35.767678 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2618) took 2221 ms. Trace:
I20260709 12:16:35.768097 10052 rpcz_store.cc:276] 0709 12:16:33.546036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.745288 (+2199252us) service_pool.cc:224] Handling call
0709 12:16:35.745627 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.767398 (+ 21771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.767620 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.683108 16045 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:35.790161 10201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.009s	sys 0.039s
W20260709 12:16:35.790723 10201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.010s	sys 0.039s
I20260709 12:16:35.793217 10128 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:16:35.795112 10130 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:16:35.792399 15836 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:35.797560 10130 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:35.797878 10047 raft_consensus.cc:1240] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:35.798566 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 900) took 1862 ms. Trace:
I20260709 12:16:35.798863 10047 rpcz_store.cc:276] 0709 12:16:33.935861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.792387 (+1856526us) service_pool.cc:224] Handling call
0709 12:16:35.797702 (+  5315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.798306 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.798511 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.800136 10047 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 12:16:35.800724 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 901) took 1864 ms. Trace:
I20260709 12:16:35.801010 10047 rpcz_store.cc:276] 0709 12:16:33.936144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.799583 (+1863439us) service_pool.cc:224] Handling call
0709 12:16:35.799921 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.800492 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.800672 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.802153 10047 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:35.818413 16030 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.819777 16030 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:35.822976 15891 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.827199 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 902) took 1890 ms. Trace:
I20260709 12:16:35.827762 10047 rpcz_store.cc:276] 0709 12:16:33.936400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.801697 (+1865297us) service_pool.cc:224] Handling call
0709 12:16:35.801992 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.826889 (+ 24897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.827123 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.829270 10047 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:35.832067 16066 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.733058 16072 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:35.837502 10121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.018s	sys 0.010s
W20260709 12:16:35.837847 10121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.018s	sys 0.010s
W20260709 12:16:35.835505 10198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.022s	sys 0.029s
W20260709 12:16:35.840360 10198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.023s	sys 0.030s
I20260709 12:16:35.834035 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 903) took 1897 ms. Trace:
I20260709 12:16:35.841675 10047 rpcz_store.cc:276] 0709 12:16:33.936624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.828739 (+1892115us) service_pool.cc:224] Handling call
0709 12:16:35.829084 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.829707 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.833967 (+  4260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.869405 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2601) took 2230 ms. Trace:
W20260709 12:16:35.870569 10199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.032s	sys 0.059s
W20260709 12:16:35.871012 10199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.033s	sys 0.060s
I20260709 12:16:35.878911 10128 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:16:35.834847 16066 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.880611 10128 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:16:35.887060 10049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.017s	sys 0.017s
W20260709 12:16:35.887560 10049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.017s	sys 0.017s
I20260709 12:16:35.888500 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2611) took 2415 ms. Trace:
I20260709 12:16:35.899893 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2610) took 1477 ms. Trace:
I20260709 12:16:35.900391 10200 rpcz_store.cc:276] 0709 12:16:34.422067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.899041 (+1476974us) service_pool.cc:224] Handling call
0709 12:16:35.899402 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.899578 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.899602 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.899641 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:35.899668 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.899722 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.899836 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.901947 10200 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:16:35.904757 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53880 (request call id 905) took 1967 ms. Trace:
I20260709 12:16:35.905189 10054 rpcz_store.cc:276] 0709 12:16:33.937060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.070572 (+1133512us) service_pool.cc:224] Handling call
0709 12:16:35.904566 (+833994us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003f8ed4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:35.904689 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265876736}
W20260709 12:16:35.908715 10129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 1018) took 1217 ms (client timeout 1539 ms). Trace:
W20260709 12:16:35.909153 10129 rpcz_store.cc:269] 0709 12:16:34.691397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.695660 (+  4263us) service_pool.cc:224] Handling call
0709 12:16:35.908517 (+1212857us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b5400242f54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:35.908653 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258833152}
I20260709 12:16:35.911161 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.912005 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 1023) took 1219 ms. Trace:
I20260709 12:16:35.912338 10124 rpcz_store.cc:276] 0709 12:16:34.692944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.694501 (+  1557us) service_pool.cc:224] Handling call
0709 12:16:35.910997 (+1216496us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b58000f4b98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:16:35.911947 (+   950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24464640}
I20260709 12:16:35.921801 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1052) took 3870 ms. Trace:
I20260709 12:16:35.918206 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2621) took 2301 ms. Trace:
I20260709 12:16:35.924515 10169 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:35.924865 10054 raft_consensus.cc:3055] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:35.925220 10054 raft_consensus.cc:740] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:35.922228 10730 rpcz_store.cc:276] 0709 12:16:32.051770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:32.061027 (+  9257us) service_pool.cc:224] Handling call
0709 12:16:32.135818 (+ 74791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.702567 (+3566749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.921508 (+218941us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54005505d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:35.921736 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8187521792}
I20260709 12:16:35.925889 10054 consensus_queue.cc:260] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.926855 10054 raft_consensus.cc:3060] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:35.879385 15958 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:35.929886 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2611) took 1496 ms. Trace:
I20260709 12:16:35.930948 10200 rpcz_store.cc:276] 0709 12:16:34.433648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.901359 (+1467711us) service_pool.cc:224] Handling call
0709 12:16:35.901716 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.902309 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.929829 (+ 27520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.924589 10055 rpcz_store.cc:276] 0709 12:16:33.616589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.626724 (+ 10135us) service_pool.cc:224] Handling call
0709 12:16:35.917999 (+2291275us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400321254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:35.918127 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114317184}
I20260709 12:16:35.932430 10055 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:16:35.933019 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2843) took 1770 ms. Trace:
I20260709 12:16:35.933327 10055 rpcz_store.cc:276] 0709 12:16:34.162511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.931877 (+1769366us) service_pool.cc:224] Handling call
0709 12:16:35.932207 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.932737 (+   530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.932969 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.934574 10055 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:35.935055 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 913) took 1758 ms. Trace:
I20260709 12:16:35.935340 10055 rpcz_store.cc:276] 0709 12:16:34.176916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.933969 (+1757053us) service_pool.cc:224] Handling call
0709 12:16:35.934246 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.934855 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.935008 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.938450 10200 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
W20260709 12:16:35.944782 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:35.887161 16026 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:35.888398 16098 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:35.923110 15923 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:35.928571 15891 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.939352 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2230) took 1489 ms. Trace:
W20260709 12:16:35.928885 15999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.014s	sys 0.023s
W20260709 12:16:35.870412 16044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.007s	sys 0.027s
I20260709 12:16:35.939316 16053 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:35.879065 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2597) took 2291 ms. Trace:
I20260709 12:16:35.948563 10055 raft_consensus.cc:1240] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:16:35.956523 10200 rpcz_store.cc:276] 0709 12:16:34.450048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.937990 (+1487942us) service_pool.cc:224] Handling call
0709 12:16:35.938271 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.939081 (+   810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.939297 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:35.957579 10202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.029s	sys 0.051s
I20260709 12:16:35.936363 16063 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:35.959479 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.019s	sys 0.011s
W20260709 12:16:35.962929 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.019s	sys 0.011s
I20260709 12:16:35.962946 10200 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:35.945343 16041 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:35.958946 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.003s	sys 0.022s
W20260709 12:16:35.963792 10202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.030s	sys 0.051s
W20260709 12:16:35.964140 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.003s	sys 0.023s
W20260709 12:16:35.964231 10096 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.014s	sys 0.024s
W20260709 12:16:35.964534 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 873644us
I20260709 12:16:35.965013 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2232) took 1452 ms. Trace:
I20260709 12:16:35.965597 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:35.965389 10200 rpcz_store.cc:276] 0709 12:16:34.512771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.962503 (+1449732us) service_pool.cc:224] Handling call
0709 12:16:35.962790 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.964720 (+  1930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.964961 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.960716 10199 rpcz_store.cc:276] 0709 12:16:33.587482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.587663 (+   181us) service_pool.cc:224] Handling call
0709 12:16:33.608116 (+ 20453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.608340 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:34.721319 (+1112979us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.878712 (+1157393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.878771 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:35.878813 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.878880 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.879009 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40097,"prepare.queue_time_us":458712,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":7293,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":328,"thread_start_us":2156084,"threads_started":2}
I20260709 12:16:35.966980 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 914) took 1789 ms. Trace:
W20260709 12:16:35.957561 15999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.014s	sys 0.023s
W20260709 12:16:35.959306 16044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.008s	sys 0.027s
W20260709 12:16:35.968966 10096 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.014s	sys 0.025s
I20260709 12:16:35.968583 10055 rpcz_store.cc:276] 0709 12:16:34.177262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.935963 (+1758701us) service_pool.cc:224] Handling call
0709 12:16:35.948338 (+ 12375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.966694 (+ 18356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.966920 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.937489 15958 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.001672 10094 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13.
I20260709 12:16:36.002008 10094 leader_election.cc:403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:35.955435 16026 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:35.955435 10054 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
W20260709 12:16:35.955974 16087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.013s	sys 0.021s
W20260709 12:16:35.969444 10093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.020s	sys 0.016s
I20260709 12:16:35.990322 10200 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:16:36.038247 16087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.013s	sys 0.021s
I20260709 12:16:36.038705 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2234) took 1478 ms. Trace:
W20260709 12:16:36.039142 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:35.964015 16116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.004s	sys 0.023s
I20260709 12:16:35.988746 15836 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:36.039553 10197 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:36.003881 10733 raft_consensus.cc:1240] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:16:36.004357 16157 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:16:36.004729 15998 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.039893 16026 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.960109 15891 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:36.040162 16116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.004s	sys 0.024s
W20260709 12:16:36.038270 10093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.020s	sys 0.016s
W20260709 12:16:36.041077 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:36.041484 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.041790 15891 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.042580 15836 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.007107 10127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55236
I20260709 12:16:36.043092 15836 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:36.008009 10124 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.044718 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.045131 15836 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.045768 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.008587 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:35.988514 16053 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:36.039050 10200 rpcz_store.cc:276] 0709 12:16:34.560519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.989639 (+1429120us) service_pool.cc:224] Handling call
0709 12:16:35.989974 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.038440 (+ 48466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.038641 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:35.888928 10049 rpcz_store.cc:276] 0709 12:16:33.473086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.473230 (+   144us) service_pool.cc:224] Handling call
0709 12:16:33.473504 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.473698 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:16:34.994366 (+1520668us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.888133 (+893767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.888204 (+    71us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:35.888252 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.888316 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.888444 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1087913,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7371,"raft.queue_time_us":83,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":35611,"thread_start_us":2402183,"threads_started":2}
I20260709 12:16:36.011222 16066 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:36.054406 10019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.017s	sys 0.026s
W20260709 12:16:36.055119 10019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.017s	sys 0.026s
W20260709 12:16:36.055470 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 830531us
I20260709 12:16:36.022850 10128 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.065215 10127 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.065675 10127 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:36.025625 16109 consensus_meta.cc:287] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.000s
I20260709 12:16:35.998240 16041 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:36.022262 16105 consensus_meta.cc:287] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.570s	user 0.003s	sys 0.002s
I20260709 12:16:36.039016 16044 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:36.122630 16044 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.124982 16044 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:35.988171 16063 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:35.989084 15923 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:16:36.127406 16063 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:36.081856 16073 consensus_meta.cc:287] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.004s
I20260709 12:16:36.128839 16073 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17.
W20260709 12:16:36.130064 15874 consensus_meta.cc:287] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.002s
I20260709 12:16:36.130518 15874 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.132587 15874 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.132741 15923 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:36.133157 15874 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:36.048269 10054 pending_rounds.cc:85] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 14
I20260709 12:16:36.134658 10054 pending_rounds.cc:107] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:16:36.021514 16139 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.157755 16081 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.050312 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.047976 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2236) took 1410 ms. Trace:
W20260709 12:16:35.997704 16142 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.030s	sys 0.059s
I20260709 12:16:36.082355 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:36.161604 10731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.059s	sys 0.039s
I20260709 12:16:36.086223 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:36.162003 10731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.059s	sys 0.039s
I20260709 12:16:36.088024 10735 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:35.991804 16115 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:16:36.165050 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:36.165692 10735 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:36.089761 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:36.089960 10019 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.094017 10737 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:36.094887 10728 pending_rounds.cc:85] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 12
I20260709 12:16:36.166950 10728 pending_rounds.cc:107] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:16:36.167222 10728 raft_consensus.cc:2889] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:36.095783 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:36.051067 15650 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13.
I20260709 12:16:36.096601 15998 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:36.097702 15939 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:36.047315 16053 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.236160 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.236883 10200 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:36.238802 10129 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:36.116698 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1073) took 1610 ms. Trace:
I20260709 12:16:36.239454 10734 rpcz_store.cc:276] 0709 12:16:34.506325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.513002 (+  6677us) service_pool.cc:224] Handling call
0709 12:16:34.538508 (+ 25506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:34.552464 (+ 13956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:34.552494 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:34.555623 (+  3129us) log.cc:844] Serialized 52 byte log entry
0709 12:16:35.740501 (+1184878us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:35.740541 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.740608 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.116383 (+375775us) raft_consensus.cc:1685] finished
0709 12:16:36.116411 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.116616 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4723,"thread_start_us":1172805,"threads_started":1,"wal-append.queue_time_us":1554461}
I20260709 12:16:36.120712 15997 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:36.140568 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.244287 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:36.134974 10054 raft_consensus.cc:2889] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:36.157997 16139 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.074362 10127 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.155560 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.249874 10128 raft_consensus.cc:2468] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:36.250931 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.251708 10128 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 21: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:36.159022 10199 rpcz_store.cc:276] 0709 12:16:34.638090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.990924 (+1352834us) service_pool.cc:224] Handling call
0709 12:16:36.003474 (+ 12550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.003641 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.003664 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.003703 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:36.047755 (+ 44052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.047827 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.047928 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.161782 10124 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:36.252990 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.162621 10729 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:36.047606 15836 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.086822 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:36.169162 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1061) took 2920 ms. Trace:
I20260709 12:16:36.167848 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:36.255539 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87758.4us
I20260709 12:16:36.203845 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.210760 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.169063 15871 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:36.256788 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 912) took 2094 ms. Trace:
I20260709 12:16:36.257129 10054 rpcz_store.cc:276] 0709 12:16:34.161975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.905990 (+1744015us) service_pool.cc:224] Handling call
0709 12:16:35.906316 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.256563 (+350247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.256738 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.258158 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:36.259500 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:36.260074 10054 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:36.232120 15998 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.209861 15939 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:36.246069 16044 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:16:36.211333 16160 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:16:36.120674 15991 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:36.263778 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2243) took 1429 ms. Trace:
I20260709 12:16:35.999408 16005 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
W20260709 12:16:36.161455 16142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.030s	sys 0.059s
I20260709 12:16:36.282784 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:36.277992 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 191224us
I20260709 12:16:36.282709 10204 rpcz_store.cc:276] 0709 12:16:34.834057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.263013 (+1428956us) service_pool.cc:224] Handling call
0709 12:16:36.263307 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.263479 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.263502 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.263542 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.263571 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.263620 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.263715 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.284101 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.284207 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:36.284657 10204 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:36.285305 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2244) took 1314 ms. Trace:
I20260709 12:16:36.285637 10204 rpcz_store.cc:276] 0709 12:16:34.971181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.284223 (+1313042us) service_pool.cc:224] Handling call
0709 12:16:36.284500 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.285073 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.285252 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.277678 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.283607 10124 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:16:36.254149 10731 rpcz_store.cc:276] 0709 12:16:33.248650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.248810 (+   160us) service_pool.cc:224] Handling call
0709 12:16:33.273781 (+ 24971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.273990 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:33.299031 (+ 25041us) log.cc:844] Serialized 14 byte log entry
0709 12:16:33.905463 (+606432us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180039ece0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:16:35.286188 (+1380725us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.168826 (+882638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.168882 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.168926 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.169006 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.169112 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2412,"prepare.queue_time_us":1864299,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":615373,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":26771,"spinlock_wait_cycles":27877248,"thread_start_us":2257837,"threads_started":2}
I20260709 12:16:36.284694 10128 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:36.289357 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.290470 10126 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:36.292131 10124 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:36.294283 10124 raft_consensus.cc:3055] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:36.294852 10124 raft_consensus.cc:740] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:36.292692 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.297894 10204 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:36.299062 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1092) took 1315 ms. Trace:
I20260709 12:16:36.299371 10204 rpcz_store.cc:276] 0709 12:16:34.983724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.286338 (+1302614us) service_pool.cc:224] Handling call
0709 12:16:36.288028 (+  1690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.298820 (+ 10792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.299007 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.276923 16066 consensus_queue.cc:1059] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:16:36.276996 15871 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.290452 15766 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:16:36.209969 16115 consensus_queue.cc:1243] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:36.093319 16109 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.302255 10204 raft_consensus.cc:1275] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:16:36.303645 10736 raft_consensus.cc:2410] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:16:36.278239 16139 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:36.307199 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.022s	sys 0.021s
I20260709 12:16:36.279204 16058 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:36.307534 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.022s	sys 0.021s
I20260709 12:16:36.134960 16041 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.281418 16044 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:36.305233 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1093) took 1320 ms. Trace:
I20260709 12:16:36.296307 10124 consensus_queue.cc:260] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:36.340113 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 665156us
I20260709 12:16:36.278090 16173 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:36.340535 10203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.017s	sys 0.038s
I20260709 12:16:36.308161 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:36.091969 16116 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.211s
I20260709 12:16:36.387892 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.343608 10054 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
W20260709 12:16:36.387003 10203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.017s	sys 0.038s
W20260709 12:16:36.387295 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79213.8us
I20260709 12:16:36.370934 10049 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.301389 16145 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:16:36.387997 10204 rpcz_store.cc:276] 0709 12:16:34.984372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.301565 (+1317193us) service_pool.cc:224] Handling call
0709 12:16:36.301925 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.304718 (+  2793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.305158 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:36.360942 10702 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.021s	sys 0.040s
I20260709 12:16:36.276743 15836 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.394073 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:36.395900 10702 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.021s	sys 0.040s
I20260709 12:16:36.241916 15997 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.399195 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.313352 16170 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:36.396553 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:36.397131 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 992372us
I20260709 12:16:36.307314 15999 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 12:16:36.399092 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.389497 16044 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:36.390857 16058 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:36.405337 16114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.020s	sys 0.040s
I20260709 12:16:36.301549 16081 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:16:36.313156 16096 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 12:16:36.390561 15766 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:16:36.424252 16114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.020s	sys 0.040s
I20260709 12:16:36.424517 15766 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.424932 15766 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:36.424787 16114 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:36.391831 16173 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.312712 16047 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
W20260709 12:16:36.400056 10196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.043s
W20260709 12:16:36.431464 10196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.013s	sys 0.043s
I20260709 12:16:36.397516 16066 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:36.433099 10169 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.028s
I20260709 12:16:36.398649 16139 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:36.420255 10130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.048s
I20260709 12:16:36.341490 16039 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:16:36.407382 16170 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.422377 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:36.458269 10054 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:36.428221 10050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.025s	sys 0.014s
I20260709 12:16:36.412036 10204 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:36.399950 16105 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:16:36.408803 15923 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:16:36.418951 16058 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:36.415766 16167 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:36.435408 10169 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.012s	sys 0.029s
W20260709 12:16:36.493916 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 564592us
W20260709 12:16:36.447721 10130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.048s
I20260709 12:16:36.460791 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:36.459404 10050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.026s	sys 0.014s
I20260709 12:16:36.495404 10204 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:36.479885 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2609) took 3020 ms. Trace:
I20260709 12:16:36.419317 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.391649 15939 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.481340 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2718) took 1864 ms. Trace:
W20260709 12:16:36.456373 16126 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.019s	sys 0.032s
I20260709 12:16:36.490885 10054 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
W20260709 12:16:36.435250 16050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.025s	sys 0.040s
I20260709 12:16:36.416930 15991 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:16:36.440619 16096 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:36.413466 16169 consensus_queue.cc:1059] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 12:16:36.498643 10169 connection.cc:256] RPC call timeout handler was delayed by -1.2140174090000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 12:16:36.502261 10054 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:36.499270 10121 rpcz_store.cc:276] 0709 12:16:34.619007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.619126 (+   119us) service_pool.cc:224] Handling call
0709 12:16:34.619466 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:34.622857 (+  3391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:34.622888 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:34.625344 (+  2456us) log.cc:844] Serialized 52 byte log entry
0709 12:16:35.838193 (+1212849us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:35.881793 (+ 43600us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.882006 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.882078 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.481060 (+598982us) raft_consensus.cc:1685] finished
0709 12:16:36.481085 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.481271 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45774,"raft.queue_time_us":3203,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":9373,"spinlock_wait_cycles":4260608,"thread_start_us":1212461,"threads_started":1,"wal-append.queue_time_us":1491433}
I20260709 12:16:36.479821 16170 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:36.554759 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 135554us
I20260709 12:16:36.555562 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.556660 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.557292 10732 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.528728 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.552989 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2633) took 1133 ms. Trace:
I20260709 12:16:36.561226 10054 rpcz_store.cc:276] 0709 12:16:35.419782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.501768 (+1081986us) service_pool.cc:224] Handling call
0709 12:16:36.502089 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.552739 (+ 50650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.552936 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:36.552191 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0322174089999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:16:36.562589 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0223174089999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 12:16:36.563828 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.459200 16139 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.496945 10048 rpcz_store.cc:276] 0709 12:16:33.459911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.460526 (+   615us) service_pool.cc:224] Handling call
0709 12:16:33.475778 (+ 15252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.570375 (+ 94597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:33.570407 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:33.570877 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:16:34.701062 (+1130185us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:34.701105 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.453851 (+1752746us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b54002756d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:36.453899 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.453948 (+    49us) raft_consensus.cc:1685] finished
0709 12:16:36.453959 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.479806 (+ 25847us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140886,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9888,"spinlock_wait_cycles":216739200,"thread_start_us":1094733,"threads_started":1,"wal-append.queue_time_us":1037401,"wal-append.run_cpu_time_us":1783,"wal-append.run_wall_time_us":1086962}
I20260709 12:16:36.500020 15891 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:36.567767 15997 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.568830 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2606) took 2195 ms. Trace:
I20260709 12:16:36.570174 16096 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:36.571817 16172 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:16:36.572381 16163 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:16:36.502592 16126 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.019s	sys 0.033s
I20260709 12:16:36.566744 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.528678 16026 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:36.626247 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59560.8us
W20260709 12:16:36.530838 16050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.025s	sys 0.040s
I20260709 12:16:36.564110 15939 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:36.496981 16167 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.562681 16081 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:36.559911 16175 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:36.627185 10020 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16.
W20260709 12:16:36.579372 16165 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:16:36.628376 16064 raft_consensus.cc:3055] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:36.629117 16026 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.573366 15650 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:16:36.579838 16168 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:16:36.625717 16164 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:16:36.575902 16109 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.638325 10020 leader_election.cc:403] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:16:36.574133 16045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.015s
I20260709 12:16:36.624430 10203 rpcz_store.cc:276] 0709 12:16:34.373804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.346418 (+972614us) service_pool.cc:224] Handling call
0709 12:16:35.369427 (+ 23009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:35.369832 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:35.369863 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:35.376842 (+  6979us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.389873 (+1013031us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:36.389915 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.389983 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.568631 (+178648us) raft_consensus.cc:1685] finished
0709 12:16:36.568649 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.568775 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":810,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1504,"thread_start_us":957809,"threads_started":1,"wal-append.queue_time_us":1155298}
I20260709 12:16:36.643102 16063 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:36.641059 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 322891us
W20260709 12:16:36.649052 10046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2830) took 3265 ms (client timeout 2243 ms). Trace:
I20260709 12:16:36.645339 16064 raft_consensus.cc:740] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:36.634297 16041 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:36.644110 16198 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:16:36.636229 15998 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:36.662822 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.667412 10204 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
W20260709 12:16:36.686918 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:36.657117 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.043s	sys 0.057s
W20260709 12:16:36.667994 10046 rpcz_store.cc:269] 0709 12:16:33.383829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.383924 (+    95us) service_pool.cc:224] Handling call
0709 12:16:36.648870 (+3264946us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001315d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:36.648984 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683508480}
W20260709 12:16:36.687743 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.043s	sys 0.057s
W20260709 12:16:36.688099 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 696696us
I20260709 12:16:36.665227 16039 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:36.664758 16045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.015s
W20260709 12:16:36.695528 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 301506us
I20260709 12:16:36.664914 15836 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:36.699131 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.701602 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.703715 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:36.687310 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:36.680920 15650 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:36.711112 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.714349 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:36.715335 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2609) took 2294 ms. Trace:
W20260709 12:16:36.679418 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 263873us
W20260709 12:16:36.715837 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 152058us
I20260709 12:16:36.665489 16050 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:16:36.719246 10196 rpcz_store.cc:276] 0709 12:16:34.421165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.730843 (+1309678us) service_pool.cc:224] Handling call
0709 12:16:35.788022 (+ 57179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.788231 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:36.431894 (+643663us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.714986 (+283092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.715040 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:36.715086 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.715157 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.715277 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":882726,"threads_started":2}
I20260709 12:16:36.721573 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:36.667927 16175 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:16:36.722949 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.723408 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:36.724083 10203 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:36.679059 16081 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 12:16:36.727571 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.692639 16041 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:36.724236 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:36.729665 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:36.680577 16109 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:16:36.732062 10121 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.683125 16071 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:16:36.739028 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.685083 16096 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:16:36.582578 15891 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.692716 15991 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:16:36.707895 16053 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:36.759097 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.771492 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.771709 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.764088 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.716398 15998 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:36.773725 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.776079 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2600) took 3179 ms. Trace:
I20260709 12:16:36.729010 15997 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:36.804045 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81157.5us
I20260709 12:16:36.806762 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.776463 10202 rpcz_store.cc:276] 0709 12:16:33.596748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.615970 (+ 19222us) service_pool.cc:224] Handling call
0709 12:16:33.616427 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:33.645090 (+ 28663us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:34.974996 (+1329906us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.967387 (+992391us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:35.967823 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:16:35.967943 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:35.967973 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.968116 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.775876 (+807760us) raft_consensus.cc:1685] finished
0709 12:16:36.775897 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.776023 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232564,"prepare.queue_time_us":452792,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":10766,"raft.queue_time_us":27747,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":27685,"thread_start_us":2171118,"threads_started":2,"wal-append.queue_time_us":1384900}
I20260709 12:16:36.849200 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:36.849821 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.850973 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:36.851269 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.740303 16126 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.842244 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.729393 16045 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:36.744361 16195 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:36.764951 16030 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:36.862533 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:36.863260 10128 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12.
I20260709 12:16:36.678709 16063 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.852391 10702 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:36.853796 10126 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:36.859638 10203 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:36.861660 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.885063 10202 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 13.
I20260709 12:16:36.886014 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:36.867074 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:36.869593 16185 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:16:36.870306 16180 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:16:36.870846 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:36.871290 16190 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:16:36.746472 15806 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
W20260709 12:16:36.871979 16187 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:16:36.860455 15766 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.765205 16064 consensus_queue.cc:260] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:36.906857 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54517.9us
I20260709 12:16:36.774222 16173 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.748754 16041 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.879443 16139 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.880621 16167 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.881464 16050 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:36.882745 16182 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:16:36.882480 15650 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.776036 15998 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:36.888124 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:36.847010 16201 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:16:36.895126 16200 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:36.901950 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1087) took 2730 ms. Trace:
I20260709 12:16:36.955451 16200 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.903977 15874 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:36.955538 10197 rpcz_store.cc:276] 0709 12:16:34.171407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.171539 (+   132us) service_pool.cc:224] Handling call
0709 12:16:34.171855 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.039964 (+1868109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.901721 (+861757us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000e88d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:36.901894 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4294919424}
W20260709 12:16:36.908754 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.957177 10197 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:36.957790 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1096) took 1932 ms. Trace:
I20260709 12:16:36.958082 10197 rpcz_store.cc:276] 0709 12:16:35.024938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.956679 (+1931741us) service_pool.cc:224] Handling call
0709 12:16:36.957007 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.957550 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.957739 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.958747 16137 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.899447 10129 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:16:36.960098 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53720 (request call id 2627) took 1607 ms (client timeout 1554 ms). Trace:
W20260709 12:16:36.960485 10053 rpcz_store.cc:269] 0709 12:16:35.352538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.358346 (+  5808us) service_pool.cc:224] Handling call
0709 12:16:36.959948 (+1601602us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400131fd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:36.960038 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647580544}
I20260709 12:16:36.961493 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:36.962191 10053 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:36.899744 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.964165 16170 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:36.897372 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:36.966686 10196 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:36.935142 16109 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.972800 15992 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:36.973886 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2241) took 2140 ms. Trace:
W20260709 12:16:36.921559 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54566us
I20260709 12:16:36.975049 16063 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:36.975611 16063 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:36.927498 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1094) took 1922 ms. Trace:
I20260709 12:16:36.861929 16195 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:36.909121 16053 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:36.929491 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:36.896782 16181 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:16:36.935379 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:36.979072 10128 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:36.907783 16064 raft_consensus.cc:3060] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:36.898757 15891 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.929368 16050 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:37.020752 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1098) took 1822 ms. Trace:
I20260709 12:16:37.021128 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1099) took 1812 ms. Trace:
I20260709 12:16:37.024271 10203 rpcz_store.cc:276] 0709 12:16:35.208602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.977318 (+1768716us) service_pool.cc:224] Handling call
0709 12:16:37.020656 (+ 43338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.020838 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.020862 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:37.020898 (+    36us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:37.020927 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.020975 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.021060 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.976663 15874 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:36.900032 16122 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:36.974927 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:36.990075 16185 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:16:36.854001 16127 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:36.976545 10202 rpcz_store.cc:276] 0709 12:16:35.005250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.926648 (+1921398us) service_pool.cc:224] Handling call
0709 12:16:36.926977 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.927157 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.927182 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.927236 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:36.927269 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.927321 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.927435 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:36.974270 10199 rpcz_store.cc:276] 0709 12:16:34.833539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.254596 (+1421057us) service_pool.cc:224] Handling call
0709 12:16:36.254923 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.280172 (+ 25249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.280207 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.303404 (+ 23197us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.720529 (+417125us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:36.720567 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.720629 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.973638 (+253009us) raft_consensus.cc:1685] finished
0709 12:16:36.973665 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:36.973820 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11433,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":19487,"thread_start_us":330003,"threads_started":1,"wal-append.queue_time_us":585555}
I20260709 12:16:37.080097 10199 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
W20260709 12:16:36.980572 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46831.1us
I20260709 12:16:36.983812 10196 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:36.861038 16198 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:16:36.976732 16195 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:36.969910 16109 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.883461 16126 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:36.952847 16194 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
I20260709 12:16:37.041126 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.025416 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:36.976191 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1069) took 2531 ms. Trace:
I20260709 12:16:37.046839 10197 rpcz_store.cc:276] 0709 12:16:35.198451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.958822 (+1760371us) service_pool.cc:224] Handling call
0709 12:16:36.959117 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.020424 (+ 61307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.020457 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:37.020500 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:37.020528 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.020589 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.020699 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34798}
W20260709 12:16:37.051044 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:36.890211 15997 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:36.935947 15998 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:36.956285 16210 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 12:16:36.985672 16200 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:37.140638 10196 raft_consensus.cc:1240] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:37.025182 16050 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:37.142925 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2248) took 1055 ms. Trace:
I20260709 12:16:37.144798 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1102) took 1473 ms. Trace:
W20260709 12:16:37.145581 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 170725us
I20260709 12:16:36.988442 16071 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:36.935731 16167 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:16:37.019584 16218 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:16:37.078611 16187 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:16:37.151074 10733 rpcz_store.cc:276] 0709 12:16:34.445124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:34.445255 (+   131us) service_pool.cc:224] Handling call
0709 12:16:34.445568 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.054065 (+1608497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.975952 (+921887us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540015a754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:36.976138 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582748032}
I20260709 12:16:36.985489 16053 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:37.023689 16005 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.128s
I20260709 12:16:37.182801 10199 rpcz_store.cc:276] 0709 12:16:36.087027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.079651 (+992624us) service_pool.cc:224] Handling call
0709 12:16:37.079934 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.142672 (+ 62738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.142870 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:37.053301 15891 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:37.185910 10053 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:37.182451 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2250) took 1094 ms. Trace:
I20260709 12:16:37.198702 10196 rpcz_store.cc:276] 0709 12:16:36.087559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.139925 (+1052366us) service_pool.cc:224] Handling call
0709 12:16:37.140458 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.182153 (+ 41695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.182380 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:37.197896 10199 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:37.157353 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 427741us
I20260709 12:16:37.076504 16127 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:37.157833 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 406968us
I20260709 12:16:37.201082 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:37.078361 16170 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:36.956230 16205 consensus_queue.cc:1048] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.224s
I20260709 12:16:37.192904 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:37.179674 16189 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:16:37.139981 16026 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:37.202616 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 295008us
I20260709 12:16:37.203033 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:37.181622 16197 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.179716 16219 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:37.213382 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:37.199420 16053 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.223687 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.224550 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.225066 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.225636 10729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:16:37.226183 10729 raft_consensus.cc:606] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:37.213472 10199 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:16:37.228680 10737 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:16:37.230887 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.202538 16218 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:37.234731 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2639) took 1499 ms. Trace:
I20260709 12:16:37.235112 10048 rpcz_store.cc:276] 0709 12:16:35.735024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.574648 (+839624us) service_pool.cc:224] Handling call
0709 12:16:36.623297 (+ 48649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.623695 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.623723 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.624183 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.747675 (+123492us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:36.747875 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.748031 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.955699 (+207668us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:37.229094 (+273395us) raft_consensus.cc:1685] finished
0709 12:16:37.229114 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.234676 (+  5562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2004,"raft.queue_time_us":1583,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":37066624,"thread_start_us":98476,"threads_started":1,"wal-append.queue_time_us":231747}
I20260709 12:16:37.238065 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.238685 10731 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:37.230947 15806 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:37.247457 15806 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.247807 15806 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:37.239337 16198 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:16:37.255551 16126 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.228518 16026 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:16:37.256341 16127 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.257602 10055 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 12:16:37.257984 10055 pending_rounds.cc:85] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting all ops after (but not including) 14
I20260709 12:16:37.258189 10055 pending_rounds.cc:107] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:16:37.258472 10055 raft_consensus.cc:2889] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:35.870458 10198 rpcz_store.cc:276] 0709 12:16:33.610734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.638830 (+ 28096us) service_pool.cc:224] Handling call
0709 12:16:33.639308 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.639614 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:34.697723 (+1058109us) log.cc:844] Serialized 14 byte log entry
0709 12:16:35.840862 (+1143139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:35.840917 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:35.840962 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:35.841025 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:35.841145 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35042,"prepare.queue_time_us":427613,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":98,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17555,"thread_start_us":2120954,"threads_started":2}
I20260709 12:16:37.260324 10055 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 920) took 2060 ms. Trace:
W20260709 12:16:37.261258 16058 consensus_meta.cc:287] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.763s	user 0.006s	sys 0.003s
I20260709 12:16:37.261674 16058 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.203717 16188 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:16:37.260716 10055 rpcz_store.cc:276] 0709 12:16:35.200307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.994759 (+794452us) service_pool.cc:224] Handling call
0709 12:16:35.995064 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.258877 (+1263813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.260081 (+  1204us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002a2454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:37.260267 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2902797696}
I20260709 12:16:37.204345 16206 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:16:37.266408 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.267624 16131 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:16:37.268065 16131 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:37.268893 16131 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.270092 16131 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:37.267771 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.295048 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.296227 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.296778 10055 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:37.297554 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.298211 10055 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:37.299177 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.300230 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.300806 10055 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:37.302063 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:37.302724 10055 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:37.273171 16219 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:16:37.273972  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:37.228678 16197 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:37.275667 16196 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:16:37.277827 16214 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:16:37.278321 16213 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.279636 16203 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:37.283623 16218 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.287089 10095 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:37.299264 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 910) took 3165 ms. Trace:
I20260709 12:16:37.349452 10050 rpcz_store.cc:276] 0709 12:16:34.134137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.890937 (+1756800us) service_pool.cc:224] Handling call
0709 12:16:35.891320 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:35.891762 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:16:35.892095 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.496104 (+604009us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.497941 (+  1837us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:36.498535 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 12:16:36.498661 (+   126us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.498691 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.498756 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:36.943201 (+444445us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b1800348940. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:37.299050 (+355849us) raft_consensus.cc:1685] finished
0709 12:16:37.299074 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.299206 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100242,"prepare.queue_time_us":5867,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":5560,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":237,"spinlock_wait_cycles":65499904,"thread_start_us":603448,"threads_started":1,"wal-append.queue_time_us":794592}
I20260709 12:16:37.260210 10198 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:37.351588 10198 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:37.355084 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68063.5us
I20260709 12:16:37.356839 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.357604 16122 raft_consensus.cc:2804] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:37.358109 16122 raft_consensus.cc:697] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:37.359174 16122 consensus_queue.cc:237] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.358228 15939 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:16:37.360806 15939 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:37.360510 10198 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.361234 15939 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:37.361519 10198 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.362176 16041 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.359745 16010 raft_consensus.cc:2764] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:16:37.362006 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2645) took 1143 ms. Trace:
I20260709 12:16:37.362841 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.363082 10046 rpcz_store.cc:276] 0709 12:16:36.218469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.699876 (+481407us) service_pool.cc:224] Handling call
0709 12:16:36.700163 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.700476 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.700502 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.700998 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.931059 (+230061us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:37.019396 (+ 88337us) log.cc:844] Serialized 14 byte log entry
0709 12:16:37.052555 (+ 33159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.052633 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.361778 (+309145us) raft_consensus.cc:1685] finished
0709 12:16:37.361800 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.361950 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32902,"prepare.queue_time_us":90347,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4619,"raft.queue_time_us":224917,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":74786,"thread_start_us":199824,"threads_started":1,"wal-append.queue_time_us":468798}
I20260709 12:16:37.364969 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:37.318533 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 120813us
I20260709 12:16:37.193672 16071 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:37.324261 10701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.332170 15891 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:37.339481 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 138449us
I20260709 12:16:37.197104 15874 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.370780 10048 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 21: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:37.371971 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:37.373953 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:37.379714 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.348940 16203 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:37.351805 16213 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.371104 15766 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.381851 10198 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:37.383606 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:37.391134 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4535125299998981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:16:37.401464 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4493203750000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 12:16:37.401901 10169 connection.cc:256] RPC call timeout handler was delayed by -1.4295203750000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:16:37.402325 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3917203749999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:16:37.402906 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3674203749999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:16:37.403231 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3044203750000634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:16:37.403544 10169 connection.cc:256] RPC call timeout handler was delayed by -1.3044203750000634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 12:16:37.414391 10055 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:37.414794 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.381626 16217 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:37.393630 16044 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.000s
I20260709 12:16:37.418877 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:37.420295 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 367410us
W20260709 12:16:37.418167 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1082203749999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:16:37.421368 10169 connection.cc:256] RPC call timeout handler was delayed by -1.1082203749999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 12:16:37.421455 10168 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:37.421698 10169 connection.cc:256] RPC call timeout handler was delayed by -1.0722203749999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 12:16:37.385416 15874 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:37.420580 10046 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:37.427858 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.428622 10055 raft_consensus.cc:2410] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
W20260709 12:16:37.416422 16005 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:16:37.433962 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.415897 16188 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:37.397629 16041 consensus_queue.cc:1059] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 12:16:37.438957 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.431648 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.417228 16109 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.430157 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.422554 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:37.446713 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.443192 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.447805 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.447923 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.449395 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.452193 10729 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.449183 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.450194 10734 raft_consensus.cc:2376] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20. Re-sending same reply.
I20260709 12:16:37.420507 16217 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.457132 15806 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.459965 16217 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.460294 15806 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:37.440657 15650 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.463092 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2646) took 1244 ms. Trace:
I20260709 12:16:37.462524 15650 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.466456 15650 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.424654 16044 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.468788 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.470914 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1207) took 2075 ms. Trace:
I20260709 12:16:37.471324 16195 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.471817 16126 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:37.473134 16192 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.830s	user 0.002s	sys 0.000s
I20260709 12:16:37.473369 16195 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.448338 16224 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:16:37.474814 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.470917 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.475627 10130 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:16:37.448499 16226 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.475587 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 950) took 1417 ms. Trace:
I20260709 12:16:37.476269 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:37.428618 16230 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:37.488495 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.477130 10728 rpcz_store.cc:276] 0709 12:16:36.058131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.058252 (+   121us) service_pool.cc:224] Handling call
0709 12:16:36.094690 (+ 36438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:36.230834 (+136144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.230863 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:36.231425 (+   562us) log.cc:844] Serialized 52 byte log entry
0709 12:16:36.636082 (+404657us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.636126 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.636196 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.472631 (+836435us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:37.475312 (+  2681us) raft_consensus.cc:1685] finished
0709 12:16:37.475333 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.475534 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":16273664,"thread_start_us":404272,"threads_started":1,"wal-append.queue_time_us":411470}
I20260709 12:16:37.471283 10732 rpcz_store.cc:276] 0709 12:16:35.395444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.475067 (+ 79623us) service_pool.cc:224] Handling call
0709 12:16:35.530588 (+ 55521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.560241 (+1029653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.470696 (+910455us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005730d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:37.470856 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360742272}
I20260709 12:16:37.478364 10731 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:37.477346 10123 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:37.438125 16010 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.417515 16221 consensus_queue.cc:1048] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:16:37.438709 16098 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:37.463467 10052 rpcz_store.cc:276] 0709 12:16:36.219044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.709243 (+490199us) service_pool.cc:224] Handling call
0709 12:16:36.709620 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.771183 (+ 61563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.771224 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.868622 (+ 97398us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.229610 (+360988us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:37.325268 (+ 95658us) log.cc:844] Serialized 14 byte log entry
0709 12:16:37.352345 (+ 27077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.352420 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.462900 (+110480us) raft_consensus.cc:1685] finished
0709 12:16:37.462920 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.463039 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26785,"prepare.queue_time_us":112020,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":198977,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":10941,"thread_start_us":339762,"threads_started":2,"wal-append.queue_time_us":437917}
I20260709 12:16:37.519862 10729 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:37.476786 16226 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.520603 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.448192 16066 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:37.521071 16201 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:16:37.520917 15923 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:37.547284 10195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2239) took 2849 ms (client timeout 2112 ms). Trace:
W20260709 12:16:37.547691 10195 rpcz_store.cc:269] 0709 12:16:34.686301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.097798 (+411497us) service_pool.cc:224] Handling call
0709 12:16:37.535110 (+2437312us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:37.535214 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312794496}
I20260709 12:16:37.522583 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.522812 16195 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:37.525271 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.527628 16010 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:37.532475 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.533535 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:37.539732 16039 consensus_meta.cc:287] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 12:16:37.587391 10196 raft_consensus.cc:3060] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:16:37.536208 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.522192 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.537618 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.515264 16217 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:37.544651 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.544950 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2252) took 1131 ms. Trace:
I20260709 12:16:37.519658 10094 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:37.588932 10051 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:37.549424 10055 raft_consensus.cc:2468] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:37.551682 10129 raft_consensus.cc:2368] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:37.552194 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37554 (request call id 951) took 1468 ms. Trace:
I20260709 12:16:37.518404 16230 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.559360 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:37.589152 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.589962 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.550913 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:37.598889 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:37.600003 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:37.600942 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:37.590399 10736 rpcz_store.cc:276] 0709 12:16:36.083640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.083776 (+   136us) service_pool.cc:224] Handling call
0709 12:16:37.552005 (+1468229us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540029d454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:37.552139 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311929600}
I20260709 12:16:37.588888 10204 rpcz_store.cc:276] 0709 12:16:36.413656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.528417 (+114761us) service_pool.cc:224] Handling call
0709 12:16:37.544788 (+1016371us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400360e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:37.544890 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243726080}
I20260709 12:16:37.434459 16229 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.117s
I20260709 12:16:37.606094 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.606827 10051 raft_consensus.cc:2393] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 21: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:37.436123 15891 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.612455 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.613004 10051 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:37.613759 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:37.614351 10051 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:37.615068 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:37.547551 15923 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:37.447167 16203 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.620170 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.621605 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.622577 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.603849 16039 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16.
I20260709 12:16:37.541097 16098 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.603480 16230 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.627033 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.628368 10736 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:37.633286 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.634377 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.637257 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.620041 15923 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:37.618825 16217 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:16:37.638939 10051 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16.
I20260709 12:16:37.639618 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:37.642652 10196 raft_consensus.cc:2468] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
W20260709 12:16:37.637445 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 214947us
I20260709 12:16:37.549907 16066 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.651957 10203 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:37.652096 16071 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.658129 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:37.655524 10129 raft_consensus.cc:2376] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15. Re-sending same reply.
I20260709 12:16:37.662699 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.667701 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:37.668550 10129 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:37.636303 15997 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.652802 16203 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.676263 10736 raft_consensus.cc:2410] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:37.661388 16197 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.679116 10169 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:37.668289 16217 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:37.691160 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:37.678951 10052 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:37.685701 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.694617 10732 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 15: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:16:37.677794 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:37.676615 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 157026us
I20260709 12:16:37.675887 16221 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:16:37.697286 16237 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:16:37.698294 16066 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.696241 10702 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.701555 16239 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:37.708647 15871 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.713764 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:37.714362 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.752245 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1105) took 1112 ms. Trace:
W20260709 12:16:37.721886 16045 consensus_meta.cc:287] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.831s	user 0.005s	sys 0.005s
I20260709 12:16:37.752650 10199 rpcz_store.cc:276] 0709 12:16:36.639762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.227647 (+587885us) service_pool.cc:224] Handling call
0709 12:16:37.227944 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.228225 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.228252 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.317470 (+ 89218us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.415711 (+ 98241us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:37.415750 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.415815 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.752014 (+336199us) raft_consensus.cc:1685] finished
0709 12:16:37.752039 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.752181 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49541,"spinlock_wait_cycles":89892736,"thread_start_us":43579,"threads_started":1,"wal-append.queue_time_us":190222}
W20260709 12:16:37.747442 16233 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 12:16:37.749639 16204 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.878s	user 0.003s	sys 0.000s
I20260709 12:16:37.686383 16231 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:16:37.719580 16229 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:37.753479 16212 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:37.756403 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:37.788173 16115 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:37.789310 10094 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:37.718990 16221 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:37.792382 16221 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:37.751837 16228 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:16:37.795728 16115 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:37.796983 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2219) took 1052 ms. Trace:
I20260709 12:16:37.797380 10121 rpcz_store.cc:276] 0709 12:16:36.744881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.745053 (+   172us) service_pool.cc:224] Handling call
0709 12:16:36.745447 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.083705 (+338258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.083735 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.151861 (+ 68126us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.383804 (+231943us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:37.383840 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.383902 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.796766 (+412864us) raft_consensus.cc:1685] finished
0709 12:16:37.796788 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.796920 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96687,"raft.queue_time_us":133452,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":392844,"threads_started":2,"wal-append.queue_time_us":366712}
I20260709 12:16:37.748217 16005 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:37.692579 16050 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.802776 16050 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.803687 16169 raft_consensus.cc:2804] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:37.804215 16169 raft_consensus.cc:697] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:37.805096 16169 consensus_queue.cc:237] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.804733 10199 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: [12.11-14.12]
W20260709 12:16:37.809716 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.813673 16212 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.819731 16212 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.772778 16045 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:37.756613 16218 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:37.751963 15997 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:16:37.831409 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.768990 15844 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:16:37.841267 16242 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:16:37.839818 16010 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.837042 16247 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:37.842778 16247 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:37.843585 16247 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.844249 15958 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:37.844892 15923 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.845996 16058 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.849758 15766 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:37.850147 15766 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:37.837838 16126 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:37.829686 16200 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 12:16:37.863626 16247 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:37.838104 16218 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:37.867681 10127 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.868156 15923 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.888504 15766 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:37.889274 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.889822 15766 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:37.890400 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.891549 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:37.892077 10732 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:16:37.892894 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2257) took 1131 ms. Trace:
W20260709 12:16:37.873234 15998 consensus_meta.cc:287] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.001s
I20260709 12:16:37.862251 10733 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:37.890530 16098 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:37.892686 16126 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:37.827399 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 113714us
I20260709 12:16:37.899174 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55236 (request call id 2719) took 1879 ms. Trace:
I20260709 12:16:37.893286 10195 rpcz_store.cc:276] 0709 12:16:36.761099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.605590 (+844491us) service_pool.cc:224] Handling call
0709 12:16:37.605903 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:37.607655 (+  1752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.607685 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:37.616132 (+  8447us) log.cc:844] Serialized 52 byte log entry
0709 12:16:37.683295 (+ 67163us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:16:37.683339 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.683417 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.892681 (+209264us) raft_consensus.cc:1685] finished
0709 12:16:37.892705 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.892836 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9672,"raft.queue_time_us":50839,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":2324,"thread_start_us":40018,"threads_started":1,"wal-append.queue_time_us":123634}
I20260709 12:16:37.903609 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:37.902127 10127 rpcz_store.cc:276] 0709 12:16:36.006769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.006987 (+   218us) service_pool.cc:224] Handling call
0709 12:16:37.866620 (+1859633us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400407754. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e787a3d 00007fc183757cd0 00007fc17ccdc254 00007fc17ccdc1e2 00007fc17ccdc111 00007fc17ccdc08c 00007fc17ccdb342 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:37.886284 (+ 19664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49610112}
I20260709 12:16:37.884207 16226 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:37.903337 16240 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:16:37.903612 16243 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 12:16:37.898123 16218 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:37.911321 16170 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:37.940477 16170 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:37.827487 16217 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.940515 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.942505  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:37.943570  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:37.894021 15998 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.884836 16230 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:37.931640 16207 log.cc:927] Time spent T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.733s	user 0.000s	sys 0.003s
I20260709 12:16:37.932369 16175 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:37.948266 16175 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:37.949126 16175 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:37.950048 16175 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:37.950798 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:37.951260 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:37.952811 16213 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.915947 16244 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:37.939978 16126 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:37.948285 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.943445 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:37.897456 16200 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:37.905201 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:37.956871 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51722.5us
I20260709 12:16:37.953457 16244 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:37.958593 16244 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:37.958503 16191 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.105s	user 0.004s	sys 0.000s
I20260709 12:16:37.959225 15958 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:37.959487 15998 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:37.947376 16053 consensus_meta.cc:287] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
I20260709 12:16:38.001164 10047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 904) took 4063 ms. Trace:
I20260709 12:16:37.998956 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37554 (request call id 949) took 1941 ms. Trace:
I20260709 12:16:38.002080 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2648) took 1276 ms. Trace:
I20260709 12:16:38.004884 10729 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:38.005636 10126 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:16:38.008095 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.014408 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.015205 10053 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:38.001817 10047 rpcz_store.cc:276] 0709 12:16:33.936848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.842524 (+1905676us) service_pool.cc:224] Handling call
0709 12:16:35.937301 (+ 94777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:35.937534 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:35.956004 (+ 18470us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.782844 (+826840us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.884603 (+101759us) log.cc:844] Serialized 14 byte log entry
0709 12:16:36.884753 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:36.884795 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:36.884841 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.884905 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.963316 (+1078411us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b5400130450. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.000317 (+ 37001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174715,"prepare.queue_time_us":135642,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":7350,"raft.queue_time_us":179107,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":51791,"spinlock_wait_cycles":217126144,"thread_start_us":819338,"threads_started":3,"wal-append.queue_time_us":678409}
I20260709 12:16:38.019933 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.020819 10047 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:38.002399 10730 rpcz_store.cc:276] 0709 12:16:36.057775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.057914 (+   139us) service_pool.cc:224] Handling call
0709 12:16:36.093993 (+ 36079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:36.094418 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.094469 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:36.094968 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:16:36.500869 (+405901us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.500909 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:36.500972 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.954475 (+1453503us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:37.959850 (+  5375us) raft_consensus.cc:1685] finished
0709 12:16:37.959880 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.998863 (+ 38983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":114,"spinlock_wait_cycles":57163520,"thread_start_us":405549,"threads_started":1,"wal-append.queue_time_us":628557}
I20260709 12:16:38.028128 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:38.029313 10735 raft_consensus.cc:3060] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:38.031764 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.033881 10197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1104) took 1784 ms. Trace:
I20260709 12:16:38.033756 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.035540 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.036567 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.000926 15958 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:37.941339 16170 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.007431 16053 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.034688 10197 rpcz_store.cc:276] 0709 12:16:36.249042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.179479 (+930437us) service_pool.cc:224] Handling call
0709 12:16:37.187916 (+  8437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.188114 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:16:37.928262 (+740148us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.033356 (+105094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.033458 (+   102us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:16:38.033520 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.033607 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.033791 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":722475,"prepare.queue_time_us":753417,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"thread_start_us":121992,"threads_started":2}
W20260709 12:16:38.148458 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.017669 16127 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:38.129962 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.232457 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.239341 10728 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:38.239595 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.038856 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.240434 10051 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:38.241114 10196 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:16:38.241303 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.241976 10051 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:38.233546 10732 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 12.
I20260709 12:16:38.243160 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.243607 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.244454 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.244714 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.245237 10199 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:38.189287 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.228297 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 1043) took 1352 ms. Trace:
I20260709 12:16:38.229185 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.041960 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.246590 10050 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.246048 10128 rpcz_store.cc:276] 0709 12:16:36.875724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.899499 (+ 23775us) service_pool.cc:224] Handling call
0709 12:16:38.228095 (+1328596us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400409554. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.228226 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37588352}
W20260709 12:16:38.249076 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 207200us
I20260709 12:16:38.248718 10734 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:38.178560 10735 raft_consensus.cc:2468] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:38.247954 10122 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:38.246196 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.253979 10199 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:38.255546 10702 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12.
I20260709 12:16:38.255897 10702 leader_election.cc:403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:16:38.128983 16258 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:16:38.113426 16249 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:16:38.257030 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:38.259274 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.260864 10051 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
W20260709 12:16:38.173794 16259 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:16:38.118750 16226 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:38.248019 16263 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:16:38.113088 16213 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.268227 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2649) took 1542 ms. Trace:
I20260709 12:16:38.252815 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.230830 16098 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:38.271649 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2636) took 2833 ms. Trace:
I20260709 12:16:38.251361 16063 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.297019 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.227224 15939 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:38.274926 16255 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:16:38.271595 16041 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:38.302071 15939 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:38.299156 16098 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.257135 16073 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:38.288372 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:38.283416 10051 rpcz_store.cc:276] 0709 12:16:36.726127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.251852 (+1525725us) service_pool.cc:224] Handling call
0709 12:16:38.252155 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.267931 (+ 15776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.268165 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:38.305593 10050 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:38.306126 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.293167 10128 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 14. Current term is 15. Ops: []
I20260709 12:16:38.272812 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1212) took 1049 ms. Trace:
I20260709 12:16:38.294939 10054 rpcz_store.cc:276] 0709 12:16:35.438375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.561997 (+1123622us) service_pool.cc:224] Handling call
0709 12:16:36.562343 (+   346us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:36.565299 (+  2956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:36.565331 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:36.569437 (+  4106us) log.cc:844] Serialized 78 byte log entry
0709 12:16:36.712893 (+143456us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:36.739772 (+ 26879us) log.cc:844] Serialized 14 byte log entry
0709 12:16:37.150239 (+410467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.150320 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:37.930997 (+780677us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:38.265435 (+334438us) raft_consensus.cc:1685] finished
0709 12:16:38.271476 (+  6041us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.271605 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23992,"prepare.queue_time_us":16845,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":168042,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":16735,"spinlock_wait_cycles":6968704,"thread_start_us":529204,"threads_started":2,"wal-append.queue_time_us":515854}
I20260709 12:16:38.263022 16225 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:38.258704 16212 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:16:38.265008 15998 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 11. Current term is 12.
I20260709 12:16:38.305946 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.310276 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2233) took 1023 ms. Trace:
I20260709 12:16:38.310707 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2652) took 1583 ms. Trace:
I20260709 12:16:38.307914 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.306931 10733 rpcz_store.cc:276] 0709 12:16:37.223311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.223452 (+   141us) service_pool.cc:224] Handling call
0709 12:16:38.272643 (+1049191us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54004b87d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.272751 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453015424}
I20260709 12:16:38.308871 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:38.310747 10121 rpcz_store.cc:276] 0709 12:16:37.286532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.799044 (+512512us) service_pool.cc:224] Handling call
0709 12:16:37.799408 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.803802 (+  4394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.803835 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.804319 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.821844 (+ 17525us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:37.821883 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.821957 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.310089 (+488132us) raft_consensus.cc:1685] finished
0709 12:16:38.310109 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.310222 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3986,"raft.queue_time_us":5125,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":17138,"threads_started":1,"wal-append.queue_time_us":116222}
I20260709 12:16:38.312222 10129 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 14: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:38.313144 10200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2240) took 3626 ms. Trace:
I20260709 12:16:38.294018 16230 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:38.293310 16105 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:38.314248 10051 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:16:38.314898 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2852) took 1160 ms. Trace:
I20260709 12:16:38.312585 10054 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:38.315204 10051 rpcz_store.cc:276] 0709 12:16:37.154266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.311109 (+1156843us) service_pool.cc:224] Handling call
0709 12:16:38.311356 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.314655 (+  3299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.314842 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:38.316449 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2653) took 1589 ms. Trace:
I20260709 12:16:38.318138 10054 rpcz_store.cc:276] 0709 12:16:36.727126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.312159 (+1585033us) service_pool.cc:224] Handling call
0709 12:16:38.312432 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.316198 (+  3766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.316393 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:38.319499 10054 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:38.312654 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.322374 10121 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:38.323904 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.286887 16200 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.324627 10053 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:38.327124 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2598) took 4733 ms. Trace:
I20260709 12:16:38.327605 10201 rpcz_store.cc:276] 0709 12:16:33.589386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:33.589552 (+   166us) service_pool.cc:224] Handling call
0709 12:16:33.602481 (+ 12929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:33.602682 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:34.701884 (+1099202us) log.cc:844] Serialized 14 byte log entry
0709 12:16:37.903320 (+3201436us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180026b0c0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b61dc0a 00007fc184d5d219 00007fc17b6a5a40 00007fc17b6a04e4 00007fc17b6a0455 00007fc1821883c7 00007fc17e79a9a7 00007fc17e7aa0bf 00007fc17e7aa038
0709 12:16:38.119444 (+216124us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.322090 (+202646us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.322148 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:38.322195 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.322272 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.322387 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50246,"prepare.queue_time_us":2588898,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":214,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":33776,"spinlock_wait_cycles":4230912,"thread_start_us":2560821,"threads_started":4,"wal-append.queue_time_us":1393561,"wal-append.run_cpu_time_us":983,"wal-append.run_wall_time_us":1045015}
I20260709 12:16:38.311201 10050 rpcz_store.cc:276] 0709 12:16:36.726903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.309937 (+1583034us) service_pool.cc:224] Handling call
0709 12:16:38.310203 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.310379 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.310404 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.310476 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:38.310504 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.310550 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.310657 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:38.339542 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2625) took 2997 ms. Trace:
I20260709 12:16:38.307005 16073 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.340029 10049 rpcz_store.cc:276] 0709 12:16:35.341802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.047672 (+705870us) service_pool.cc:224] Handling call
0709 12:16:36.047934 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.390244 (+342310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.339273 (+1949029us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400351e54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:38.339471 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742288128}
I20260709 12:16:38.341744 10049 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:16:38.283746 16226 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.345505 16226 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:38.382728 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.294654 16213 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.312747 16211 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:38.323611 16105 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.322320 16040 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:38.403038 10129 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:16:38.346592 15766 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.371711 16073 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.306355 16203 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 12:16:38.298969 15958 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.415167 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2255) took 1654 ms. Trace:
I20260709 12:16:38.415562 10204 rpcz_store.cc:276] 0709 12:16:36.760631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.602965 (+842334us) service_pool.cc:224] Handling call
0709 12:16:37.603262 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.709115 (+105853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.709245 (+   130us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:37.711890 (+  2645us) log.cc:844] Serialized 26 byte log entry
0709 12:16:37.986735 (+274845us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:37.986776 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.986851 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.414966 (+428115us) raft_consensus.cc:1685] finished
0709 12:16:38.414986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.415113 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19182,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10831,"thread_start_us":329031,"threads_started":2,"wal-append.queue_time_us":325382}
I20260709 12:16:38.424199 16213 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:38.313503 10200 rpcz_store.cc:276] 0709 12:16:34.686560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.237589 (+1551029us) service_pool.cc:224] Handling call
0709 12:16:36.237893 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:36.238082 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:38.049046 (+1810964us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.312517 (+263471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.312566 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:38.312605 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.312977 (+   372us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.313092 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1665293,"prepare.queue_time_us":1703234,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1554,"thread_start_us":406452,"threads_started":2}
I20260709 12:16:38.434170 10128 raft_consensus.cc:2410] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:16:38.434170 10122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 2192) took 3361 ms (client timeout 1572 ms). Trace:
W20260709 12:16:38.434752 10122 rpcz_store.cc:269] 0709 12:16:35.072740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:35.100448 (+ 27708us) service_pool.cc:224] Handling call
0709 12:16:38.433961 (+3333513us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b5400197dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.434073 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6854512896}
I20260709 12:16:38.435382 15806 raft_consensus.cc:993] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
W20260709 12:16:38.435853 16271 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:16:37.182893 10202 rpcz_store.cc:276] 0709 12:16:35.671595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.076962 (+1405367us) service_pool.cc:224] Handling call
0709 12:16:37.077314 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.144215 (+ 66901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.144274 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:37.144345 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:37.144404 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:37.144517 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:37.144716 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66403,"raft.queue_time_us":108661}
I20260709 12:16:38.407251 16040 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.435868 15806 raft_consensus.cc:1081] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:38.441800 10125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2222) took 1662 ms. Trace:
I20260709 12:16:38.443676 16198 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:38.445044 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2230) took 1249 ms. Trace:
I20260709 12:16:38.445758 16098 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:38.449950 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2738) took 1005 ms. Trace:
I20260709 12:16:38.450325 10123 rpcz_store.cc:276] 0709 12:16:37.444569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.868876 (+424307us) service_pool.cc:224] Handling call
0709 12:16:37.869213 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:37.901394 (+ 32181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:37.901425 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:37.912165 (+ 10740us) log.cc:844] Serialized 52 byte log entry
0709 12:16:38.039104 (+126939us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:38.067031 (+ 27927us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.067258 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.067338 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.449742 (+382404us) raft_consensus.cc:1685] finished
0709 12:16:38.449762 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.449893 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31462,"prepare.queue_time_us":33331,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":31965,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":7850,"thread_start_us":92410,"threads_started":1,"wal-append.queue_time_us":525116}
I20260709 12:16:38.452431 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2254) took 1692 ms. Trace:
I20260709 12:16:38.452775 10198 rpcz_store.cc:276] 0709 12:16:36.760397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.399555 (+639158us) service_pool.cc:224] Handling call
0709 12:16:37.399949 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:37.400333 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:38.024580 (+624247us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.238588 (+214008us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:38.256832 (+ 18244us) log.cc:844] Serialized 52 byte log entry
0709 12:16:38.258369 (+  1537us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:38.271210 (+ 12841us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.271406 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.271486 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.452212 (+180726us) raft_consensus.cc:1685] finished
0709 12:16:38.452232 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.452374 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":522919,"prepare.queue_time_us":576090,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":75,"raft.queue_time_us":17937,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":10645,"thread_start_us":279419,"threads_started":2,"wal-append.queue_time_us":408268}
I20260709 12:16:38.454109 16053 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:38.445218 16058 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.455343 16058 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.404289 16105 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:38.457266 10130 rpcz_store.cc:276] 0709 12:16:37.195583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.230113 (+ 34530us) service_pool.cc:224] Handling call
0709 12:16:37.285688 (+ 55575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:37.476029 (+190341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.444779 (+968750us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001b0654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:38.444980 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436263168}
I20260709 12:16:38.461848 10124 raft_consensus.cc:3060] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:38.463080 10733 raft_consensus.cc:1240] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
W20260709 12:16:38.461786 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 203607us
I20260709 12:16:38.442209 10125 rpcz_store.cc:276] 0709 12:16:36.780598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.806045 (+ 25447us) service_pool.cc:224] Handling call
0709 12:16:38.440008 (+1633963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.440309 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:38.440336 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.440383 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:38.440410 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.440468 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.441640 (+  1172us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400197dd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.441743 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":149,"spinlock_wait_cycles":3648548608}
I20260709 12:16:38.409950 15766 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.002516 10048 rpcz_store.cc:276] 0709 12:16:36.725850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.711076 (+985226us) service_pool.cc:224] Handling call
0709 12:16:37.711417 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.711623 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:16:37.711922 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.001760 (+289838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.001814 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:38.001855 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.001921 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.002030 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8959,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":15611,"thread_start_us":278592,"threads_started":1,"wal-append.queue_time_us":293849}
I20260709 12:16:38.464274 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:38.468726 16058 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.469837 16073 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.473311 10127 raft_consensus.cc:2393] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:38.478688 10203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2246) took 3253 ms. Trace:
I20260709 12:16:38.479085 10203 rpcz_store.cc:276] 0709 12:16:35.225004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.025130 (+1800126us) service_pool.cc:224] Handling call
0709 12:16:37.082301 (+ 57171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:37.657522 (+575221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.478394 (+820872us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54000ea6d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:38.478615 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309553920}
I20260709 12:16:38.481513 16044 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.484838 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:38.486639 15939 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:38.487105 15939 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.487468 15939 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:38.486195 10095 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.491127 16010 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:38.491550 16010 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.491891 16010 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:38.495824 16142 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:16:38.497185 16200 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:38.497581 16200 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:38.498559 16200 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.500105 10095 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.501003 16195 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:38.501534 16195 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:38.502440 16195 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.513852 16200 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.514459 16167 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:38.515439 16167 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:38.465267 16218 consensus_meta.cc:287] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.005s
I20260709 12:16:38.518684 16218 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.520658 16218 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:38.468694 15766 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:38.522182 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57969.5us
I20260709 12:16:38.523953 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 2229) took 1328 ms. Trace:
I20260709 12:16:38.524369 10126 rpcz_store.cc:276] 0709 12:16:37.195336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.215248 (+ 19912us) service_pool.cc:224] Handling call
0709 12:16:37.239201 (+ 23953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.006074 (+766873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.523690 (+517616us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54001284d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:38.523888 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750669696}
I20260709 12:16:38.440486 16040 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:38.526486 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:38.526865 10123 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:38.527729 10121 pending_rounds.cc:85] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 12
I20260709 12:16:38.530658 10121 pending_rounds.cc:107] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:16:38.530949 10121 raft_consensus.cc:2889] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:38.533540 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:38.533764 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.534377 10735 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:38.535355 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:38.536001 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.524940 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.539300 10198 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 15: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:38.539197 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.540134 10130 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:38.541141 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.545068 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.545282 10051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 922) took 1124 ms. Trace:
I20260709 12:16:38.461618 16063 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:38.546955 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.547884 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:38.556145 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 56133.9us
I20260709 12:16:38.561138 10129 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:16:38.563223 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:38.518122 16167 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:38.551465 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.552050 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:38.551362 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.521063 16170 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:38.584064 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.546864 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:38.572441 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.587071 10199 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:38.538337 16142 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:38.545711 10051 rpcz_store.cc:276] 0709 12:16:37.421153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.317058 (+895905us) service_pool.cc:224] Handling call
0709 12:16:38.317358 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.544918 (+227560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.544950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.544995 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:38.545027 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.545102 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.545215 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107112,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":70,"thread_start_us":227165,"threads_started":1}
I20260709 12:16:38.568820 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.536945 16045 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:38.581310 10204 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:38.544589 16040 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:38.594548 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.581019 10201 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:38.597141 10201 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:38.581921 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 1033) took 2558 ms. Trace:
I20260709 12:16:38.598232 10124 rpcz_store.cc:276] 0709 12:16:36.010374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:36.293871 (+283497us) service_pool.cc:224] Handling call
0709 12:16:36.294157 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.461475 (+2167318us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540008df20. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e705a1d 00007fc17e6ec1a4 00007fc17e76e447 00007fc17e786fe7 00007fc17e7887de 00007fc17e792b49 00007fc17e793416 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419
0709 12:16:38.568700 (+107225us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:16:38.568729 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:38.568770 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:16:38.568799 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.568863 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.568978 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":14476,"spinlock_wait_cycles":360466816}
I20260709 12:16:38.583199 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:38.585150 10168 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:38.589530 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 250829us
I20260709 12:16:38.591717 10702 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.602006 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:38.602175 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.552881 16213 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:38.635248 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.605942 10203 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:16:38.658596 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66968us
I20260709 12:16:38.659642 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.660233 10197 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:38.660506 10197 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:38.660704 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.660954 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.661530 10051 raft_consensus.cc:2410] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:16:38.662288 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.663092 10053 raft_consensus.cc:2393] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:38.666211 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.606717 10729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52036 (request call id 1225) took 1069 ms. Trace:
I20260709 12:16:38.607213 10737 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:16:38.627106 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 43994.7us
I20260709 12:16:38.676618 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:38.677579 10047 raft_consensus.cc:2368] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18.
I20260709 12:16:38.678512 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.679590 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:38.573922 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 311804us
I20260709 12:16:38.680158 10047 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:38.672362 10729 rpcz_store.cc:276] 0709 12:16:37.537264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.537395 (+   131us) service_pool.cc:224] Handling call
0709 12:16:38.606557 (+1069162us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54006455d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:38.606664 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857356032}
I20260709 12:16:38.555953 16105 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:38.693603 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.694095 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.663976 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.695889 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.703490 10053 raft_consensus.cc:2393] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:38.696472 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.593261 16219 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:38.593889 16045 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:38.704097 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:38.714736 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:38.704769 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.600178 16063 raft_consensus.cc:2764] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:16:38.628305 16167 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:38.706175 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.578855 16217 consensus_queue.cc:1059] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:16:38.708149 10051 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 18. Ops: []
I20260709 12:16:38.708278 10053 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:16:38.708593 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:38.697795 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:38.712980 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:38.584920 15997 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:16:38.751400 10055 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:38.657008 16247 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:16:38.695834 16258 log.cc:927] Time spent T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:16:38.697238 10197 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.764232 10197 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.656100 15923 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:38.729699 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:38.767041 10734 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:38.729205 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.677954 15844 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:38.749725 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.768450 10047 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:38.584643 16205 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:16:38.754858 10053 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:38.713282 10195 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:38.694078 16044 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:38.721346 16045 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:38.603673 16142 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.706897 16105 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.592492 16010 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:38.802525 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 94010.9us
I20260709 12:16:38.804092 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:38.805454 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:38.779901 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:38.780691 10197 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
W20260709 12:16:38.729079 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 324328us
I20260709 12:16:38.788676 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.770828 15923 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:38.798717 10203 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:38.701781 16203 consensus_queue.cc:1059] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:16:38.728788 16116 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:38.702028 16213 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:38.798483 16063 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:38.807276 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:38.821730 16219 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:38.817198 16010 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.823153 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 931) took 1393 ms. Trace:
I20260709 12:16:38.820694 15939 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.835331 10047 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:38.836894 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.850502 10054 rpcz_store.cc:276] 0709 12:16:37.429918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.320319 (+890401us) service_pool.cc:224] Handling call
0709 12:16:38.320626 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.346781 (+ 26155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.346814 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.347238 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:16:38.475219 (+127981us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:38.475259 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:38.822755 (+347496us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54003fa2d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:38.822802 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:38.822853 (+    51us) raft_consensus.cc:1685] finished
0709 12:16:38.822864 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:38.823093 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78456,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":44,"spinlock_wait_cycles":59333504,"thread_start_us":127691,"threads_started":1,"wal-append.queue_time_us":124482}
I20260709 12:16:38.842496 10195 raft_consensus.cc:2393] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:38.815048 16218 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:38.838447 15923 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:38.848399 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:38.838379 16238 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 18 is higher.
I20260709 12:16:38.852911 10169 leader_election.cc:400] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18.
I20260709 12:16:38.855223 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.865908 10169 leader_election.cc:403] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:38.865727 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.847636 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.869831 10197 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:38.863476 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.844069 16063 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:38.874181 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.873095 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:38.875888 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.873759 16219 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:38.882078 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.883112 10195 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:38.884006 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.885082 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.889775 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:38.890913 10053 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:38.862756 16280 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:38.879585 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.857949 16218 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:38.894138 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.866272 16050 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:38.939764 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 337824us
I20260709 12:16:38.940877 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:38.874994 15958 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:38.964278 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84772.7us
I20260709 12:16:38.964706 10052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53880
I20260709 12:16:38.966720 10019 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:38.967028 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:38.962191 16219 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:38.846899 16116 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:38.887341 16175 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:38.881877 16278 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:38.962236 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:38.886132 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.987571 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.938619 16218 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:39.005576 10020 leader_election.cc:400] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:38.895361 16280 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:39.008563 10019 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.008487 10020 leader_election.cc:403] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:16:38.988308 16244 consensus_meta.cc:287] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.003s
I20260709 12:16:38.963750 15958 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:38.985536 16219 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.007566 16285 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:39.042874 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 306634us
W20260709 12:16:39.040154 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50548.9us
I20260709 12:16:39.042624 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:38.989634 16096 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:16:39.043169 10048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.013s	sys 0.011s
W20260709 12:16:39.051389 10048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.013s	sys 0.011s
I20260709 12:16:39.051491 10197 raft_consensus.cc:2410] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:16:39.011889 16010 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.013622 16114 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:16:39.020571 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 58376.7us
I20260709 12:16:39.044102 15958 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:39.017710 16142 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:38.964282 16050 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.010739 16063 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.074556 16203 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.085217 16203 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.087764 16203 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:39.069505 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:39.039642 15997 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:39.043706 16127 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:39.046854 16291 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:39.091909 15939 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:39.093169 15923 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.102223 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.094583 16050 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:39.103948 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:39.104698 10734 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:39.095257 16230 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:16:39.097107 16200 consensus_meta.cc:287] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.000s
W20260709 12:16:39.097777 16170 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.000s
I20260709 12:16:39.098371 16116 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:39.046878 16219 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:39.039414 16244 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:39.086287 16302 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:16:39.049007 16058 consensus_queue.cc:1059] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:16:39.118314 10122 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:39.078510 16114 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:39.125165 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.069936 16072 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:39.117614 16303 log.cc:927] Time spent T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:16:39.115329 16300 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.130399 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.131523 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.126194 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:39.135079 10196 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:39.089036 16285 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:16:39.142105 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.124333 15923 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:39.147573 10052 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:39.148044 10052 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:39.172619 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:39.215577 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:39.226999 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.009s	sys 0.021s
W20260709 12:16:39.228823 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.021s
I20260709 12:16:39.245121 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.245807 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.246147 10735 raft_consensus.cc:2410] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:16:39.244696 16200 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:39.247586 10735 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:16:39.251358 10052 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.089560 16280 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.258881 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:39.180855 16300 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:39.180743 16041 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18.
I20260709 12:16:39.243311 15939 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:39.283407 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:39.257082 16206 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:39.302134 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1085) took 1415 ms. Trace:
I20260709 12:16:39.303192 10736 rpcz_store.cc:276] 0709 12:16:37.886978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.252429 (+365451us) service_pool.cc:224] Handling call
0709 12:16:38.252673 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.252868 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:16:38.676422 (+423554us) log.cc:844] Serialized 14 byte log entry
0709 12:16:39.298170 (+621748us) log.cc:844] Serialized 14 byte log entry
0709 12:16:39.301421 (+  3251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:39.301534 (+   113us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:39.301620 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.301752 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.302048 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53882,"prepare.queue_time_us":559470,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":51913,"thread_start_us":937663,"threads_started":2}
W20260709 12:16:39.302977 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 427128us
I20260709 12:16:39.279452 16307 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:39.306995 16230 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.306870 16315 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.301748 16280 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:39.349048 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65684.7us
I20260709 12:16:39.308238 16206 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:39.358767 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 286555us
W20260709 12:16:39.360328 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.361027 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:39.361927 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 306011us
W20260709 12:16:39.353385 16304 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:16:39.365757 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:39.357920 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 301117us
I20260709 12:16:39.370663 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:39.370935 10200 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:16:39.372694 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:39.373268 10736 raft_consensus.cc:1813] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Handling vote request from an unknown peer 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:39.373749 10736 raft_consensus.cc:2368] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 12.
I20260709 12:16:39.368984 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:39.301077 16114 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.355726 16126 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:39.359519 16206 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:39.379446 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:39.381419 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:39.383004 16291 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:39.383460 16291 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:39.383551 16310 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:16:39.383826 16291 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:39.385250 16319 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:16:39.386135 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1087) took 1498 ms. Trace:
I20260709 12:16:39.386547 10728 rpcz_store.cc:276] 0709 12:16:37.887549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.267616 (+380067us) service_pool.cc:224] Handling call
0709 12:16:38.267918 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.573377 (+305459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.573425 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.698611 (+125186us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.013671 (+315060us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:39.053950 (+ 40279us) log.cc:844] Serialized 14 byte log entry
0709 12:16:39.072912 (+ 18962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.072999 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.385923 (+312924us) raft_consensus.cc:1685] finished
0709 12:16:39.385943 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.386064 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18435,"prepare.queue_time_us":38519,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":59250,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":5894,"spinlock_wait_cycles":26273024,"thread_start_us":554374,"threads_started":2,"wal-append.queue_time_us":413165}
I20260709 12:16:39.319027 16307 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.389178 16219 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.396862 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.397854 10702 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16.
I20260709 12:16:39.399053 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:39.552347 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 154614us
W20260709 12:16:39.552704 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 153738us
I20260709 12:16:39.418308 10200 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:39.555172 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:39.556180 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:39.556701 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 14.
I20260709 12:16:39.557433 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:39.557967 10200 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:39.558588 16167 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.559252 16167 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:39.375249 16203 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:39.561645 16203 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:39.396716 16211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.022s
W20260709 12:16:39.563308 16211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.007s	sys 0.023s
I20260709 12:16:39.565052 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:39.439998 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:39.440567 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 58645.2us
I20260709 12:16:39.566287 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.554293 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:39.568984 16341 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:39.569439 16341 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:39.569804 16341 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:39.571305 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.574451 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.372587 16200 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:16:39.575569 16200 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:39.575925 16200 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:39.576732 16200 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.577903 16200 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:39.396263 16170 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:39.373026 15923 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:16:39.354575 16315 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.412012 16226 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:39.572149 16167 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:39.566648 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:39.515194 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 118405us
I20260709 12:16:39.608814 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.540800 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:39.609867 10199 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:39.585628 10200 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:39.611235 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:39.588383 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:39.602658 16305 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 12:16:39.621346 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.624327 10198 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:16:39.625118 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 254606us
I20260709 12:16:39.602226 15999 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:39.592499 16325 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:39.614850 16244 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:39.645561 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:39.646704 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.641737 10199 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:39.626247 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:39.619530 16212 consensus_queue.cc:1059] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:16:39.626205 16342 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:39.630357 15999 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:39.679337 16322 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 12:16:39.685448 16045 consensus_meta.cc:287] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.000s
I20260709 12:16:39.686394 16219 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:39.687898 16345 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:39.688472 16345 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:39.690835 16320 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 12:16:39.692564 16324 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:16:39.694809 16323 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:16:39.626012  9947 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 15 to 17, leader changed from <none> to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 17 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:39.702302 16308 log.cc:927] Time spent T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 12:16:39.702530  9946 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 275) took 23732 ms (client timeout 15000 ms). Trace:
I20260709 12:16:39.704500 16338 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.709852 15939 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:39.711040 10121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 1049) took 1184 ms. Trace:
I20260709 12:16:39.711452 10121 rpcz_store.cc:276] 0709 12:16:38.526251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.527262 (+  1011us) service_pool.cc:224] Handling call
0709 12:16:38.527557 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.539168 (+ 11611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.539203 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.539635 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.009161 (+469526us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:39.009202 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.009268 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.710813 (+701545us) raft_consensus.cc:1685] finished
0709 12:16:39.710835 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.710977 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":401313,"threads_started":1,"wal-append.queue_time_us":562918}
I20260709 12:16:39.664877 16337 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:39.719563 16315 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:39.720413 10202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.016s
W20260709 12:16:39.720707 10202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.008s	sys 0.017s
I20260709 12:16:39.655467 16211 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:39.662694 16230 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:39.720893 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2654) took 1768 ms. Trace:
I20260709 12:16:39.724040 10050 rpcz_store.cc:276] 0709 12:16:37.952059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.332035 (+379976us) service_pool.cc:224] Handling call
0709 12:16:38.332347 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.652860 (+320513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.652900 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.698335 (+ 45435us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.023994 (+325659us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:39.074726 (+ 50732us) log.cc:844] Serialized 14 byte log entry
0709 12:16:39.350613 (+275887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.350699 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.720661 (+369962us) raft_consensus.cc:1685] finished
0709 12:16:39.720681 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.720832 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59698,"prepare.queue_time_us":51300,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":118305,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":830164,"threads_started":3,"wal-append.queue_time_us":620164}
W20260709 12:16:39.749127 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 182916us
I20260709 12:16:39.713801 16341 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.720280 15999 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:39.667218 16314 raft_consensus.cc:2764] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:16:39.661516 16041 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:39.720299 16010 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:39.762501 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 209410us
W20260709 12:16:39.843194 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 173047us
I20260709 12:16:39.801764 16226 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:39.685940 16045 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.795375 10204 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:39.825853 16341 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:39.761533 16346 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:16:39.702991  9946 rpcz_store.cc:269] 0709 12:16:15.878160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:15.888708 (+ 10548us) service_pool.cc:224] Handling call
0709 12:16:39.595046 (+23706338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:29.949174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:29.950047 (+   873us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:29.950108 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:16:29.950140 (+    32us) tablet.cc:662] Decoding operations
0709 12:16:29.953032 (+  2892us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:29.953121 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:29.953162 (+    41us) tablet.cc:685] Acquiring locks for 34 operations
0709 12:16:30.163152 (+209990us) tablet.cc:701] Row locks acquired
0709 12:16:30.163202 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:16:30.163420 (+   218us) write_op.cc:270] Start()
0709 12:16:30.163572 (+   152us) write_op.cc:276] Timestamp: P: 1783599390163353 usec, L: 0
0709 12:16:30.163608 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:16:30.193399 (+ 29791us) log.cc:844] Serialized 13276 byte log entry
0709 12:16:30.766055 (+572656us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78be28 00007fc1821c6581 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901 00007fc1821c9b2d 0000000000388634 0000000000388479
0709 12:16:30.971619 (+205564us) op_driver.cc:464] REPLICATION: finished
0709 12:16:31.172283 (+200664us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78d32a 00007fc17e712f14 00007fc17e712ec3 00007fc17e712e38 00007fc17e712df3 00007fc17e7120dc 00007fc17e73be16 00007fc17e723cbb 00007fc17e70e39d 00007fc17e711d75
0709 12:16:31.217400 (+ 45117us) write_op.cc:301] APPLY: starting
0709 12:16:31.217528 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:31.967240 (+749712us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:31.967295 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:33.222278 (+1254983us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:33.365873 (+143595us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=0,mrs_lookups=0
0709 12:16:33.394468 (+ 28595us) write_op.cc:312] APPLY: finished
0709 12:16:33.486292 (+ 91824us) log.cc:844] Serialized 292 byte log entry
0709 12:16:34.698810 (+1212518us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:34.709183 (+ 10373us) write_op.cc:454] Released schema lock
0709 12:16:34.709270 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:34.709697 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:34.709727 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8744,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":153125,"apply.run_cpu_time_us":77609,"apply.run_wall_time_us":3557018,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146315,"num_ops":34,"prepare.queue_time_us":534884,"prepare.run_cpu_time_us":34021,"prepare.run_wall_time_us":817175,"raft.queue_time_us":181725,"raft.run_cpu_time_us":13230,"raft.run_wall_time_us":224653,"replication_time_us":801454,"spinlock_wait_cycles":74781056,"thread_start_us":1956053,"threads_started":5,"wal-append.queue_time_us":2049749,"wal-append.run_cpu_time_us":23815,"wal-append.run_wall_time_us":2413306}]]}
I20260709 12:16:39.795251 16337 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:16:39.808234  9947 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 8 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 12 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:39.824260 16351 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:39.793918 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 145077us
I20260709 12:16:39.813922 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38760 (request call id 2275) took 1024 ms. Trace:
I20260709 12:16:39.797313 16300 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:39.801818 16218 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.784s	user 0.008s	sys 0.003s
W20260709 12:16:39.881278 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:39.880059 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 253882us
I20260709 12:16:39.883351 10095 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:39.887976  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:39.905402 10121 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:39.880980 10195 rpcz_store.cc:276] 0709 12:16:38.789166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.040419 (+251253us) service_pool.cc:224] Handling call
0709 12:16:39.041535 (+  1116us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:39.379824 (+338289us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:16:39.398954 (+ 19130us) log.cc:844] Serialized 14 byte log entry
0709 12:16:39.636710 (+237756us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:39.652757 (+ 16047us) log.cc:844] Serialized 52 byte log entry
0709 12:16:39.652917 (+   160us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:16:39.652952 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.653027 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:39.813673 (+160646us) raft_consensus.cc:1685] finished
0709 12:16:39.813695 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:39.813854 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69615,"prepare.queue_time_us":18477,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":323761,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":11361,"thread_start_us":435078,"threads_started":2,"wal-append.queue_time_us":352973}
I20260709 12:16:39.909492 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:39.911005 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 302256us
I20260709 12:16:39.911970 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.916077 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.916887 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.917918 10127 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:39.936896 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:39.895681 16291 consensus_meta.cc:287] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
I20260709 12:16:39.940614 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:39.944486 10127 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:39.945355 10047 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:39.880218 16328 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.936622 16346 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:39.946696 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:39.947036 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76873.5us
I20260709 12:16:39.941319 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.947711 10702 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:39.948447 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.942502 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:39.903837 15958 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.001s
I20260709 12:16:39.895975 16301 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:39.894037 16226 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:39.904187 16337 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.953720 10019 leader_election.cc:400] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 12.
I20260709 12:16:39.894224 16348 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.956632 10019 leader_election.cc:403] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:39.957170 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.958443 10094 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:39.964468 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:39.886958 15939 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:16:39.968353 10197 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:39.883291 16010 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:39.953094 16280 consensus_meta.cc:287] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 12:16:39.974785 10728 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:16:39.975960 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:39.950196 16114 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.887256 16218 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.992969 16073 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:39.993443 16307 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:39.993616 16347 log.cc:927] Time spent T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:16:39.994782 16358 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.952363 16346 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.973807 16337 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.887439 16300 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.968046 16348 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:40.007352 16206 consensus_meta.cc:287] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.003s
I20260709 12:16:40.032325 16206 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.974062 16355 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:40.034801 16355 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.035822 16355 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.977734 16338 consensus_queue.cc:1059] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:16:39.952083 16291 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.039196 16338 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:40.039615 16338 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:40.000036 16342 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:40.012027 16213 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.040463 16338 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.011962 16356 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:39.951166 16328 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.041692 16356 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.041898 16338 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:40.025995 16358 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.967087 16226 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.042863 16356 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.020118 16360 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:16:40.020592 16339 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:16:40.020821 16353 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 9 FOLLOWER]: Advancing to term 12
I20260709 12:16:39.886476 16351 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.996448 16312 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:40.031697 16348 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.012140 16362 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:40.040321 16291 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.043048 16328 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.044598 16358 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.051574 16351 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.052038 16346 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.053249 16337 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.060483 16353 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 10. Current term is 12.
I20260709 12:16:40.102056 10050 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:40.099922  9947 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 4 to 6, term changed from 4 to 6, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 6 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:40.103670 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:40.104789 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 151023us
I20260709 12:16:39.994558 15923 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:40.109702 10197 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:39.974643 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.110714 10203 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:40.111308 10126 raft_consensus.cc:2410] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:16:39.975188 10127 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:40.112815 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:39.991729 10734 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:16:40.005138 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1231) took 2328 ms. Trace:
I20260709 12:16:39.996083 15844 raft_consensus.cc:3055] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:39.957059 15958 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.015905 15999 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:39.996757 16010 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.226250 16301 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.107594 10123 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:40.008262 16045 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.001650 16063 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.228118 16301 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.122818 16026 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.231110 16218 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.230906 16026 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.233421 16026 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.123131 16053 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:40.124027 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.234455 15844 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.236075 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.236239 15844 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:39.990347 16114 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.124291 16058 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:40.238605 16058 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:40.240094 16058 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.241446 16058 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:40.044607 16226 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.133109 15923 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.242810 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.151299 16206 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.152886 16300 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.153627 10053 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:40.160041 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.121955 16050 raft_consensus.cc:3055] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:40.230022 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:40.258229 10195 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:40.238373 15844 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:40.254648 10130 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:40.256995 10019 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.253479 16050 raft_consensus.cc:740] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:40.255394 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:40.278183 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:40.280085 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.234280 16053 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.257682 15958 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.278354 10125 raft_consensus.cc:1240] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 18. Ops: []
I20260709 12:16:40.259418 15999 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.285529 10128 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:40.289178 10055 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:40.289981 16053 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.279978 16285 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.290611 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.290871 16285 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.291371 10127 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:40.293356 16285 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.295747 16050 consensus_queue.cc:260] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.299360 16114 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.298223 16050 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:40.325928 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 349913us
I20260709 12:16:40.258551 10737 rpcz_store.cc:276] 0709 12:16:37.676951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:37.678303 (+  1352us) service_pool.cc:224] Handling call
0709 12:16:38.606886 (+928583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:38.672901 (+ 66015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.004891 (+1331990us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54006455d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.005069 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122993024}
I20260709 12:16:40.278704 16366 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.335440 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.353757 16345 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.365976 10124 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:40.374336 16306 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.177s	user 0.000s	sys 0.003s
I20260709 12:16:40.377823 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.381875 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:40.383198 10020 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:40.380016 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 306464us
I20260709 12:16:40.386502 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:40.386791 10122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54462 (request call id 1047) took 1860 ms (client timeout 1797 ms). Trace:
W20260709 12:16:40.387207 10122 rpcz_store.cc:269] 0709 12:16:38.525720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.527158 (+  1438us) service_pool.cc:224] Handling call
0709 12:16:40.386415 (+1859257us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54002107d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.386585 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316803968}
I20260709 12:16:40.388564 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.389971 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.378034 15958 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.390965 15958 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.391033 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:40.395334 10124 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:40.396163 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.397368 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.398154 10124 raft_consensus.cc:2393] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:40.399049 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.399854 10124 raft_consensus.cc:2410] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:16:40.400555 10048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2669) took 2103 ms. Trace:
I20260709 12:16:40.401031 10048 rpcz_store.cc:276] 0709 12:16:38.296757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.468709 (+171952us) service_pool.cc:224] Handling call
0709 12:16:38.469050 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.469381 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:38.469410 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:38.469838 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:16:39.051919 (+582081us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:39.051963 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:39.052032 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:40.284502 (+1232470us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:40.400100 (+115598us) raft_consensus.cc:1685] finished
0709 12:16:40.400119 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.400344 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":671,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"spinlock_wait_cycles":69455232,"thread_start_us":581631,"threads_started":1,"wal-append.queue_time_us":660734}
I20260709 12:16:40.402951 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.337242  9947 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 13, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 13 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.403671 10200 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:40.406793 16366 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.409837 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.410928 10128 raft_consensus.cc:2410] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:16:40.400647 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.393460 15958 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:40.429524 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 79387.6us
I20260709 12:16:40.429860 10124 raft_consensus.cc:1240] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:40.405143  9947 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 8 to 12, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 12 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } }
W20260709 12:16:40.458060 10203 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2272) took 1674 ms (client timeout 1597 ms). Trace:
W20260709 12:16:40.460603 10203 rpcz_store.cc:269] 0709 12:16:38.784016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.845607 (+ 61591us) service_pool.cc:224] Handling call
0709 12:16:40.457788 (+1612181us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000eabd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.457955 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849960832}
I20260709 12:16:40.466671 10199 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:40.467689 10200 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:40.480460 10735 raft_consensus.cc:2410] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:40.487490  9947 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 10 to 11, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 11 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.491815 10122 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:16:40.503168 16366 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.520051 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:40.524209 16330 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:40.529268 10128 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:16:40.534104 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.533988 15844 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:16:40.540635 16116 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:16:40.546384 10124 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:40.547375 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.549101 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:40.548146 10168 connection.cc:256] RPC call timeout handler was delayed by -1.2597684790002859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:16:40.511408  9947 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 12 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:40.549633 15958 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.563010 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:40.563920 10734 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:40.563711 15958 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:40.564862 16321 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 1.207s	user 0.000s	sys 0.003s
I20260709 12:16:40.563706 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.566084 15958 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.556154 15999 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:40.566882 15999 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.567795 16170 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:40.569772 15999 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.570451 15844 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:40.570827 10125 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:16:40.571200 10125 pending_rounds.cc:85] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 9
I20260709 12:16:40.571604 10125 pending_rounds.cc:107] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:16:40.571164 15844 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.571862 10125 raft_consensus.cc:2889] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:40.566045 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:40.572805 10052 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.573431 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:40.574251 10196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38760 (request call id 2265) took 2327 ms (client timeout 2112 ms). Trace:
W20260709 12:16:40.574676 10196 rpcz_store.cc:269] 0709 12:16:38.246502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.259010 (+ 12508us) service_pool.cc:224] Handling call
0709 12:16:40.573853 (+2314843us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540007e254. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.574068 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997385984}
I20260709 12:16:40.575831 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.576614 15844 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.576932 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.577551 10196 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:40.579159 10201 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:40.579663 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.582849 10200 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
W20260709 12:16:40.556056 16336 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.959s	user 0.005s	sys 0.000s
I20260709 12:16:40.580826 10201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2648) took 1878 ms. Trace:
I20260709 12:16:40.583901 10198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2651) took 1219 ms. Trace:
I20260709 12:16:40.584316 10201 rpcz_store.cc:276] 0709 12:16:38.702525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.702684 (+   159us) service_pool.cc:224] Handling call
0709 12:16:40.578724 (+1876040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:40.579703 (+   979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.580622 (+   919us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540007e250. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.580747 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4313565952}
W20260709 12:16:40.579100 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.584816 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1120) took 1217 ms. Trace:
I20260709 12:16:40.573424 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53880 (request call id 939) took 1683 ms. Trace:
I20260709 12:16:40.573477 10125 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:16:40.585659 10052 rpcz_store.cc:276] 0709 12:16:38.964410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.964571 (+   161us) service_pool.cc:224] Handling call
0709 12:16:40.518153 (+1553582us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003e7454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e787a3d 00007fc183757cd0 00007fc17ccdc254 00007fc17ccdc1e2 00007fc17ccdc111 00007fc17ccdc08c 00007fc17ccdb342 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.573300 (+ 55147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419086080}
I20260709 12:16:40.592419 10055 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:40.586350 10198 rpcz_store.cc:276] 0709 12:16:39.365002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.365123 (+   121us) service_pool.cc:224] Handling call
0709 12:16:39.365391 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.625524 (+260133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.583466 (+957942us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002215d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:40.583733 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587813120}
I20260709 12:16:40.563706 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:40.598968 10129 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:40.600013 16359 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.585469 10199 rpcz_store.cc:276] 0709 12:16:39.367391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.649349 (+281958us) service_pool.cc:224] Handling call
0709 12:16:40.459837 (+810488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:40.467182 (+  7345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.584639 (+117457us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54000eabd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.584765 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860274432}
I20260709 12:16:40.590672 16170 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.613750 10737 raft_consensus.cc:2410] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:16:40.583125  9947 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 6 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 12 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:40.619078 16384 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:16:40.619736 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:40.620607 10046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 932) took 3190 ms. Trace:
I20260709 12:16:40.620986 10046 rpcz_store.cc:276] 0709 12:16:37.430172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:38.328275 (+898103us) service_pool.cc:224] Handling call
0709 12:16:38.328584 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:38.328919 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:38.569317 (+240398us) log.cc:844] Serialized 14 byte log entry
0709 12:16:38.766694 (+197377us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:39.670708 (+904014us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800245560. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6712a6 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a
0709 12:16:40.393136 (+722428us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b2c000014c8. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:40.393688 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:16:40.501581 (+107893us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:40.501626 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.506752 (+  5126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:40.620263 (+113511us) raft_consensus.cc:1685] finished
0709 12:16:40.620283 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:40.620440 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26855,"prepare.queue_time_us":472828,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":691,"raft.queue_time_us":110794,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5002,"spinlock_wait_cycles":26776576,"thread_start_us":469723,"threads_started":3,"wal-append.queue_time_us":483693,"wal-append.run_cpu_time_us":2344,"wal-append.run_wall_time_us":1178850}
I20260709 12:16:40.623085 15844 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:40.623490 15844 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.623891 15844 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.623503 16359 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.627019 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.627704 16359 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.628423 16359 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:40.628988 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.629626 10204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1121) took 1261 ms. Trace:
I20260709 12:16:40.612421 15999 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.630016 16203 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:40.630609 15999 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.623620 16063 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.630009 10204 rpcz_store.cc:276] 0709 12:16:39.367600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.650919 (+283319us) service_pool.cc:224] Handling call
0709 12:16:39.670065 (+ 19146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:39.875656 (+205591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.629200 (+753544us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540003c5d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:40.629451 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287732992}
I20260709 12:16:40.633249 16063 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.635298  9947 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:16:40.639216 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47062.5us
I20260709 12:16:40.639671 10124 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:40.632737 15999 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.644657 10129 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:40.637164  9947 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 7 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 12 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.643671 16369 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.649068 16369 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.652326 10094 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:40.678396 16340 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 1.086s	user 0.001s	sys 0.002s
W20260709 12:16:40.678884 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 422087us
I20260709 12:16:40.679823 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.678776 16096 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:40.681273 16096 raft_consensus.cc:2764] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:16:40.681480 10019 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.684360 16114 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:40.685102 16114 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:40.685427 16114 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:40.685753 16114 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.696911 16063 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:40.708125 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 56745us
W20260709 12:16:40.709509 16379 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.291s	user 0.001s	sys 0.002s
I20260709 12:16:40.711665 16188 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:40.712460 15923 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:40.713598 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 1093) took 1457 ms (client timeout 1580 ms). Trace:
W20260709 12:16:40.714006 10735 rpcz_store.cc:269] 0709 12:16:39.256248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.258592 (+  2344us) service_pool.cc:224] Handling call
0709 12:16:40.713333 (+1454741us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540062c854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:40.713517 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798173568}
W20260709 12:16:40.682353 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 296070us
I20260709 12:16:40.715237 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:40.656390  9947 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 14, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 14 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:40.720166 16279 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:40.720691 16279 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:40.721901 16376 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:16:40.722348 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:40.723793 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75542.6us
I20260709 12:16:40.725265 16338 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.725517 16278 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.726238 16278 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:40.731402 10169 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.194:34999 timed out after 1.574s (SENT) [suppressed 35 similar messages]
I20260709 12:16:40.731832 16278 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:40.728109 16387 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:16:40.732929 16284 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:40.733345 16284 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:40.734083 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:40.734341 16284 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:40.728385 16063 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.725983 16338 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.734380 16050 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.747380 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.748199 10052 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.748997 10126 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:40.735419 16284 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:40.752080 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:40.752760 16137 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.753489 16137 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.755714 16137 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.756368 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:40.755990 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:40.757645 10729 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:40.735532 16226 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.758836 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.735991 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.759656 10053 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:40.756942 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.729434 16170 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.761435 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.737875 16063 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.758807 16226 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.739711 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.766646 10123 raft_consensus.cc:2410] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:40.766821 16226 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.740023 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.740176 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:40.768098 10198 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.726846 16355 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:40.739799 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.721962 16279 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.740505 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.744998 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:40.736510 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.736786 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.740428 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:40.812148 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.813864 10050 raft_consensus.cc:1240] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:16:40.810962 16279 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:40.827554 16170 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:40.831789 16389 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:16:40.813050 10048 raft_consensus.cc:1275] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:16:40.831921 16170 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.837005 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.837857 10050 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:40.746140 16050 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.840649 16050 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.811355 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:40.842041 10047 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:40.843230 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:40.844254 16225 consensus_queue.cc:1059] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:40.845537 16225 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:40.846691 10051 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:40.810185 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:40.848212 16369 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:40.835789 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.855535 16116 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:40.856701 16356 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:40.846367 16225 raft_consensus.cc:3055] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:40.814967 16203 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.797506 16063 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:40.809504 16188 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:16:40.867074 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57008.1us
I20260709 12:16:40.873420 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:40.885488 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 154236us
I20260709 12:16:40.890398 16300 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:40.890594 15958 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:40.890916 16300 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.891803 16300 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.892865 16300 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:40.893456 16355 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.894063 16355 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:40.893850 15958 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:40.894935 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:40.883432 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.897357 10048 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:40.898344 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.899046 10048 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:40.899870 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.900478 10048 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:40.901362 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.901890 10048 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:40.909835 10052 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:40.910945 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.911525 10052 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:40.912734 10052 raft_consensus.cc:1275] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:40.917048 16330 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:40.928051 10047 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:40.810940 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.797983 10046 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:40.737020 16366 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:40.868678 16116 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:40.860925 16170 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.745077 16285 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:40.966801 16285 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:40.967963 10054 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:40.744935 16338 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:40.966719 10047 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
W20260709 12:16:40.970942 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 97790.6us
I20260709 12:16:40.858141 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:40.954665 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:40.960639 16356 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:40.869807 16203 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:40.869321 16225 raft_consensus.cc:740] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:40.951104 16116 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:40.934028 16050 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:40.962237 15991 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.962502 15999 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.962323 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:40.744074 16096 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:40.981681 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 300322us
W20260709 12:16:41.020684 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 163017us
I20260709 12:16:40.989071 10198 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:40.947379 16366 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.870509 16188 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:41.000450 10051 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:40.927596 16114 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:40.989804 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 146643us
W20260709 12:16:41.003252 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49658.2us
I20260709 12:16:41.036417 10046 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:41.004501 16050 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.052621 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.032140 16366 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.041337 16301 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:41.053159 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:16:41.067713 10048 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:41.048960 15923 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.098572 15923 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.100888 15923 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.048530 16050 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:41.036698 16359 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.080s
I20260709 12:16:41.105691 16359 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:41.106117 16359 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:41.107190 16359 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.108616 16359 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.111501 16284 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.112142 16284 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.063009 16369 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:16:41.052999 15999 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.086297 16345 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:41.114886 16345 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.116145 15999 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.116899 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.117743 16345 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.088869 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:41.118613 16338 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:41.119164 15844 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.121222 16312 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:41.121798 16312 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:41.089337 16225 consensus_queue.cc:260] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.090755 16114 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.123291 16225 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:41.122962 16312 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.126019 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.126991 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:41.127876 16284 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:41.128681 16352 consensus_queue.cc:1175] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 12:16:41.081144 16301 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.129968 16301 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:41.134447 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.084159 15958 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:41.135178 15958 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:41.044211 16285 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.091581 16010 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.097121 16063 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:41.112473 16203 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:41.128114 16306 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:41.136224 16195 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:41.094750 16096 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.090440 16116 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.142299 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.127694 10125 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
W20260709 12:16:41.142264 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 73650.8us
I20260709 12:16:41.057794 16356 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:41.163684 10054 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:41.166569 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:41.172523 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.178972 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:41.037822 15991 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:41.205005 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.211439 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:41.216976 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:41.219411 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:41.220043 10125 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:41.216184 10122 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:41.179383 16285 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:41.249908 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.233779 10124 pending_rounds.cc:85] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 11
I20260709 12:16:41.253399 10124 pending_rounds.cc:107] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:16:41.253698 10124 raft_consensus.cc:2889] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:41.255811 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.256419 10126 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
W20260709 12:16:41.257308 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 231200us
I20260709 12:16:41.258271 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.258616 16137 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.259287 16137 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.269735 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 325478us
I20260709 12:16:41.136365 15958 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:41.284817 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 166496us
I20260709 12:16:41.257478 16404 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:41.160449 16369 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:16:41.299381 16404 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.304394 10130 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:41.305444 10734 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:41.305984 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.272377 15923 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:41.284930 16116 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:41.333222 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.333915 10730 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:41.334756 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:41.334897 10702 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:41.335058 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:41.187292 16010 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.336796 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.335765 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.359905 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.366602 16285 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:41.234090 16356 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.369359 16356 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.369868 16356 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.366070 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.341971 10204 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:41.309365 16137 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:41.379142 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 121008us
I20260709 12:16:41.374459 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:41.383226 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.370302 16356 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.384404 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.384694 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:41.385380 10052 raft_consensus.cc:606] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.385694 10052 raft_consensus.cc:614] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:41.385589 16356 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.431274 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.385892 16285 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:41.436208 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.383222 16225 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:41.443977 10737 raft_consensus.cc:2410] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:16:41.333036 16403 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 12:16:41.478219 16400 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:41.435907 15999 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:16:41.487468 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 121469us
I20260709 12:16:41.493233 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.447309 16225 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:41.493919 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50950.8us
I20260709 12:16:41.444060 15844 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.490852 15999 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.501788 16405 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:41.497181 10204 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:16:41.502173 16399 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:16:41.505472 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:41.492890 16355 consensus_meta.cc:287] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.001s
I20260709 12:16:41.495576 16330 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:41.527419 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 152824us
W20260709 12:16:41.531443 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.502811 16225 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:41.514534 15999 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.541435 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:41.543358 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.559495 16312 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:41.559970 16312 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.560297 16312 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:41.564369 10204 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:41.555840 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:41.569147 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 472267us
I20260709 12:16:41.541138 16188 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:41.593859 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51796.1us
I20260709 12:16:41.594630 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.569133 16137 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.599244 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:41.575559 16203 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:41.525347 16355 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.602973 10052 raft_consensus.cc:606] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.613294 10052 raft_consensus.cc:614] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:41.540969 16356 consensus_queue.cc:1048] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 12:16:41.606150 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51447.5us
I20260709 12:16:41.587007 16405 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:41.563050 16301 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:41.612882 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.590334 16345 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:41.587078 16369 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.617244 16405 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:41.626499 16395 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 12:16:41.627184 16345 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.627985 16392 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:16:41.628834 16391 log.cc:927] Time spent T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.403s	user 0.002s	sys 0.000s
W20260709 12:16:41.612494 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2741) took 1611 ms (client timeout 1574 ms). Trace:
I20260709 12:16:41.624588 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.617906 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.634136 10127 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:41.631076 10121 rpcz_store.cc:269] 0709 12:16:39.910941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:39.911739 (+   798us) service_pool.cc:224] Handling call
0709 12:16:41.514440 (+1602701us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001e4454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:41.522558 (+  8118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433771392}
I20260709 12:16:41.612864 16203 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.641691 10701 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:41.639046 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 44348.4us
I20260709 12:16:41.602810 16170 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:41.618053 16063 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.623974 16355 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.660156 10736 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:41.659219 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38758 (request call id 2668) took 1087 ms. Trace:
I20260709 12:16:41.661044 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.661667 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
W20260709 12:16:41.662133 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 286994us
I20260709 12:16:41.650826 16203 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.664501 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:41.642894 16404 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:41.656512 16195 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:41.660872 10196 rpcz_store.cc:276] 0709 12:16:40.571494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.578112 (+  6618us) service_pool.cc:224] Handling call
0709 12:16:40.588392 (+ 10280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:40.644470 (+ 56078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:40.644502 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:40.649386 (+  4884us) log.cc:844] Serialized 26 byte log entry
0709 12:16:40.919495 (+270109us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:40.919537 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:40.919609 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:41.659002 (+739393us) raft_consensus.cc:1685] finished
0709 12:16:41.659021 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:41.659161 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27966,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":269669,"threads_started":1,"wal-append.queue_time_us":618340}
I20260709 12:16:41.671293 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:41.673283 10094 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:41.636566 16369 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:41.675542 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 51036.1us
I20260709 12:16:41.675601 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:41.479079 16400 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.576009 16330 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.650411 16137 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.685645 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.672704 16195 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.672441 16402 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.675202 16404 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:41.694185 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:41.694873 10052 raft_consensus.cc:606] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.695191 10052 raft_consensus.cc:614] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:41.627039 16405 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.693109 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.701689 16402 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.702916 16137 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.698849 15844 raft_consensus.cc:2764] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:16:41.703567 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.703824 16402 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:41.692728 16404 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.704484 16404 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.704846 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.690435 16195 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:41.709901 10728 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:41.688571 16170 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:41.676774 16063 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.720996 16137 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.721567 16137 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.724682 16137 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:41.725196 16396 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:16:41.705583 16400 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.718930 16402 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:16:41.707367 16401 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:41.728045 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.728443 16063 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.730012 16411 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:41.730587 16063 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:41.731002 16063 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:41.731607 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:41.732401 10052 raft_consensus.cc:606] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.731712 16063 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:41.735878 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:41.736095 16330 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.736550 10052 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.736958 10052 raft_consensus.cc:614] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:41.738121  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:16:41.738706 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 72062.7us
I20260709 12:16:41.740010  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:41.740058 10019 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.741326  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:41.742597 16285 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:41.744549 16301 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.747758 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:41.748533 16170 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:41.748922 16170 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.749301 16170 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:41.750615 15844 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.751170 15844 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:41.753114 15844 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.755323 16401 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:41.756399 16300 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:41.756323 16401 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.756850 16300 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:41.730952 16420 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:41.758113 16420 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:41.759032 16420 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.757287 16050 consensus_meta.cc:287] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.655s	user 0.003s	sys 0.007s
I20260709 12:16:41.742167 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.731083 16369 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.730561 16411 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:41.778556 16415 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:16:41.764885 16010 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:41.781033 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 53102us
I20260709 12:16:41.782718 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.783121 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2766) took 1043 ms. Trace:
W20260709 12:16:41.783123 16417 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 12:16:41.784121 16400 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:41.785307 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.783536 10127 rpcz_store.cc:276] 0709 12:16:40.739262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.739793 (+   531us) service_pool.cc:224] Handling call
0709 12:16:41.782922 (+1043129us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400174154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:41.783059 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980750208}
I20260709 12:16:41.757406 16170 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:41.805253 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 145226us
W20260709 12:16:41.809756 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 67660us
I20260709 12:16:41.787756 16411 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.784849 16400 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:41.783712 16403 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:41.765587 16050 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.810534 16330 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:41.853051 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:41.853225 16424 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:41.852754 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 68907.6us
I20260709 12:16:41.757716 16300 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.859189 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.859915 15844 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:41.860107 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:41.873518 16063 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.877928 16359 consensus_meta.cc:287] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.001s
I20260709 12:16:41.803934 16416 consensus_queue.cc:1048] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:16:41.819526 15999 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.844776 16278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.018s	sys 0.042s
W20260709 12:16:41.894742 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.007s
I20260709 12:16:41.848974 16330 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:41.900911 15999 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:41.901343 16063 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:41.896579 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 254955us
I20260709 12:16:41.904102 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.904942 10196 raft_consensus.cc:2410] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:16:41.904999 16195 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.906581 16300 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:41.908784 16404 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.909579 16330 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:41.911666 16050 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.925815 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.913909 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:41.894337 16278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.019s	sys 0.043s
I20260709 12:16:41.893432 16402 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:41.895776 16010 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:41.912452 16312 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.926612 10196 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:41.923403 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.883678 16400 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:41.931820 10200 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
W20260709 12:16:41.927151 16116 consensus_meta.cc:287] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 12:16:41.930737 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:41.942799 10203 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:41.940126 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:41.929338 10731 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:41.920110 16203 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:41.899652 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.015s	sys 0.007s
I20260709 12:16:41.930346 16010 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:41.963960 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 629238us
W20260709 12:16:41.967778 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44449us
I20260709 12:16:41.941810 16403 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:41.960485 16010 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:41.961882 16366 consensus_meta.cc:287] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.817s	user 0.005s	sys 0.006s
I20260709 12:16:41.966892 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:41.973620 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:41.971253 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:41.961048 15999 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:41.975579 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 84494us
I20260709 12:16:41.978726 10169 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:41.978840 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:41.970901 16050 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:41.980844 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53087.9us
I20260709 12:16:41.983454 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:41.984016 10126 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.973979 16195 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.992574 10127 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:41.988655 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:41.981884 16416 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:41.979878 16170 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.997138 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.997637 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:41.998864 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:41.999621 16114 raft_consensus.cc:993] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:16:42.000094 16114 raft_consensus.cc:1081] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:16:42.000392 10019 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.000655 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.001441 10195 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:42.003019 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:42.006812 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.007870 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.008329 10200 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:42.010669 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.011199 10124 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:42.011716 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.012315 10196 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:42.013057 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.015924 16203 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.013322 16285 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:41.979877 15999 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:41.992097 16278 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.018410 16312 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.018580 10729 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:41.972366 16424 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:16:42.019234 16424 consensus_queue.cc:1243] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:41.977833 16366 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.019392 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.018172 16278 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.019586 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.024423 10202 raft_consensus.cc:2393] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.000003 10169 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.022110 10728 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.019692 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:42.023761 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.036199 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:16:42.037014 10126 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
W20260709 12:16:42.037838 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68307.9us
I20260709 12:16:41.987694 16188 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:42.041050 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:42.045702 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45806.3us
I20260709 12:16:42.046396 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.046499 10734 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:16:42.047823 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:42.048233 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.046057 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.047106 10196 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.021427 16366 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:41.988253 16430 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:42.051697 16114 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.084729 16114 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.085189 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 2886) took 1350 ms. Trace:
I20260709 12:16:42.085546 10054 rpcz_store.cc:276] 0709 12:16:40.734930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.736442 (+  1512us) service_pool.cc:224] Handling call
0709 12:16:42.085004 (+1348562us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002486d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:42.085112 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369076480}
I20260709 12:16:42.086645 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.086759 16114 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.056283 16278 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:41.997583 16416 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.087152 10054 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:42.087409 16416 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:41.997892 16063 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:42.088323 16063 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.088898 16063 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.090905 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.092056 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.093484 10050 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:42.094734 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2691) took 1233 ms. Trace:
I20260709 12:16:42.095038 10050 rpcz_store.cc:276] 0709 12:16:40.861566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:40.962049 (+100483us) service_pool.cc:224] Handling call
0709 12:16:42.093316 (+1131267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:42.093840 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.094567 (+   727us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002486d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:42.094680 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600828800}
I20260709 12:16:42.096315 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.097043 10050 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:42.097831 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.057654 16405 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.101154 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.051316 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.102840 10127 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.047155 10734 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.103868 16188 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:16:42.103673 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52775.1us
I20260709 12:16:42.111024 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:42.106990 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.111052 10734 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.112488 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.112488 10734 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:42.113118 10735 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
W20260709 12:16:42.115638 16225 consensus_meta.cc:287] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:16:42.116120 16225 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.062071 16285 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:42.064280 15999 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.022989 16404 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.117748 16404 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:42.118125 16225 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.066556 15991 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.069769 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.071103 16195 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:42.119019 10053 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.071970 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.121503 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.122148 10195 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:42.122850 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.073541 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.123996 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.124997 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.074180 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.021303 16400 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.074651 16345 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.075134 10055 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:42.075933 16170 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:42.125871 10046 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:16:42.071869 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.126530 10047 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:42.112079 16426 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.329s	user 0.004s	sys 0.001s
I20260709 12:16:42.127825 10053 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:42.079146 10197 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:42.079749 16010 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.080367 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.080462 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.081146 16050 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:42.081969 10200 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:42.049590 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.082950 10203 raft_consensus.cc:2393] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:42.134079 10734 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:42.074669 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.038141 16422 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:42.137502 10728 raft_consensus.cc:2410] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:16:42.116806 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.072896 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.130159 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.131800 10124 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:16:42.138279 10053 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:42.138216 10049 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
W20260709 12:16:42.142853 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.143882 16404 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.103027 10204 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:42.149080 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.126009 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:42.135298 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.135300 10051 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.098326 10050 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 14.
I20260709 12:16:42.083696 16402 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:42.135874 10200 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:42.082087 16096 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.136226 10126 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.134306 10199 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:42.157315 10197 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:42.170886 10051 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
W20260709 12:16:42.168332 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 201509us
I20260709 12:16:42.177129 10053 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:42.172858 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.178719 10126 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:42.181445 16422 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:42.182554 16422 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:42.182901 16422 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:42.183806 16422 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.185160 16422 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.186671 16096 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.187227 16096 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.189473 16096 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.190887 10126 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:16:42.156389 16345 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:42.199185 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 153190us
I20260709 12:16:42.200296 10123 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:42.200966 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.202955 10198 raft_consensus.cc:2410] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:16:42.205667 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.206378 10124 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.206588 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.207137 10126 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:42.207405 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:42.207782 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.201663 10728 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
W20260709 12:16:42.209399 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44832.1us
I20260709 12:16:42.210371 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.216817 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.217731 10126 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.213057 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.215114 10127 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
W20260709 12:16:42.222999 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 1.804s (SENT)
I20260709 12:16:42.223265 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.223834 10735 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:42.223417 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:42.271178 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62789.7us
W20260709 12:16:42.272568 16351 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:16:42.284567 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.290331 10734 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:42.290819 10197 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:42.216389 16402 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.274693 16416 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.276690 16330 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.219832 15844 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:42.219846 16345 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.217896 16195 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:16:42.277791 16063 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.223861 16300 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:42.178766 16411 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.218081 16356 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:42.280987 16116 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.278355 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.283385 10055 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:42.351377 10728 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:42.270447 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.283684 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.284642 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.199328 15991 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:42.288657 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.287556 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.289304 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.287297 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:42.290156 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.353025 10127 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:42.348858 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.354012 10121 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:42.353183 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 65943.5us
I20260709 12:16:42.297911 10204 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:42.298064 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:42.299943 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.315775 10046 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:42.283375 16404 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:42.355195 10125 raft_consensus.cc:2376] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17. Re-sending same reply.
I20260709 12:16:42.358418 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.359087 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.349678 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.349893 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.359870 10051 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:42.350651 10198 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:42.355684 10052 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:42.348723 16402 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:42.363415 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75926.6us
I20260709 12:16:42.364307 16411 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.364941 16402 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.365455 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.365675 10094 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.366496 16441 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:42.366880 16441 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.367241 16441 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:42.367902 16063 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.298273 16096 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:16:42.370705 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:42.374785 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 158524us
I20260709 12:16:42.375794 16345 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.377107 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.377321 16345 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:42.377681 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.384124 16345 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:42.384763 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.359905 10128 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:42.377883 15844 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:42.378585 16010 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.385861 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.385005 16345 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.378909 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.379832 10735 pending_rounds.cc:85] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 10
I20260709 12:16:42.387169 10735 pending_rounds.cc:107] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:16:42.386914 16441 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.374830 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.350623 16225 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:42.387624 16416 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.388051 10122 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.387452 10735 raft_consensus.cc:2889] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:42.390009 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.388906 16441 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.390749 10128 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.391481 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.391614 16330 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.391984 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:42.392771 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.393718 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.395159 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.395723 10127 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:42.388851 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:42.399174 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 101190us
I20260709 12:16:42.400017 10124 raft_consensus.cc:2410] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:16:42.362275 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:42.396485 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.403069 10127 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.394299 10128 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.398723 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:42.408972 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.409513 10125 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:42.410125 10197 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:16:42.411440 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.412807 10095 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.407769 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.415181 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.415897 10046 raft_consensus.cc:2393] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:42.416397 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.416549 10128 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:42.416919 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.413681 16422 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:42.418913 16096 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:42.419219 16411 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:42.419684 16063 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:42.420326 16402 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.419018 16422 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.421126 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.414198 16356 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:42.411360 15991 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:42.422600 15991 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.419816 16411 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:42.422952 15991 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.420872 16402 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.422986 16422 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.358302 16285 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:42.420745 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.442543 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.419335 16351 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:42.445417 10095 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.428217 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.446152 10123 raft_consensus.cc:2393] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:16:42.446529 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45021.3us
I20260709 12:16:42.451380 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.452059 10702 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.453028 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.453612 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:42.470077 10051 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:42.471081 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.441921 16430 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:16:42.452229 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 81368.7us
I20260709 12:16:42.471910 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.419870 16300 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:42.472512 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.476706 10049 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:42.409860 16116 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.469125 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.445098 16050 raft_consensus.cc:2764] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:16:42.450510 16400 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:42.453241 16416 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:42.476747 10046 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:42.484362 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.450631 16446 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.471910 10052 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:42.481411 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.472227 16137 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:42.489818 16406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.020s	sys 0.028s
I20260709 12:16:42.492069 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.473376 16285 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:42.472286 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.494908 16369 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:42.495669 16300 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:42.473522 16351 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.478276 16359 raft_consensus.cc:2804] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:42.497782 10126 raft_consensus.cc:2376] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20. Re-sending same reply.
I20260709 12:16:42.483052 16430 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:42.519156 16416 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:42.519477 16444 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:42.519953 16444 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:42.520133 16416 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.448660 16356 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:16:42.507157 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:42.500414 16406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.021s	sys 0.028s
I20260709 12:16:42.477986 15923 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:42.454157 16404 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:16:42.519181 16430 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.516937 16063 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:42.517490 16369 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:42.518235 16116 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.480791 16366 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:42.538831 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65594.7us
I20260709 12:16:42.515486 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.524956 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.485839 16405 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:42.476257 16188 consensus_queue.cc:1059] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:16:42.423687 16411 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:42.527861 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51325us
I20260709 12:16:42.513582 16050 raft_consensus.cc:2764] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:16:42.530763 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.548996 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.541601 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:42.542562 10048 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:42.550493 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.551155 10048 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.549542 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.531749 16137 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:42.526938 16444 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.529974 16359 raft_consensus.cc:697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.517429 16300 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.567540 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.557139 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.542135 16063 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.569592 16063 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.529901 16351 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.559072 16441 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:42.538470 16402 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.559705 16424 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:42.561839 10198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:16:42.574065 16424 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:42.544008 16366 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.562553 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.575208 10202 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:42.536163 16369 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:42.535737 15923 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:42.575426 16424 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.576337 15923 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.577147 16441 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:42.564004 16404 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:42.568228 10196 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:42.581710 10121 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:42.564819 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.566942 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.582490 10127 raft_consensus.cc:1240] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:16:42.583070 10200 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:42.562045 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.574095 10198 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.583913 10198 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:42.584163 10199 raft_consensus.cc:2410] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:16:42.589507 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.590106 10019 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.587925 16402 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:16:42.567456 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52037.2us
W20260709 12:16:42.594698 16450 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:16:42.580204 16404 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:42.585615 16420 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:42.601262 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.622220 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.624140 16356 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:42.624462 16441 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:42.625463 16050 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:16:42.639088 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49079.9us
I20260709 12:16:42.631989 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.645296 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.649262 10048 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:42.650229 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.604426 16010 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:42.655985 10702 leader_election.cc:336] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Timed out: RequestConsensusVote RPC to 127.8.178.193:45801 timed out after 2.003s (SENT)
I20260709 12:16:42.652367 10019 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.652246 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:42.648779 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.656481 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.643896 10198 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.600489 16285 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.653069 16400 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:42.663264 16400 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.666882 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:42.667201 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 185920us
W20260709 12:16:42.670125 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.660591 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.672307 10019 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.677950 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.678714 10050 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.679997 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.680974 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:16:42.643813 16452 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:16:42.672899 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:42.623082 16420 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.686115 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.688831 10198 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.690740 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.692505 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.693133 10048 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:42.698021 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.698699 10049 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:42.677975 16416 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:42.677618 16096 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.684939 16170 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:42.711627 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.712683 10048 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:42.711887 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.595575 16359 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.715080 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:42.665920 16010 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.718068 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.724089 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.725061 16463 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:42.697624 16462 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:42.708596 16416 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.713976 16170 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.715974 16137 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:42.740922 16137 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.743655 16137 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:42.745800 16137 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:42.747315 16137 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:42.750284 16137 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.750917 16137 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.753317 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.754063 10048 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 14.
I20260709 12:16:42.725091 16345 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:42.758179 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.759212 10198 raft_consensus.cc:3060] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:42.715161 16096 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.733338 16416 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:42.754824 16170 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:42.765606 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:42.760479 16453 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:16:42.768692 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.757592 16203 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:42.761224 16345 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.697875 16369 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.778333 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:42.776599 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.739840 16463 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:16:42.723337 16404 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.786820 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.779145 10047 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 19: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:42.753172 16468 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:16:42.787739 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:42.774471 16345 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:42.807195 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.808075 10047 raft_consensus.cc:2410] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:16:42.808903 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.809895 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.812093 10050 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:42.813031 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:42.813210 10198 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:42.775329 16403 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:42.774549 16472 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:42.798156 16203 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:42.818655 10049 raft_consensus.cc:2468] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:42.849992 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.852794 16203 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.853457 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:42.757632 16420 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:42.828258 16464 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.051s	user 0.003s	sys 0.003s
I20260709 12:16:42.859856 10049 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:42.859758 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:42.862373 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:42.866629 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 215026us
I20260709 12:16:42.867013 10198 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:42.864559 10048 raft_consensus.cc:1240] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:42.867769 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.873349 10737 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:42.873406 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.855000 16474 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:42.877370 10734 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.887180 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.887969 10198 raft_consensus.cc:2393] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:42.854964 16442 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.156s
I20260709 12:16:42.868001 16411 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:42.893611 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.898764 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:42.899856 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:42.901540 10731 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.876968 16446 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:42.893501 16351 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:42.946022 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:42.946743 10198 raft_consensus.cc:3060] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:42.946933 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53395.8us
I20260709 12:16:42.941246 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
W20260709 12:16:42.944008 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 232212us
I20260709 12:16:42.882186 16403 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:42.943876 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.950599 10729 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
W20260709 12:16:42.945681 15991 consensus_meta.cc:287] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.001s
I20260709 12:16:42.901146 16411 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:42.953631 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 165953us
I20260709 12:16:42.953320 16484 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:42.960640 16471 log.cc:927] Time spent T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:16:42.961211 16473 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:42.961781 16473 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:42.964072 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:42.965102 16461 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.343s	user 0.004s	sys 0.000s
I20260709 12:16:42.957171 15991 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.965510 16476 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:42.966106 16476 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.967494 10054 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:42.954821 16403 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:42.950043 16351 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:42.967998 16351 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:42.969159 16403 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.967052 15991 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:42.969947 16469 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:16:42.970511 16467 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:42.970954 16467 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.971285 16467 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:42.965369 16010 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.949862 16203 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:42.955261 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.957813 10055 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:42.904589 16330 raft_consensus.cc:3055] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:16:42.959281 16411 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:42.986179 10731 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:42.988175 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.889091 16474 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:42.966960 16096 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:42.998126 10198 raft_consensus.cc:2468] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:43.008571 10701 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:43.009372 16428 raft_consensus.cc:2804] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:43.009861 16428 raft_consensus.cc:697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:42.991777 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.010839 16428 consensus_queue.cc:237] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.017352 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.997849 10130 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:16:43.003595 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 226796us
I20260709 12:16:43.018863 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.019114 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:42.999073 10094 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:42.999963 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:42.982161 16330 raft_consensus.cc:740] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:42.992462 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.021595 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:43.020426 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:42.995797 16468 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:43.022938 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.024322 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.029960 10197 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:43.028517 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.032141 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.043959 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.055255 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.007016 16472 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:43.026203 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:43.024003 16491 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:43.071175 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48547.2us
I20260709 12:16:43.029825 16096 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:43.070783 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.025465 16114 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:43.033666 16403 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:43.029354 15991 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:43.025682 16468 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.077235 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.085726 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.075119 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.086088 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:43.077454 10126 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:43.076602 10730 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:43.044691 16462 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:43.033311 16487 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:43.093662 16359 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.093752 16475 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:43.094131 16457 raft_consensus.cc:2804] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:43.074316 16116 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:43.064254 16170 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.076448 16114 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:43.108786 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.087419 16403 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:43.092959 16468 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:43.099001 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.128832 16476 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.074610 16430 consensus_queue.cc:1059] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:16:43.182664 16116 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:43.221910 16116 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.222386 16439 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:43.223361 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 154723us
W20260709 12:16:43.210211 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 138444us
I20260709 12:16:43.224447 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:43.211243 16489 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:16:43.214629 16481 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:16:43.214937 16494 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:43.215291 16478 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.178503 16424 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:43.220896 10129 raft_consensus.cc:2368] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
W20260709 12:16:43.225701 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 126790us
I20260709 12:16:43.185503 16403 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:43.174898 16345 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.205269 16457 raft_consensus.cc:697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:43.183588 16114 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:43.219574 16359 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:43.179256 16475 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.237169 15991 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.099001 16330 consensus_queue.cc:260] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.253958 10020 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.263309 16345 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.263873 16170 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.266837 16475 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.272217 16474 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:43.273332 16499 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:16:43.274940 16466 log.cc:927] Time spent T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.574s	user 0.000s	sys 0.004s
W20260709 12:16:43.276835 16493 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:16:43.278155 16458 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.662s	user 0.000s	sys 0.011s
I20260709 12:16:43.240346 16424 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:43.281857 16278 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:43.282493 16278 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:43.278947 16446 consensus_queue.cc:1059] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:43.265856 16467 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.294488 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.295143 10728 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:43.299505 16424 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.302829 16278 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.227264 16472 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.307808 10125 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:16:43.308820 16496 log.cc:927] Time spent T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:16:43.309322 16457 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.311129 16422 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:43.311550 16422 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:43.312703 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:43.314136 16460 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.697s	user 0.000s	sys 0.002s
I20260709 12:16:43.268527 16416 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.315909 16416 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.306706 16468 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.319554 10202 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:43.319916 16468 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:43.320413 16137 consensus_meta.cc:287] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.002s
I20260709 12:16:43.320845 16137 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.322769 10047 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 17: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:43.323722 16467 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.324111 16403 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.325019 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2893) took 1040 ms. Trace:
I20260709 12:16:43.325793 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.326118 16403 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.340092 16401 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:43.290891 16351 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.342635 10737 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:43.325369 10053 rpcz_store.cc:276] 0709 12:16:42.284855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.284985 (+   130us) service_pool.cc:224] Handling call
0709 12:16:42.285262 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:42.310106 (+ 24844us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:16:42.310148 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:42.354335 (+ 44187us) log.cc:844] Serialized 26 byte log entry
0709 12:16:42.475427 (+121092us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:42.475473 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:42.475534 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:43.277457 (+801923us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:43.324749 (+ 47292us) raft_consensus.cc:1685] finished
0709 12:16:43.324772 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:43.324961 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342,"raft.queue_time_us":6522,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":3469568,"thread_start_us":104204,"threads_started":1,"wal-append.queue_time_us":170407}
I20260709 12:16:43.312408 16422 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.334609 10732 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:43.344139 16422 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:43.344990 16096 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:43.289182 16446 consensus_queue.cc:1243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:16:43.334254 16444 consensus_meta.cc:287] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.000s
I20260709 12:16:43.346504 16444 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:43.347448 16114 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.348160 16351 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.338235 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.340255 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.325810 16404 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:43.343053 16137 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.348606 16444 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.337642 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.336727 16411 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.353047 10728 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
I20260709 12:16:43.356033 10732 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
W20260709 12:16:43.356746 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 106096us
I20260709 12:16:43.381224 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.382051 10127 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:43.378227 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:43.384641 16345 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:43.385190 16345 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:43.386088 16345 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:43.394255 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.395228 10125 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:16:43.396474 16484 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:43.403273 10201 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:16:43.410610 16457 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.416319 16457 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:43.409313 16285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.010s	sys 0.004s
I20260709 12:16:43.404280 16484 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:16:43.419766 16369 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:43.426180 16465 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.695s	user 0.000s	sys 0.003s
I20260709 12:16:43.428988 16457 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:43.424428 16285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.010s	sys 0.004s
I20260709 12:16:43.437777 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.417876 16114 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.436713 16411 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.461680 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.462373 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.463698 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.464473 10728 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 15: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:43.465241 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.465711 10049 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:43.464884 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.467571 10201 raft_consensus.cc:2393] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:43.470325 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.471419 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.472637 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.473716 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.474656 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.474176 10202 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:43.472517 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.476158 10729 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:43.464383 16404 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.478840 16400 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.474220 15999 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:43.489913 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.496218 10052 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:43.490794 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.492161 10050 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:16:43.499500 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.499742 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.500105 10201 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:43.502102 16330 raft_consensus.cc:3060] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:43.473990 16411 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:43.502653 16473 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.495445 16404 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.509667 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.510226 10050 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:43.502761 10197 raft_consensus.cc:2393] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:43.502868 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.511544 10127 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:43.504164 10054 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:16:43.512248 10046 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:43.505724 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.508347 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.515269 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.515785 10046 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:43.519236 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.519840 10055 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:43.520573 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.521166 10127 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:43.521906 10201 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:43.523900 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.524477 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.528337 10052 raft_consensus.cc:2393] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:43.531029 16137 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:43.532596 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.533339 10095 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:43.535650 10019 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:43.552879 10201 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:43.558017 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.558578 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:43.559824 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.561058 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.562616 10050 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:43.564481 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:43.564925 16518 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:16:43.565279 16170 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:43.566860 16170 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:43.568878 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:43.570946 16355 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:43.571389 16355 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.571708 16355 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:43.525615 16050 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.575104 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.576488 10020 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.508934 16411 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.579324 10202 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:43.579680 10127 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:43.578965 16480 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:43.586097 16507 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:43.558455 16462 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:43.564414 16300 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:43.587927 16300 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.588333 16300 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:43.577345 16096 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:43.590979 16096 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:43.591382 16096 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:43.595937 16479 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:43.523710 15999 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:16:43.598045 16462 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:43.598994 16462 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.599817 16411 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.600664 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.577406 16487 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:43.577507 16468 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:43.621153 16404 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:43.627569 16516 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 12:16:43.624801 16405 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.660744 10053 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:16:43.662446 16515 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 12:16:43.684846 16405 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.707785 10121 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
W20260709 12:16:43.725052 16456 log.cc:927] Time spent T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.094s	user 0.005s	sys 0.004s
I20260709 12:16:43.734336 16096 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.735008 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.735889 10734 raft_consensus.cc:2368] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:43.736706 16096 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.745353 16355 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.745752 10126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2779) took 1101 ms. Trace:
I20260709 12:16:43.745675 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.746325 10126 rpcz_store.cc:276] 0709 12:16:42.644016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.644144 (+   128us) service_pool.cc:224] Handling call
0709 12:16:42.668940 (+ 24796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.092141 (+423201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.745492 (+653351us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54000997d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:43.745671 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939044736}
I20260709 12:16:43.747268 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2783) took 1100 ms. Trace:
I20260709 12:16:43.747735 10129 rpcz_store.cc:276] 0709 12:16:42.646987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.647097 (+   110us) service_pool.cc:224] Handling call
0709 12:16:43.747062 (+1099965us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54003d1154. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:43.747201 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242082560}
I20260709 12:16:43.749110 16355 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.749680 16355 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.757385 16405 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.760074 16369 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:16:43.761504 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.767601 10169 leader_election.cc:400] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:43.768021 16402 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:43.769732 10198 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:16:43.770108 16402 consensus_queue.cc:1243] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:16:43.770605 16402 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:43.768741 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.769084 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.770906 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:43.769196 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.769678 10169 leader_election.cc:403] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:43.773479 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:43.773871 10202 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:16:43.779063 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.779789 10129 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:43.750121 16355 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.778633 16422 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:43.770921 16402 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:43.761512 16369 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:16:43.794214 10200 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:16:43.763209 16300 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.799368 16400 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.799885 10200 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:43.799634 16402 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.800732 15844 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:43.802680 10199 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:16:43.803030 10199 pending_rounds.cc:85] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 9
I20260709 12:16:43.803236 10199 pending_rounds.cc:107] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:16:43.803467 10199 raft_consensus.cc:2889] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:43.804041 16424 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:43.805321 10126 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:43.800850 16402 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:43.806092 16424 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.806998 15844 consensus_queue.cc:1059] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:43.807963 16369 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:43.808701 16424 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.809926 15844 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:43.810379 15844 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:43.812592 15844 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.806728 16404 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:16:43.814241 16366 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.815398 16300 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.814504 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:43.814307 16404 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:16:43.798712 16459 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.165s	user 0.002s	sys 0.006s
I20260709 12:16:43.799988 16400 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.824477 16366 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.829974 10169 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:43.830557 16114 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.842330 10055 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:43.833369 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.847003 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.845275 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 949) took 1353 ms. Trace:
I20260709 12:16:43.847914 10049 rpcz_store.cc:276] 0709 12:16:42.491572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.865264 (+373692us) service_pool.cc:224] Handling call
0709 12:16:42.875144 (+  9880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:43.466123 (+590979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:43.845050 (+378927us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54003e7454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:43.845214 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357771136}
I20260709 12:16:43.850816 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.821283 16404 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:43.849813 16403 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.866664 10049 raft_consensus.cc:1240] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:16:43.858664 16411 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:43.869189 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.860270 16424 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:43.871163 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.872331 10055 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:43.862591 15844 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:43.875202 10046 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:43.875624 10046 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:43.875598 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.854705 16467 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:16:43.849886 16114 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.872694 16411 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:43.891160 16411 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:43.891616 10124 raft_consensus.cc:1240] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:43.872671 16404 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.893667 16188 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.894124 16188 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:43.898567 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 274280us
I20260709 12:16:43.899307 16400 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.900766 10168 leader_election.cc:400] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 14. Current term is 15.
I20260709 12:16:43.880527 10055 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:43.902315 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:43.902925 10734 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:43.902253 16188 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:43.905859 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 150930us
I20260709 12:16:43.849931 16366 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.884239 10197 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:16:43.921511 10197 pending_rounds.cc:85] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 11
I20260709 12:16:43.921780 10197 pending_rounds.cc:107] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:16:43.879506 10046 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:43.922014 10197 raft_consensus.cc:2889] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:43.890647 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:43.912868 10734 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
W20260709 12:16:43.924546 10121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 2284) took 1298 ms (client timeout 1544 ms). Trace:
W20260709 12:16:43.924968 10121 rpcz_store.cc:269] 0709 12:16:42.625714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.651969 (+ 26255us) service_pool.cc:224] Handling call
0709 12:16:43.924387 (+1272418us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001d6854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:43.924493 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2392860416}
I20260709 12:16:43.925269 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.926729 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.927794 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.929725 10055 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:43.930758 10048 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:43.931107 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.931972 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.890851 16355 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.930665 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:43.940502 10050 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:43.940379 10054 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:43.894327 16404 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:43.878858 16424 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:43.945598 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.944605 10049 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:43.947144 10051 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:16:43.947755 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.948904 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:43.948307 10046 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:43.950685 10124 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:43.951187 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:43.954044 10737 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:16:43.941403 16439 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:43.944013 16355 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:43.951746 16351 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:16:43.964375 16366 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:43.964540 15999 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:43.945573 16010 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:43.965914 16010 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.966279 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.967005 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.968037 16010 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.968196 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:43.968999 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:43.969566 10053 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:43.970854 16439 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.972983 16439 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:43.973470 16488 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:43.974457 16225 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:43.974666 16411 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.976887 16411 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:43.951973 16203 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:16:43.982807 16424 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.987253 16462 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:43.987696 16462 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:43.987772 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:43.988246 16539 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:16:43.988590 16462 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:43.958082 16494 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:43.998886 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:44.000130 16355 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.002357 16355 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:44.003575 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.003939 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:44.004827 10198 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 15: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:44.005028 16538 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:16:44.003857 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:44.006655 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:44.009377 16114 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:44.009704 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:44.010752 16356 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:44.011313 16356 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.013473 16356 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:44.022836 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:44.035095 10199 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:44.038410 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.038607 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.040241 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.040750 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.041643 10199 raft_consensus.cc:2410] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:16:44.043051 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.043866 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:44.045840 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:44.046864 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.048221 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.048341 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:44.049234 10195 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:44.050945 16188 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.051462 16400 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:44.051823 10203 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:44.052191 16400 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:44.052977 10203 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:16:44.056349 16010 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:44.059403 16422 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:44.060067 16422 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:44.061141 16403 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:44.061513 16403 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:44.046419 10737 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:44.063567 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:44.066818 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 101421us
I20260709 12:16:44.068562 10201 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:44.027652 16462 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:44.065769 16355 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.076339 16114 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:44.062295 16403 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.092934 10731 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:44.093073 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:44.102560 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.090929 16403 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:44.101133 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:44.076948 16402 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:16:44.105257 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.112517 10054 raft_consensus.cc:1275] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:44.110751 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:44.127882 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.081782 16441 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 12:16:44.127912 10021 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.083564 16010 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:16:44.144060 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.144878 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.091387 16351 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:16:44.119760 16400 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:44.127245 16468 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:44.150662 16484 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:16:44.149396 16300 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:16:44.158951 16405 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:44.094434 16116 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:16:44.088913 16355 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:44.091189 16114 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:44.132184 16476 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:44.146145 16096 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:44.180119 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:44.183893 10051 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:44.167032 16468 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.169939 16457 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:44.199071 10129 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:44.192118 16400 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:44.178828 16411 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:44.203419 16114 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:44.204696 16543 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:16:44.205083 16330 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:44.192601 16096 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.186662 16345 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:16:44.196847 16476 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:44.206714 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.198108 16468 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.208774 10046 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:44.209594 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.166038 16442 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:16:44.184839 16446 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:44.218657 10195 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:44.220429 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:44.253959 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 148765us
I20260709 12:16:44.187533 16063 consensus_queue.cc:1048] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:16:44.265888 10055 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:44.264873 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:44.269672 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.267474 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:44.263085 16551 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:44.254069 16457 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:44.274806 16552 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:16:44.275856 16416 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:16:44.284477 16540 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:16:44.285252 16546 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:16:44.289299 10195 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:16:44.299597 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.300288 10051 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:44.301118 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.259296 16330 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:44.303089 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 159095us
I20260709 12:16:44.287547 16411 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:44.309008 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 198321us
I20260709 12:16:44.310171 10733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52022 (request call id 1119) took 1412 ms. Trace:
I20260709 12:16:44.304177 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.313418 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:44.310650 10733 rpcz_store.cc:276] 0709 12:16:42.898142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:42.904416 (+  6274us) service_pool.cc:224] Handling call
0709 12:16:44.306454 (+1402038us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400159d54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:44.310109 (+  3655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500899712}
I20260709 12:16:44.317394 10054 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:16:44.321981 10018 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.285949 16476 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:44.321986 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.319697 10054 raft_consensus.cc:1240] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:44.325029 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.309350 16411 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:44.336714 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 191916us
I20260709 12:16:44.312568 16416 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:44.316516 16424 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:44.345243 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.339996 10055 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:44.304679 16494 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:16:44.314200 16402 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:16:44.339319 16411 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.339471 16345 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:44.308729 16400 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:44.358541 16494 consensus_queue.cc:1243] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:16:44.371500 16330 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:44.363343 16457 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.373883 10199 pending_rounds.cc:85] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:44.374212 10199 pending_rounds.cc:107] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:16:44.374442 10199 raft_consensus.cc:2889] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:44.352164 16441 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:44.329644 16554 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 12:16:44.371516 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.377847 10053 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
W20260709 12:16:44.383241 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.385489 16416 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.386368 10049 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:16:44.352109 16137 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:44.352593 16405 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:44.406606 16547 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:16:44.403165 10049 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:16:44.404332 16096 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:44.365280 16355 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:44.459527 16468 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:44.427677 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 114384us
W20260709 12:16:44.430056 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 105231us
W20260709 12:16:44.429378 16564 log.cc:927] Time spent T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
W20260709 12:16:44.429311 16557 log.cc:927] Time spent T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 12:16:44.465544 16411 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.471791 16170 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:16:44.426956 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 115179us
I20260709 12:16:44.489341 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:44.494168 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 169223us
I20260709 12:16:44.495008 10195 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:44.531360 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.489562 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.532790 10195 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:44.536639 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.530861 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.540371 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:44.541563 10203 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:16:44.543402 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:44.544179 10731 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:16:44.544400 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:44.530334 16170 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:44.545663 16170 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.546823 16170 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:44.548781 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:44.553118 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77917.1us
I20260709 12:16:44.553906 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:44.558671 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 69180.3us
W20260709 12:16:44.559213 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.528749 16188 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:44.496315 16137 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:44.565768 16405 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:44.579705 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.580154 16468 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:44.587880 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:44.589509 10052 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:16:44.557111 16403 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:44.548305 16567 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:44.564232 16570 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:44.597177 10052 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:16:44.566133 15923 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:44.604344 10052 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:44.586158 16568 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:44.630831 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:44.631309 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:44.631524 10128 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:44.627594 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:44.633555 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:44.635102 10130 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:44.636313 10124 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 18: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:44.636201 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.638643 10200 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:44.640475 10126 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:16:44.642185 10126 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:44.644948 16096 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:44.646852 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:44.671478 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74843.5us
I20260709 12:16:44.649226 16559 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:44.679788 16553 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:44.680691 16402 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:44.681126 16402 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:44.681730 16548 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.341s	user 0.000s	sys 0.003s
I20260709 12:16:44.682054 16402 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:44.682991 16553 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:44.683508 16402 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.687656 10126 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:44.694926 16411 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:44.695315 16569 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:16:44.673336 16420 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:16:44.673617 16468 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:16:44.699628 16566 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:16:44.702602 10048 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:44.655647 16137 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.600486 16555 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:16:44.690223 16553 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:44.710004 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 177823us
I20260709 12:16:44.727221 10127 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:44.677945 16096 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:16:44.728317 16300 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:44.734210 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.675959 16559 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:44.741911 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:44.746768 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:44.753813 10126 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.751261 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:44.740199 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 189896us
W20260709 12:16:44.742178 16579 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:16:44.738183 16300 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:44.760738 16468 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:44.768393 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:44.755757 16559 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:44.770581 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:44.739882 16467 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:16:44.778586 10126 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:44.779740 10169 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:44.754851 16188 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:16:44.741786 16114 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:16:44.814498 16404 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:44.763986 16330 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:16:44.768491 16588 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:16:44.798725 16581 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:44.836568 10201 raft_consensus.cc:2410] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:16:44.841042 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:44.827914 16404 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:44.861318 16404 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.857311 16467 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:44.803845 16300 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.866571 16300 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:44.869472 10051 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:16:44.880815 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:44.916558 10051 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:16:44.916481 16454 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:44.983076 16596 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:16:44.984431 16597 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:16:44.991080 16602 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:16:44.994896 16591 log.cc:927] Time spent T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:16:44.995612 16559 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:44.996775 10050 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:44.923942 16454 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:45.001837 16454 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:44.990931 16600 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:16:45.008565 16559 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.010332 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:45.020293 16586 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:16:45.023726 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.027235 16170 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.027830 16170 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.029887 16170 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.032120 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:45.032985 10052 raft_consensus.cc:2410] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 20 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 12:16:45.033795 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.034773 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:45.035218 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:45.035578 10053 raft_consensus.cc:2410] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:45.035876 10127 raft_consensus.cc:2393] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:45.036872 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:45.038177 16492 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:45.046736 10731 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:16:45.067045 16558 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.067641 16558 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.069805 16558 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.075470 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:45.076114 10127 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:45.073525 16404 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:16:45.077453 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:45.083036 16592 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.083599 16592 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.073354 16010 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:45.084653 16010 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.085767 16592 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.086810 16010 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.088006 16403 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:16:45.099985 16593 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 12:16:45.106302 10054 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:45.108256 10019 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:45.112058 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:45.122982 16462 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:45.113309 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:45.126327 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:45.080834 16558 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:45.145542 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:45.146744 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:45.147372 10735 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:45.148864 16454 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:45.152806 16345 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:16:45.116459 16403 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:45.157209 16590 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:16:45.134637 16300 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:45.158926 16300 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:45.159338 16300 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:45.163053 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:45.158082 16403 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.165555 16457 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:45.169765 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:45.135869 16558 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.176424 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:45.168015 16403 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:45.168617 16170 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:45.175371 16404 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:45.176266 16558 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:45.174643 16570 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:16:45.185060 16404 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.189698 16170 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:45.197296 16404 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:16:45.214543 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:45.198992 16170 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:44.825292  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.222123 16116 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:16:45.227732 16170 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:45.218495 16555 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 12:16:45.273347 16599 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
W20260709 12:16:45.298408 16604 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:16:45.303679 16542 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:45.312449 16603 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:16:45.309618 16542 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.359443 10054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2750) took 1206 ms. Trace:
I20260709 12:16:45.359889 10054 rpcz_store.cc:276] 0709 12:16:44.152917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.328160 (+175243us) service_pool.cc:224] Handling call
0709 12:16:44.328492 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:45.121499 (+793007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.359177 (+237678us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003f9dd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:45.359355 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788049280}
I20260709 12:16:45.365285 10196 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:16:45.373330 16366 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:16:45.370631 16300 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.388547 10127 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
W20260709 12:16:45.387184 16608 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:16:45.399729 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:45.409214 10051 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:16:45.419752 16542 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.421885 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:45.423755 10123 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:45.422039 16553 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:45.390003  9947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 268) took 41192 ms (client timeout 15000 ms). Trace:
I20260709 12:16:45.426774 16553 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.407639 16558 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.434916 16403 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:16:45.442462 16554 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:16:45.429920 16462 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:45.443646 10200 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:45.445379 16553 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.446498 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:45.459311 10123 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:45.447247 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:45.449746 16404 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.455679 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:45.456267 16300 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.460619 10052 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:16:45.461553 10733 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:45.460170 10051 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 15.
I20260709 12:16:45.468538 16096 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.469022 16096 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:45.471055 16096 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:45.465533 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:45.461091 16462 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.472245 10168 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:45.473878 16462 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.475075 16554 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:45.475478 16554 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.475795 16554 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:45.470813 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 2927) took 1194 ms. Trace:
I20260709 12:16:45.478137 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:45.478811 10130 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:45.488384 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:45.572921 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:45.593012 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 104950us
I20260709 12:16:45.573241 10729 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 21: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:45.477468 10049 rpcz_store.cc:276] 0709 12:16:44.276640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.432584 (+155944us) service_pool.cc:224] Handling call
0709 12:16:44.440692 (+  8108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:44.441035 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.441061 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:44.470707 (+ 29646us) log.cc:844] Serialized 26 byte log entry
0709 12:16:44.613980 (+143273us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:44.632819 (+ 18839us) log.cc:844] Serialized 14 byte log entry
0709 12:16:45.469719 (+836900us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b1800435280. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6712a6 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e70b733 00007fc17e790dbf 00007fc17e78f83e
0709 12:16:45.470482 (+   763us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b54000e5220. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e70b733 00007fc17e790dbf 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c
0709 12:16:45.470524 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.470597 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.470638 (+    41us) raft_consensus.cc:1685] finished
0709 12:16:45.470649 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.470761 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10950,"prepare.queue_time_us":20410,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":2819,"raft.queue_time_us":33798,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":58849,"spinlock_wait_cycles":38182144,"thread_start_us":142899,"threads_started":1,"wal-append.queue_time_us":134387}
I20260709 12:16:45.599104 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:45.599927 10198 raft_consensus.cc:2368] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 21. Current term is 22.
I20260709 12:16:45.573629 10047 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 15.
I20260709 12:16:45.675230 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:45.511718 16558 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:45.689246 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 194869us
W20260709 12:16:45.717375 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 123070us
I20260709 12:16:45.677160 16402 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.678570 16568 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.681664 16405 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.726584 16366 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:45.773264 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 376924us
I20260709 12:16:45.684319 16170 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:45.742952 16608 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:16:45.787325 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 481547us
I20260709 12:16:45.727308 16558 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.747924 16584 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.773774 16570 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:45.775804 16555 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.740379 16402 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.769516 16405 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.806087 16446 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.789997 16366 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.806879 16558 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.826465 16330 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.827968 16631 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.849298 16638 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.851531 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:45.852380 16063 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:45.852859 16063 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:45.853245 16063 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:45.865132 16063 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.828646 16446 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.867813 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:45.873265 10729 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:45.836772 16404 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:45.821689 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 133668us
I20260709 12:16:45.878140 10049 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:45.879371 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:45.880079 10046 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:16:45.868870 16330 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:45.890522 16624 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:16:45.897102 16405 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:45.899674 16405 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:45.895064 16629 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:16:45.903204 10046 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:45.895242 16552 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.815696 16555 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.811946 16584 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.817425 16570 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:45.914686 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 124906us
I20260709 12:16:45.872017 16631 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.908692 16633 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:45.743304 16568 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.909332 16462 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.849828 16638 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.901268 16405 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:45.938095 10019 leader_election.cc:400] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 21. Current term is 22.
I20260709 12:16:45.938535 10019 leader_election.cc:403] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:45.927935 16114 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.954007 16424 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:45.954622 16424 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.956673 16424 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.966905 16559 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.967531 16559 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.969650 16559 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:45.973327 16446 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.975409 16366 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:45.987772 16170 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:45.993516 16628 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:16:45.995434 16626 log.cc:927] Time spent T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:16:45.998203 10199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1166) took 1625 ms. Trace:
I20260709 12:16:45.998597 10199 rpcz_store.cc:276] 0709 12:16:44.373173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.373327 (+   154us) service_pool.cc:224] Handling call
0709 12:16:44.373662 (+   335us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:16:44.375106 (+  1444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:44.375147 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:16:45.383346 (+1008199us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c00107318. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:45.385772 (+  2426us) log.cc:844] Serialized 78 byte log entry
0709 12:16:45.433628 (+ 47856us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:45.454360 (+ 20732us) log.cc:844] Serialized 14 byte log entry
0709 12:16:45.454758 (+   398us) log.cc:844] Serialized 14 byte log entry
0709 12:16:45.454950 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:45.455022 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:45.994871 (+539849us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:45.997949 (+  3078us) raft_consensus.cc:1685] finished
0709 12:16:45.997971 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:45.998143 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1196,"prepare.queue_time_us":20573,"raft.queue_time_us":3589,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":48301952,"thread_start_us":30352,"threads_started":1,"wal-append.queue_time_us":184045}
I20260709 12:16:45.970211 16559 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 21. Current term is 22.
W20260709 12:16:46.026857 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 249756us
W20260709 12:16:46.020503 16646 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:16:45.937840 16402 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:45.921898 16552 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.040035 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:46.036576 16558 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:46.042865 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 102869us
I20260709 12:16:46.044324 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:46.045082 10196 raft_consensus.cc:2393] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:45.936584 16462 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:46.049783 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:46.042462 16592 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:45.931458 16633 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.051472 16592 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.052817 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:46.053471 16592 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:46.054023 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:46.056526 16542 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.057046 16542 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:45.939818 16647 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.107s
I20260709 12:16:46.046761 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:46.065438 10729 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:46.066932 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:46.042146 16402 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.022528 16114 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:46.049029 16630 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:16:46.070287 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.077440 10127 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:46.081154 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.083009 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.103030 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.103600 10127 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:46.103807 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.104446 10123 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:46.105309 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.088487 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.106236 10124 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:46.079990 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:46.089442 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.109737 10128 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:16:46.081938 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:46.110948 10049 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:46.098232 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:46.061450 16640 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:46.118477 10196 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:46.095567 10046 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:46.120167 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.068732 16635 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.104658 16559 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.104910 16366 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:46.115427 16586 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:46.136904 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 107539us
W20260709 12:16:46.141546 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 85820.8us
I20260709 12:16:46.142196 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:46.174853 16639 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.175536 16639 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.098837 16402 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:46.211712 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 43480.6us
I20260709 12:16:46.210572 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:46.143726 16330 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:46.209977 16646 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:16:46.210580 16630 log.cc:927] Time spent T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:16:46.289628 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:46.202688 16652 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.168170 16649 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.129338 16640 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.288882 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:46.308063 10200 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:46.145831 16424 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:16:46.146747 16559 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.217815 16570 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.146461 16635 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.204918 16366 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.222823 16584 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.287523 16203 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.285091 16359 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.289376 16063 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.204428 16586 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.369052 16568 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.368634 16651 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:46.371796 16330 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:46.415491 16662 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:46.416109 16662 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.418192 16662 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:46.423499 16641 log.cc:927] Time spent T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:16:46.428058 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:46.428668 10046 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:46.385669 16631 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.397028 16644 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.397472 16345 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:46.434998 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:46.397333 16638 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:46.438941 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48304us
I20260709 12:16:46.324481 16652 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.363899 16649 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.383153 16203 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.445688 10095 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:46.428470 16552 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.444965 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:46.386160 16359 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.458094 16640 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.427022 16650 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:16:46.427700 16330 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:45.427994  9947 rpcz_store.cc:269] 0709 12:16:04.232896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:04.286006 (+ 53110us) service_pool.cc:224] Handling call
0709 12:16:45.385561 (+41099555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:41.498098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:41.498827 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:41.498880 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:16:41.498906 (+    26us) tablet.cc:662] Decoding operations
0709 12:16:41.692769 (+193863us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:41.713034 (+ 20265us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:41.715724 (+  2690us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:16:41.759944 (+ 44220us) tablet.cc:701] Row locks acquired
0709 12:16:41.759992 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:16:41.760191 (+   199us) write_op.cc:270] Start()
0709 12:16:41.760367 (+   176us) write_op.cc:276] Timestamp: P: 1783599401760117 usec, L: 0
0709 12:16:41.760402 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:16:41.778855 (+ 18453us) log.cc:844] Serialized 4437 byte log entry
0709 12:16:42.067606 (+288751us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17b6860ac 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b
0709 12:16:43.100282 (+1032676us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400036220. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6fa090 00007fc17e7076b8 00007fc17e7072fa 00007fc17e78b965 00007fc17e78be09 00007fc1821c6581 00007fc1821c5d58 00007fc1821ca9f1 00007fc1821ca9a9 00007fc1821ca939 00007fc1821ca901
0709 12:16:43.223806 (+123524us) op_driver.cc:464] REPLICATION: finished
0709 12:16:43.420267 (+196461us) write_op.cc:301] APPLY: starting
0709 12:16:43.420368 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:43.430598 (+ 10230us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:43.430634 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:43.464389 (+ 33755us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78d32a 00007fc17e712f14 00007fc17e712ec3 00007fc17e712e38 00007fc17e712df3 00007fc17e7120dc 00007fc17e73be16 00007fc17e723cbb 00007fc17e70e39d 00007fc17e711d75
0709 12:16:43.503104 (+ 38715us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:43.503403 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:16:43.503460 (+    57us) write_op.cc:312] APPLY: finished
0709 12:16:43.590793 (+ 87333us) log.cc:844] Serialized 105 byte log entry
0709 12:16:43.591007 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:43.591176 (+   169us) write_op.cc:454] Released schema lock
0709 12:16:43.591244 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:43.591686 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:43.591715 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":824342,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":185521,"apply.run_cpu_time_us":15412,"apply.run_wall_time_us":171400,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":400826,"prepare.run_cpu_time_us":61204,"prepare.run_wall_time_us":1631532,"raft.queue_time_us":200264,"raft.run_cpu_time_us":11303,"raft.run_wall_time_us":645251,"replication_time_us":1418897,"spinlock_wait_cycles":839221760,"thread_start_us":1302481,"threads_started":4,"wal-append.queue_time_us":671629,"wal-append.run_cpu_time_us":8377,"wal-append.run_wall_time_us":2145627}]]}
W20260709 12:16:46.461215 16554 consensus_meta.cc:287] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: Time spent flushing consensus metadata: real 0.985s	user 0.011s	sys 0.001s
I20260709 12:16:46.444820 16462 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:46.451001 16114 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:46.470504 16590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.012s
W20260709 12:16:46.512151 16590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.008s	sys 0.013s
W20260709 12:16:46.512816 16666 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:16:46.441807 16345 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.514917 16345 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.468055 16170 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:46.468473 16300 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:46.441618 16644 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.507113 16554 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.511690 16559 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.471012 16633 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.540032 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:46.546293 10052 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53880 (request call id 982) took 1375 ms. Trace:
I20260709 12:16:46.546742 10052 rpcz_store.cc:276] 0709 12:16:45.170809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:45.170955 (+   146us) service_pool.cc:224] Handling call
0709 12:16:45.171236 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:45.466308 (+295072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:46.546031 (+1079723us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400131354. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:46.546229 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665039616}
I20260709 12:16:46.570148 16402 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.551690 16635 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.548590 16170 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:46.555970 16586 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.573638 16300 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:46.556944 16356 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:46.573213 16552 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.622488 10204 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:16:46.622900 10204 pending_rounds.cc:85] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 10
I20260709 12:16:46.623121 10204 pending_rounds.cc:107] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:16:46.623342 10204 raft_consensus.cc:2889] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:46.653077 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:46.660559 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 437107us
I20260709 12:16:46.661450 10169 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:46.662509 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:46.666842 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:46.617769 16300 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:46.619580 16366 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:46.802098 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:46.802456 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:46.802871 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 342309us
I20260709 12:16:46.813298 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:46.817173 10204 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:46.815482 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 153048us
W20260709 12:16:46.808202 16624 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:16:46.789680 16300 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:46.839509 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:46.763067 16402 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:16:46.620806 16356 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.807885 16359 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.656311 16552 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.849467 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:46.826565 16424 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:46.838393 16633 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:46.842473 16369 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:46.842089 16672 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:46.841550 16670 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:46.845466 16203 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.917266 16402 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:46.927960 16652 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:46.929209 16670 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:46.931595 16665 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 12:16:46.927549 16633 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.928308 16441 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:46.924377 16454 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:16:46.968482 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 144386us
I20260709 12:16:46.925168 16424 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:46.986708 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:46.931308 16672 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.966550 16330 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:46.977649 16568 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:46.972293 16644 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.009485 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:46.970707 16670 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:47.028255 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:47.037672 10203 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:47.028868 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:47.035808 16673 log.cc:927] Time spent T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:16:47.012660 16010 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:16:47.014407 16667 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.396s	user 0.000s	sys 0.000s
I20260709 12:16:47.039197 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.046061 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.016397 15844 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:47.046301 10203 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
W20260709 12:16:47.038271 16668 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:16:46.984602 16441 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:46.845811 16170 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.064467 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.047829 16644 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.050154 16554 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.076735 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.090104 10202 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:47.054504 16588 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.052618 16685 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:47.058912 16686 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:47.024195 16402 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.073076 16687 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.095405 15999 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.086162 16680 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.101806 16552 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.120282 10124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2820) took 1036 ms. Trace:
I20260709 12:16:47.123438 10124 rpcz_store.cc:276] 0709 12:16:46.083677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.083805 (+   128us) service_pool.cc:224] Handling call
0709 12:16:46.102833 (+ 19028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:46.106610 (+  3777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.120053 (+1013443us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54001284d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:47.120216 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42946816}
W20260709 12:16:47.128345 16688 log.cc:927] Time spent T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:16:47.102252 16644 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:47.133226 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 283814us
I20260709 12:16:47.124266 16554 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.113201 15999 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.101145 16588 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.113834 16687 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.131052 16633 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.148211 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.148855 10049 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:47.120636 16680 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.151010 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.152783 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.153649 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.154969 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.154246 10055 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:47.157021 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.160145 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.164053 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.164129 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.164420 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.166352 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.145110 16554 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.168226 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.151609 16454 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.173249 16454 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.175500 16454 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.171969 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.176314 10055 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:47.177659 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.179610 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.181134 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.182641 16633 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.183179 16633 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.183490 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.184938 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.185178 16633 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.188050 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:47.188295 16693 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.188736 10129 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:47.188903 16693 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.189970 16680 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:47.195729 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 51873.1us
I20260709 12:16:47.195921 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.197903 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.199425 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.199872 10055 raft_consensus.cc:3060] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:16:47.188643 16671 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:16:47.163579 16424 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.206231 10126 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:47.206996 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.208451 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.208956 10049 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:47.191130 16693 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.212837 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.215421 10204 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:47.192966 16441 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.231772 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:47.231864 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.233219 10051 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:47.216665 16691 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.233381 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.248622 10055 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:47.238880 16454 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:47.250979 16454 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.251381 16454 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:47.253072 10129 raft_consensus.cc:2468] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:16:47.254719 16554 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.239503 16644 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.255669 15999 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.256233 16300 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.258252 16300 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.262009 10124 raft_consensus.cc:1240] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
W20260709 12:16:47.265242 16695 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:16:47.266772 16645 log.cc:927] Time spent T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 1.045s	user 0.006s	sys 0.008s
I20260709 12:16:47.270506 16405 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.271111 16330 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.271632 16330 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.273761 16366 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.274259 16366 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.282776 16366 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.243530 16691 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.283291 16366 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.285423 16691 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:47.295141 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 65314.1us
I20260709 12:16:47.295804 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:47.304224 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.309260 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.310047 10046 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:47.301407 15999 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:47.318794 15999 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.319211 15999 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:47.325457 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.283775 16366 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.326104 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.302397 16330 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.326463 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.327189 10198 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:47.336642 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.330513 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:47.338121 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.338845 16689 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.340711 16689 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.343040 16689 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.343798 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.344211 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.345429 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.348819 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.350922 16662 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:47.351302 16662 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:47.352182 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.352094 16662 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.352846 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.353024 16662 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.353914 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.354223 15999 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.357527 15999 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.359076 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.344081 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:47.355166 16639 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.360365 10129 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:47.349524 10049 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
I20260709 12:16:47.363674 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:47.372862 16542 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.373953 10095 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.376194 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:47.376979 10729 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 16: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:47.377276 10055 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:47.378966 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.379452 10729 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:47.379640 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.380193 10130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2816) took 1893 ms. Trace:
I20260709 12:16:47.383536 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.382061 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.383896 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.383524 10048 raft_consensus.cc:2393] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 16: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:47.381358 10130 rpcz_store.cc:276] 0709 12:16:45.487105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:45.487261 (+   156us) service_pool.cc:224] Handling call
0709 12:16:45.487588 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:45.790896 (+303308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:45.790925 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:45.791485 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:16:45.949677 (+158192us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4800240258. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc1836b9aa1 00007fc1836b0b37 00007fc1836b09ca 00007fc1837a826f 00007fc1837a7f37 00007fc1837bc55c 00007fc1837bc508 00007fc1837bc488 00007fc1837bc443 00007fc1837bb6ec 00007fc1826e5a96
0709 12:16:46.021937 (+ 72260us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:46.021983 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:46.022052 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:47.266254 (+1244202us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:47.379978 (+113724us) raft_consensus.cc:1685] finished
0709 12:16:47.380000 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.380136 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380112,"raft.queue_time_us":316183,"raft.run_cpu_time_us":1204,"raft.run_wall_time_us":142210,"spinlock_wait_cycles":160482560,"thread_start_us":197549,"threads_started":1,"wal-append.queue_time_us":322304}
I20260709 12:16:47.387166 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.389794 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.371886 15999 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:47.359719 16672 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.393193 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.393945 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.412959 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.407446 10198 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:47.387730 10049 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:47.411558 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.434685 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.427809 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.359300 16454 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.444774 10701 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:47.427321 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.451119 16672 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:16:47.456238 16555 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.457350 16635 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.457932 16635 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.458987 16664 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.459501 16664 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.392011 16687 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.413991 15999 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.461526 16687 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:47.461814 15999 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:47.462141 16687 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.463452 16404 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.464075 16687 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.463943 16404 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.464572 16687 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.464980 16687 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.465898 16404 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.392179 16195 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:47.466831 16687 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.461508 16664 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.468101 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.469208 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.431835 16356 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.470611 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.470276 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.471304 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.471567 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.471779 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.472311 10049 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
W20260709 12:16:47.467254 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54577.8us
I20260709 12:16:47.472322 10054 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:47.473168 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.469231 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.459990 16635 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.474841 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:47.475962 16683 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.492s	user 0.000s	sys 0.002s
I20260709 12:16:47.478060 10053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2780) took 2182 ms. Trace:
I20260709 12:16:47.478392 10053 rpcz_store.cc:276] 0709 12:16:45.295393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:45.308858 (+ 13465us) service_pool.cc:224] Handling call
0709 12:16:45.309162 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:45.309819 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:45.309846 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:45.311373 (+  1527us) log.cc:844] Serialized 26 byte log entry
0709 12:16:46.541895 (+1230522us) spinlock_profiling.cc:243] Waited 895 us on lock 0x7b180038a9a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b 00007fc17e32fd23 00007fc17e3300d1 00007fc17e74ba0f
0709 12:16:46.621323 (+ 79428us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:16:46.621398 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:46.621474 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:47.475455 (+853981us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:47.477880 (+  2425us) raft_consensus.cc:1685] finished
0709 12:16:47.477900 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.478011 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2732,"raft.queue_time_us":907,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":13750400,"thread_start_us":78067,"threads_started":1,"wal-append.queue_time_us":1649524}
I20260709 12:16:47.470342 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.482400 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.483203 16457 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:47.408856 16644 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:47.485138 16644 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.485498 16644 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.428009 16670 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.487211 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.488227 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.490139 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.490741 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.491231 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.492420 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:47.470854 10170 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.493454 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.496423 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.497484 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:47.498011 16660 log.cc:927] Time spent T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.960s	user 0.004s	sys 0.000s
I20260709 12:16:47.496097 10046 raft_consensus.cc:2393] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:47.473311 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.502995 16454 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.419795 15844 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:47.507278 16588 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.507869 15999 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.508719 16632 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.509196 16632 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.509752 15999 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.466413 16422 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.512247 16649 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.492720 16366 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.507493 10094 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:47.503695 16682 log.cc:927] Time spent T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 12:16:47.519991 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:47.520262 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.520481 10020 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.520933 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.522568 10198 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:47.525209 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:47.522089 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 79097.4us
I20260709 12:16:47.446949 10168 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:47.526587 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 79699.5us
I20260709 12:16:47.530992 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.530962 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.522635 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:47.532068 10196 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:47.533267 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.533699 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:47.534901 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.535682 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.536639 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:47.538759 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 94048.5us
I20260709 12:16:47.544797 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.547725 10729 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 16.
I20260709 12:16:47.550875 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.551067 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.551762 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.512205 16422 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.536594 16366 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:47.538714 16651 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.549371 16590 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.549578 16418 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:47.564918 16632 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.552006 15844 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:47.565996 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.539379 16588 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:47.567458 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:47.586506 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.546288 16457 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:47.573894 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.569396 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.553241 16195 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.574927 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.579192 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.590780 10728 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:47.573233 16689 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.584296 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:47.556540 16492 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:47.586773 10204 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:47.590699 10734 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:47.576004 16467 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:47.579281 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.604281 10053 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:16:47.577121 16570 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.586593 16670 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.586237 15844 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:47.587415 16588 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.620054 10196 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:47.577795 16651 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.637142 10197 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:47.627993 16698 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:47.629734 16422 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.589581 16418 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:47.611778 16420 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:47.605235 16492 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.636987 15844 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:47.641930 16492 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:47.645459 16545 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:47.578850 16590 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.648705 16590 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.610972 16555 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:16:47.649874 16555 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:47.616500 16570 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.652295 16570 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.611155 16467 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.656396 16467 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.657287 16418 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.605922 16195 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.660148 16195 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.654201 10204 raft_consensus.cc:2468] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:47.650193 16555 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:47.637646 16588 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:47.660281 16677 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.701s	user 0.003s	sys 0.000s
I20260709 12:16:47.666999 10701 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:47.669256 16542 raft_consensus.cc:2804] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:47.669808 16542 raft_consensus.cc:697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:47.673522 10169 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.667893 16570 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.682476 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1151) took 1319 ms. Trace:
I20260709 12:16:47.683568 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.684496 16403 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:47.686827 10050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53720 (request call id 2797) took 1262 ms. Trace:
I20260709 12:16:47.687211 10050 rpcz_store.cc:276] 0709 12:16:46.424731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.430256 (+  5525us) service_pool.cc:224] Handling call
0709 12:16:46.430634 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:46.430951 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:46.430977 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:46.431370 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:16:46.793502 (+362132us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:16:46.793543 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:46.793617 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:47.659746 (+866129us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:47.686536 (+ 26790us) raft_consensus.cc:1685] finished
0709 12:16:47.686558 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.686768 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4599,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":747,"spinlock_wait_cycles":13400448,"thread_start_us":326348,"threads_started":1,"wal-append.queue_time_us":436738}
I20260709 12:16:47.682849 10731 rpcz_store.cc:276] 0709 12:16:46.360671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.369057 (+  8386us) service_pool.cc:224] Handling call
0709 12:16:46.369435 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:46.387126 (+ 17691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:46.387158 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:46.387722 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:16:46.807588 (+419866us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:46.807634 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:47.674160 (+866526us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54004b9454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:47.674208 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:47.676583 (+  2375us) raft_consensus.cc:1685] finished
0709 12:16:47.676602 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:47.679794 (+  3192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":13322,"spinlock_wait_cycles":39681792,"thread_start_us":392674,"threads_started":1,"wal-append.queue_time_us":659803}
I20260709 12:16:47.666453 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.696827 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.609297 16689 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.700304 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.690961 16010 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.672550 16492 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:47.677111 16670 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:16:47.700780 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.701859 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:47.693425 16403 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:47.715085 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.718438 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
W20260709 12:16:47.744091 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 47319.4us
I20260709 12:16:47.679947 16555 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.717260 16652 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:47.794833 16652 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:47.795265 16652 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:47.799564 15844 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.801730 15844 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.691813 16570 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.804783 16570 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.793756 16422 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:47.694448 16454 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:47.703042 15999 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:16:47.791392 16713 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:16:47.790608 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 75595.9us
W20260709 12:16:47.793069 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 75158.4us
I20260709 12:16:47.817764 10169 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.712402 16632 consensus_queue.cc:1059] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:16:47.712478 16542 consensus_queue.cc:237] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.819605 16632 raft_consensus.cc:3055] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:47.819967 16632 raft_consensus.cc:740] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:47.820739 16632 consensus_queue.cc:260] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.821882 16632 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.716610 16010 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.823108 10094 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:47.823848 16570 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:16:47.789965 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71313us
I20260709 12:16:47.813671 16454 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.824361 16570 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:47.824739 16662 consensus_queue.cc:1175] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 10 } }
I20260709 12:16:47.790416 16484 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:47.789989 10050 raft_consensus.cc:606] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.826270 10050 raft_consensus.cc:614] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:47.812300 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.818825 16650 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:47.825776 16454 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.833041 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56431c97132141908463e11690f7ba09"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:47.833650 10050 raft_consensus.cc:606] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.833976 10050 raft_consensus.cc:614] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:47.825229 16570 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.835319 16644 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.836596 10124 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:47.837484 16644 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.824033 16010 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:47.840855 16652 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:47.827292 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.827898 16203 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:47.828735 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.824582 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:47.843838 16689 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:47.844041 16467 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:47.844525 16467 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.844893 16467 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.845147 16652 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.843875 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:47.852437 16709 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:47.852180 16588 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:47.852895 16709 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.853343 16709 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:47.853889 16715 log.cc:927] Time spent T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.007s
I20260709 12:16:47.854866 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.856809 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.858067 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.794289 16356 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:47.859218 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:47.859586 16651 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.860342 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40172
I20260709 12:16:47.861337 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:47.846165 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 321023us
I20260709 12:16:47.865792 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.866393 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:47.868405 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.869671 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.864161 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:47.876757 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:47.790750 16717 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:16:47.880941 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52266.7us
I20260709 12:16:47.882565 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.869906 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.870556 16366 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:47.871407 16404 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:47.874580 16330 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:47.889671 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.897365 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.898820 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.913986 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.914774 10050 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.918783 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:47.919500 10048 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:47.922885 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.927753 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.929061 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:47.936749 16472 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:47.937264 16472 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:47.945525 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63022.4us
I20260709 12:16:47.946326 10702 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.947829 10048 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:47.888841 16717 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:47.888411 16366 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:47.954010 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50848us
I20260709 12:16:47.894694 16330 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:47.958648 10169 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:47.954553 10050 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
W20260709 12:16:47.938297 16719 log.cc:927] Time spent T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:16:47.895076 16632 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:47.937243 16492 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:47.902828 16203 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:47.904603 16650 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:47.965114 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:47.979740 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 70659.4us
I20260709 12:16:47.980252 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:47.958014 16366 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:47.947889 16404 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:47.974336 16718 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:47.902671 16649 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:47.995172 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.952832 16637 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:47.993244 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.983924 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:48.012401 10731 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:16:47.963085 16330 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:47.955976 16717 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:47.957623 16544 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:48.035811 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:47.978981 16632 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:47.997316 16404 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:48.047657 16404 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:48.051730 16555 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:47.938360 16472 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.052771 16472 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:48.033567 16674 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.060230 16674 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:48.062763 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 158745us
I20260709 12:16:48.063503 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.019855 16542 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:47.983999 16203 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:47.995963 16402 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:47.985924 16418 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:48.050465 16632 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:48.041887 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 58033.5us
I20260709 12:16:48.078866 10169 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:48.064159 16649 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:48.085081 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.066989 16203 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:16:48.092986 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 199059us
I20260709 12:16:48.099213 10121 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:48.100669 10169 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:48.105528 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.106405 16652 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:48.107962 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.110791 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.111320 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.111482 10122 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 13.
I20260709 12:16:48.111779 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.112289 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.112629 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.111505 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.112977 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.113353 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:48.113734 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.113906 10046 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:48.114197 10127 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:48.113658 10130 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:16:48.112210 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.087203 16649 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.114748 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.089103 16651 raft_consensus.cc:2804] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:16:48.115196 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.092864 16568 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:48.117745 10125 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:48.123247 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.125728 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.130760 16366 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.132118 10050 raft_consensus.cc:2410] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:16:48.132846 16725 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:16:48.133023 16724 tablet_replica.cc:333] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:16:48.134161 16724 raft_consensus.cc:2243] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:48.156015 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.157183 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:48.157748 10055 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:48.135291 10046 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:48.140717 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.098842 16727 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:48.145188 16709 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.117726 16650 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:48.154124 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.118079 16559 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:48.154667 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:48.155445 10049 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:16:48.164804 10046 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:16:48.123195 16649 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:48.185118 10055 raft_consensus.cc:2468] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:48.187762 10169 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.187904 16366 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:48.188665 16404 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.163985 16718 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.149166 16467 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.178179 16727 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.192766 16709 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.178144 16651 raft_consensus.cc:697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:48.200407 16203 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.205323 10123 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:48.206900 16724 raft_consensus.cc:2272] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:48.207710 16717 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.153293 16403 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:48.230222 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.260247 10732 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:48.209908 16330 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.221167 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.251803 16404 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:48.263430 10197 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:48.256990 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 270365us
I20260709 12:16:48.255107 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.236037 16568 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:48.260000 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.216142 15999 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.284789 10095 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.285765 10095 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.268489 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.291814 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.286559 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.302131 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.253563 16651 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.322369 10048 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:48.259207 16403 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.327060 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:48.262816 16681 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:16:48.331928 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.332643 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 269207us
I20260709 12:16:48.361734 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.292997 16662 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:16:48.413044 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 79622.2us
I20260709 12:16:48.455837 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.457875 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:48.412860 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 126356us
I20260709 12:16:48.326774 16170 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:48.323882 16439 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:48.324374 16402 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:48.255947 16718 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.329331 16568 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:48.482679 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:48.330600 16681 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:48.412683 16404 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:48.483485 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.488291 10054 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:48.321978 15999 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.474808 16369 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:48.458104 16662 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:48.497051 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.508184 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.480409 16559 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:48.481130 16402 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.511184 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.474551 16366 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:16:48.487125 16681 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:48.517326 16736 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:48.509450 16729 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:48.523787 15999 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:48.490180 16170 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:48.510560 16737 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:48.527266 16403 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.527894 16203 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:48.513999 16422 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:48.514202 16402 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:48.498112 16369 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:48.547644 16369 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:48.510738 16662 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:48.548745 16170 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.547200 16717 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.540578 16728 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:48.553411 16330 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:48.556981 10051 raft_consensus.cc:1240] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:48.561640 16681 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.563084 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:48.563339 16735 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:16:48.567703 16724 ts_tablet_manager.cc:1916] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:48.541538 10020 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.565680 16632 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.575995 16369 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.574502 16662 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.585378 16649 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:48.639708 10094 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.029s	sys 0.036s
W20260709 12:16:48.668468 10094 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.029s	sys 0.036s
W20260709 12:16:48.650993 16652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.030s	sys 0.038s
I20260709 12:16:48.656901 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.663745 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.671272 10204 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
W20260709 12:16:48.664973 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 123628us
I20260709 12:16:48.673326 16439 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:48.674028 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:48.690623 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 178493us
W20260709 12:16:48.692247 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 330605us
I20260709 12:16:48.694519 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:48.674650 16439 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.691567 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:48.695595 10050 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:48.697681 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.704879 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:48.691236 16652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.030s	sys 0.038s
I20260709 12:16:48.704793 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:48.667900 16366 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:48.707279 10198 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:48.709513 10169 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:48.713907 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.715291 16652 raft_consensus.cc:2804] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:48.711838 16729 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:48.719331 16729 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:48.719702 16729 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:48.718786 16697 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:48.720302 16697 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:48.720649 16697 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:48.726274 16652 raft_consensus.cc:697] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:48.727365 16652 consensus_queue.cc:237] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.734306 10128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54462 (request call id 1140) took 1110 ms. Trace:
I20260709 12:16:48.734799 10128 rpcz_store.cc:276] 0709 12:16:47.623856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.624006 (+   150us) service_pool.cc:224] Handling call
0709 12:16:47.624328 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:47.790402 (+166074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:47.790455 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:47.790497 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:47.790524 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:48.734087 (+943563us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400212854. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:48.734132 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:48.734248 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247430016}
I20260709 12:16:48.736277 16588 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.738480 10201 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:48.694952 16670 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:48.741855 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.756342 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.757028 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.751824 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:48.752125 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:48.754544 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.741963 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.743263 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.753135 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.743728 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.744688 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:48.754078 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.710464 16422 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260709 12:16:48.748239 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:48.750299 16748 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:48.704102 16403 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:48.745777 10195 raft_consensus.cc:1240] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:48.767889 10731 raft_consensus.cc:1240] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:48.801697 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:48.771543 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.802171 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.803064 10202 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:48.806257 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.761119 10199 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:48.780525 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.696938 16404 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:48.778584 10196 raft_consensus.cc:1240] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:48.750391 16632 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:48.820446 10196 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:48.753312 16681 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:48.715029 16746 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:48.822886 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:48.754314 16662 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:48.751900 16727 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:48.800624 16728 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.835915 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.751361 16568 consensus_queue.cc:1059] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:16:48.851639 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:48.816416 16743 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:48.754861 16670 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.755887 16402 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.751497 16545 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:16:48.900324 10204 raft_consensus.cc:2368] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:48.901547 10203 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:48.855321 10126 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
I20260709 12:16:48.755697 16697 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.863335 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.866760 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:48.870124 10202 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:48.869220 10199 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:48.873386 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:48.904678 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 81571.5us
I20260709 12:16:48.810035 16403 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.882113 16369 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.832382 16748 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:16:48.885530 16670 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:48.869976 16728 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:48.856714 16737 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:16:48.869735 16730 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:48.889823 16402 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:48.938526 10203 raft_consensus.cc:1240] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22. Ops: []
W20260709 12:16:48.938676 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.911939 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48689.8us
I20260709 12:16:48.864566 16472 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:48.935648 10127 raft_consensus.cc:2368] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:48.942991 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.946854 10020 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:48.942318 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:48.936628 10197 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:48.866158 16709 consensus_queue.cc:1059] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:16:48.845495 16404 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:48.911124 16747 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:48.951535 10094 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:48.913919 16736 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:48.933866 16567 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:48.906893 16727 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:16:49.004415 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:48.951251 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 190512us
I20260709 12:16:49.009277 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.009903 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.011932 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.014947 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:49.017361 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.017970 10124 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:49.019645 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:49.007221 16738 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:16:48.951956 16472 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:49.073984 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 122544us
I20260709 12:16:48.960947 16747 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:49.090031 10168 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:38867 timed out after 1.702s (SENT) [suppressed 4 similar messages]
I20260709 12:16:49.042035 16698 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.104519 10124 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:49.110682 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.111558 16681 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:49.121933 16681 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:49.123024 16681 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.057461 16736 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.069396 16753 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:16:49.129577 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 48605.5us
I20260709 12:16:49.071762 16755 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:49.086699 16727 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:49.160549 10094 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.162987 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.165007 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.167550 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.168651 10051 raft_consensus.cc:1240] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
W20260709 12:16:49.172384 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 225588us
W20260709 12:16:49.172010 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 219198us
I20260709 12:16:49.178278 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.180019 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:49.180786 10124 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:16:49.182080 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.196610 10052 raft_consensus.cc:1240] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:49.128832 16698 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.205473 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:49.211519 10169 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:49.206977 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.212728 10051 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:49.183869 16736 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:16:49.217420 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.185616 16422 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:49.223189 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:49.220667 16670 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:16:49.195119 16765 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.219125 16697 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.270542 16745 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.270834 16776 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.273310 10051 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:49.198499 16728 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:49.284667 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75081us
I20260709 12:16:49.285933 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.217909 16753 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:16:49.225993 16736 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:16:49.324878 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 455455us
W20260709 12:16:49.326228 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.269124 16760 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:16:49.327296 10052 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:49.175724 16567 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:49.330977 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45116.3us
W20260709 12:16:49.338714 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 248707us
I20260709 12:16:49.342886 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.248020 16698 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.248764 16472 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.242755 16568 consensus_queue.cc:1059] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
W20260709 12:16:49.414649 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 84062.2us
I20260709 12:16:49.251291 16422 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:16:49.446920 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 118660us
I20260709 12:16:49.338281 16757 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:49.284174 16773 consensus_queue.cc:1059] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.175s
I20260709 12:16:49.288321 16745 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.458048 16698 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:49.460310 16422 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:49.291297 16776 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:49.480991 10700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.471431 16730 raft_consensus.cc:2764] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:16:49.418877 16765 consensus_queue.cc:1059] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:16:49.505730 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.504221 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.488807 16747 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.506383 10731 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:49.509059 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:49.511730 16745 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.478695 16698 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.514990 16759 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:49.487502 16767 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:49.540599 16767 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.542958 16767 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:49.547914 16729 consensus_meta.cc:287] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.003s
I20260709 12:16:49.548405 16729 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.551352 16567 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:49.527204 16745 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.552438 16745 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.553418 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:49.554104 10126 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:49.556250 16422 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.533787 16759 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:49.559643 16759 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.560668 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.561820 16651 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:49.562250 16651 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:49.562654 16651 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.563665 16674 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.544798 16776 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.567518 16422 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.568382 16745 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.568254 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.569531 10126 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:49.570698 16652 raft_consensus.cc:3055] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:49.571120 16652 raft_consensus.cc:740] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:49.533982 16698 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:49.534235 16709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.010s	sys 0.007s
W20260709 12:16:49.572438 16709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.010s	sys 0.007s
I20260709 12:16:49.571995 16652 consensus_queue.cc:260] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.574636 16746 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:49.575002 16746 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:49.575764 16746 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:49.577064 16746 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.578024 10126 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
W20260709 12:16:49.579525 16751 log.cc:927] Time spent T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.779s	user 0.001s	sys 0.004s
I20260709 12:16:49.579912 16729 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.589704 16698 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.591431 16770 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:49.562038 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:49.592657 16786 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:49.597608 16403 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.598394 16652 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:49.644065 16698 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.636548 16420 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:49.600821 16649 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:49.604393 16752 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.805s	user 0.000s	sys 0.017s
I20260709 12:16:49.605556 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.605007 16681 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 12:16:49.607963 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98976.4us
I20260709 12:16:49.608551 16785 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:49.699421 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.699635 16785 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:49.700138 16785 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:49.609974 16753 raft_consensus.cc:3055] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:49.611891 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.702634 16753 raft_consensus.cc:740] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:49.702832 10053 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.703589 16753 consensus_queue.cc:260] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.704887 16753 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:49.619488 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.707154 10047 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:49.622570 10052 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:16:49.615219 16010 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.624763 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.626328 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:49.632117 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 289308us
I20260709 12:16:49.709009 16781 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:49.709600 16781 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:49.708863 10050 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
W20260709 12:16:49.634816 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 72841.7us
I20260709 12:16:49.710635 16781 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.713096 16681 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:16:49.637866 16786 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.713898 16706 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:49.714708 16706 consensus_queue.cc:1243] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer a29bed9eb81541dba9ec7a447986e01e log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:16:49.663453 16724 ts_tablet_manager.cc:1929] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
W20260709 12:16:49.664363 10123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55236 (request call id 2849) took 1553 ms (client timeout 1920 ms). Trace:
I20260709 12:16:49.715536 16786 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:49.715816 10123 rpcz_store.cc:269] 0709 12:16:48.110666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.112766 (+  2100us) service_pool.cc:224] Handling call
0709 12:16:49.664145 (+1551379us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400232654. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:49.664286 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181186816}
I20260709 12:16:49.709671 10094 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:49.708863 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 84178.7us
I20260709 12:16:49.718633 16689 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:49.719286 16345 consensus_queue.cc:1059] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:49.721498 16590 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:49.723171 16759 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:49.723769 16590 raft_consensus.cc:3055] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:49.713227 10168 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.708880 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.637436 16770 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.724748 10125 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:49.724901 10124 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
W20260709 12:16:49.633342 16737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.003s	sys 0.011s
I20260709 12:16:49.730012 10732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1296) took 1737 ms. Trace:
I20260709 12:16:49.709510 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:49.731151 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.737982 16718 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.739588 16770 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.731237 10732 rpcz_store.cc:276] 0709 12:16:47.992565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.992939 (+   374us) service_pool.cc:224] Handling call
0709 12:16:48.035908 (+ 42969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:48.260660 (+224752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.729813 (+1469153us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54006455d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:49.729958 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515528576}
I20260709 12:16:49.743964 10053 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:49.744720 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:49.746017 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.746511 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.747392 10124 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:49.747407 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:49.749089 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:49.749775 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.753317 10019 leader_election.cc:400] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:49.754669 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:49.746008 16737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.004s	sys 0.012s
I20260709 12:16:49.759048 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.763597 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.764436 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.769986 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.764698 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.765107 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.731375 16590 raft_consensus.cc:740] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:49.766798 10047 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:49.763037 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.748517 16649 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.776533 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.750514 16639 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:49.779388 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:49.782094 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.749323 16786 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.752595 16203 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:49.782330 10051 raft_consensus.cc:2393] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 18: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:49.756335 16724 log.cc:1199] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/52fc66fb7de4405ba4a4ef0ea5ca5ba1
I20260709 12:16:49.654196 16651 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.757339 16681 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:49.779910 16737 consensus_queue.cc:1243] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer 4b3390fbbe574de7bf154b5a6cc35677 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:16:49.768826 16170 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.786079 10050 raft_consensus.cc:1240] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:49.805320 10737 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:49.784790 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.790318 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.775523 16356 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.806615 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:49.805691 10737 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:49.816295 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:49.816812 10124 raft_consensus.cc:606] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.767072 16760 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:16:49.774091 16403 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:16:49.804874 16439 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.803057 16743 consensus_queue.cc:1059] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:16:49.795580 16203 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.792006 16639 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.814600 16649 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:49.788296 16786 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.820978 16590 consensus_queue.cc:260] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.826270 16203 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.828051 16639 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.827128 16758 raft_consensus.cc:993] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:16:49.840914 16758 raft_consensus.cc:1081] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
W20260709 12:16:49.841889 16722 log.cc:927] Time spent T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 1.725s	user 0.000s	sys 0.028s
I20260709 12:16:49.842458 16786 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.828397 10737 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.843142 10737 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.844601 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.831784 16779 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.846788 16779 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.846513 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:49.848578 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:49.848912 16779 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.822101 16439 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.850749 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.851248 10728 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:49.851583 10728 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:49.852301 10728 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.852681 10019 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.853397 10728 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:49.853827 16366 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.855036 10197 raft_consensus.cc:1240] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 13. Current term is 14. Ops: []
I20260709 12:16:49.836691 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add21891a8334a65adf1e2611b794222"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:49.859083 10737 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:16:49.859280 10051 raft_consensus.cc:606] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.859689 16439 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.822954 16651 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:49.826822 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:49.861186 10050 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.861466 10047 raft_consensus.cc:1240] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22. Ops: []
I20260709 12:16:49.862398 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.863425 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.864995 10046 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:49.836802 16472 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.833953 16649 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.867163 10127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 2328) took 1121 ms. Trace:
I20260709 12:16:49.867574 10127 rpcz_store.cc:276] 0709 12:16:48.745329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.756826 (+ 11497us) service_pool.cc:224] Handling call
0709 12:16:49.866980 (+1110154us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001900d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:49.867108 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409091328}
I20260709 12:16:49.868729 16649 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:49.871743 10196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1220) took 1004 ms. Trace:
I20260709 12:16:49.784523 16790 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:49.878295 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.831506 16724 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40172 (request call id 0) took 1971 ms. Trace:
I20260709 12:16:49.859684 10051 raft_consensus.cc:614] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:49.873219 10737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:16:49.881074 10737 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.881321 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.826464 16770 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:49.872249 10055 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:16:49.874893 16754 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.916s	user 0.002s	sys 0.002s
I20260709 12:16:49.875708 16570 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:49.887579 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:49.872135 10196 rpcz_store.cc:276] 0709 12:16:48.867379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.868334 (+   955us) service_pool.cc:224] Handling call
0709 12:16:48.868573 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:48.900560 (+ 31987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:48.900591 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:48.900634 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:16:48.900663 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:49.850272 (+949609us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54003142d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:49.850316 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:49.871685 (+ 21369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73093504}
I20260709 12:16:49.888633 10202 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:16:49.890231 10202 pending_rounds.cc:85] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 11
I20260709 12:16:49.891290 10202 pending_rounds.cc:107] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:16:49.890110 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.891558 10202 raft_consensus.cc:2889] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:49.891862 10203 raft_consensus.cc:2393] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:49.892736 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:49.893347 10202 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:49.774113 16404 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:16:49.875937 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.881511 10737 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.866164 16472 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.815441 16356 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.875514 10053 raft_consensus.cc:3055] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:49.895229 10053 raft_consensus.cc:740] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:49.880087 10047 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:49.885978 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:49.840430 10730 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:49.890156 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.889016 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.876461 16203 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:49.890792 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.890911 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.898155 10050 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:49.898748 10196 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:49.896451 10127 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.821604 16785 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.878360 16366 consensus_queue.cc:1059] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:49.903628 16467 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.904531 16472 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:49.894889 16639 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.906247 16639 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.908782 16639 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:49.911010 16758 raft_consensus.cc:2764] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:16:49.913055 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:49.913648 10197 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:49.914579 10734 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:49.915187 10054 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:49.916268 16736 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.880581 16724 rpcz_store.cc:276] 0709 12:16:47.859846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:47.860079 (+   233us) service_pool.cc:224] Handling call
0709 12:16:48.116321 (+256242us) ts_tablet_manager.cc:1151] Deleting tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1
0709 12:16:48.121440 (+  5119us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:16:49.454540 (+1333100us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:49.663276 (+208736us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:49.831415 (+168139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":255183,"thread_start_us":110180,"threads_started":1}
I20260709 12:16:49.923410  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:16:49.896306 16369 consensus_queue.cc:1059] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:16:49.927430 16762 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:49.927906 16762 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:49.928740 16762 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:49.930696 16736 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:16:49.886483 16770 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.935372 16770 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.910130 10737 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.936532 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:49.937252 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:49.902323 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 125698us
I20260709 12:16:49.938169 10203 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:49.939262 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.944792 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:49.895958 10053 consensus_queue.cc:260] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:49.949426 10053 raft_consensus.cc:3060] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:49.957612 10168 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:49.958644 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.958998 10053 raft_consensus.cc:1275] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:49.959390 10197 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:49.960106 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.959728 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:49.962908 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.970506 10127 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:49.971611 10737 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:49.978667 10202 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:49.981065 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:50.009706 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:49.983489 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:49.976286 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:49.984584 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:49.983424 16765 raft_consensus.cc:3055] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:16:49.991261 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:49.992987 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:49.946987 16651 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.996131 10124 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:49.996558 10168 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:49.997109 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 95577.1us
I20260709 12:16:49.982574 16786 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:16:49.948897 16785 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:49.965693 16203 consensus_queue.cc:1243] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:16:49.961068 16790 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:49.999945 10729 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:16:50.028906 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:50.000552 16369 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:50.001103 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.002125 10702 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.998158 16632 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:50.004981 16442 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:50.005827 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.006381 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.006920 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:49.960512 10728 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:16:50.012266 10201 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:50.017907 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:50.020579 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.021898 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:50.045588 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:50.012719 16765 raft_consensus.cc:740] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:50.108467 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.153811 10121 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:50.154441 10728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52022 (request call id 1178) took 1214 ms. Trace:
W20260709 12:16:50.139452 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59640.7us
I20260709 12:16:50.029929 16746 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:16:50.155483 16484 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:16:50.157148 10051 raft_consensus.cc:606] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:50.157259 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 155203us
I20260709 12:16:50.157995 10702 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.023283 16345 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:50.072903 16793 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.131s
I20260709 12:16:50.160529 15999 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:16:50.078802 16790 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.081625 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.163929 16790 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:50.164108 16746 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:50.028807 16768 consensus_queue.cc:1059] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.140s
W20260709 12:16:50.158093 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 136281us
I20260709 12:16:50.086882 10124 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:16:50.107450  9945 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 12 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.166117  9945 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:50.167932 16765 consensus_queue.cc:260] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.168108  9945 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 10 to 15, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 15 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.158798 10728 rpcz_store.cc:276] 0709 12:16:48.939792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.939998 (+   206us) service_pool.cc:224] Handling call
0709 12:16:48.940247 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:49.851160 (+910913us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b540015a2a0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e707dc0 00007fc17e7921c0 00007fc17e793231 00007fc17e78fd8f 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c
0709 12:16:50.154047 (+302887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.154361 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11937664}
I20260709 12:16:50.023980 16651 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.173647 16651 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:50.174103 16770 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.174629 16770 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:50.163939 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 82405.6us
W20260709 12:16:50.177932 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.170501  9945 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:50.156062 16442 consensus_queue.cc:1243] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:16:50.026310 16757 consensus_queue.cc:1059] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.137s
I20260709 12:16:50.175201 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:50.169169 16765 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:50.179801 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:50.186774 10051 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:50.187333 16651 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:16:50.189086  9945 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 8 to 17, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:50.189917 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:50.190255 16345 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:50.191437 10204 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
W20260709 12:16:50.159090 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 141247us
I20260709 12:16:50.192730 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:50.193535 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.213861 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:50.230016 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.230783 10124 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:50.199988 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:50.186110 16681 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:50.232179 10126 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:50.195853 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.179744 16706 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:50.239398 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:50.240000 10051 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.241684 16706 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:50.242188 16706 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:50.242627 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50565.7us
I20260709 12:16:50.104206 16356 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.176674 16484 consensus_queue.cc:1048] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:16:50.245899 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:50.246766 16758 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:50.247949 16758 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:50.248351 16758 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:50.236824 10126 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:50.237753 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:50.249372 16758 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.251770 10050 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:16:50.238308 16709 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:16:50.251917 16762 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:50.253082 16746 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:50.253507 16746 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.253835 16746 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.191720 16770 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.255519 16586 raft_consensus.cc:3055] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:50.255096  9945 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 14 to 16, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.257395  9945 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 14 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:50.248288 16706 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:50.258967 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.259507 10126 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.260608 10126 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.263929 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.264309 10019 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.265239 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.265879 10129 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:50.265897 10046 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:50.255927 16586 raft_consensus.cc:740] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:50.267560 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.276494 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.279831 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.198792 16203 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:50.281370 16345 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.281594 16586 consensus_queue.cc:260] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.285387 16590 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:50.197925 16570 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:16:50.274873 16770 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:50.232295 16404 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 12:16:50.286958 16559 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:16:50.291497 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 289105us
I20260709 12:16:50.292518 10020 leader_election.cc:400] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:50.292900 10020 leader_election.cc:403] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:16:50.293593 16691 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:50.301600 10126 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:16:50.195950 16676 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:16:50.343150 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 66555.2us
I20260709 12:16:50.194926 16442 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:50.292749 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:16:50.347407 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54731.4us
I20260709 12:16:50.348215 10094 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.188287 16759 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 12:16:50.201696 16784 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:16:50.347407 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71018.3us
I20260709 12:16:50.350239 10020 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.353807 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.296538 16758 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:50.357645 10094 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:50.360010 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.303551 16681 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
W20260709 12:16:50.365051 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.368242 10197 raft_consensus.cc:1240] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:50.368309 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:50.354667 16010 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:50.345512 16770 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:50.342233 16676 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:50.366000 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:50.353253 16422 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:50.388814 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.347020 16442 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.357971 16784 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.401278 10733 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:50.356406 16643 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:50.406163 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.395243 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:50.361128 16195 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:50.414180 10200 raft_consensus.cc:1217] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Deduplicated request from leader. Original: 18.15->[19.16-20.17]   Dedup: 19.16->[20.17-20.17]
I20260709 12:16:50.426039 10200 raft_consensus.cc:1240] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: [19.16-20.17]
I20260709 12:16:50.412352 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:50.361232 16559 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:50.429546 10019 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.388641 16644 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:50.394711 16790 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:50.431387 10731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.025s	sys 0.060s
W20260709 12:16:50.441675 10731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.025s	sys 0.061s
I20260709 12:16:50.405357 16686 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:50.428289 16170 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:50.429623 16770 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:50.432698 16779 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:16:50.437340 16697 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:16:50.439031 16644 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:50.450165 16170 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:50.454967 16644 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.455683 16170 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:50.443053 10200 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:50.434881 16545 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:50.405561 16442 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:50.410323 16351 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:50.411590 16784 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.446014 10121 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:50.411876 16786 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:16:50.452117 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.430178 16709 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:50.479270 16484 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:16:50.462991 16676 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.504122 10195 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:50.447165 16686 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:50.504988 16686 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.446826 16422 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:50.508551 16422 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.509030 16746 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.441068 16748 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:16:50.499465 16786 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:50.511723 16786 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:50.503244 16709 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.503721 16484 consensus_queue.cc:1243] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer 7c74f73af6ac4ce394a0ae7a2eefbeae log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:16:50.514981 10202 raft_consensus.cc:2393] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:50.441763 16651 consensus_queue.cc:1059] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 12:16:50.486330 16351 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:50.481030 16681 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.522028 16650 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:50.538612 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:50.529860 16748 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:16:50.608227 16760 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.608669 16746 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:50.571461 16422 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:50.608937 16760 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.570984 16748 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:50.617900 16760 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:50.570523 16651 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 12:16:50.640331 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:50.639154 16472 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:16:50.694319 16803 log.cc:927] Time spent T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:16:50.693025 16709 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.652302 16686 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.741398 16170 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.655664 16748 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.768437 16748 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:50.772116 16170 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:50.752581 16796 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:16:50.730005 16442 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.791802 16442 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:50.726274 16784 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.794365 16784 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.765702 16786 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.748090 16686 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:50.796972 16786 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.803829 10731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52036 (request call id 1309) took 1049 ms. Trace:
I20260709 12:16:50.804376 10731 rpcz_store.cc:276] 0709 12:16:49.754562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.754699 (+   137us) service_pool.cc:224] Handling call
0709 12:16:49.754974 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:49.759908 (+  4934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:49.759938 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:49.760384 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:16:50.442093 (+681709us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:16:50.637475 (+195382us) log.cc:844] Serialized 14 byte log entry
0709 12:16:50.637911 (+   436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.637989 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:50.803619 (+165630us) raft_consensus.cc:1685] finished
0709 12:16:50.803641 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:50.803768 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":314749,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":5483,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10718,"spinlock_wait_cycles":3036416,"thread_start_us":876457,"threads_started":2,"wal-append.queue_time_us":881613}
I20260709 12:16:50.871572 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:50.874662 10052 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 12:16:50.875051 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:50.875895 10046 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:16:50.280418 10051 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
W20260709 12:16:50.890588 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 460949us
I20260709 12:16:50.893923 10126 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:50.900352 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:50.904284 16330 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.904454 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:50.905575 10735 raft_consensus.cc:2368] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:50.905370 16330 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.906038 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:50.908448 16330 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:50.908751 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:50.909828 16010 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:16:50.934943 10020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.007s
W20260709 12:16:50.935397 10020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.015s	sys 0.007s
I20260709 12:16:50.938254 16802 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:50.943569 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:50.944808 10733 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:16:50.945627 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45801.2us
I20260709 12:16:50.950011 16010 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:50.952677 16010 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:50.868402  9945 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 14 to 16, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.964557 16790 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.965917 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:50.966261 16790 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:50.932737 16330 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:50.969259 16790 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:50.980731 10050 raft_consensus.cc:1240] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:16:50.981906 16804 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:50.982378 10094 leader_election.cc:400] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:51.018831 10094 leader_election.cc:403] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:16:50.984196 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.019883 10050 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:50.991765 16748 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:16:50.997656 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 50416.2us
I20260709 12:16:51.004199 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.010824 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:50.995388 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.015615 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.014647 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:51.041713 10046 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:51.005137 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.019958 16758 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:51.055377  9945 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.010308 16345 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:51.057621 16345 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:50.983665 16804 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:51.058813 16804 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:51.059279 16586 raft_consensus.cc:3060] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:51.060245 16804 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.062075 16804 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:50.979465 16770 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.056597 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:51.070453 16351 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.072686 16351 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:51.076902 10702 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.083720 10169 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.083940 16681 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:51.086021 16681 raft_consensus.cc:2804] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:51.094349 16681 raft_consensus.cc:697] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:51.094488 10127 raft_consensus.cc:3060] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:51.095072 10735 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:51.096159 10204 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:51.097345 10051 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:51.099676 16790 raft_consensus.cc:993] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:16:51.096436 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:51.107714 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:51.055409 16746 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:16:51.108685 10047 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:51.113170 16330 raft_consensus.cc:1081] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:16:51.113539 16746 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:51.115917 16330 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:51.116315 16330 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.116700 16330 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:51.116981 10048 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:51.113822 16770 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.121584 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.122686 10051 raft_consensus.cc:2393] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:51.124506 16790 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.125133 16650 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:51.125329 16790 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.125669 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:51.126449 16650 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:51.126869 16650 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:51.127957 16650 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.129613 16650 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:51.113689 10731 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:16:51.130976 10731 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:51.131929 10731 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.133051 10731 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:16:51.133860 16797 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.633s	user 0.002s	sys 0.038s
I20260709 12:16:51.099587 16681 consensus_queue.cc:237] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.148944 10733 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:51.156049 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:51.127790 10204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:16:51.159591 10204 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.160070 10204 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:51.186939 16706 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:51.188148 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.161705 16770 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:51.332408 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 166268us
I20260709 12:16:51.114007  9945 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 17 to 19, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 19 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.115953 16746 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.400835 10127 raft_consensus.cc:2468] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
W20260709 12:16:51.401820 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 229974us
I20260709 12:16:51.408564 10198 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 14.
I20260709 12:16:51.405110 16586 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:51.410270 16586 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.410645 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.411846 16819 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.412616 16586 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.412444 16819 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.423537 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.424391 10123 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 17.
W20260709 12:16:51.431457 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.432904 16790 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.433499 16784 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.436524 16345 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:51.450598 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.452457 16330 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.453409 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:51.453557 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.455376 10733 raft_consensus.cc:1275] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 12:16:51.455730 10733 pending_rounds.cc:85] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting all ops after (but not including) 16
I20260709 12:16:51.455971 10733 pending_rounds.cc:107] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 12:16:51.456225 10733 raft_consensus.cc:2889] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:51.456909 10737 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:51.457711 16330 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.458881 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.405385 16770 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.415107 16808 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:51.484934 16824 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:16:51.485090 16709 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.485299 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:51.485927 10730 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:51.486241 16762 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.487013 16762 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.489216 16686 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:51.489468 16689 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.490728 16820 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.491381 16820 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.493436 10202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38758 (request call id 2820) took 1081 ms. Trace:
I20260709 12:16:51.493892 10202 rpcz_store.cc:276] 0709 12:16:50.366901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.368101 (+  1200us) service_pool.cc:224] Handling call
0709 12:16:51.448243 (+1080142us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000e9cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:51.448449 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333217536}
I20260709 12:16:51.496464 16819 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.434221 16784 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.482210 16345 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.481099 16330 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.485872 16709 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.500396 16330 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.497267 16808 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.503810 10730 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:51.505303 10019 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:51.489962 16686 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.508383 16686 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.484961  9945 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 12 to 14, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:51.509958  9945 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:51.490267 16689 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.513891 16758 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:51.514739 16689 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.515048 16770 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.515588 16345 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.517598 16345 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.519771 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.522729 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.525308 10123 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:51.526517 16356 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.527165 16356 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.529968 16356 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.531646 16300 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:51.531864 16785 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:51.532373 16785 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:51.533411 16785 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.534281 16820 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.499585 16442 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:51.535292 16442 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:51.536243 16442 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.537212 10195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1223) took 1643 ms. Trace:
I20260709 12:16:51.537577 10195 rpcz_store.cc:276] 0709 12:16:49.893766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.898999 (+  5233us) service_pool.cc:224] Handling call
0709 12:16:50.503957 (+604958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:50.504531 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.536839 (+1032308us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54000e97d0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:51.537044 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390590848}
I20260709 12:16:51.538378 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.540453 10049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53728 (request call id 3006) took 1698 ms. Trace:
I20260709 12:16:51.540849 10049 rpcz_store.cc:276] 0709 12:16:49.841495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:49.842396 (+   901us) service_pool.cc:224] Handling call
0709 12:16:49.842895 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:16:49.843231 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:49.843260 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:16:49.843817 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 12:16:50.232768 (+388951us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:16:50.232808 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:50.232877 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:51.132969 (+900092us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:51.539936 (+406967us) raft_consensus.cc:1685] finished
0709 12:16:51.539961 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:51.540264 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1627,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":21347072,"thread_start_us":388473,"threads_started":1,"wal-append.queue_time_us":597304}
I20260709 12:16:51.545508 16762 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.546280 10731 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:16:51.547031 16768 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:16:51.548770  9945 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:51.514607 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:51.551100 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 77147.3us
I20260709 12:16:51.550957  9945 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 10 to 11, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 11 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.553011 16676 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:51.555867 16170 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:51.556443 16170 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:51.557466 16170 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.558701 16759 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:51.565110 10728 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:51.566283 16827 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.566900 16827 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:51.566795 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.580454 16827 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.581790 16831 raft_consensus.cc:493] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.582569 16831 raft_consensus.cc:515] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.585085 16831 leader_election.cc:290] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.585794 16831 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.586823 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.588009 16784 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.589720 16748 consensus_queue.cc:1048] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:16:51.573207 10204 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.600000 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:51.573167 10737 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:51.592118 16808 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.590348 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.592878 16746 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:51.602164 16330 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.620302 10122 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:51.621951 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:51.623607 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.624058 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.631471 16784 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.632357 10204 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.619403 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.632618 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.634654 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:51.650573 10123 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:51.532306 16300 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.678200 16422 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.678861 16422 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.680451 16300 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.680927 16422 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.657342 10047 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:51.681846 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.666337 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.655377 16330 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:16:51.683341 16330 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.683748 16330 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:16:51.686564 16829 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.687163 16829 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.689445 16829 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.676599 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.663365 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.690821 10127 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:51.682816 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.694069 10051 raft_consensus.cc:2393] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 19: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:51.668635 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:51.695389 10202 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:51.697243 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.697932 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.699805 10047 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:51.705658 16330 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.668444 16748 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:51.711035 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.711519 16784 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:51.712617 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 122415us
W20260709 12:16:51.697083 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44889us
I20260709 12:16:51.712510 16760 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.710528 16830 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.746517 10198 raft_consensus.cc:1240] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []
I20260709 12:16:51.647697 16831 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.744207 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:51.742596 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67478.4us
I20260709 12:16:51.749454 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:51.746284 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.757784 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.760915 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:51.761910 10200 raft_consensus.cc:2393] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 22: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:51.762956 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.763656 10124 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:51.772051 16330 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.772261 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.772964 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:51.753567  9945 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 7 to 13, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 13 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:51.749269 16760 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.775991 10198 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:51.776479 16760 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.753607 16830 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.759016 16300 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:51.778352 16300 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.778769 16784 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.778986 16830 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.779536 10195 raft_consensus.cc:2393] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 19: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:51.779569 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:51.777105 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:51.783298 16804 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:51.783811 16804 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:51.784754 16804 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.783994 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.775307  9945 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 11 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.783440 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.789701 10202 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:16:51.795776 16753 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:51.796254 16753 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.796610 16753 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:51.798820 16691 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:51.799401 16691 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.802567 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.803228 10197 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:51.803812 10200 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:16:51.803929 10129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2884) took 1394 ms. Trace:
I20260709 12:16:51.805127 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.804349 10129 rpcz_store.cc:276] 0709 12:16:50.409678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.409821 (+   143us) service_pool.cc:224] Handling call
0709 12:16:50.431996 (+ 22175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:50.440311 (+  8315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:50.440341 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:51.546535 (+1106194us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b2c00010c48. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d099372 00007fc17e7cba01 00007fc17e79043a 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2
0709 12:16:51.547058 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:16:51.648013 (+100955us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:16:51.648048 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:51.656535 (+  8487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:51.803495 (+146960us) raft_consensus.cc:1685] finished
0709 12:16:51.803513 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:51.803750 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45688,"raft.queue_time_us":8147,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":5611392,"thread_start_us":100538,"threads_started":1,"wal-append.queue_time_us":232568}
I20260709 12:16:51.807583 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.808280 10051 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:51.808617 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.809324 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.810817 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:51.814890 10049 raft_consensus.cc:3055] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:16:51.815196 10049 raft_consensus.cc:740] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:51.816571 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.814265 10204 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:51.817206 10047 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:51.821316 10019 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.826201 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.832327 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.832712 10128 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:16:51.832989 10203 raft_consensus.cc:2468] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
I20260709 12:16:51.833828 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.833609 10049 consensus_queue.cc:260] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.834352 10203 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:51.834631 10049 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:51.836758 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.837913 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.839489 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:51.840036 10202 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:16:51.840580 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57237.7us
I20260709 12:16:51.844936 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.849741 16834 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:51.853353 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:51.857271 10049 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:51.815269 16784 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:51.864461 10202 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:51.867394 10128 raft_consensus.cc:3060] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:51.874557 16829 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.875451 16300 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.868148 10204 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 15.
W20260709 12:16:51.850893 16330 consensus_queue.cc:1175] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" responder_term: 18 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:16:51.828044 16442 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:16:51.874387 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 198434us
I20260709 12:16:51.858952 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.850594 16834 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:51.873283 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.875181 16829 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.868008 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.887899 10047 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:51.884372 10122 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:51.884495 10055 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
W20260709 12:16:51.893481 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.890527 10019 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.893803 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.892776 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:51.901468 10728 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:51.902688 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:51.903295 10129 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:51.900552 10019 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.897053 10121 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:51.896361 10020 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.910666 16836 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 12:16:51.912768 16837 log.cc:927] Time spent T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:16:51.915217 16831 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:51.918813 10167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:51.919539 16829 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.921586 16833 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.922199 16833 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.924553 16833 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.925706 10197 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:16:51.927075 16709 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.889350 16834 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.927785 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.928537 10197 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:51.931234 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.906778 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.939244 10169 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:51.940567 10169 leader_election.cc:304] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:51.947031 16689 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:16:51.943181 16834 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:51.950922 16831 raft_consensus.cc:2749] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:51.927083 16835 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.951856 16835 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.954144 16835 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:51.906468 16785 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:51.908797 16808 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:16:51.980955 16808 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:51.982007 16808 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.982913 10128 raft_consensus.cc:2468] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:16:51.955163 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.960718 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.984030 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.941910 10094 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:51.966768 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.966686 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.967649 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:51.969607 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 73334.4us
I20260709 12:16:51.968456 10053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:51.987046 10200 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:51.987100 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.968724 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:51.968890 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.959285 16790 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:51.957958 16676 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:51.970224 16691 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:51.993294 10169 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:51.970777 16830 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:51.995566 16830 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:51.996186 16422 raft_consensus.cc:2804] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:51.996729 16422 raft_consensus.cc:697] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:51.997643 16830 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.972057 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.997646 16422 consensus_queue.cc:237] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:51.999017 16844 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 12:16:51.968386 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.973098 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.000859 10020 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:16:52.001657 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59840us
I20260709 12:16:51.907239 16753 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:51.978957 16770 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:51.970654 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.964687 16330 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:51.967063  9945 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 15 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.986203 10049 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:51.987447 10053 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.013556 10053 raft_consensus.cc:614] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:51.989075 10196 raft_consensus.cc:2368] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:51.989274 16748 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:51.959313 16785 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:51.990118 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:51.990736 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:51.959762 16836 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:51.992457 16676 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.001199 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.001538 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:52.012151 16833 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:16:52.013813 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45277.1us
I20260709 12:16:52.016011 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.020946 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:51.955863 16829 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:52.014599 16835 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.011737 16691 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:52.013207 16790 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:52.020076 16785 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:52.055778 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.026199 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:52.015686 16748 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:52.028641 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 62351.9us
I20260709 12:16:52.028590 10052 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:52.019765 16804 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:52.068037 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.053500 16833 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.068684 10094 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.027607 16681 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:52.057116 16829 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.030882 16676 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.076727 10735 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:52.076870 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:52.060249 10020 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.057263 16691 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:52.064116 16748 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.058187 16709 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:52.062819 16300 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.063265 16804 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:52.088758 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.028010 16457 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:16:52.038983 16762 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.069196 16836 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:52.090451 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.090530 10052 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:16:52.092556 16369 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:52.094329 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.094631 16786 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:52.096390 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.119612 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.097024 16689 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:16:52.076274 16833 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.036446 16330 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.089620 16691 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.080117 16681 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.110962 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.121361 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:52.111167 10020 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.083648 16829 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:52.113410 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.111756 16790 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:52.112684 16804 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:52.136755 10094 leader_election.cc:400] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:52.135492 10201 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:52.137111 10094 leader_election.cc:403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:52.137979 16762 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.138767 16590 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:16:52.139148 16590 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.139461 16590 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.140369 16762 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.140942 16762 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:52.119410 16836 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.085178 16835 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.125335 16709 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:52.163609 10051 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:52.162936 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.122268 16786 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.121685 16689 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:52.120345 16746 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.131923 16681 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:52.179318 10095 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.124679 16827 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 12:16:52.201062 16851 log.cc:927] Time spent T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 12:16:52.153556 16836 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.166857 16439 consensus_queue.cc:1059] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 12:16:52.198630 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.211206 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.211886 10201 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 23.
I20260709 12:16:52.125164 16300 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.187299 16689 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:52.165100 16786 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:52.186590 16356 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:16:52.224205 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.163903 16709 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.166930 16762 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:16:52.229506 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:52.236938 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 167830us
I20260709 12:16:52.207655 16834 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.226799 16753 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:52.231446 16709 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:52.207708 16746 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.231209 16832 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:16:52.244716 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 65496.3us
I20260709 12:16:52.229563 16830 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:16:52.253526 16836 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.255373 16835 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.259756 16300 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.260771 16834 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.263705  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:52.235097 16819 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:52.266923 16709 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.253556 10054 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22. Ops: []
I20260709 12:16:52.268033 10053 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:52.238957 16808 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:16:52.269001 16808 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.269362 16808 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:52.274804 16757 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:52.275264 16757 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:52.276156 16757 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.277539 16757 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.278648 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.253890 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.279963 10732 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:52.280515 10053 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:52.280882 16790 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:52.285502 16676 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:52.287052 16709 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.290932 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:52.293545 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.294142 10198 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:52.305379 10197 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:52.308924 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.309659 10203 raft_consensus.cc:2368] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
W20260709 12:16:52.311113 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 238243us
I20260709 12:16:52.312160 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.315747 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.304677 16457 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:52.324990  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.259826 16785 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.332155 16785 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.320919 16457 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.318367 16832 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:52.335848 10046 raft_consensus.cc:2368] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22.
I20260709 12:16:52.338193  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.324144 16860 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.172696  9945 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 6 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:52.398222 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 167843us
I20260709 12:16:52.400794 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.342983 16457 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:52.323385 16804 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.336431 16829 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
W20260709 12:16:52.421657 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 136862us
I20260709 12:16:52.347930 16786 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.423547 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.424109 10123 raft_consensus.cc:3060] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:52.351563 16748 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.436949 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.437295 16790 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.437693 10733 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:52.442765 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.441154 16790 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.418121 16330 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.453541 16590 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.455317 16864 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:52.456349 16790 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.397107 16860 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.464466 16748 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.472414 16786 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.474165 16829 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:52.496338 16826 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:16:52.497473 16784 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.497917 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.498061 16784 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.498696 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.499017 16804 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.499367 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.500264 16784 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.501092 16860 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:52.482762 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.502614 10198 raft_consensus.cc:2368] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:52.505300 10195 raft_consensus.cc:2393] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 17: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:52.506590  9945 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 13 to 14, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 14 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:52.508102  9945 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:52.509300 16691 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:52.456267 16746 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:52.483700 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 162815us
I20260709 12:16:52.513399 16681 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.516435 16590 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.427045 16833 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.522809 10203 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 22: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:52.519775 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.511881 10123 raft_consensus.cc:2468] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:52.527949 16786 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.542956 16858 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.543190 10019 leader_election.cc:400] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:52.542737 16786 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.543751 16790 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.544281 16790 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.545042 16786 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.518368 16356 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 14. Current term is 15.
I20260709 12:16:52.542098 16833 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.519366 16689 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.547565 16691 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.548372 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:52.538620 16859 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.550014 10195 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:16:52.549901 16859 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.551883 16859 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.556861 16859 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.557484 16859 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.543531 10019 leader_election.cc:403] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:16:52.559537 10019 leader_election.cc:400] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:52.559824 10019 leader_election.cc:403] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:16:52.559964 16859 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.560735 16859 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:52.546213 16790 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.543526 16858 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.517987 16808 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.538775 16834 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.562947 16689 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.563485 16762 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.541338 16836 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:52.571668 10094 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:52.578769 16864 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:52.509616  9945 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.584331 10047 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 24: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:52.565572 10169 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:52.581394 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 144585us
I20260709 12:16:52.588827 10735 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:16:52.589880 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.590611 10051 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:16:52.578926 16833 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.592871 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.595086 10051 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:52.595806 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.596506 10202 raft_consensus.cc:2368] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20.
I20260709 12:16:52.596412 10053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.599148 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.599543 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.600109 10046 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.602658 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:52.603235 10733 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.603940 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:52.614694 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 138996us
I20260709 12:16:52.594485 16836 raft_consensus.cc:2804] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:52.616053 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.591192 16369 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:52.665668 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.666471 10095 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.666724 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.719061 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.671303 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:52.671098 16369 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:52.673035 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:16:52.727547 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 61173.5us
I20260709 12:16:52.731710 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:52.733865 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.734047 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.734571 10128 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:16:52.734491 10123 raft_consensus.cc:3060] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.735587 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:52.738742 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:52.727824 16369 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:52.729475 10129 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:16:52.729913 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 124063us
W20260709 12:16:52.730995 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 58020.8us
I20260709 12:16:52.740048 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.707613 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.749027 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.749395 16457 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.751698 16457 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.754568 16644 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:52.755019 16644 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.755357 16644 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:52.758643 16784 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.759167 16784 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.762001 16709 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.762590 16709 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.763069 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.763833 10054 raft_consensus.cc:2393] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:52.764633 16709 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.737495 16170 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:52.770570 10128 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:16:52.771806 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:52.772378 10204 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.777011 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.778414 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:52.781562 16681 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:52.745930 10124 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:52.595500 16859 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 12:16:52.746131 10052 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:52.785032 10052 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:16:52.782342  9945 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:52.740490 16836 raft_consensus.cc:697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:52.785694 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.743045 16829 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:16:52.786337 16829 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:52.786576 16836 consensus_queue.cc:237] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.604460 16833 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.792168 10121 raft_consensus.cc:1275] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:16:52.795006 10054 raft_consensus.cc:2368] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18.
I20260709 12:16:52.796679 10051 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:52.797493 10202 raft_consensus.cc:2368] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
W20260709 12:16:52.798256 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60398.2us
I20260709 12:16:52.799041 10095 leader_election.cc:400] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22.
I20260709 12:16:52.799314 10095 leader_election.cc:403] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:52.742502 16748 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:52.800118 16748 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:52.800463 16748 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.721314 16819 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:52.801987 10204 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:52.770159 10733 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:52.667513 16691 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 12:16:52.793371 16829 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:52.796680 10123 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:52.805142 10046 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:52.811931 16868 raft_consensus.cc:2764] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:16:52.813568 10121 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:52.812381 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:52.815271 10169 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:52.826354 10129 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:52.604621 16834 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.838348 16878 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:16:52.837359 16746 consensus_queue.cc:1048] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:16:52.841365 16644 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.833549 16681 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:52.842866 16681 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:52.843809 16681 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:16:52.838372 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.845628 10046 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:52.845983 10050 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:16:52.803856 16676 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:16:52.847323 16356 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:52.834373 16422 raft_consensus.cc:2804] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:52.849050 16422 raft_consensus.cc:697] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:52.826637 16864 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:16:52.851684 16422 consensus_queue.cc:237] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.855118 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:52.858960 16829 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:52.850502 16356 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.861901 16829 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.884436 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.884708 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.889967 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.890362 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.893247 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.893939 10125 raft_consensus.cc:2368] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:52.895040 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.895560 16784 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.895794 10125 raft_consensus.cc:2368] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:52.897094 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.898514 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.903103 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.908655 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.909838 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.911171 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.913403 10130 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.912451 16356 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.912704 16644 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:52.906855 10124 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 15.
I20260709 12:16:52.928063 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:52.929097 10734 raft_consensus.cc:3060] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:52.945436 10701 leader_election.cc:400] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20.
I20260709 12:16:52.945888 10701 leader_election.cc:403] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:16:52.947265 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.955858 16877 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:16:52.956321 16877 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:52.956804 16879 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.141s	user 0.009s	sys 0.000s
W20260709 12:16:52.957868 16870 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.204s	user 0.008s	sys 0.005s
I20260709 12:16:52.954259 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:52.958448 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.960112 10055 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:16:52.964781 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:52.959291 16873 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:52.981137 10734 raft_consensus.cc:2468] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:52.982594 16858 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.983213 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.985042 16676 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:16:52.995467 10048 raft_consensus.cc:2368] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20.
I20260709 12:16:52.986613 16834 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:52.986692 16762 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:52.997681 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:52.998389 10050 raft_consensus.cc:2368] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:52.999933 16203 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:16:53.001925 10130 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 18.
I20260709 12:16:52.979676 16748 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.005056 16748 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:53.006161 10125 raft_consensus.cc:2368] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:53.002832 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:53.007269 10730 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:16:52.991221 10126 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:16:53.008800 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:52.992519 16860 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20.
I20260709 12:16:53.011992 10169 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:53.013110 16681 raft_consensus.cc:2804] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:53.013587 16681 raft_consensus.cc:697] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:53.015149 10126 raft_consensus.cc:1275] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:16:53.016621 16681 consensus_queue.cc:237] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:52.988938 16369 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.020586 16369 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:53.021555 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.022554 16632 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:53.025228 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:53.026010 16746 consensus_queue.cc:1048] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:16:52.996312 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:53.028237 10048 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 24: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:52.998297 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:53.034744 10730 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 24.
I20260709 12:16:53.051095 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:53.051848 10730 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:53.054802 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.056061 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
W20260709 12:16:53.057729 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59514.9us
I20260709 12:16:53.058966 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:53.059250 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:53.061686 10048 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:16:53.075479 10730 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:53.054702 10055 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:16:53.083843 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:53.098801 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.091737 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:53.102279 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.078178 16706 raft_consensus.cc:2764] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:16:52.990352 16873 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.110699 10094 leader_election.cc:400] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:53.124006 10094 leader_election.cc:403] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:16:53.116318 16757 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:16:53.117010 16875 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:16:53.122120 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:53.131829 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:53.130765 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:53.131350 16833 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:53.135563 16878 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22.
I20260709 12:16:53.136001 16457 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:53.136754 10128 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:16:53.135447 16170 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595) with higher term. Message: Invalid argument: T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:53.119182 16760 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:53.141983 10200 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 24: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
W20260709 12:16:53.142972 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 75228.4us
I20260709 12:16:53.147100 10702 leader_election.cc:400] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18.
I20260709 12:16:53.147302 10019 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:53.136528 16457 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:53.162868 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:53.203502 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 106483us
I20260709 12:16:53.207269 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:53.209406 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.162510 16833 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:16:53.225044 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:53.157891 16639 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
W20260709 12:16:53.211205 16866 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:16:53.234807 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:53.235358 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 82320.7us
W20260709 12:16:53.237782 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 104175us
I20260709 12:16:53.246805 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.247200 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:53.232004 16833 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:53.256085 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.256850 10127 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:53.254153 16639 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:16:53.250289 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.231014 16872 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:16:53.251922 10702 leader_election.cc:400] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20.
I20260709 12:16:53.275969 10048 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:53.283262 10020 leader_election.cc:400] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:53.284268 10020 leader_election.cc:400] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:53.284567 10020 leader_election.cc:403] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:53.284348 16785 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:53.287683 10095 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:53.254953 16834 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:53.316300 16356 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:53.341708 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 57576.3us
I20260709 12:16:53.342705 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.356305 10020 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.358011 10200 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:53.360639 10020 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.244125 16457 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.467667 16330 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:16:53.490984 16632 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:53.491734 16632 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.494061 16632 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:53.496578 16808 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:53.498028 16785 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 17. Current term is 18.
I20260709 12:16:53.467689 16790 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:16:53.501153 16888 log.cc:927] Time spent T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
W20260709 12:16:53.502767 16885 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:16:53.468228 16867 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.504212 16867 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:53.510813 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 150260us
I20260709 12:16:53.511795 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:53.514004 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 262406us
I20260709 12:16:53.519290 10020 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.357492 16836 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:53.535013 16836 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.537122 16836 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:53.527105 16588 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:53.522636 16834 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:53.532987 16890 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 12:16:53.525699 16833 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.545758 16899 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:53.546414 16899 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.548550 16899 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:53.551994 16889 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.470s	user 0.003s	sys 0.002s
I20260709 12:16:53.553457 16873 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:53.554594 16897 log.cc:927] Time spent T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:16:53.523689 16785 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:53.519047 16790 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:53.537865 16588 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.559105 16588 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:53.561439 16868 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:53.562028 16868 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.564092 16868 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:53.567976 16867 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:53.576830 16877 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.586519 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.595209 10728 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:16:53.584192 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:53.593689 10095 leader_election.cc:400] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21.
I20260709 12:16:53.599143 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:53.600901 16867 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:53.601408 16867 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:53.606495 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81408.7us
I20260709 12:16:53.607254 10020 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.608050 10128 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:53.617156 10053 raft_consensus.cc:2468] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:53.619048 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:53.620893 10095 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.622160 10095 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:53.622329 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:53.622938 10052 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:53.625561 16689 raft_consensus.cc:2749] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:53.625735 10195 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:16:53.629110 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:53.629765 10046 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:53.630062 10052 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
I20260709 12:16:53.631764 16892 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:16:53.632198 16892 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:53.640395 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.653616 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.610932 16632 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:16:53.670234 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:53.671111 10054 raft_consensus.cc:2393] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:53.667444 10095 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:53.620354 16790 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:53.682078 10020 leader_election.cc:400] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20.
I20260709 12:16:53.683597 10020 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.639734 16784 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:53.613263 16753 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:16:53.671398 16330 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:53.693542 16904 raft_consensus.cc:2749] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:53.679232 16632 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:53.695760 16632 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.666791 16808 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:16:53.703806 10020 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.602329 16867 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.639489 16804 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:16:53.708477 10020 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:53.720063 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:53.708873 16904 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:53.716425 16330 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:53.718858 16785 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:53.748260 10128 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:16:53.749104 10124 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:16:53.727674 16170 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:53.707494 16784 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:53.728746 16808 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:53.727162 16833 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.749039 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:53.773531 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 106180us
I20260709 12:16:53.782030 10127 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:53.782328 10095 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:53.784519 16457 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:53.788033 16457 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:53.794760 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:53.773361 16650 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:53.806201 16831 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:53.840456 16831 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.789098 16457 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.807314 16650 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.785446 16833 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.786755 16808 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:53.948609 16170 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:53.949221 16170 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:53.960918 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:53.961814 10728 raft_consensus.cc:2393] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 24: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:16:53.964479 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:54.011734 16858 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:16:54.028323 16874 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:54.035892 16874 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.037964 16877 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:16:54.039772 16203 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:54.093154 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.096297 10053 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53728 (request call id 3051) took 1500 ms (client timeout 1826 ms). Trace:
W20260709 12:16:54.096807 10053 rpcz_store.cc:269] 0709 12:16:52.596030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:52.596183 (+   153us) service_pool.cc:224] Handling call
0709 12:16:54.096057 (+1499874us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400274cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:16:54.096199 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323003648}
I20260709 12:16:54.111287  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:54.129786 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 347545us
I20260709 12:16:54.131629 16808 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.138024 16170 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:54.138957 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 174568us
I20260709 12:16:54.164875 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:54.166369 10046 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 21. Current term is 22. Ops: []
I20260709 12:16:54.167930 10048 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:54.172125 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.183588 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.185520 10129 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:54.184819 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:54.189091 10126 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:54.189174 16170 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:54.195477 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.067878 16203 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.207413 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.208105 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:54.208755 10048 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:54.214874 10052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.027s	sys 0.051s
W20260709 12:16:54.215257 10052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.027s	sys 0.051s
I20260709 12:16:54.217202 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:54.219683 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:54.220269 16831 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.222754 10048 raft_consensus.cc:1275] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:16:54.225003 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:54.227442 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.229528 16590 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:54.230062 16590 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.231956 16590 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:54.234908 16644 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:54.203994 16356 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:54.233909 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:54.241398 10048 raft_consensus.cc:1275] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:16:54.241439 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:54.244240 10049 raft_consensus.cc:2368] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23.
I20260709 12:16:54.221637 16859 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:54.248147 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:54.248942 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.254194 10020 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:54.240254 16650 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.224335 16588 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:54.256433 16650 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:54.228220 16831 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:16:54.261044 10050 raft_consensus.cc:1275] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:16:54.261647 10049 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:16:54.259373 10129 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:54.269102 16874 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.249995 16833 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.270354 16859 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:54.271800 16203 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.290546 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:54.240458 16422 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:16:54.286612 16762 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:54.272879 16790 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:54.264593 16650 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:54.292027 16859 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:54.286362 16914 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:54.321661 16650 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:54.321396 16914 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.306631 16762 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:54.322870 16762 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:54.325748 16914 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:54.254877 16356 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.256570 16588 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.298262 16833 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.354875 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:54.355836 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 152313us
I20260709 12:16:54.305130 16784 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:16:54.361943 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 159182us
I20260709 12:16:54.292768 16770 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:16:54.367465 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:54.369869 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:54.378965 10734 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:16:54.380168 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:54.383967 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 170458us
I20260709 12:16:54.420990 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.429826 10094 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:54.426883 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 193023us
I20260709 12:16:54.361763 16833 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.368274 16790 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.471266 10169 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:54.468498 16356 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:54.486817 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.487277 16836 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:54.480346 10127 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:16:54.482671 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.483579 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:54.467671 16920 log.cc:927] Time spent T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:16:54.493402 16911 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:16:54.495535 16833 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.495785 16867 consensus_queue.cc:1059] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:16:54.492246 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:54.491964 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.467367 16940 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.504509 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.505363 10169 leader_election.cc:400] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23.
I20260709 12:16:54.507381 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.508726 10169 leader_election.cc:403] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:54.509415 16831 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:16:54.513090 16422 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:54.514685 16422 consensus_queue.cc:1048] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:54.517887 10128 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:16:54.518656 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:54.520495 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:54.519731 16911 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:54.479210 16869 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.537437 10127 raft_consensus.cc:1240] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 21. Current term is 22. Ops: []
I20260709 12:16:54.536844 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:54.543846 10169 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:54.611748 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59616.9us
I20260709 12:16:54.486830 16650 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.615929 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:54.542374 16827 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:54.505970 16632 consensus_queue.cc:1048] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 12:16:54.496801 16928 consensus_queue.cc:1048] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:16:54.539501 16898 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 12:16:54.641321 10199 raft_consensus.cc:2410] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:16:54.540704 16762 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:54.620882 16889 log.cc:927] Time spent T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:16:54.538534 16869 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.655890 16650 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.532430 16940 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:54.658077 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:54.623208 16356 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:16:54.750154 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 92168.8us
I20260709 12:16:54.667357 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:54.548137 16926 consensus_queue.cc:1059] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.090s
I20260709 12:16:54.658700 16932 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 12:16:54.839962 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 172692us
W20260709 12:16:54.839082 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 87516us
I20260709 12:16:54.839226 10094 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:54.843770 16912 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:54.845073 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:54.845889 16914 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:54.755584 16873 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.747030 16827 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.172s
I20260709 12:16:54.757030 16588 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.754840 16941 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:54.842330 16898 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:54.667330 16911 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:54.881862 16859 consensus_meta.cc:287] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.001s
I20260709 12:16:54.882481 16790 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.874876 16949 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:54.883172 16949 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.883945 16952 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:54.884477 16952 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.885406 16949 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.887225 16762 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.889017 16203 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.887234 16859 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.864790 16873 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.890897 16203 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.891642 16859 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:54.892702 16873 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.893100 16952 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:54.896452 16831 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801) with higher term. Message: Invalid argument: T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23.
I20260709 12:16:54.892761 16203 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:54.899887 16910 log.cc:927] Time spent T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 12:16:54.905464 16929 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:16:54.913038 16940 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:54.949569 16874 raft_consensus.cc:3055] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:16:54.950083 16874 raft_consensus.cc:740] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:54.950956 16874 consensus_queue.cc:260] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:54.952189 16874 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:16:54.979708 16946 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:16:54.995121 16937 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:55.007867 16808 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:55.008522 16808 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:55.010224 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 397736us
I20260709 12:16:55.017992 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.022229 10051 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:16:55.025278 16869 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.031556 16864 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:16:55.036245 16676 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:55.036981 16676 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.040338 16892 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.041733 16892 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:16:55.047925 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.047993 16691 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.049024 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:55.049166 16691 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.049784 10054 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:55.049191 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.022472 16895 raft_consensus.cc:3055] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:55.052835 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:55.054210 10052 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:55.051098 10019 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.054381 10051 raft_consensus.cc:606] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:55.055158 10051 raft_consensus.cc:614] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.057838 10052 raft_consensus.cc:1240] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:55.056267 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:55.066262 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 178677us
I20260709 12:16:55.068955 16422 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.086766 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.091300 10051 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:16:55.057183 16895 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:55.100836 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.099355 16827 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.105866 16827 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:16:55.106837 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 50665.9us
I20260709 12:16:55.107120 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:55.107424 16829 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:55.108150 16827 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.109055 16808 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.097230 16757 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.111328 16757 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.113771 10050 raft_consensus.cc:606] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.114107 10050 raft_consensus.cc:614] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.117027 16918 consensus_queue.cc:1059] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:55.118062 16918 raft_consensus.cc:3055] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:55.118393 16918 raft_consensus.cc:740] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:55.119138 16918 consensus_queue.cc:260] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.120226 16918 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:55.067435 16762 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:55.127388 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:55.128490 10095 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:55.130363 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.130975 10124 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:55.134847 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.134124 10126 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:55.142362 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.143249 10129 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:16:55.145292 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.165467 10095 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:55.165863 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.176419 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.181304 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.188306 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.190485 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.191891 10050 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
W20260709 12:16:55.193938 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59168.3us
I20260709 12:16:55.194269 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.196277 10197 raft_consensus.cc:2410] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 9.
W20260709 12:16:55.183694 16955 log.cc:927] Time spent T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:16:55.149336 16878 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:55.207557 10730 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:16:55.207743 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:55.173236 16330 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.094482 16422 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.186713 16689 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:55.210772 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.184031 16899 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:55.204625 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.218825 10055 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:55.200711 16934 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.222951 16170 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:55.224838 10055 raft_consensus.cc:1240] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:55.205854 16746 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:16:55.273000 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.275590 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.277210 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.283342 10050 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:55.287964 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.280090 16753 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:16:55.293164 10170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.001s
I20260709 12:16:55.212625 16878 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.288957 16892 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:16:55.348899 16878 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:55.350517 16970 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:16:55.351361 16757 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:55.212028 16895 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.352708 16895 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:55.356222 16356 consensus_queue.cc:1175] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" responder_term: 19 status { last_received { term: 19 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 19 index: 10 } }
I20260709 12:16:55.278362 16746 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.357652 16746 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:16:55.335515 10170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.012s	sys 0.001s
I20260709 12:16:55.330735 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.337245 16676 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.279281 16934 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.343314 16691 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:55.344849 16836 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.345366 16753 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:55.361723 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.375241 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:55.379524 16927 log.cc:927] Time spent T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:16:55.380295 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.380303 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:55.222271 16330 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.381479 10125 raft_consensus.cc:606] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.387794 10195 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:16:55.389801 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.390875 10125 raft_consensus.cc:614] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.366604 16804 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:55.428591 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.433755 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.434165 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.434931 16893 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.435422 16893 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.438990 16753 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.442505 16934 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.443598 16873 consensus_queue.cc:1059] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:55.446448 16203 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:16:55.444053 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 54331.2us
I20260709 12:16:55.409049 16457 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:16:55.451114 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.446009 16892 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:55.452795 16892 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.409575 16949 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:16:55.453836 16804 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:16:55.454444 16804 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.457351 16804 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:16:55.463002 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.457811 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.446153 16422 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:55.462343 10094 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.467211 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.446818 16203 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:55.463153 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.453147 16892 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:55.467698 10197 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:55.471796 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.393415 16836 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.475725 16899 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:55.478725 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:55.466207 16918 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.471148 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.486030 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.487514 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.499660 10195 raft_consensus.cc:1240] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
W20260709 12:16:55.504030 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 299185us
I20260709 12:16:55.489017 16442 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:55.488934 16952 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:55.506489 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.506795 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.507036 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.483438 16757 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:16:55.509866 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.510878 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.511755 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.513098 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.514416 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.519726 16836 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.540594 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.541060 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.491211 16873 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:55.542007 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.538203 10019 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:55.541172 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.543690 10050 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:55.546619 16941 raft_consensus.cc:2749] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:16:55.491650 16918 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.500543 16203 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.553303 16760 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.557766 16203 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:55.557649 16760 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.559983 16760 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.561280 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.562024 10055 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:55.564867 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.566274 10020 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.503724 16746 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.585204 10054 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:16:55.551573 16808 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:55.596830 10196 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:55.625761 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:55.626670 10054 raft_consensus.cc:2393] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:55.589424 16941 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:55.633097 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:55.635661 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.636479 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.588305 16904 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:55.639596 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.650827 10201 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:16:55.637542 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.648093 10199 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 12:16:55.654947 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.657027 10054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:55.624529 16746 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.657621 10054 raft_consensus.cc:606] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.658047 10054 raft_consensus.cc:614] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.664819 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:55.665604 10730 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:16:55.597720 16808 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:55.680699 16904 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.690974 16457 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:55.689484 16836 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:55.711314 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.712074 10054 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:55.717746 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.714807 16836 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.706173 16457 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.724205 16457 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.707913 16904 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.724243 16808 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.728304 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.727116 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.729732 10200 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:55.726061 16904 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.730697 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:55.732371 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:55.736513 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.731606 16918 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.737896 16904 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:55.743358 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
W20260709 12:16:55.726908 16967 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.315s	user 0.004s	sys 0.000s
W20260709 12:16:55.747603 10094 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.749415 16899 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:55.749887 16899 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.738288 16836 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:55.751852 16899 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.753263 10126 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:55.754447 10169 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.742660 16912 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:16:55.740235 16904 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:55.757580 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:55.758754 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.763729 16330 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:55.757253 16912 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.766907 16912 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:55.770605 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.771859 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.772866 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.773911 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.759554 16904 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:55.774451 10126 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:16:55.758394 16836 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:16:55.779234 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:55.779933 10126 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:16:55.782006 16836 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:55.782964 16836 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.786839 10020 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.788105 10020 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.809039 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:55.811172 16746 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:55.811666 16949 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:16:55.812175 16949 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:55.811618 16746 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.812937 16746 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.818682 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:55.819667 16681 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:55.820055 16681 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.820370 16681 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.795030 16762 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:55.795172 16330 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:16:55.781227 16892 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.862498 10734 raft_consensus.cc:1240] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 12:16:55.884068 16984 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:16:55.891228 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.891610 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:55.892380 16904 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.896063 10051 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:55.896368 16904 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:55.899523 16892 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:55.899789 16982 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 12:16:55.906646 16912 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.908407 16170 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:16:55.909205 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.906329 16681 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.909956 16356 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:55.910319 16356 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.911003 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:55.911079 16681 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.920378 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:55.927441 10048 raft_consensus.cc:606] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.927778 10048 raft_consensus.cc:614] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.928085 16949 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:55.910673 16356 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.930220 16949 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:55.922147 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:55.935021 10055 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.912770 16746 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:55.940812 16746 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:55.942574 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 137722us
I20260709 12:16:55.948235 10169 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:55.949709 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:55.952170 16990 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:55.952883 16990 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:55.953234 16990 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.953534 16990 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:55.952455 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:55.954406 10049 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.959954 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.961807 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:55.962414 10128 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:55.916302 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:55.971201 10195 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:55.910382 10095 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:55.976934 10128 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:55.980729 10049 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:55.982671 10055 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:16:55.953639 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:55.985550 16170 raft_consensus.cc:2764] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 12:16:55.988162 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 77850.8us
I20260709 12:16:55.988941 10095 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.993264 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:55.993892 10730 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:16:55.995668 16170 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:55.997490 10095 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:55.998643 16895 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:55.995625 16691 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:16:55.911896 16912 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:56.008868 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add21891a8334a65adf1e2611b794222"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:56.009554 10055 raft_consensus.cc:606] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:56.009905 10055 raft_consensus.cc:614] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:55.998863 16819 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:56.010998  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:56.012830  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:56.013643  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:56.016522 16356 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.017705 16691 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:16:56.025878 10195 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:16:56.028839 10019 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:56.039014 10730 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 17.
I20260709 12:16:56.041009 10195 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 12:16:56.028025 16990 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.039106 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:56.044840 10095 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:56.046888 16422 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:56.047981 16422 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:56.038568 16913 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:56.046931 16912 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:56.048614 10095 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:56.052364 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:56.045486 16356 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:56.056095 16590 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:56.057746 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.052002 16913 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:56.061913 16691 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:16:56.062857 16836 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:56.067940 16836 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:56.071269 16457 consensus_queue.cc:1059] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:56.066254 16422 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.095834 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:16:56.100925 16986 log.cc:927] Time spent T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.235s	user 0.003s	sys 0.000s
I20260709 12:16:56.106599 16819 consensus_queue.cc:1059] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:16:56.107682 16819 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:16:56.108072 16819 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:56.108868 16819 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.109839 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:56.107108 16990 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:56.115000 16993 log.cc:927] Time spent T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:16:56.116428 16913 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.081261 16836 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.120539 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:56.121248 10128 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:56.128852 10728 raft_consensus.cc:1240] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 18. Current term is 19. Ops: []
I20260709 12:16:56.129253 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:56.098520 16691 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:56.130661 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.131775 16988 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:56.131500 16691 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:56.138592 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68959.2us
I20260709 12:16:56.142969 10195 raft_consensus.cc:1240] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 20. Current term is 21. Ops: []
I20260709 12:16:56.145526 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:56.146159 10047 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:56.110142 16819 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:56.148718 10052 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 22. Current term is 23. Ops: [21.10-22.11]
I20260709 12:16:56.149528 16893 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:56.153297 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:56.153816 10047 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
I20260709 12:16:56.155509 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.158661 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:56.159819 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:56.161161 16980 log.cc:927] Time spent T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
I20260709 12:16:56.161583 16632 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:16:56.163818 16914 raft_consensus.cc:3055] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:16:56.164196 16914 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:56.165107 16914 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.166344 16914 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:56.131438 16989 consensus_queue.cc:1059] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:16:56.172906 10123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55236 (request call id 2948) took 1149 ms. Trace:
I20260709 12:16:56.173336 10123 rpcz_store.cc:276] 0709 12:16:55.023871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.025208 (+  1337us) service_pool.cc:224] Handling call
0709 12:16:55.025518 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:55.025882 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:55.025910 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:55.026381 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:16:55.203684 (+177303us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:16:55.203726 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:55.203795 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:55.714666 (+510871us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:16:56.171933 (+457267us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b240023f438. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5299c4 00007fc17b527acb 00007fc17b6e2dc9 00007fc17b6e2a55 00007fc17b6e1fb0 00007fc17e358488 00007fc17e358be8 00007fc17e330398 00007fc17e32b76a 00007fc17e32abb6
0709 12:16:56.172701 (+   768us) raft_consensus.cc:1685] finished
0709 12:16:56.172723 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:56.172846 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1438,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":20390528,"thread_start_us":176757,"threads_started":1,"wal-append.queue_time_us":265731}
I20260709 12:16:56.175583 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:56.179000 16941 raft_consensus.cc:3055] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:16:56.179422 16941 raft_consensus.cc:740] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:56.179849 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:56.180238 16941 consensus_queue.cc:260] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.180888 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:56.181488 16941 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:56.187427 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.189538 16949 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:16:56.199404 10128 raft_consensus.cc:2468] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:16:56.200636 10169 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:56.207770 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:56.234387 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.240742 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:56.251605 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 153742us
I20260709 12:16:56.206079 16934 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:56.231730 16681 raft_consensus.cc:2804] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:56.251000 16893 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:56.261550 16934 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.266295 16934 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:56.261739 16676 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:56.271865 16681 raft_consensus.cc:697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:56.297137 10196 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:16:56.289163 16676 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:16:56.325003 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 67911.3us
I20260709 12:16:56.326383 10128 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:56.334616 16676 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.323002 16904 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:16:56.346478 10047 raft_consensus.cc:2468] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:16:56.347488 10128 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:16:56.349663 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:56.354348 10051 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 21: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:56.363485 10053 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23. Ops: []
W20260709 12:16:56.404196  9945 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 289) took 25626 ms (client timeout 15000 ms). Trace:
I20260709 12:16:56.357777 16681 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.381625 16904 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:16:56.381681 16753 consensus_queue.cc:1059] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:16:56.450795 16753 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:16:56.451227 16753 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:16:56.452025 16753 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.453207 16753 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:56.456351 16964 consensus_queue.cc:1059] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:16:56.458541 16819 raft_consensus.cc:3055] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:56.458914 16819 raft_consensus.cc:740] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:56.459260 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:56.459971 10733 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:56.459714 16819 consensus_queue.cc:260] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.461190 16819 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:16:56.470006 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 96035.5us
I20260709 12:16:56.471627 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:16:56.477121 16977 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:16:56.508941 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 101243us
W20260709 12:16:56.404675  9945 rpcz_store.cc:269] 0709 12:16:30.766454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:30.767308 (+   854us) service_pool.cc:224] Handling call
0709 12:16:31.505357 (+738049us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b54001f0090. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66c0b2 00007fc1845e5759 00007fc18457da76 00007fc18454ed58 00007fc18464d04e 00007fc182b0e2a4 00007fc182b0e232 00007fc182b0e161 00007fc182b0e0dc
0709 12:16:56.392641 (+24887284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:53.507374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:53.508140 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:53.508196 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:16:53.508225 (+    29us) tablet.cc:662] Decoding operations
0709 12:16:53.565148 (+ 56923us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:53.565233 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:53.565266 (+    33us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:16:53.604933 (+ 39667us) tablet.cc:701] Row locks acquired
0709 12:16:53.604977 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:16:53.605150 (+   173us) write_op.cc:270] Start()
0709 12:16:53.605324 (+   174us) write_op.cc:276] Timestamp: P: 1783599413605086 usec, L: 0
0709 12:16:53.605362 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:16:53.606054 (+   692us) log.cc:844] Serialized 8719 byte log entry
0709 12:16:54.107139 (+501085us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18000bec60. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b6a33f3 00007fc17b6a57c1 00007fc17b6a5779 00007fc17b6a5709 00007fc17b6a56d1 00007fc17b6a49cd 0000000000388634 0000000000388479 00007fc17b68683a
0709 12:16:54.468019 (+360880us) op_driver.cc:464] REPLICATION: finished
0709 12:16:54.903685 (+435666us) write_op.cc:301] APPLY: starting
0709 12:16:54.903795 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:54.920531 (+ 16736us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:54.920570 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:54.955120 (+ 34550us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:54.955465 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:16:54.959448 (+  3983us) write_op.cc:312] APPLY: finished
0709 12:16:54.960961 (+  1513us) log.cc:844] Serialized 196 byte log entry
0709 12:16:54.961148 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:54.961338 (+   190us) write_op.cc:454] Released schema lock
0709 12:16:54.961412 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:55.205352 (+243940us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:55.208991 (+  3639us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29637,"reported_tablets":49,"spinlock_wait_cycles":18131200,"child_traces":[["op",{"apply.queue_time_us":435395,"apply.run_cpu_time_us":25411,"apply.run_wall_time_us":273999,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96131,"num_ops":22,"prepare.queue_time_us":210259,"prepare.run_cpu_time_us":25810,"prepare.run_wall_time_us":472932,"raft.queue_time_us":357492,"raft.run_cpu_time_us":36394,"raft.run_wall_time_us":409298,"replication_time_us":862494,"spinlock_wait_cycles":2809600,"thread_start_us":920335,"threads_started":4,"wal-append.queue_time_us":182732,"wal-append.run_cpu_time_us":79964,"wal-append.run_wall_time_us":1856071}]]}
I20260709 12:16:56.512728 10702 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:56.497742 17002 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:16:56.523124 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 142035us
I20260709 12:16:56.528277 10129 raft_consensus.cc:1240] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 22. Current term is 23. Ops: []
I20260709 12:16:56.572701 10046 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:16:56.516768 17002 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:56.569170 16949 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.595222 16949 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.597350 16949 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:56.528574 16904 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:56.598212 16904 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.600337 16904 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:56.612085 16831 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:16:56.623956 17007 log.cc:927] Time spent T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:16:56.625180 17014 raft_consensus.cc:2804] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:16:56.625742 17014 raft_consensus.cc:697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:16:56.626622 17014 consensus_queue.cc:237] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:56.645007 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 48840.6us
I20260709 12:16:56.646654 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:56.647387 10129 raft_consensus.cc:2368] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:56.648514 10020 leader_election.cc:400] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:56.648811 10020 leader_election.cc:403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:56.653174 10128 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:16:56.635972 17002 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:56.660910 10124 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:16:56.662410 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 47257.5us
I20260709 12:16:56.667201 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:16:56.686419 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 136815us
W20260709 12:16:56.679579 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 66588.3us
I20260709 12:16:56.688930 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:56.687042 16904 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:56.690006 10124 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:16:56.693279 10047 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 12:16:56.694267 10051 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:16:56.694917 10124 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 12:16:56.695313 10124 pending_rounds.cc:85] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Aborting all ops after (but not including) 10
I20260709 12:16:56.695637 10124 pending_rounds.cc:107] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 12:16:56.696478 10124 raft_consensus.cc:2889] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:56.684561 16913 raft_consensus.cc:3060] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:16:56.705497  9948 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 15, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:56.707399  9948 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:56.695634 16904 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.709035  9948 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 11 to 13, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 13 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.725457  9948 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:56.735670 17018 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:16:56.748010 17002 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.750489 16913 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:56.751529 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:56.759140 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:56.759961 10048 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 21: Already voted for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in this term.
I20260709 12:16:56.761483 10052 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:16:56.766554 10199 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:16:56.768193 10737 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:16:56.744988  9948 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 6 to 9, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 9 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:56.774008 16691 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:16:56.770249 16590 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.777709 16590 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:56.779829 16590 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:56.783694 10199 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:16:56.792469 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:56.791008 16962 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:16:56.791534 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:56.799296 10734 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:56.802830  9948 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:56.801198 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 116100us
I20260709 12:16:56.808779  9948 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:56.809985 16975 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:16:56.793576 16904 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:56.800807 16874 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:16:56.819567 10124 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 12:16:56.820863 10199 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:16:56.792580 17002 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:56.825501 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:56.806573 16962 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:16:56.819634 16874 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.837260 16874 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:56.844604 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:56.850104 10054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:56.851640 10054 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:16:56.852919 17006 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:56.869082 17006 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:56.871191 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:56.874174 16934 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:56.870126 17006 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.909547 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:56.910069 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50708.2us
I20260709 12:16:56.910465 10128 raft_consensus.cc:2393] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 22: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:16:56.915311 10196 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:16:56.915741 10196 pending_rounds.cc:85] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting all ops after (but not including) 11
I20260709 12:16:56.915947 10196 pending_rounds.cc:107] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:16:56.916163 10196 raft_consensus.cc:2889] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:56.924706 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:56.943769  9948 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 12 to 16, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } }
I20260709 12:16:56.871517 16590 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:16:56.965924  9948 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:56.903658 16874 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:56.937841 16912 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:16:56.952265 16918 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.937579 17022 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:16:56.985862  9948 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.009725 10734 raft_consensus.cc:2368] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:57.021955 10051 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:16:56.963701 16753 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:16:57.045111 10019 leader_election.cc:400] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:57.045477 10019 leader_election.cc:403] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.049340 10129 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:16:56.963740 17010 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:16:57.047044  9948 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 11 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 12 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.009054 16918 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:57.058145 16988 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:16:57.077219  9948 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 12 to 14, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 14 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:57.050264 16990 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:16:57.046746 16746 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:16:57.123260 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:57.130528 10127 raft_consensus.cc:3060] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:16:57.114789 16831 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:16:57.133850  9948 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 16, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.138036 10053 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:57.181311 10127 raft_consensus.cc:1275] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:16:57.223273  9948 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 9 to 11, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 11 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.171597 16874 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:16:57.244501 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120919us
I20260709 12:16:57.224387 16892 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:16:57.258986 16918 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:57.270550 17012 consensus_queue.cc:1048] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:16:57.255507 17029 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:16:57.297873 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:16:57.299782 17033 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:16:57.314890  9948 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 16 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:57.322240 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:16:57.346112 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 98898.7us
I20260709 12:16:57.365680 10047 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:16:57.372424 16914 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:16:57.409569 16988 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 22. Current term is 23.
I20260709 12:16:57.425786 10051 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
W20260709 12:16:57.426743 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 101475us
I20260709 12:16:57.431671 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:57.432276 10129 raft_consensus.cc:3060] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:16:57.438102  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:57.468533 10702 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:16:57.485428 10129 raft_consensus.cc:2468] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:16:57.492250 10169 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:57.505713 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 155128us
W20260709 12:16:57.512389 17043 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:16:57.502682 16874 raft_consensus.cc:2804] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:16:57.503238 16937 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:16:57.549993 10737 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:16:57.558537 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03eb59a6c9c6418299ed25e8330b2cef"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:57.559165 10046 raft_consensus.cc:606] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:57.559577 10046 raft_consensus.cc:614] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:57.548163 16874 raft_consensus.cc:697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:16:57.584883 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55750us
I20260709 12:16:57.617771 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:57.618515 10051 raft_consensus.cc:606] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:57.618850 10051 raft_consensus.cc:614] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:57.701479 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 190705us
I20260709 12:16:57.706548 16904 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:16:57.727998 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 243900us
I20260709 12:16:57.758791 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:57.759536 10052 raft_consensus.cc:606] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:57.759902 10052 raft_consensus.cc:614] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:57.760708 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 197865us
I20260709 12:16:57.759069 17038 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.748346 16904 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:57.799863 10052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:57.800686 10052 raft_consensus.cc:606] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:57.801033 10052 raft_consensus.cc:614] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:16:57.803510 16904 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:57.785009 17038 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:57.807582 17038 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:16:57.759285 16874 consensus_queue.cc:237] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:57.862599 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 100631us
I20260709 12:16:57.863641 17067 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
W20260709 12:16:57.908710 17045 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.375s	user 0.012s	sys 0.013s
I20260709 12:16:57.929278 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:57.930094 10737 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:57.934834 10196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:16:57.935478 10196 raft_consensus.cc:606] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:57.935818 10196 raft_consensus.cc:614] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:57.961831 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 186560us
I20260709 12:16:57.975592 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:57.976468 10052 raft_consensus.cc:2410] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:16:58.026539 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:16:58.027173 10051 raft_consensus.cc:606] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
W20260709 12:16:58.072916 17069 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.054s	user 0.002s	sys 0.007s
I20260709 12:16:58.074515 10051 raft_consensus.cc:614] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:16:58.087780 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 59355us
W20260709 12:16:58.090161 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 62093.7us
W20260709 12:16:58.090929 17035 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:16:58.092039 17068 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:16:58.092484  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:16:58.077037 17043 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:16:58.094556  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:58.095664  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.087498 17039 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.134084 17039 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:58.136598 17039 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:58.140246 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:58.141181 10125 raft_consensus.cc:2410] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:16:58.143539 16819 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:58.150190 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:16:58.146517 16819 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:58.155292 17071 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:16:58.164400 16819 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:58.170266 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:58.171039 10734 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:16:58.177866 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:16:58.176187 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:16:58.218529 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:58.219173 10129 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:58.224535 10020 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:16:58.226781 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:58.227447 10046 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:16:58.227900 17017 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:16:58.228292 17017 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:16:58.228647 17017 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:58.228925 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:16:58.239991 17017 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:58.242636 17017 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:58.176347 10094 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
W20260709 12:16:58.251238 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74990.7us
I20260709 12:16:58.254678 16691 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:16:58.255175 16691 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.255563 16691 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:58.261185 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:16:58.263266 16590 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:16:58.267540 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:58.268272 10737 raft_consensus.cc:2393] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b in current term 20: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:16:58.268532 16691 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:58.273705 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:16:58.274473 10047 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:58.275641 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:58.279412 10128 raft_consensus.cc:2368] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:58.282095 10047 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:58.282999 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:16:58.283581 10737 raft_consensus.cc:3060] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:58.274914 16691 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:58.295683 10737 raft_consensus.cc:2468] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:16:58.300033 10095 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:58.307103 10020 leader_election.cc:400] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:58.307467 10020 leader_election.cc:403] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.307301 16819 raft_consensus.cc:2804] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:16:58.308266 16819 raft_consensus.cc:697] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:58.308573 17022 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999) with higher term. Message: Invalid argument: T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 20. Current term is 21.
I20260709 12:16:58.309118 16819 consensus_queue.cc:237] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:58.370584 10047 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:16:58.372468 16874 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:16:58.390550  9947 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 13 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.392356  9947 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.393687  9947 catalog_manager.cc:5697] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 15 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.397184  9947 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.420650  9947 catalog_manager.cc:5697] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.423659  9947 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.425061  9947 catalog_manager.cc:5697] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 13 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:58.426877  9948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 269) took 30222 ms (client timeout 15000 ms). Trace:
W20260709 12:16:58.427304  9948 rpcz_store.cc:269] 0709 12:16:28.204521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:28.204810 (+   289us) service_pool.cc:224] Handling call
0709 12:16:58.426791 (+30221981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:57.795321 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:57.796112 (+   791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:57.796155 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:16:57.796173 (+    18us) tablet.cc:662] Decoding operations
0709 12:16:57.797499 (+  1326us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:57.797555 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:57.797586 (+    31us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:16:57.814877 (+ 17291us) tablet.cc:701] Row locks acquired
0709 12:16:57.814895 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:16:57.815059 (+   164us) write_op.cc:270] Start()
0709 12:16:57.815172 (+   113us) write_op.cc:276] Timestamp: P: 1783599417815007 usec, L: 0
0709 12:16:57.815189 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:16:57.815874 (+   685us) log.cc:844] Serialized 5915 byte log entry
0709 12:16:58.161941 (+346067us) op_driver.cc:464] REPLICATION: finished
0709 12:16:58.299000 (+137059us) write_op.cc:301] APPLY: starting
0709 12:16:58.299509 (+   509us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:58.320055 (+ 20546us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:58.320161 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:58.344180 (+ 24019us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:58.344764 (+   584us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:16:58.344805 (+    41us) write_op.cc:312] APPLY: finished
0709 12:16:58.345117 (+   312us) log.cc:844] Serialized 139 byte log entry
0709 12:16:58.345282 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.345430 (+   148us) write_op.cc:454] Released schema lock
0709 12:16:58.345481 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:58.349561 (+  4080us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.349600 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":146,"reported_tablets":49,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":136770,"apply.run_cpu_time_us":19063,"apply.run_wall_time_us":50532,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":244444,"prepare.run_cpu_time_us":62616,"prepare.run_wall_time_us":200280,"raft.queue_time_us":87662,"raft.run_cpu_time_us":4210,"raft.run_wall_time_us":122149,"replication_time_us":346599,"thread_start_us":580830,"threads_started":4,"wal-append.queue_time_us":202766}]]}
I20260709 12:16:58.427136 10128 raft_consensus.cc:1275] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:16:58.432065 16874 consensus_queue.cc:1048] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:16:58.432204  9947 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 17, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.435761  9947 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 23, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 23 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.438562  9947 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 20, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 20 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.440028  9947 catalog_manager.cc:5697] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.442934  9947 catalog_manager.cc:5697] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.444324  9947 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 13 to 19, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.449913  9947 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.451256  9947 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 15 to 17, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.452545  9947 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.453920  9947 catalog_manager.cc:5697] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 17 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.455452  9947 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 14 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 16 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.460042  9947 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 14 to 16, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 16 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.463455  9947 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 12 to 16, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 16 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.465498  9947 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 15 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 17 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.466993  9947 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 13 to 16, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.468298  9947 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 9 to 12, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 12 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.469535  9947 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 19, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.470959  9947 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 11 to 19, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 19 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.472203  9947 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.473446  9947 catalog_manager.cc:5697] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 11 to 14, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 14 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.663098  9946 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.669041  9946 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 14 to 16, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:16:58.667826  9947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 178) took 11749 ms (client timeout 15000 ms). Trace:
I20260709 12:16:58.673341  9946 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.677026  9946 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 15 to 18, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:16:58.671907  9947 rpcz_store.cc:269] 0709 12:16:46.918742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:46.926115 (+  7373us) service_pool.cc:224] Handling call
0709 12:16:58.667746 (+11741631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:58.482356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:58.482894 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:58.482931 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:16:58.482947 (+    16us) tablet.cc:662] Decoding operations
0709 12:16:58.484655 (+  1708us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:58.484709 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:58.484741 (+    32us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:16:58.486690 (+  1949us) tablet.cc:701] Row locks acquired
0709 12:16:58.486709 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:16:58.486862 (+   153us) write_op.cc:270] Start()
0709 12:16:58.486982 (+   120us) write_op.cc:276] Timestamp: P: 1783599418486810 usec, L: 0
0709 12:16:58.487004 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:16:58.534815 (+ 47811us) log.cc:844] Serialized 10554 byte log entry
0709 12:16:58.539733 (+  4918us) op_driver.cc:464] REPLICATION: finished
0709 12:16:58.540078 (+   345us) write_op.cc:301] APPLY: starting
0709 12:16:58.540180 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:58.568127 (+ 27947us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:58.568240 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:58.616062 (+ 47822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:58.617665 (+  1603us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:16:58.617710 (+    45us) write_op.cc:312] APPLY: finished
0709 12:16:58.618142 (+   432us) log.cc:844] Serialized 236 byte log entry
0709 12:16:58.618333 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.618561 (+   228us) write_op.cc:454] Released schema lock
0709 12:16:58.618624 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:58.646790 (+ 28166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.646822 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":221,"mutex_wait_us":21117,"reported_tablets":32,"spinlock_wait_cycles":97024,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":32243,"apply.run_wall_time_us":106656,"cfile_cache_hit":108,"cfile_cache_hit_bytes":112914,"num_ops":27,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":5903,"prepare.run_wall_time_us":57037,"replication_time_us":52591}]]}
I20260709 12:16:58.689345  9946 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.697448  9946 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 19 to 20, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 20 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.701095  9946 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 18, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.729838  9946 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 11 to 13, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 13 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.731643  9946 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.735178  9946 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 12 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.744105  9946 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.745712  9946 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.747514  9946 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 17, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.852690 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:40172
W20260709 12:16:58.852906  9946 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42606 (request call id 276) took 14129 ms (client timeout 15000 ms). Trace:
W20260709 12:16:58.853436  9946 rpcz_store.cc:269] 0709 12:16:44.723491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:44.737362 (+ 13871us) service_pool.cc:224] Handling call
0709 12:16:58.852836 (+14115474us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:58.754322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:58.754872 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:58.754906 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:16:58.754919 (+    13us) tablet.cc:662] Decoding operations
0709 12:16:58.755985 (+  1066us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:58.756040 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:58.756068 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:16:58.757162 (+  1094us) tablet.cc:701] Row locks acquired
0709 12:16:58.757181 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:16:58.757335 (+   154us) write_op.cc:270] Start()
0709 12:16:58.757453 (+   118us) write_op.cc:276] Timestamp: P: 1783599418757282 usec, L: 0
0709 12:16:58.757476 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:16:58.767409 (+  9933us) log.cc:844] Serialized 5193 byte log entry
0709 12:16:58.770095 (+  2686us) op_driver.cc:464] REPLICATION: finished
0709 12:16:58.770632 (+   537us) write_op.cc:301] APPLY: starting
0709 12:16:58.770718 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:58.777396 (+  6678us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:58.777490 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:58.788274 (+ 10784us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:58.788525 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:16:58.788570 (+    45us) write_op.cc:312] APPLY: finished
0709 12:16:58.788886 (+   316us) log.cc:844] Serialized 121 byte log entry
0709 12:16:58.789647 (+   761us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.790176 (+   529us) write_op.cc:454] Released schema lock
0709 12:16:58.790227 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:58.790663 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:58.790692 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":461278,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":315,"apply.run_cpu_time_us":16339,"apply.run_wall_time_us":19983,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54366,"num_ops":13,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":4206,"prepare.run_wall_time_us":15389,"replication_time_us":12481}]]}
W20260709 12:16:58.889724  9950 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 288) took 50784 ms (client timeout 15000 ms). Trace:
I20260709 12:16:58.889369 10732 consensus_queue.cc:237] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:16:58.900942  9950 rpcz_store.cc:269] 0709 12:16:08.105661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:08.105854 (+   193us) service_pool.cc:224] Handling call
0709 12:16:08.912584 (+806730us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400035cd4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6fa090 00007fc17e798f3a 00007fc18454ee9c 00007fc18464d04e 00007fc182b0e2a4 00007fc182b0e232 00007fc182b0e161 00007fc182b0e0dc 00007fc182b0d392 00007fc17cacb48c 00007fc17caca8c6
0709 12:16:58.889531 (+49976947us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6192,"reported_tablets":49,"spinlock_wait_cycles":1410221312}
I20260709 12:16:58.904762 10047 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:16:58.906364 17052 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:58.913012 10128 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:16:58.913226 10204 raft_consensus.cc:1275] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:16:58.914538 17019 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:16:58.919445 17014 consensus_queue.cc:1048] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:16:58.925292  9944 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.934962  9944 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 15 to 16, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.934080  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:16:58.937425  9944 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 13 to 17, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 17 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.939538  9944 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 17 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.941025  9944 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 18 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.944631  9944 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 18 to 19, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 19 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.946205  9944 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.941802 10732 raft_consensus.cc:1275] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:16:58.943610  9951 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 176) took 60926 ms (client timeout 15000 ms). Trace:
W20260709 12:16:58.950759  9951 rpcz_store.cc:269] 0709 12:15:58.016958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.022383 (+  5425us) service_pool.cc:224] Handling call
0709 12:16:58.943413 (+60921030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11279,"reported_tablets":32}
I20260709 12:16:58.949914  9944 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 15 to 18, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.952296 17052 consensus_queue.cc:1048] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:16:58.956840 17014 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 8 to 15, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.954145  9944 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:58.959950 10128 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 8 to 15, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.975136  9944 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 17 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.979857 10196 raft_consensus.cc:2955] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 8 to 15, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:58.999080  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d0b2763b8154a7392dcbe6c6acfec0c with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:59.003108  9944 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 15 to 18, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.074990  9944 catalog_manager.cc:5697] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 16 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.080870  9944 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 13 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 17 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.084658  9944 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.116616  9944 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 16 to 20, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 20 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.299110  9947 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 13 to 16, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.301261  9947 catalog_manager.cc:5697] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 20 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 21 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.319178  9947 catalog_manager.cc:5697] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.320638  9947 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 20, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 20 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.321976  9947 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 19 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.323589  9947 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 17, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 17 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.325086  9947 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.326294  9947 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.327447  9947 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 17, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 17 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.328624  9947 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 15 to 17, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 17 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.343917  9944 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 270) took 11100 ms. Trace:
I20260709 12:16:59.329843  9947 catalog_manager.cc:5697] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.346941  9947 catalog_manager.cc:5697] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 19, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.348367  9947 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.349308  9947 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.350174  9947 catalog_manager.cc:5697] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.344404  9944 rpcz_store.cc:276] 0709 12:16:48.244015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:48.244247 (+   232us) service_pool.cc:224] Handling call
0709 12:16:59.343844 (+11099597us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:59.232509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:59.233037 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:59.233075 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:16:59.233090 (+    15us) tablet.cc:662] Decoding operations
0709 12:16:59.234353 (+  1263us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:59.234409 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:59.234462 (+    53us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:16:59.235563 (+  1101us) tablet.cc:701] Row locks acquired
0709 12:16:59.235585 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:16:59.235734 (+   149us) write_op.cc:270] Start()
0709 12:16:59.235865 (+   131us) write_op.cc:276] Timestamp: P: 1783599419235684 usec, L: 0
0709 12:16:59.235896 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:16:59.236578 (+   682us) log.cc:844] Serialized 5969 byte log entry
0709 12:16:59.238685 (+  2107us) op_driver.cc:464] REPLICATION: finished
0709 12:16:59.239165 (+   480us) write_op.cc:301] APPLY: starting
0709 12:16:59.239250 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:59.247148 (+  7898us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:59.247267 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:59.269534 (+ 22267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:59.269783 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:16:59.269826 (+    43us) write_op.cc:312] APPLY: finished
0709 12:16:59.270154 (+   328us) log.cc:844] Serialized 139 byte log entry
0709 12:16:59.270323 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:59.278363 (+  8040us) write_op.cc:454] Released schema lock
0709 12:16:59.278442 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:59.282351 (+  3909us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:59.282383 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26814,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":19295,"apply.run_wall_time_us":43134,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62730,"num_ops":15,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":4379,"prepare.run_wall_time_us":6104,"replication_time_us":2657}]]}
I20260709 12:16:59.453893  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.501302  9951 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.503170  9951 catalog_manager.cc:5697] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 21 to 23, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 23 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:16:59.503723  9938 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 6d0b2763b8154a7392dcbe6c6acfec0c with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 8 but the committed config has opid_index of 15
I20260709 12:16:59.505213  9951 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.508970  9951 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 21, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.510510  9951 catalog_manager.cc:5697] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.512027  9951 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 19 to 21, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.513803  9951 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 20 to 23, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 23 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.515403  9951 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.516583  9951 catalog_manager.cc:5697] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 20, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.519471  9951 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } }
I20260709 12:16:59.530676  9951 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.535036  9951 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.551515  9951 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.552875  9951 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.554203  9951 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 21, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.567248  9951 catalog_manager.cc:5697] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 17 to 21, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 21 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:16:59.570011  9951 catalog_manager.cc:5697] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 17 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:16:59.632643 10128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:59.633257 10128 raft_consensus.cc:606] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:59.659443 10128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:59.660198 10128 raft_consensus.cc:606] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:59.665697 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:59.666303 10124 raft_consensus.cc:606] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:59.672968 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:59.673578 10124 raft_consensus.cc:606] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:59.692020 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:16:59.692591 10124 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:16:59.696831  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:59.698648  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:59.699713  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.707460 16964 raft_consensus.cc:993] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.708001 16964 raft_consensus.cc:1081] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.717715 10052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:16:59.718238 10052 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.718550 10052 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:59.732946 10052 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.765486  9947 catalog_manager.cc:5697] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 8 to 15, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 23 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.777999 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:59.778789 10128 raft_consensus.cc:3055] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:16:59.779094 10128 raft_consensus.cc:740] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:59.779778 10128 consensus_queue.cc:260] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.780949 10128 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:59.789606 10128 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:16:59.790989 10020 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:59.791826 17101 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:16:59.792374 17101 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:59.793241 17101 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.799319 10052 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:59.800354 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:59.800961 10196 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:16:59.817617 10196 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
W20260709 12:16:59.827008 17069 log.cc:927] Time spent T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: Append to log took a long time: real 0.055s	user 0.008s	sys 0.006s
I20260709 12:16:59.831943 17095 raft_consensus.cc:993] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.832518 17095 raft_consensus.cc:1081] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.836814 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:16:59.837805 10046 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.838189 10046 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:16:59.868265 17104 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.057s	user 0.010s	sys 0.010s
I20260709 12:16:59.869024 10046 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.872258 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:59.872839 10124 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:16:59.873122 10124 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:59.873803 10124 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.874891 10124 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:59.881695 10124 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:16:59.882949 10020 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:16:59.883808 17101 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:16:59.883966 10046 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:59.885780 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:59.886341 10201 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:59.895027 10201 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:16:59.924039 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d0b2763b8154a7392dcbe6c6acfec0c with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:40172
I20260709 12:16:59.930963 17052 raft_consensus.cc:993] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.931531 17052 raft_consensus.cc:1081] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.933285 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:16:59.933835 10046 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.934185 10046 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:59.947551 16964 raft_consensus.cc:993] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.948081 16964 raft_consensus.cc:1081] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:16:59.949780 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:16:59.950341 10047 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.950809 10047 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:16:59.953361 10046 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.957332 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:16:59.957916 10124 raft_consensus.cc:3055] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:16:59.958181 10124 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:16:59.958900 10124 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:16:59.962956 10046 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:16:59.963992 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:16:59.964612 10201 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:59.968459 10124 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:16:59.972142 17105 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:16:59.972762 17105 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:59.975095 10201 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:16:59.977743 10019 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:16:59.991873 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:16:59.983129 10047 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:16:59.953801 17101 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:16:59.986987 17100 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:16:59.996402 17105 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:16:59.998618 10124 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:16:59.996321 17106 tablet_replica.cc:333] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:00.006886 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:00.008140 10124 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:00.008432 10124 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:00.011731 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:00.012053 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:00.013321 10047 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:00.014567 10019 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:00.015852 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:00.016439 10730 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:00.006641 17100 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:00.018476 10124 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:00.029294 10730 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:17:00.030499 10124 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:00.041356 10124 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:17:00.042919 10020 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:00.047657 17107 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:00.048215 17107 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:00.049110 17107 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:00.050477 17105 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:00.034588 17101 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:00.084015 17106 raft_consensus.cc:2243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:00.068748 17100 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:00.193892 17106 raft_consensus.cc:2272] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:00.207731 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 127729us
I20260709 12:17:00.249155 10201 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:17:00.251098 17115 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:17:00.273221 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71010.4us
W20260709 12:17:00.279789  9953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 287) took 77154 ms (client timeout 15000 ms). Trace:
W20260709 12:17:00.280243  9953 rpcz_store.cc:269] 0709 12:15:43.120326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.127593 (+  7267us) service_pool.cc:224] Handling call
0709 12:17:00.270993 (+77143400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527519,"reported_tablets":49}
W20260709 12:17:00.338057 17119 log.cc:927] Time spent T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:17:00.343231 17106 ts_tablet_manager.cc:1916] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:00.453753 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 64093.3us
W20260709 12:17:00.512529 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 293015us
I20260709 12:17:00.582894 10730 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:17:00.588886 10125 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:17:00.599628 17113 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:00.606947 10127 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:17:00.609784 17095 raft_consensus.cc:993] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:00.610335 17095 raft_consensus.cc:1081] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:00.616549 17108 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:17:00.640027 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 58354.3us
I20260709 12:17:00.672408 10199 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:17:00.685113 17108 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:00.694290 17105 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:00.696182 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:17:00.696869 10047 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:00.697242 10047 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:00.715039 10127 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:17:00.720307 10127 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:17:00.721168 10047 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:00.729209 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:00.729836 10127 raft_consensus.cc:3055] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:00.730134 10127 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:00.732725 10127 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:00.733673 10127 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:00.754211 10047 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:00.733644 17108 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:17:00.761910 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:00.763026 10204 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:00.734848 17113 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:17:00.772921 10127 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:00.774201 10020 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:00.776580  9949 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 52fc66fb7de4405ba4a4ef0ea5ca5ba1 with cas_config_opid_index 4: aborting the task: latest config opid_index 6; task opid_index 4
W20260709 12:17:00.778590  9949 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42612 (request call id 267) took 82254 ms (client timeout 15000 ms). Trace:
W20260709 12:17:00.778981  9949 rpcz_store.cc:269] 0709 12:15:38.524799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.534577 (+  9778us) service_pool.cc:224] Handling call
0709 12:17:00.778480 (+82243903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4281,"reported_tablets":49}
I20260709 12:17:00.779652 10199 consensus_queue.cc:237] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:00.784271  9953 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 19 to 20, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 20 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.786098  9953 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 23 to 24, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.786506  9944 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 20 to 21, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:00.776588 17106 ts_tablet_manager.cc:1929] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.14
I20260709 12:17:00.788182 17106 log.cc:1199] T 6d0b2763b8154a7392dcbe6c6acfec0c P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/6d0b2763b8154a7392dcbe6c6acfec0c
I20260709 12:17:00.820997 10204 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
W20260709 12:17:00.823611 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 46336.8us
I20260709 12:17:00.820125  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:00.836889  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 6d0b2763b8154a7392dcbe6c6acfec0c (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:00.819747 17107 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:00.873821 17107 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:00.883006 17107 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:00.901908 10195 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:17:00.931758 17112 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:17:01.062041 17142 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.183s	user 0.005s	sys 0.000s
W20260709 12:17:01.121773 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 328342us
I20260709 12:17:01.208801 10728 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:17:01.225987 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 237631us
W20260709 12:17:01.248893 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 235426us
I20260709 12:17:01.264221  9945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 290) took 7728 ms. Trace:
I20260709 12:17:01.282564  9945 rpcz_store.cc:276] 0709 12:16:53.535813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.601293 (+3065480us) service_pool.cc:224] Handling call
0709 12:17:01.263988 (+4662695us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1635,"reported_tablets":49}
W20260709 12:17:01.291504 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 60132.4us
I20260709 12:17:01.292276 17136 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:17:01.382165 10169 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.423985 10204 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:17:01.431888 17157 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:17:01.447026 10049 raft_consensus.cc:1275] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:17:01.565706 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 302069us
I20260709 12:17:01.566040 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:01.567351 10195 raft_consensus.cc:606] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:01.649410  9944 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 23 to 24, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
W20260709 12:17:01.648219 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 60301.4us
I20260709 12:17:01.655674 16829 raft_consensus.cc:993] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:01.657049 17061 raft_consensus.cc:1081] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:01.676687 17123 consensus_queue.cc:1048] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:17:01.684213 17127 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:17:01.699515  9952 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44990 (request call id 177) took 33932 ms (client timeout 15000 ms). Trace:
W20260709 12:17:01.700047  9952 rpcz_store.cc:269] 0709 12:16:27.766819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:27.766992 (+   173us) service_pool.cc:224] Handling call
0709 12:17:01.699299 (+33932307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201,"reported_tablets":32}
W20260709 12:17:01.709486 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53877.5us
I20260709 12:17:01.715996 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:01.716822 10047 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.717263 10047 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:01.722976 10124 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:17:01.734390 10047 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:01.722584 10734 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:01.737782 17157 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:17:01.842525  9945 catalog_manager.cc:5697] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 3 to 12, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 16 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:01.863003 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49224 (request call id 0) took 1135 ms. Trace:
I20260709 12:17:01.863544 17127 rpcz_store.cc:276] 0709 12:17:00.728706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.737403 (+  8697us) service_pool.cc:224] Handling call
0709 12:17:00.778764 (+ 41361us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b580065ccd0. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e6ec0aa 00007fc17e76e447 00007fc17e78b70a 00007fc17e78c76a 00007fc17e78b91b 00007fc17e79703c 00007fc17e7966b3 00007fc17e78e9fa 00007fc1837564c9 00007fc17ccd2c54
0709 12:17:00.887911 (+109147us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c00107318. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17d089a11 00007fc17d098a0a 00007fc17d098693 00007fc17d098631 00007fc17e7cb3f1 00007fc17e7049fe 00007fc17e78b749 00007fc17e78c76a 00007fc17e78b91b 00007fc17e79703c 00007fc17e7966b3
0709 12:17:00.889695 (+  1784us) log.cc:844] Serialized 501 byte log entry
0709 12:17:01.862878 (+973183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52347,"raft.run_cpu_time_us":2210,"raft.run_wall_time_us":2208,"spinlock_wait_cycles":70186624,"thread_start_us":252172,"threads_started":1,"wal-append.queue_time_us":170037}
I20260709 12:17:01.865948  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 505b084a723d46f28d06230c6bb0c5bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:01.877274 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:01.877993 10197 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:17:01.878288 10197 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:01.870667 10047 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:01.879089 10197 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:01.881742 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:01.882261 10197 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:01.882360 10130 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:01.891135 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:01.891803 10204 raft_consensus.cc:606] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:01.895027 10130 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:17:01.900348 10197 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:17:01.908568 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:01.913810 17168 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:17:01.914362 17168 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:01.915525 17168 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:01.924331 10130 raft_consensus.cc:1240] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 23. Current term is 24. Ops: []
I20260709 12:17:01.899276 10050 raft_consensus.cc:2955] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 3 to 12, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:01.952461 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:01.953063 10204 raft_consensus.cc:606] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:01.959802  9952 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 19, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.969936 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:01.970631 10204 raft_consensus.cc:606] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:01.978509 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:01.979147 10125 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:01.979490 10125 raft_consensus.cc:614] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:01.981021  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:01.983462  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:02.002943  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:02.019227 17123 raft_consensus.cc:993] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.019865 17123 raft_consensus.cc:1081] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.022172 10050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:02.022702 10050 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.023025 10050 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:02.037220 10050 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:02.041020 10050 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:02.043965 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:02.044483 17176 raft_consensus.cc:993] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.044596 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:02.050554 10204 raft_consensus.cc:3055] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:02.050884 10734 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:02.050909 17176 raft_consensus.cc:1081] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.051117 10204 raft_consensus.cc:740] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:02.052157 10204 consensus_queue.cc:260] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:02.053225 10204 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:02.058404 10734 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:02.059803 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:02.060451 10047 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.060808 10047 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:02.068384 17177 raft_consensus.cc:993] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.068944 17177 raft_consensus.cc:1081] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:02.072744 10204 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:02.073697 10049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:02.085457 10049 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.085857 10049 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:02.085929 10019 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:17:02.079520 17186 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 12:17:02.086900 17105 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:02.087428 17105 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:02.088394 17105 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:02.091835 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 505b084a723d46f28d06230c6bb0c5bb with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:35268
I20260709 12:17:02.094100 10049 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.105588 10047 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.108871 10049 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:02.110293 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:02.110972 10204 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:17:02.111249 10204 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:02.112826 10047 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:02.113658 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:02.114249 10127 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:02.114444 17190 tablet_replica.cc:333] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:02.113092 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:02.115633 17190 raft_consensus.cc:2243] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:02.115767 10125 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:02.119647 17190 raft_consensus.cc:2272] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:02.124884 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:02.127651 10197 raft_consensus.cc:3055] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:17:02.128011 10197 raft_consensus.cc:740] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:02.128707 10204 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.136317 10197 consensus_queue.cc:260] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.138537 10204 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:02.152241 10125 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:17:02.153664 10020 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:02.154726 17157 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:17:02.155633 17157 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:02.156051 17190 ts_tablet_manager.cc:1916] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:02.156713 17157 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.171926 10204 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:17:02.174820 10127 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 20.
I20260709 12:17:02.173141 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:02.179083 17168 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:02.179659 17168 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:02.180516 17168 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:02.187189 10197 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:02.220172 10197 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 24.
I20260709 12:17:02.239743  9944 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.250207  9944 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 23 to 24, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.251900  9944 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 23 to 24, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.278985 17190 ts_tablet_manager.cc:1929] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:17:02.279660 17190 log.cc:1199] T 505b084a723d46f28d06230c6bb0c5bb P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/505b084a723d46f28d06230c6bb0c5bb
I20260709 12:17:02.285487  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 505b084a723d46f28d06230c6bb0c5bb (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:02.333556 10199 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:17:02.335314 17157 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:02.308570  9949 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 19 to 20, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 20 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.519836 10125 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:17:02.547453 17168 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:02.550742 10195 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:17:02.556018 17108 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:17:02.597443 10734 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:17:02.599179 17195 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:17:02.681730 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 64108.1us
W20260709 12:17:02.691159 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56366us
W20260709 12:17:02.720366 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 89282.1us
I20260709 12:17:02.733237 10127 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 12:17:02.775799 17168 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:17:02.806169 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 68979.5us
W20260709 12:17:02.914094 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 176959us
W20260709 12:17:02.915287 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 170017us
W20260709 12:17:02.926967 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 179120us
I20260709 12:17:02.946584 10128 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:02.948752 10201 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:02.951906 10199 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 12:17:03.012678 17157 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:03.016666 17157 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:03.021785 17218 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:17:03.193233  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.303030 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:03.303633 10048 raft_consensus.cc:606] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:03.306418 10127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56431c97132141908463e11690f7ba09"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:03.307001 10127 raft_consensus.cc:606] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:03.311103 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:03.311724 10048 raft_consensus.cc:606] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:03.314468 10127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c49badfb58494d79890f98353e487b55"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:03.315050 10127 raft_consensus.cc:606] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:03.317654  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:03.319766  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:03.327162  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.359790 10129 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:03.398149 17170 raft_consensus.cc:993] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:03.398736 17170 raft_consensus.cc:1081] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:03.409546 10734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c49badfb58494d79890f98353e487b55"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:17:03.410143 10734 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:03.415020 10734 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:03.421967 10048 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:03.423383 10197 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:03.423732 17138 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:17:03.428143 10094 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64c7a23860d1449c94c3bf85f8dee617. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:03.429140 17170 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:03.442184 10734 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:03.480955 10734 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:03.483682 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:03.485743 10048 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:03.486320 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:03.487344 10129 raft_consensus.cc:3055] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:17:03.487624 10129 raft_consensus.cc:740] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:03.488440 10129 consensus_queue.cc:260] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:03.489388 10129 raft_consensus.cc:3060] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:03.485824 17138 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:03.496294 10048 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:03.523805 10129 raft_consensus.cc:2468] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:03.588488 10197 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:03.611961 17218 raft_consensus.cc:993] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:03.612501 17218 raft_consensus.cc:1081] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
W20260709 12:17:03.613472 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 55168.7us
I20260709 12:17:03.617911 10702 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:03.622674 17213 raft_consensus.cc:2804] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:03.629434 10202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:17:03.630082 10202 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:03.630455 10202 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:03.632153  9949 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:03.641652 10202 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:03.688135 10202 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:03.794689 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 127906us
W20260709 12:17:03.795670 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 128351us
I20260709 12:17:03.791999 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:03.802270 10046 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:17:03.802791 10046 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
W20260709 12:17:03.804529 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44625.6us
I20260709 12:17:03.803532 10046 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:03.811201 10046 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:03.805116 17213 raft_consensus.cc:697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:03.860322 10048 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:03.876293 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:03.876950 10124 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:03.870121 10046 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 25.
I20260709 12:17:03.893314 10124 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 25.
W20260709 12:17:03.914933 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 99588.6us
I20260709 12:17:03.905664 17213 consensus_queue.cc:237] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:03.934486 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 120370us
I20260709 12:17:03.937599 17157 raft_consensus.cc:993] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:03.946700 17157 raft_consensus.cc:1081] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:03.948742 10202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:17:03.949306 10202 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:03.949679 10202 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:03.964152 10202 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:03.982628 17207 raft_consensus.cc:993] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:03.983275 17253 raft_consensus.cc:1081] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:03.992630 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56431c97132141908463e11690f7ba09"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:17:03.997191 10048 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:03.997795 10048 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:04.001219 10202 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:04.006081 10048 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.010555 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:04.011193 10124 raft_consensus.cc:3055] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:04.011513 10124 raft_consensus.cc:740] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:04.013160 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:04.013772 10202 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:04.012142 10048 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:04.015435 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:04.029633 10124 consensus_queue.cc:260] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.031136 10124 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:04.033545 17123 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:17:04.034132 17123 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:04.034968 17123 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.041064 10124 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:04.042985 10020 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:04.048267 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:04.048951 10046 raft_consensus.cc:3055] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:04.049255 10046 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:04.038661 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:04.050767 10128 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:04.049952 10046 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.050936 10202 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:04.054469 17220 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:04.054687 10046 raft_consensus.cc:3060] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:04.055097 17220 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:04.055924 17220 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.060742 10204 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:04.061797 10046 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:04.067384 10169 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:04.068378 17260 raft_consensus.cc:2804] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:04.069209 17260 raft_consensus.cc:697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:04.070204 17260 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:04.118538 17263 ts_tablet_manager.cc:933] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:04.125203 10128 raft_consensus.cc:2468] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:04.145455 17263 tablet_copy_client.cc:323] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
W20260709 12:17:04.146586 10168 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47e2925796cf4be4ab9f040c07bf6dd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.164772 10125 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:17:04.164899 10046 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:17:04.165369 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 64c7a23860d1449c94c3bf85f8dee617 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:17:04.165971 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 64c7a23860d1449c94c3bf85f8dee617 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-64c7a23860d1449c94c3bf85f8dee617
I20260709 12:17:04.163617  9945 catalog_manager.cc:5697] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 21 to 22, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 22 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:04.171845 17235 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:04.181594 10140 tablet_copy_source_session.cc:215] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:04.187462 17235 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:04.191211 17263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c7a23860d1449c94c3bf85f8dee617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:04.240814 17235 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:04.242911 10124 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:04.253489 17263 tablet_copy_client.cc:806] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:04.255473 17263 tablet_copy_client.cc:670] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:04.260210 17263 tablet_copy_client.cc:538] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:04.277304  9949 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 24 to 25, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 25 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:04.281514  9949 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 17 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:04.273710  9952 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 19, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:04.295568 10001 auto_rebalancer.cc:629] Failed to schedule move for tablet 56431c97132141908463e11690f7ba09: Illegal state: Replica a29bed9eb81541dba9ec7a447986e01e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } }
I20260709 12:17:04.303153 10124 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:04.362301 10125 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:04.365974 17250 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:17:04.384388  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:04.377602  9944 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:04.301345 10046 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:04.467458 10202 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:04.481734 10047 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:04.483434 10197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:04.484076 10197 raft_consensus.cc:606] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:04.485507 17252 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:04.489902 17243 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:17:04.491143 10094 consensus_peers.cc:597] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95fdf558c4914764bc33fc57324bdaf5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.500018 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:04.500801 10048 raft_consensus.cc:606] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:04.506865  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:04.508689  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:04.509542  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:04.529919 10048 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:17:04.540406 17260 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:04.574224 10048 raft_consensus.cc:1275] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:04.577884 17263 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:04.587045 17213 consensus_queue.cc:1048] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:04.606706 10124 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:17:04.614665 10125 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:04.631402 17123 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:17:04.659966 10052 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:04.679538 10197 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:17:04.622061 17235 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:17:04.708068 17280 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:17:04.690286 17240 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:17:04.769608 10124 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:17:04.771536 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44628.7us
I20260709 12:17:04.838418 17280 raft_consensus.cc:993] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
W20260709 12:17:04.878927 17287 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:17:04.770129 17242 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:04.882627 10202 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:17:05.024116 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89963.7us
W20260709 12:17:05.088282 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 305093us
I20260709 12:17:05.096357 17255 raft_consensus.cc:1081] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
W20260709 12:17:05.113164 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 339408us
I20260709 12:17:05.118654 17276 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:17:05.131297 17294 log.cc:927] Time spent T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:17:05.136025 17289 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:17:05.135129 17302 ts_tablet_manager.cc:933] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:05.143249 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 135697us
W20260709 12:17:05.153349 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 121556us
W20260709 12:17:05.255836 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 60041.1us
W20260709 12:17:05.262167 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 65567.9us
W20260709 12:17:05.263972 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89214.2us
I20260709 12:17:05.261488 17302 tablet_copy_client.cc:323] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:17:05.296726 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:05.298635 10048 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:05.299099 10048 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:05.361277 10048 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:05.385385 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:05.386145 10048 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 25 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:05.386242 10195 raft_consensus.cc:3055] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:17:05.395025 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 47e2925796cf4be4ab9f040c07bf6dd8 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:17:05.395717 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 47e2925796cf4be4ab9f040c07bf6dd8 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-47e2925796cf4be4ab9f040c07bf6dd8
I20260709 12:17:05.387048 10195 raft_consensus.cc:740] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:05.369042 10052 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:05.406934 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:05.407670 10734 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:05.404101 10195 consensus_queue.cc:260] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:05.433362 10214 tablet_copy_source_session.cc:215] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:05.488833 17302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e2925796cf4be4ab9f040c07bf6dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:05.543277 10734 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 25.
W20260709 12:17:05.557687 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 141331us
W20260709 12:17:05.570874 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 158071us
I20260709 12:17:05.568511 10019 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:05.591150 17286 raft_consensus.cc:993] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:05.604821 17310 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:17:05.638185 17331 raft_consensus.cc:1081] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:05.639021 17310 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:05.640149 17310 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:05.652522 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 59735.1us
I20260709 12:17:05.663014 10129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3687623d905944cb972fbfff21e2d729"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:05.663713 10129 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:05.664114 10129 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:05.684079  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:05.689165 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 98640.4us
I20260709 12:17:05.691114 17252 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:05.701938 10129 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:05.702067 17252 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:05.704031 17252 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:05.708379 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" is_pre_election: true
I20260709 12:17:05.711784 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:05.712584 10052 raft_consensus.cc:3055] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:17:05.712961 10052 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:05.713842 10052 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:05.714881 10052 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:17:05.712818 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44640.4us
I20260709 12:17:05.721036 10129 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:05.750116 17302 tablet_copy_client.cc:806] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:05.750875 17302 tablet_copy_client.cc:670] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:05.755252 17302 tablet_copy_client.cc:538] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:17:05.778271 10168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.779984 10052 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 25.
W20260709 12:17:05.775018 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54824.9us
I20260709 12:17:05.786010 10732 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 24. Current term is 25. Ops: []
I20260709 12:17:05.801544 10055 raft_consensus.cc:1240] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 LEADER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 24. Current term is 25. Ops: []
I20260709 12:17:05.808616 10195 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:05.813133 10095 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:05.817981 17298 raft_consensus.cc:2804] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:17:05.818567 17298 raft_consensus.cc:697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:05.819458 17298 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:05.823952  9949 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:05.854019 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:05.856088 10197 raft_consensus.cc:3060] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:05.858184 17337 ts_tablet_manager.cc:933] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:05.859453 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:05.834200 10195 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 25.
I20260709 12:17:05.868525 10197 raft_consensus.cc:2468] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 25.
I20260709 12:17:05.873833 10197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:05.874495 10197 raft_consensus.cc:606] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:05.877558 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:05.878126 10046 raft_consensus.cc:606] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:05.879407  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:05.881187  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.894676  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:05.900003 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:05.901075 17309 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:05.930541 17302 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:05.955565 17337 tablet_copy_client.cc:323] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:17:05.958806 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 95fdf558c4914764bc33fc57324bdaf5 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:17:05.959404 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 95fdf558c4914764bc33fc57324bdaf5 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-95fdf558c4914764bc33fc57324bdaf5
I20260709 12:17:05.972543 10140 tablet_copy_source_session.cc:215] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:05.977185 17337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95fdf558c4914764bc33fc57324bdaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:06.141470 17303 raft_consensus.cc:993] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:06.145473 17303 raft_consensus.cc:1081] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:06.169298 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27f26165888546baaae16d413e9601c5"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:06.169875 10046 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:06.170249 10046 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:06.177963 10732 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
I20260709 12:17:06.172845 17263 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:06.189137 10046 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.192607 17310 raft_consensus.cc:993] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:06.193184 17310 raft_consensus.cc:1081] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:06.196012 10125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:06.196564 10125 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:06.196924 10125 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:06.198463 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:06.199046 10129 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:06.183115 17258 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.015s
I20260709 12:17:06.223466 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:06.224076 10197 raft_consensus.cc:3055] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:17:06.224385 10197 raft_consensus.cc:740] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:06.225098 10197 consensus_queue.cc:260] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.226177 10197 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:06.241060 10125 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.250566 10046 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 26 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:06.264750 10125 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:06.266137 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:06.266782 10055 raft_consensus.cc:3055] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:17:06.267077 10055 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:06.267970 17337 tablet_copy_client.cc:806] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:06.268668 17337 tablet_copy_client.cc:670] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:06.270247 10198 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:17:06.270922 10195 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
I20260709 12:17:06.250855 17263 tablet_bootstrap.cc:492] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:06.272118 17263 ts_tablet_manager.cc:1403] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 1.701s	user 0.070s	sys 0.020s
I20260709 12:17:06.273108 10129 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 26.
I20260709 12:17:06.276624 17276 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:17:06.278035 17337 tablet_copy_client.cc:538] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:06.278187 10020 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:06.279066 17276 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:17:06.279589 17276 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 26 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:06.280637 17276 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.283675 10197 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 26.
I20260709 12:17:06.287917 17311 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:06.291525 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:06.292169 10198 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:06.297814 10055 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.299923 10055 raft_consensus.cc:3060] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:17:06.308847 17337 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:06.310642 10055 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:17:06.311995 10095 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:06.312930 17311 raft_consensus.cc:2804] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:17:06.313655 17311 raft_consensus.cc:697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:06.314591 17311 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:06.339884 10052 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:17:06.346563 10198 raft_consensus.cc:2468] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 16.
I20260709 12:17:06.343132 17233 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:17:06.379964 17263 raft_consensus.cc:359] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.389297 17263 raft_consensus.cc:740] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
W20260709 12:17:06.405705 17346 log.cc:927] Time spent T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:17:06.432853 17263 consensus_queue.cc:260] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.449630 17263 ts_tablet_manager.cc:1434] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.177s	user 0.007s	sys 0.001s
I20260709 12:17:06.459542 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-64c7a23860d1449c94c3bf85f8dee617 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:17:06.460366 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-64c7a23860d1449c94c3bf85f8dee617 on tablet 64c7a23860d1449c94c3bf85f8dee617 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:06.491416  9952 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 24 to 25, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 25 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.538626  9945 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 24 to 25, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 25 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:06.554263 17302 log.cc:927] Time spent T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
I20260709 12:17:06.555981 17302 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:06.571106 17302 tablet_bootstrap.cc:492] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:06.570385  9949 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 25 to 26, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 26 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.571895 17302 ts_tablet_manager.cc:1403] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.642s	user 0.040s	sys 0.017s
I20260709 12:17:06.589977 17302 raft_consensus.cc:359] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.590884 17302 raft_consensus.cc:740] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:06.591573 17302 consensus_queue.cc:260] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.598785  9944 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 15 to 16, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.614475 10732 raft_consensus.cc:1217] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:17:06.612632 17302 ts_tablet_manager.cc:1434] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:17:06.645864 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-47e2925796cf4be4ab9f040c07bf6dd8 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:17:06.648782 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-47e2925796cf4be4ab9f040c07bf6dd8 on tablet 47e2925796cf4be4ab9f040c07bf6dd8 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:06.672358 10732 raft_consensus.cc:1217] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 12:17:06.690716 10129 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:17:06.692281 17331 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:06.710112 10195 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:17:06.711658 17332 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:06.777763 10195 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:17:06.780372 17317 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:06.808292 17337 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:06.815699 10055 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:17:06.858197 17317 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:06.881882 17337 tablet_bootstrap.cc:492] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:06.889678 17337 ts_tablet_manager.cc:1403] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.581s	user 0.051s	sys 0.021s
I20260709 12:17:06.893989 17337 raft_consensus.cc:359] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.914331 17337 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:06.919631 17337 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:06.922309 17337 ts_tablet_manager.cc:1434] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.003s
I20260709 12:17:06.938017 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-95fdf558c4914764bc33fc57324bdaf5 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:17:06.938509 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-95fdf558c4914764bc33fc57324bdaf5 on tablet 95fdf558c4914764bc33fc57324bdaf5 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:07.103057 17283 raft_consensus.cc:1064] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:07.105726 17283 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.180413  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.188591 10055 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:17:07.188814 10125 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:17:07.191159 17288 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.194535 17288 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.206576 10734 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:17:07.208108 17233 raft_consensus.cc:1064] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:07.218918 17288 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:17:07.220165 17233 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.259418 17283 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.264415 10129 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.274391 10052 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.284742 10732 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.309417 10732 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:07.311470 17242 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:07.315797 10195 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:07.316447  9944 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.318356 17317 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:07.355891 10052 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:07.358273 17242 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:07.423228 17233 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.436910 10734 raft_consensus.cc:1217] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:17:07.447952 10195 consensus_queue.cc:237] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.451610 10732 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.455317 10197 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.459024 10055 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.475847 10734 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:07.481628 10129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:07.482251 10129 raft_consensus.cc:606] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:07.495748 10052 raft_consensus.cc:1275] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:07.492554 17361 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:17:07.515662 10129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:07.516398 10129 raft_consensus.cc:606] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:07.502076 17283 consensus_queue.cc:1048] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:17:07.524353 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:07.524978 10046 raft_consensus.cc:606] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:07.529399  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:07.531137  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:07.532028  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.538678 17303 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.552910 10734 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.565889 10047 raft_consensus.cc:2955] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.574007  9952 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.591737 17332 raft_consensus.cc:993] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:07.592310 17157 raft_consensus.cc:1081] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:07.593948 10197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:17:07.594532 10197 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:07.594873 10197 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:07.610349 10197 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:07.611529  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47e2925796cf4be4ab9f040c07bf6dd8 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:07.614944 10197 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:07.618862 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:07.619472 10129 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:07.619597 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:07.620267 10047 raft_consensus.cc:3055] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:07.620571 10047 raft_consensus.cc:740] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:07.621308 10047 consensus_queue.cc:260] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:07.623337 10047 raft_consensus.cc:3060] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:07.664769  9944 catalog_manager.cc:5697] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 13 to 14, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.665584 10129 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:17:07.680840 10128 consensus_queue.cc:237] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.688699 10734 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:07.690508 17242 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.692420 10047 raft_consensus.cc:2468] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:17:07.693259 10052 raft_consensus.cc:1275] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:07.702725 17317 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.707813 17373 consensus_queue.cc:1048] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.698141 17242 raft_consensus.cc:993] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:07.711333 17242 raft_consensus.cc:1081] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:07.714967 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:17:07.715540 10046 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:07.715938 10046 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:07.715127 10734 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.717374 10047 raft_consensus.cc:2955] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:17:07.718291 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44374.7us
I20260709 12:17:07.721306 10169 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:07.722119 17303 raft_consensus.cc:2804] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:07.722726 17303 raft_consensus.cc:697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:07.723573 17303 consensus_queue.cc:237] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:07.725834 10046 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.733649 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 47e2925796cf4be4ab9f040c07bf6dd8 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:35268
I20260709 12:17:07.753408 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:07.754029 10128 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:07.754328 10128 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:07.755406 10046 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:07.755101 10128 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.756330 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:07.756512 10128 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:07.756913 10732 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:07.764135 10128 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:17:07.764204 10732 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 12.
I20260709 12:17:07.776221 10019 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:07.777177 17332 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:07.777966 17332 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:07.778930 17332 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.793563  9949 catalog_manager.cc:5697] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 20 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.825022  9949 catalog_manager.cc:5697] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 12 to 13, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:07.837538  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64c7a23860d1449c94c3bf85f8dee617 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:07.843106 17375 tablet_replica.cc:333] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:07.844537 17375 raft_consensus.cc:2243] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:07.845449 17375 raft_consensus.cc:2272] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:07.859520 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c7a23860d1449c94c3bf85f8dee617 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:49224
I20260709 12:17:07.892354 17375 ts_tablet_manager.cc:1916] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:07.899297 17242 raft_consensus.cc:1064] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:07.902061 17242 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:07.905990 17377 tablet_replica.cc:333] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:07.907274 17377 raft_consensus.cc:2243] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:07.908162 17377 raft_consensus.cc:2272] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:07.914232 10195 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:07.916910 10734 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:07.919552 17373 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.921540 17373 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:07.929988  9945 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 11 to 12, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 12 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:07.937007 17377 ts_tablet_manager.cc:1916] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:07.975665 17372 raft_consensus.cc:993] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:07.982376 17372 raft_consensus.cc:1081] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:07.991209 10047 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:07.994210 10052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:17:07.994887 10052 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:07.995229 10052 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:08.000588 17373 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:08.037424 17375 ts_tablet_manager.cc:1929] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 12:17:08.038045 17375 log.cc:1199] T 47e2925796cf4be4ab9f040c07bf6dd8 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/47e2925796cf4be4ab9f040c07bf6dd8
I20260709 12:17:08.039772  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 47e2925796cf4be4ab9f040c07bf6dd8 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:08.070806 17377 ts_tablet_manager.cc:1929] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 12:17:08.071324 17377 log.cc:1199] T 64c7a23860d1449c94c3bf85f8dee617 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/64c7a23860d1449c94c3bf85f8dee617
I20260709 12:17:08.073210  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 64c7a23860d1449c94c3bf85f8dee617 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:08.077656 17233 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.084626 10734 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.122963 10050 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:08.125320 17303 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:08.119004  9949 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.166110 10734 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:17:08.165267 10046 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.167860 17332 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:17:08.206604 10052 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:08.208935 10052 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:08.210047 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:08.210677 10732 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:08.217584 10732 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:17:08.219009 10019 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:08.219843 17157 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:08.220360 17157 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:08.221326 17157 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:08.235229 10197 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:17:08.243139 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 80330.4us
I20260709 12:17:08.251741 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:08.252372 10129 raft_consensus.cc:3055] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:17:08.252687 10129 raft_consensus.cc:740] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:08.253497 10129 consensus_queue.cc:260] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:08.255059 10129 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:08.272500 10128 raft_consensus.cc:1275] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:08.279287 10125 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:08.287832 17288 consensus_queue.cc:1048] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:17:08.314107 10129 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:17:08.402680 10130 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:17:08.408864 17157 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:17:08.426199 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54840.2us
W20260709 12:17:08.435611 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 54424.9us
I20260709 12:17:08.452091 10734 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:17:08.462213 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46209.5us
I20260709 12:17:08.465762 17372 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
W20260709 12:17:08.466500 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53612.8us
I20260709 12:17:08.520599  9945 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 21 to 22, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 22 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:08.571694 10197 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:17:08.580956 17373 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 12:17:08.622957 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 99796.8us
W20260709 12:17:08.624512 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 49676.7us
I20260709 12:17:08.712883 10732 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.734575 10196 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.713565 17311 raft_consensus.cc:2955] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:08.746155  9945 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 13 to 14, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:17:08.792547 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 250912us
W20260709 12:17:08.796139 17380 log.cc:927] Time spent T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.069s	user 0.001s	sys 0.007s
I20260709 12:17:08.823786 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 95fdf558c4914764bc33fc57324bdaf5 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:08.824765 10732 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:17:08.826617 17400 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:17:08.831489 10125 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:17:08.841094 17387 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:17:08.857113  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95fdf558c4914764bc33fc57324bdaf5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:08.887490  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.899302 17411 tablet_replica.cc:333] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:08.901682 17411 raft_consensus.cc:2243] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:08.904341 17411 raft_consensus.cc:2272] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:08.923069 17411 ts_tablet_manager.cc:1916] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:09.039189 17411 ts_tablet_manager.cc:1929] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 12:17:09.039691 17411 log.cc:1199] T 95fdf558c4914764bc33fc57324bdaf5 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/95fdf558c4914764bc33fc57324bdaf5
I20260709 12:17:09.041425  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 95fdf558c4914764bc33fc57324bdaf5 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:09.058943 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:09.060194 10055 raft_consensus.cc:606] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:09.066219 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:09.066900 10046 raft_consensus.cc:606] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:09.070081 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:09.070703 10198 raft_consensus.cc:606] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:09.072067  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:09.073841  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.074612  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.155268 17400 raft_consensus.cc:993] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:09.155882 17400 raft_consensus.cc:1081] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:09.169304 10732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37554
I20260709 12:17:09.169883 10732 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:09.170241 10732 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:09.192078 10732 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:09.195559 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:09.196194 10055 raft_consensus.cc:3055] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:09.196472 10055 raft_consensus.cc:740] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:09.197242 10055 consensus_queue.cc:260] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:09.198356 10055 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:09.202005 10732 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:09.202997 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:09.203536 10124 raft_consensus.cc:3060] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:09.205020 10055 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:17:09.206651 10702 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:09.207660 17359 raft_consensus.cc:2804] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:09.208148 17359 raft_consensus.cc:697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:09.208931 17359 consensus_queue.cc:237] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:09.210096 10124 raft_consensus.cc:2468] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:17:09.226814  9945 catalog_manager.cc:5697] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 12 to 13, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 13 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:09.426618 17332 raft_consensus.cc:993] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:09.427162 17332 raft_consensus.cc:1081] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:09.434234 10124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:09.434851 10124 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:09.435178 10124 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:09.443881 10124 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.450927 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:09.451560 10046 raft_consensus.cc:3055] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:09.451876 10046 raft_consensus.cc:740] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:09.452596 10046 consensus_queue.cc:260] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.453683 10046 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:09.462762 10046 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:17:09.465862 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:09.474695 10195 raft_consensus.cc:3060] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:09.489256 10195 raft_consensus.cc:2468] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:17:09.490694 10094 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:09.491690 17311 raft_consensus.cc:2804] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:09.492200 17311 raft_consensus.cc:697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:09.493052 17311 consensus_queue.cc:237] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.474001 10124 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:09.516549  9945 catalog_manager.cc:5697] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 17 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 18 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.621199 10046 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:17:09.625300 17359 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:09.627810 17288 raft_consensus.cc:993] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:09.628515 17288 raft_consensus.cc:1081] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:09.660763 10055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:09.661404 10055 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:09.661814 10055 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:09.675073 10055 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.686326 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:09.687048 10130 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:09.687770 10055 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:09.691254 10124 raft_consensus.cc:1275] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:17:09.692672 17259 consensus_queue.cc:1048] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:09.729938 10130 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:17:09.730971 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:09.737910 10198 raft_consensus.cc:3055] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:09.738296 10198 raft_consensus.cc:740] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:09.739156 10198 consensus_queue.cc:260] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.740789 10198 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:09.758170 10020 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:09.759392 17418 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:09.759986 17418 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:09.760886 17418 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:09.768671 10198 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
W20260709 12:17:09.898324 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 69809.9us
I20260709 12:17:09.902657  9953 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 20 to 21, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:09.925935 10046 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:17:09.932812 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 108898us
I20260709 12:17:09.968043 17409 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:17:10.008350 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 78794.1us
I20260709 12:17:10.025517 10196 raft_consensus.cc:1275] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:17:10.027640 17409 consensus_queue.cc:1048] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:10.043166 10124 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:17:10.081951 10094 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd6ec4c2ee75449d8ab4f971e9de7e77. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.096216 10195 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:17:10.098097 17436 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:10.104650 10052 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:17:10.109879 17426 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:10.153134 17434 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.156352 10046 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.178658 10196 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.183570  9945 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.201776  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.302270 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "add21891a8334a65adf1e2611b794222"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:10.302870 10124 raft_consensus.cc:606] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:10.302975 10195 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:10.305234 17428 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:10.306198 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:10.306795 10046 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:10.307979  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:10.309718  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.310539  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.352823 10124 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:10.354528 17428 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:10.357208 17332 raft_consensus.cc:993] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:10.358021 17419 raft_consensus.cc:1081] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:10.361351 10046 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:10.367411 10124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:10.368996 10124 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.369372 10124 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:10.381587 17436 raft_consensus.cc:993] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:10.382719 17432 raft_consensus.cc:1081] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:10.384452 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "add21891a8334a65adf1e2611b794222"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38758
I20260709 12:17:10.384970 10196 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:10.385279 10196 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:10.388934 10124 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:10.393949 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:10.394726 10047 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:17:10.395035 10047 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:10.395726 10047 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:10.395861 10196 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:10.396834 10047 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:10.400262 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:10.400892 10730 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:10.399137 10124 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:10.411201 10047 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:17:10.411945 10730 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:17:10.417690 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:10.444918 10052 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:10.417778 10196 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:10.444821 10095 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:10.452147 17434 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:10.452668 10130 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:17:10.456116 10196 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:17:10.458782 17419 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:17:10.459695 10019 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8783323a2d554a0ca5fb7d1c9cf54ac1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.460809 17419 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:10.452678 17434 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:10.429068 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:10.464388 17434 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:10.465046 10124 raft_consensus.cc:3055] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:10.465466 10124 raft_consensus.cc:740] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:10.467021 10124 consensus_queue.cc:260] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:10.479054 10052 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:10.481110 10169 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:10.483105 17407 raft_consensus.cc:2804] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:10.483712 17407 raft_consensus.cc:697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:10.484633 17407 consensus_queue.cc:237] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:10.484432 10124 raft_consensus.cc:3060] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:10.507884 10124 raft_consensus.cc:2468] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:10.518600  9953 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 21 to 22, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 22 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.549187 17332 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.554265 10130 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.561866 10198 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.556521  9949 catalog_manager.cc:5697] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 17 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.595136 17448 ts_tablet_manager.cc:933] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:10.595006  9949 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:17:10.617869 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 85542.3us
I20260709 12:17:10.613044 10196 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:10.623777 17448 tablet_copy_client.cc:323] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:17:10.639390 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:17:10.639977 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet bd6ec4c2ee75449d8ab4f971e9de7e77 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-bd6ec4c2ee75449d8ab4f971e9de7e77
I20260709 12:17:10.665225 10140 tablet_copy_source_session.cc:215] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.679086 17448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6ec4c2ee75449d8ab4f971e9de7e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.699609 10130 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:17:10.699709 10168 consensus_peers.cc:597] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0075e506a7e41288c8c852a9911174c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.701049 10052 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:10.703369 17407 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:10.706025 17407 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:10.739303 17407 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.744885 10052 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.746997 17448 tablet_copy_client.cc:806] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.753139 17448 tablet_copy_client.cc:670] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.750808 10125 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.757149 17448 tablet_copy_client.cc:538] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.784376  9945 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index -1 to 13, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.787426 17448 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:10.831218 10052 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:10.861208 10196 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:17:10.866466 10125 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:17:10.868085 10019 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ad3dc473b284687afcc907cd7aea9ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.868932 17394 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:10.872221 17332 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:17:10.911077 10124 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:10.922396 17407 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:17:10.937991 10047 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:17:10.941720 17418 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.944394 10198 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.946581 17431 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:10.957221 10124 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.971606 10052 raft_consensus.cc:1275] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:10.974538 10732 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:17:10.974730 17288 consensus_queue.cc:1048] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:10.981263  9949 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:10.985987 17432 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:11.014611 17463 ts_tablet_manager.cc:933] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:17:11.055167 17463 tablet_copy_client.cc:323] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
W20260709 12:17:11.084640 17448 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.052s	user 0.002s	sys 0.001s
I20260709 12:17:11.141522 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:17:11.246137 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-8783323a2d554a0ca5fb7d1c9cf54ac1
I20260709 12:17:11.294463 10065 tablet_copy_source_session.cc:215] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:17:11.327176 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 122067us
W20260709 12:17:11.337734 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 204823us
I20260709 12:17:11.376392 17448 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:11.377527 17448 tablet_bootstrap.cc:492] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:11.377806 17491 ts_tablet_manager.cc:933] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:11.378196 17448 ts_tablet_manager.cc:1403] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.591s	user 0.046s	sys 0.020s
I20260709 12:17:11.379686 17491 tablet_copy_client.cc:323] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:17:11.380861 17448 raft_consensus.cc:359] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:11.381536 17448 raft_consensus.cc:740] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:11.382100 17448 consensus_queue.cc:260] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:11.384615 17448 ts_tablet_manager.cc:1434] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:17:11.431973 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 88065.6us
I20260709 12:17:11.445142 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet e0075e506a7e41288c8c852a9911174c from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:17:11.446034 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet e0075e506a7e41288c8c852a9911174c from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-e0075e506a7e41288c8c852a9911174c
W20260709 12:17:11.444196 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 317557us
W20260709 12:17:11.525940 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 63110.8us
I20260709 12:17:11.552987  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:11.566165 17463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.629652 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-bd6ec4c2ee75449d8ab4f971e9de7e77 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:17:11.630405 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-bd6ec4c2ee75449d8ab4f971e9de7e77 on tablet bd6ec4c2ee75449d8ab4f971e9de7e77 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:11.640436 10214 tablet_copy_source_session.cc:215] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:11.662644 10732 raft_consensus.cc:1217] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 12:17:11.710820 17491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0075e506a7e41288c8c852a9911174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.750713 17497 ts_tablet_manager.cc:933] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
W20260709 12:17:11.851099 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 45004.5us
I20260709 12:17:11.875607 17491 tablet_copy_client.cc:806] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:11.876430 17491 tablet_copy_client.cc:670] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:11.882069 17491 tablet_copy_client.cc:538] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.894358 17463 tablet_copy_client.cc:806] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:11.896028 17497 tablet_copy_client.cc:323] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:17:11.899417 17463 tablet_copy_client.cc:670] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:11.911041 10065 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 5ad3dc473b284687afcc907cd7aea9ea from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:17:11.911859 10065 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 5ad3dc473b284687afcc907cd7aea9ea from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-5ad3dc473b284687afcc907cd7aea9ea
I20260709 12:17:11.945108 17463 tablet_copy_client.cc:538] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.990607 10065 tablet_copy_source_session.cc:215] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:11.994859 17497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad3dc473b284687afcc907cd7aea9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.996526 17491 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:12.082897 17463 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:12.124094 10130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "370d155a067d4428a676aa10078366b8"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:12.125041 10130 raft_consensus.cc:606] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:12.130553 10204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:12.131174 10204 raft_consensus.cc:606] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:12.136317  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:12.138203  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:12.157783 17497 tablet_copy_client.cc:806] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:12.158988 17497 tablet_copy_client.cc:670] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:12.160181  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.168043 17497 tablet_copy_client.cc:538] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:12.195897 17407 raft_consensus.cc:993] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:12.196609 17490 raft_consensus.cc:1081] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:12.204668 10052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:12.205399 10052 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.205818 10052 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:12.227130 10052 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:12.230149 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:12.230887 10196 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:17:12.231184 10196 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:12.231769 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:12.232049 10196 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:12.233525 10130 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:12.233654 10196 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:12.242748 10052 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:12.247397 10196 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:17:12.248698 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:12.249665 17419 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:12.250160 17419 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:12.251092 17419 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:12.289155 17497 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:12.303316 10130 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 22.
I20260709 12:17:12.336864  9949 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 21 to 22, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 22 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:12.363710 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 74007us
I20260709 12:17:12.376289 17434 raft_consensus.cc:1064] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:12.386497 17434 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:12.421016 10055 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:17:12.423655 10734 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:17:12.423539 17504 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:17:12.425770 10204 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:17:12.428766 17502 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:17:12.430802 17502 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:12.466168 17504 raft_consensus.cc:993] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:12.466744 17504 raft_consensus.cc:1081] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:12.472254 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "370d155a067d4428a676aa10078366b8"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38758
I20260709 12:17:12.472857 10196 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.473196 10196 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:12.490022 10196 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:12.516597 10730 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:12.548075  9945 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:12.548192 10204 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:12.499509 17499 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:12.567909 10196 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:12.583858 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:12.584571 10734 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:12.591269 17491 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:12.592360 17491 tablet_bootstrap.cc:492] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:12.593139 17491 ts_tablet_manager.cc:1403] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.597s	user 0.050s	sys 0.009s
I20260709 12:17:12.660111 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:12.660758 10130 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:12.661118 10130 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:12.659329 10055 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:12.668773 10734 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:12.666611 10130 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:12.684296 17491 raft_consensus.cc:359] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:12.689855 10732 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:12.691653 17491 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
W20260709 12:17:12.723601 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44448us
I20260709 12:17:12.769165 10168 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:17:12.804751 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 82005.3us
W20260709 12:17:12.859344 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 123378us
W20260709 12:17:12.860208 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 45118.8us
I20260709 12:17:12.869131 10130 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:12.749538 17491 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:17:12.920512 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 176855us
W20260709 12:17:12.928884 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 54069.1us
I20260709 12:17:12.945050 17463 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:12.952505 17463 tablet_bootstrap.cc:492] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:12.953256 17463 ts_tablet_manager.cc:1403] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.871s	user 0.041s	sys 0.017s
I20260709 12:17:12.956962 10130 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 18.
I20260709 12:17:12.942353 17519 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:17:12.998387 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76166us
W20260709 12:17:13.008116 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 80432.6us
W20260709 12:17:13.011461 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 128781us
I20260709 12:17:13.017050 10130 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:13.053000 17527 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:17:13.015151 17519 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:13.109817 17519 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:13.117038 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 48116.2us
I20260709 12:17:13.066759 17463 raft_consensus.cc:359] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:13.163848 17491 ts_tablet_manager.cc:1434] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.570s	user 0.012s	sys 0.014s
W20260709 12:17:13.164273 17491 ts_tablet_manager.cc:1467] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Tablet startup took 570ms
W20260709 12:17:13.158789 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89595.6us
I20260709 12:17:13.157408 17463 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:13.186038 17463 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:13.195987 17463 ts_tablet_manager.cc:1434] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.242s	user 0.009s	sys 0.000s
W20260709 12:17:13.164608 17491 ts_tablet_manager.cc:1469] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Trace:
0709 12:17:11.354126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.354254 (+   128us) service_pool.cc:224] Handling call
0709 12:17:11.378199 (+ 23945us) ts_tablet_manager.cc:934] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
0709 12:17:11.709136 (+330937us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:11.776637 (+ 67501us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:11.776798 (+   161us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:11.873713 (+ 96915us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:11.874616 (+   903us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:11.874984 (+   368us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:11.875105 (+   121us) inbound_call.cc:177] Queueing success response
0709 12:17:11.996037 (+120932us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:17:12.593465 (+597428us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:17:12.676793 (+ 83328us) tablet_replica.cc:261] Starting instrumentation
0709 12:17:12.677443 (+   650us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":270,"mutex_wait_us":2474,"raft.queue_time_us":49014,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14817,"tablet-copy.queue_time_us":23092,"tablet-download-pool.queue_time_us":546,"tablet-download-pool.run_cpu_time_us":1218,"tablet-download-pool.run_wall_time_us":4494,"thread_start_us":156919,"threads_started":3}
I20260709 12:17:13.201300 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-e0075e506a7e41288c8c852a9911174c received from {username='slave'} at 127.0.0.1:49780
I20260709 12:17:13.201874 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-e0075e506a7e41288c8c852a9911174c on tablet e0075e506a7e41288c8c852a9911174c with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:13.289341 17497 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:13.290499 17497 tablet_bootstrap.cc:492] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:13.291302 17497 ts_tablet_manager.cc:1403] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 1.006s	user 0.051s	sys 0.013s
W20260709 12:17:13.300544 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 179584us
I20260709 12:17:13.317224 17497 raft_consensus.cc:359] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:13.318221 17497 raft_consensus.cc:740] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:13.318943 17497 consensus_queue.cc:260] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:13.321599 17497 ts_tablet_manager.cc:1434] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:17:13.350390 10123 consensus_queue.cc:237] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:13.415632  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.421680 10732 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:17:13.430538 17494 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:17:13.455771 10168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.082s	sys 0.102s
W20260709 12:17:13.456197 10168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.082s	sys 0.102s
I20260709 12:17:13.464329 10733 raft_consensus.cc:1217] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:17:13.466969 10732 raft_consensus.cc:1217] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
I20260709 12:17:13.468400 10195 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:13.505568  9949 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 17 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.511332 10065 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-8783323a2d554a0ca5fb7d1c9cf54ac1 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:17:13.511911 10065 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-8783323a2d554a0ca5fb7d1c9cf54ac1 on tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:13.512858 10064 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-5ad3dc473b284687afcc907cd7aea9ea received from {username='slave'} at 127.0.0.1:53880
I20260709 12:17:13.513315 10064 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-5ad3dc473b284687afcc907cd7aea9ea on tablet 5ad3dc473b284687afcc907cd7aea9ea with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:13.514752 10055 raft_consensus.cc:1275] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:17:13.516119 17494 consensus_queue.cc:1048] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:17:13.520028 17553 log.cc:927] Time spent T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.062s	user 0.003s	sys 0.013s
W20260709 12:17:13.521274 17510 log.cc:927] Time spent T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.055s	user 0.007s	sys 0.011s
I20260709 12:17:13.544765 17504 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:13.546630 10055 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:13.562758 10734 raft_consensus.cc:2955] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:13.564059 17552 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:13.594794  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:13.618078 10125 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:13.619601 17519 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:13.631347  9944 catalog_manager.cc:5697] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 13 to 14, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 16 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
W20260709 12:17:13.762457 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 60373.4us
I20260709 12:17:13.791348 10734 raft_consensus.cc:1217] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 12:17:13.823022 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet bd6ec4c2ee75449d8ab4f971e9de7e77 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:49224
I20260709 12:17:13.874784 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:13.875459 10055 raft_consensus.cc:606] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Received request to transfer leadership to TS a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:13.913287 10201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:13.913903 10201 raft_consensus.cc:606] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:13.916136  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:13.917842  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:13.918675  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.932904 10732 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:13.936892 17563 tablet_replica.cc:333] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:13.938105 17563 raft_consensus.cc:2243] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:13.938961 17563 raft_consensus.cc:2272] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:13.939322 17551 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:13.945628 17563 ts_tablet_manager.cc:1916] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:13.967646 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 53217us
I20260709 12:17:14.007278 17546 raft_consensus.cc:1064] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:14.012576 17525 raft_consensus.cc:993] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:14.013154 17525 raft_consensus.cc:1081] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:14.017120 10123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:14.017673 10123 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.017998 10123 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:14.010136 17546 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:14.063323 17536 raft_consensus.cc:993] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:14.063846 17536 raft_consensus.cc:1081] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:14.065966 10052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:14.066555 10052 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.066901 10052 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:14.075698 10052 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:14.085104 17563 ts_tablet_manager.cc:1929] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:17:14.075877 10123 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:14.088896 10052 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:14.088384 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:14.090178 10125 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:14.098392 10129 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:17:14.099967 17524 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:14.106365 10123 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:14.110584 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:14.111855 10125 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:17:14.113674 10195 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:17:14.120030 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:14.120724 10201 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:14.121018 10201 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:14.123873 10052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:14.124490 10052 raft_consensus.cc:3055] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:17:14.124811 10052 raft_consensus.cc:740] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:14.121821 10201 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:14.125552 10052 consensus_queue.cc:260] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:14.126446 10201 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:14.131258 10732 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:17:14.131719 10052 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:14.131719 10020 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:14.133960 17514 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:14.134541 17514 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:14.135495 17514 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:14.139372 17563 log.cc:1199] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/bd6ec4c2ee75449d8ab4f971e9de7e77
I20260709 12:17:14.143697 17546 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:17:14.151789 17546 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:14.165546 10052 raft_consensus.cc:2468] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
I20260709 12:17:14.166236 10201 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 21.
I20260709 12:17:14.167027 10095 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:14.168584 17547 raft_consensus.cc:2804] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:17:14.169108 17547 raft_consensus.cc:697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:14.170033 17547 consensus_queue.cc:237] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:14.202859  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet bd6ec4c2ee75449d8ab4f971e9de7e77 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:14.235137  9945 catalog_manager.cc:5697] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 22 to 23, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 23 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.239370 17524 raft_consensus.cc:1064] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:14.236456  9953 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 20 to 21, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.250976 17524 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:14.264231 17546 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.269078 10195 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.278095 10732 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.307030 10123 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.337888 10195 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:17:14.341774 17525 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:14.344802  9949 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.361575 10733 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:17:14.377185 17525 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:14.388983 10129 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:17:14.390834 17514 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:14.465575 17524 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.480671 10734 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.501957 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:14.502611 10046 raft_consensus.cc:606] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Received request to transfer leadership
I20260709 12:17:14.506541 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:14.507068 10046 raft_consensus.cc:606] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Received request to transfer leadership
W20260709 12:17:14.515048  9939 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for e0075e506a7e41288c8c852a9911174c already in progress
I20260709 12:17:14.536525 10198 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.549540 10129 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.567203  9953 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:14.586388  9939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71368.4us
I20260709 12:17:14.587957 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:14.588580 10046 raft_consensus.cc:606] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Received request to transfer leadership
I20260709 12:17:14.608904 10052 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:14.614194 10001 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:17:14.614854 10001 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e0075e506a7e41288c8c852a9911174c already in progress
W20260709 12:17:14.615146 10001 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e0075e506a7e41288c8c852a9911174c already in progress
I20260709 12:17:14.615971 10046 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:14.629216 10734 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:17:14.631312 17520 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:14.632113 10127 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:17:14.633549 17524 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:14.637030 10734 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:17:14.641759 17567 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.645459 10127 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.652153 10198 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:17:14.654778 10198 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:14.656709 17524 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:14.658764 10046 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:17:14.660070 17550 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:14.661526 17524 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:14.674796 17520 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:14.677198 10734 raft_consensus.cc:2955] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.670727  9953 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 24 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.700318 17546 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.705202 10734 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Advancing to term 21
I20260709 12:17:14.703671 10733 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.713300 10201 raft_consensus.cc:2955] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:14.724710  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ad3dc473b284687afcc907cd7aea9ea with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:14.732112 10734 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:14.733392 10129 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:14.734054  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:14.736060 17520 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:14.737766 17524 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:14.749619  9945 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 16 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.763353 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad3dc473b284687afcc907cd7aea9ea with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:49224
I20260709 12:17:14.798300 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35268
I20260709 12:17:14.804383 10204 raft_consensus.cc:3060] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:14.820336 17520 raft_consensus.cc:1064] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
W20260709 12:17:14.820833 17520 raft_consensus.cc:1068] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Unable to promote non-voter 4b3390fbbe574de7bf154b5a6cc35677: Service unavailable: leader transfer in progress
I20260709 12:17:14.846673 10204 raft_consensus.cc:1275] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:17:14.853320 17547 consensus_queue.cc:1048] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:14.860529 17585 tablet_replica.cc:333] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:14.868867 17566 raft_consensus.cc:993] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:14.874917 17585 raft_consensus.cc:2243] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.876073 17585 raft_consensus.cc:2272] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.879552 17525 raft_consensus.cc:1081] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Signalling peer a29bed9eb81541dba9ec7a447986e01e to start an election
I20260709 12:17:14.899902 10123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
 from {username='slave'} at 127.0.0.1:55224
I20260709 12:17:14.908676 17587 tablet_replica.cc:333] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:14.909771 17587 raft_consensus.cc:2243] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:14.910840 17587 raft_consensus.cc:2272] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:14.938789 17587 ts_tablet_manager.cc:1916] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:14.943035 10123 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.943552 10123 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:14.945200 17585 ts_tablet_manager.cc:1916] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:14.953359 10123 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:14.989042 10123 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:14.994551 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:14.995172 10197 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:15.005761 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:15.006902 10046 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:17:15.007242 10046 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:15.008347 10046 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:15.009758 10046 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:15.041344 17585 ts_tablet_manager.cc:1929] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.16
I20260709 12:17:15.041858 17585 log.cc:1199] T 5ad3dc473b284687afcc907cd7aea9ea P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/5ad3dc473b284687afcc907cd7aea9ea
I20260709 12:17:15.043304  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 5ad3dc473b284687afcc907cd7aea9ea (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:15.043933 10046 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:17:15.044656 10197 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:17:15.044898 10095 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:15.051957 17494 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:15.052445 17494 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:15.053275 17494 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:15.065599 17587 ts_tablet_manager.cc:1929] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:17:15.084354 17587 log.cc:1199] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/8783323a2d554a0ca5fb7d1c9cf54ac1
I20260709 12:17:15.086174  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 8783323a2d554a0ca5fb7d1c9cf54ac1 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:15.082664  9953 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 21 to 22, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 22 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.176047  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:15.303532 10127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:15.304176 10127 raft_consensus.cc:606] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:15.319211 10127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:42524
I20260709 12:17:15.319823 10127 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:15.322009  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:15.323781  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:15.324610  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:15.438097 17550 raft_consensus.cc:993] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:15.438730 17550 raft_consensus.cc:1081] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:15.452600 10733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52022
I20260709 12:17:15.453173 10733 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:15.453521 10733 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:15.498052 10046 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:15.514272 17504 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:15.538410 10197 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:15.544291 10734 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Advancing to term 22
I20260709 12:17:15.544077 17550 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:15.474226 10733 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.549338 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:15.549901 10733 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:15.550693 10046 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:15.550997 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:15.551671 10127 raft_consensus.cc:3055] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:15.551968 10127 raft_consensus.cc:740] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:15.552822 10127 consensus_queue.cc:260] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.563033 10734 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:17:15.570262 17550 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:15.570979 10046 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:17:15.572094 10127 raft_consensus.cc:3060] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:15.572562 10702 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:15.573426 17594 raft_consensus.cc:2804] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:15.574190 17594 raft_consensus.cc:697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:15.575094 17594 consensus_queue.cc:237] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.578986 10127 raft_consensus.cc:2468] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
W20260709 12:17:15.647588 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 50786.6us
I20260709 12:17:15.652204 17605 raft_consensus.cc:1064] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:15.655736 17605 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.664278  9945 catalog_manager.cc:5697] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 20 to 21, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 21 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.681100 10733 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:17:15.683086 10055 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:17:15.681232 10197 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:17:15.683344 17494 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:17:15.685079 17604 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:15.688858 17606 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:15.696827 17604 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 13 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.698020 10734 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 13 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.703116 10197 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 13 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.714573 10055 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 13 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.756657 17606 raft_consensus.cc:993] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:15.757282 17606 raft_consensus.cc:1081] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:15.762548 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53720
I20260709 12:17:15.763130 10046 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:15.765520 10046 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:15.777060 10046 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.779760 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:15.780364 10127 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:17:15.780633 10127 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:15.781394 10127 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.782678 10127 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:15.783136 10046 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:15.784318 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:15.784902 10734 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:15.791755 10734 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 23.
I20260709 12:17:15.793090 10019 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677; no voters: 
I20260709 12:17:15.796727 17546 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:17:15.797292 17546 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:15.798157 17546 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.800331  9953 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 13 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.812688 10127 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 23.
I20260709 12:17:15.824776 10129 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:15.840343 10197 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:17:15.841706 10734 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:17:15.843926 17604 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:15.853396 17604 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:15.856712  9944 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 22 to 23, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 23 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.858922 17606 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.870711 10197 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.913362 10734 raft_consensus.cc:2955] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.953361  9944 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 16 to 17, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 22 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:15.972599  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0075e506a7e41288c8c852a9911174c with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:16.008118 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet e0075e506a7e41288c8c852a9911174c with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:16.043124 10127 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:16.065083 17517 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:16.101876 10046 raft_consensus.cc:1275] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:16.111778 17596 consensus_queue.cc:1048] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:16.178840 17611 tablet_replica.cc:333] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:16.179920 17611 raft_consensus.cc:2243] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.180686 17611 raft_consensus.cc:2272] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.184455 10052 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:16.186565 17611 ts_tablet_manager.cc:1916] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:16.225375 17611 ts_tablet_manager.cc:1929] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.16
I20260709 12:17:16.225874 17611 log.cc:1199] T e0075e506a7e41288c8c852a9911174c P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/e0075e506a7e41288c8c852a9911174c
I20260709 12:17:16.227892  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet e0075e506a7e41288c8c852a9911174c (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
W20260709 12:17:16.260924 10019 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77943463ebc54e5183b2d6477b6de047. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.275341 10197 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:17:16.276641 10129 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:17:16.277097 17546 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:16.279395 17525 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:16.307709 17566 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.328276 10198 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.337057 10734 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:17:16.339931 17525 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:17:16.348863  9952 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:17:16.380223 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 46040.9us
I20260709 12:17:16.391395 10197 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:16.392421 10127 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:17:16.447842 17566 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:17:16.395572 10127 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.452992 10052 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:16.460593 17616 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:16.462841 10129 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:16.464582 17616 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:16.472597  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:16.515102 17593 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.536296 10124 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:16.531528 10129 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:17:16.558939 10168 consensus_peers.cc:597] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48f4645742c44585a93863b12f58ba75. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.560770 10046 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.568042  9952 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 12, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.607481 10197 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:17:16.608390 10052 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:17:16.608922 17494 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:16.610055 17605 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:17:16.620401 10094 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3687623d905944cb972fbfff21e2d729. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.646840 17494 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.650681 10052 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.678026 10198 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.693094 10046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:16.693759 10046 raft_consensus.cc:606] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Received request to transfer leadership to TS 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:16.695034  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:16.696656  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:16.697376  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:16.705539  9949 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 15, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 25 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.723253 10197 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:16.783591 17546 raft_consensus.cc:993] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:16.784112 17525 raft_consensus.cc:1081] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:16.788475 10201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:17:16.789106 10201 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:16.789508 10201 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:16.828107 10201 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:16.829295 10127 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:16.832106 17628 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:17:16.837016 10168 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc69f8e7f4804e73bc970c103ca90e60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.843034 10046 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:17:16.848459 17523 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:17:16.829964 17633 ts_tablet_manager.cc:933] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:17:16.861645 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:16.861797 10201 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:16.862342 10046 raft_consensus.cc:3055] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:17:16.862711 10046 raft_consensus.cc:740] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:16.863441 10046 consensus_queue.cc:260] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:16.864668 10046 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:16.868052 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:16.868669 10732 raft_consensus.cc:3060] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:16.873188 10046 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:17:16.875514 10169 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:16.875969 10732 raft_consensus.cc:2468] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:17:16.876935 17616 raft_consensus.cc:2804] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:17:16.877519 17616 raft_consensus.cc:697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:16.880491 17616 consensus_queue.cc:237] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:16.892345 17633 tablet_copy_client.cc:323] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:17:16.894351 10064 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 77943463ebc54e5183b2d6477b6de047 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:17:16.894979 10064 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 77943463ebc54e5183b2d6477b6de047 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-77943463ebc54e5183b2d6477b6de047
I20260709 12:17:16.909293 10064 tablet_copy_source_session.cc:215] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:16.917901 17523 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.920003 17633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77943463ebc54e5183b2d6477b6de047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:16.919361 10127 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.936568  9944 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:16.948001 17638 ts_tablet_manager.cc:933] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:16.977458  9949 catalog_manager.cc:5697] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 16 to 17, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 17 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.000972 10052 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:17.022729 17638 tablet_copy_client.cc:323] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:17:17.024746 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet 48f4645742c44585a93863b12f58ba75 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:17:17.025334 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet 48f4645742c44585a93863b12f58ba75 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-48f4645742c44585a93863b12f58ba75
I20260709 12:17:17.029668 17633 tablet_copy_client.cc:806] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.035110 10214 tablet_copy_source_session.cc:215] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.039903 17638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48f4645742c44585a93863b12f58ba75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.030295 17633 tablet_copy_client.cc:670] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.070407 17633 tablet_copy_client.cc:538] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.104321 17633 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:17.115598 17638 tablet_copy_client.cc:806] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.132745 17638 tablet_copy_client.cc:670] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.141224 17638 tablet_copy_client.cc:538] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.197503 17643 ts_tablet_manager.cc:933] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:17.221537 17643 tablet_copy_client.cc:323] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.194:34999
I20260709 12:17:17.288105 10140 tablet_copy_service.cc:140] P a29bed9eb81541dba9ec7a447986e01e: Received BeginTabletCopySession request for tablet 3687623d905944cb972fbfff21e2d729 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:54462)
I20260709 12:17:17.288652 10140 tablet_copy_service.cc:161] P a29bed9eb81541dba9ec7a447986e01e: Beginning new tablet copy session on tablet 3687623d905944cb972fbfff21e2d729 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:54462: session id = 4b3390fbbe574de7bf154b5a6cc35677-3687623d905944cb972fbfff21e2d729
W20260709 12:17:17.289404 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 75112.9us
I20260709 12:17:17.305325 10140 tablet_copy_source_session.cc:215] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.308415 17638 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:17.316128 17643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3687623d905944cb972fbfff21e2d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.332818 10055 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:17:17.340492 17616 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:17.395593 17647 ts_tablet_manager.cc:933] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:17.429754 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55220.4us
I20260709 12:17:17.485034 10732 raft_consensus.cc:1275] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:17:17.495071 17616 consensus_queue.cc:1048] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:17.501907 17643 tablet_copy_client.cc:806] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.521829 17643 tablet_copy_client.cc:670] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.509295 17647 tablet_copy_client.cc:323] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.195:33595
I20260709 12:17:17.538056 10214 tablet_copy_service.cc:140] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Received BeginTabletCopySession request for tablet bc69f8e7f4804e73bc970c103ca90e60 from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:49780)
I20260709 12:17:17.538688 10214 tablet_copy_service.cc:161] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Beginning new tablet copy session on tablet bc69f8e7f4804e73bc970c103ca90e60 from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:49780: session id = 4b3390fbbe574de7bf154b5a6cc35677-bc69f8e7f4804e73bc970c103ca90e60
I20260709 12:17:17.553632 17643 tablet_copy_client.cc:538] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.565675 10214 tablet_copy_source_session.cc:215] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.576715 17643 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:17.583396 17647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc69f8e7f4804e73bc970c103ca90e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.686852 17633 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.687860 17633 tablet_bootstrap.cc:492] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:17.688601 17633 ts_tablet_manager.cc:1403] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.585s	user 0.053s	sys 0.005s
I20260709 12:17:17.697350 17647 tablet_copy_client.cc:806] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.698009 17647 tablet_copy_client.cc:670] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.701980 17647 tablet_copy_client.cc:538] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.725831 17633 raft_consensus.cc:359] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:17.726787 17633 raft_consensus.cc:740] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:17.742683 17647 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:17.727443 17633 consensus_queue.cc:260] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:17.747911 17633 ts_tablet_manager.cc:1434] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:17:17.759572 10064 tablet_copy_service.cc:342] P 1c0050fa6eee4a0183cbe41a3f72c62b: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-77943463ebc54e5183b2d6477b6de047 received from {username='slave'} at 127.0.0.1:53880
I20260709 12:17:17.760339 10064 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-77943463ebc54e5183b2d6477b6de047 on tablet 77943463ebc54e5183b2d6477b6de047 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:17.760989 17638 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.761946 17638 tablet_bootstrap.cc:492] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:17.786748 17638 ts_tablet_manager.cc:1403] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.479s	user 0.040s	sys 0.042s
I20260709 12:17:17.796815 17638 raft_consensus.cc:359] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:17.798038 17638 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:17.798834 17638 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:17.824342  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.887501 10732 raft_consensus.cc:1217] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:17:17.897429 17647 tablet_bootstrap.cc:700] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent opening tablet: real 0.104s	user 0.002s	sys 0.001s
I20260709 12:17:17.898491 17638 ts_tablet_manager.cc:1434] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.111s	user 0.004s	sys 0.003s
I20260709 12:17:17.903192 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-48f4645742c44585a93863b12f58ba75 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:17:17.903707 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-48f4645742c44585a93863b12f58ba75 on tablet 48f4645742c44585a93863b12f58ba75 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:18.099892 17643 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:18.100854 17643 tablet_bootstrap.cc:492] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:18.114481 17643 ts_tablet_manager.cc:1403] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.543s	user 0.064s	sys 0.018s
I20260709 12:17:18.121723 10201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:18.122414 10201 raft_consensus.cc:606] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Received request to transfer leadership to TS 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:18.123785  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:18.125520  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:18.130985  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.130499 17643 raft_consensus.cc:359] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.132025 17643 raft_consensus.cc:740] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:18.132776 17643 consensus_queue.cc:260] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.134039 17647 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:18.135243 17647 tablet_bootstrap.cc:492] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:18.136080 17647 ts_tablet_manager.cc:1403] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.394s	user 0.033s	sys 0.022s
I20260709 12:17:18.146358 17643 ts_tablet_manager.cc:1434] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 12:17:18.148041 10140 tablet_copy_service.cc:342] P a29bed9eb81541dba9ec7a447986e01e: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-3687623d905944cb972fbfff21e2d729 received from {username='slave'} at 127.0.0.1:54462
I20260709 12:17:18.148437 10140 tablet_copy_service.cc:434] P a29bed9eb81541dba9ec7a447986e01e: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-3687623d905944cb972fbfff21e2d729 on tablet 3687623d905944cb972fbfff21e2d729 with peer 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:18.169766 10733 raft_consensus.cc:1217] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.14->[25.15-25.15]   Dedup: 25.15->[]
I20260709 12:17:18.199162 17523 raft_consensus.cc:993] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:18.200395 17523 raft_consensus.cc:1081] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Signalling peer 1c0050fa6eee4a0183cbe41a3f72c62b to start an election
I20260709 12:17:18.200964 10733 raft_consensus.cc:1217] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:17:18.201985 10055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
 from {username='slave'} at 127.0.0.1:53728
I20260709 12:17:18.202615 10055 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:18.202934 10055 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:18.212891 10055 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.216857 10055 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:18.223280 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:18.223942 10127 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:18.244406 17647 raft_consensus.cc:359] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.245985 17647 raft_consensus.cc:740] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:18.271286 17647 consensus_queue.cc:260] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
W20260709 12:17:18.276477 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 61010.9us
I20260709 12:17:18.279295 10127 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
I20260709 12:17:18.284705 10020 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:18.295998 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:18.296649 10197 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:18.296943 10197 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:18.299515 10197 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.338392 10197 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:18.309749 17566 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:18.368062 10197 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0050fa6eee4a0183cbe41a3f72c62b in term 19.
W20260709 12:17:18.400434 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 81792.7us
I20260709 12:17:18.398819 17566 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Leader. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:18.444726 17566 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:18.468431 17647 ts_tablet_manager.cc:1434] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.332s	user 0.009s	sys 0.010s
I20260709 12:17:18.470453 10214 tablet_copy_service.cc:342] P 7c74f73af6ac4ce394a0ae7a2eefbeae: Request end of tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-bc69f8e7f4804e73bc970c103ca90e60 received from {username='slave'} at 127.0.0.1:49780
I20260709 12:17:18.470902 10214 tablet_copy_service.cc:434] P 7c74f73af6ac4ce394a0ae7a2eefbeae: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-bc69f8e7f4804e73bc970c103ca90e60 on tablet bc69f8e7f4804e73bc970c103ca90e60 with peer 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:18.476059 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 136586us
I20260709 12:17:18.506263  9944 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193). New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.537976 17494 raft_consensus.cc:1064] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:18.540478 17494 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:18.557287 10737 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 LEARNER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:17:18.558161 10051 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:17:18.559962 17605 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:18.561549 10197 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:17:18.563617 17605 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:18.565075 17645 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:18.592669 17645 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.611178 10737 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.629405  9949 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.638114 10051 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.683470 10197 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.704918 17566 raft_consensus.cc:1064] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:18.707459 17566 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:18.723922 10737 raft_consensus.cc:1217] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:17:18.757990 10197 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:18.760317 10737 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:18.762624 17661 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:18.763602 17668 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:18.767082 10127 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:18.768738 17673 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:18.827708 17661 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.854447 10733 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Advancing to term 19
I20260709 12:17:18.855162 10127 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.865573 10733 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:17:18.867170 17660 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:18.869731 10201 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.886560 10737 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.900735 10124 consensus_queue.cc:237] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:18.913240 17670 raft_consensus.cc:1064] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:18.913573 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:18.914197 10051 raft_consensus.cc:606] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Received request to transfer leadership
W20260709 12:17:18.913779 17670 raft_consensus.cc:1068] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Unable to promote non-voter 4b3390fbbe574de7bf154b5a6cc35677: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:17:18.919904  9952 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.922964 10730 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:17:18.924439 17494 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:18.924789 10051 raft_consensus.cc:1275] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:17:18.928551 10055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:18.928808 17494 consensus_queue.cc:1048] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:18.929133 10055 raft_consensus.cc:606] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Received request to transfer leadership
I20260709 12:17:18.934195 10201 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:17:18.940734 17566 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:18.945381 10124 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:17:18.949062 17668 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:18.994230 17605 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:18.996999 10055 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.003715 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:19.004400 10051 raft_consensus.cc:606] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Received request to transfer leadership
I20260709 12:17:19.008584  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3687623d905944cb972fbfff21e2d729 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.009465 10737 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:17:19.012183 17668 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:17:19.015137 10001 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:17:19.015496 10001 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 48f4645742c44585a93863b12f58ba75 already in progress
W20260709 12:17:19.015780 10001 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 48f4645742c44585a93863b12f58ba75 already in progress
I20260709 12:17:19.022112 10197 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:17:19.024372 17566 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.025935 10737 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.026772 17668 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:19.034106 10197 raft_consensus.cc:2955] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.038803  9939 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77943463ebc54e5183b2d6477b6de047 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.049707 17661 raft_consensus.cc:993] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:19.050215 17661 raft_consensus.cc:1081] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Signalling peer 7c74f73af6ac4ce394a0ae7a2eefbeae to start an election
I20260709 12:17:19.057384 10198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48f4645742c44585a93863b12f58ba75"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
 from {username='slave'} at 127.0.0.1:38760
I20260709 12:17:19.057891 10198 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:19.058224 10198 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:19.066473  9944 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 15 to 16, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 19 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.070632 10198 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:19.076856 10051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:19.078822 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:19.081005 10201 raft_consensus.cc:1240] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer 1c0050fa6eee4a0183cbe41a3f72c62b for earlier term 19. Current term is 20. Ops: []
I20260709 12:17:19.097206 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet 77943463ebc54e5183b2d6477b6de047 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:35268
I20260709 12:17:19.098948 10198 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:19.119652 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 126890us
W20260709 12:17:19.120766 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 128417us
I20260709 12:17:19.130599 10730 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.107448 17661 consensus_queue.cc:1059] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:17:19.180384 10055 raft_consensus.cc:2955] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.189235  9953 catalog_manager.cc:5697] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: config changed from index 16 to 17, VOTER 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) evicted. New cstate: current_term: 25 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.183252 17696 tablet_replica.cc:333] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:19.202210 10051 raft_consensus.cc:3055] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:17:19.202618 10051 raft_consensus.cc:740] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:19.203469 10051 consensus_queue.cc:260] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:19.204803 10051 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:17:19.278401 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 68108.8us
I20260709 12:17:19.285848 10051 raft_consensus.cc:2468] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
W20260709 12:17:19.324168 17670 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:17:19.340179  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:19.359786 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 170754us
I20260709 12:17:19.399364 17696 raft_consensus.cc:2243] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.400301 17696 raft_consensus.cc:2272] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.410454 17696 ts_tablet_manager.cc:1916] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.462603 10189 tablet_service.cc:1558] Processing DeleteTablet for tablet 3687623d905944cb972fbfff21e2d729 with delete_type TABLET_DATA_TOMBSTONED (TS 7c74f73af6ac4ce394a0ae7a2eefbeae not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:49224
W20260709 12:17:19.466140 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 67517.6us
I20260709 12:17:19.481508 17707 raft_consensus.cc:1064] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:19.483763 17707 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.494956 10169 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:19.495986 17705 raft_consensus.cc:2804] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:19.496501 17705 raft_consensus.cc:697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:19.497373 17705 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:19.524122 10732 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:19.531934 17708 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:19.551239  9953 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 19 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:19.538676 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 169728us
I20260709 12:17:19.555819 17712 tablet_replica.cc:333] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:19.556388 10129 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:19.556938 17712 raft_consensus.cc:2243] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.557703 17712 raft_consensus.cc:2272] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.560432 10051 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:17:19.577188 10051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37150
I20260709 12:17:19.577801 10051 raft_consensus.cc:606] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:19.578075 10019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 179450us
I20260709 12:17:19.595510  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:19.597506  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:19.598443  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:19.595165 17712 ts_tablet_manager.cc:1916] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.623167 17696 ts_tablet_manager.cc:1929] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 12:17:19.623610 17696 log.cc:1199] T 77943463ebc54e5183b2d6477b6de047 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/77943463ebc54e5183b2d6477b6de047
I20260709 12:17:19.624786 17707 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:19.625741  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet 77943463ebc54e5183b2d6477b6de047 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:19.647923 17707 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:17:19.686890 17710 raft_consensus.cc:993] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:19.687464 17566 raft_consensus.cc:1081] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:19.690045 17712 ts_tablet_manager.cc:1929] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.16
I20260709 12:17:19.690539 17712 log.cc:1199] T 3687623d905944cb972fbfff21e2d729 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/wals/3687623d905944cb972fbfff21e2d729
I20260709 12:17:19.693291  9938 catalog_manager.cc:5028] TS 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): tablet 3687623d905944cb972fbfff21e2d729 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:19.700269 17707 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.727691 10730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:37554
I20260709 12:17:19.728390 10730 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:19.728729 10730 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:19.738947 10730 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.753835 10730 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 24 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:19.750893 10055 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.740410 10124 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.762306  9953 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:19.808161 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 91108.9us
I20260709 12:17:19.815657 10055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b"
I20260709 12:17:19.816258 10055 raft_consensus.cc:3055] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:17:19.816547 10055 raft_consensus.cc:740] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1c0050fa6eee4a0183cbe41a3f72c62b, State: Running, Role: LEADER
I20260709 12:17:19.819644 10204 consensus_queue.cc:237] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.831192 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:19.831810 10124 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:19.817248 10055 consensus_queue.cc:260] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.836687 10055 raft_consensus.cc:3060] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:19.846632 10730 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } attrs { replace: true } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.858803 10124 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 24.
I20260709 12:17:19.862286 10048 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:19.863950 17707 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:19.867105 10055 raft_consensus.cc:2468] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 24.
I20260709 12:17:19.871800 10702 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:19.872603 17711 raft_consensus.cc:2804] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:17:19.873159 17711 raft_consensus.cc:697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:19.874027 17711 consensus_queue.cc:237] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:19.875299 17704 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.883001 10730 raft_consensus.cc:1275] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:17:19.893370 10055 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.899909 17708 consensus_queue.cc:1048] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:17:19.916391 10730 raft_consensus.cc:2955] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.922614 10055 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:17:19.924427  9953 catalog_manager.cc:5697] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 12 to 13, VOTER a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) evicted. New cstate: current_term: 18 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:19.927095 17708 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:17:19.950771 10124 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:19.955271  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc69f8e7f4804e73bc970c103ca90e60 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.964170 10124 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:17:19.964416  9944 catalog_manager.cc:5697] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 23 to 24, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 24 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.970189 10115 tablet_service.cc:1558] Processing DeleteTablet for tablet bc69f8e7f4804e73bc970c103ca90e60 with delete_type TABLET_DATA_TOMBSTONED (TS a29bed9eb81541dba9ec7a447986e01e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35268
I20260709 12:17:19.971104 17696 tablet_replica.cc:333] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:19.982574 17696 raft_consensus.cc:2243] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.983469 17696 raft_consensus.cc:2272] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.984280 17674 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:17:19.988761 17696 ts_tablet_manager.cc:1916] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:20.042848 10730 raft_consensus.cc:3060] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEARNER]: Advancing to term 20
I20260709 12:17:20.053761 10730 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:17:20.055053 17705 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:20.083967 17707 raft_consensus.cc:1064] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:20.086460 17707 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:20.093762 10733 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEARNER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:17:20.095166 10129 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:17:20.096575 17709 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:20.097262 17696 ts_tablet_manager.cc:1929] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 12:17:20.097761 17696 log.cc:1199] T bc69f8e7f4804e73bc970c103ca90e60 P a29bed9eb81541dba9ec7a447986e01e: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/wals/bc69f8e7f4804e73bc970c103ca90e60
I20260709 12:17:20.099385  9939 catalog_manager.cc:5028] TS a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): tablet bc69f8e7f4804e73bc970c103ca90e60 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:20.099717 17709 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:20.104722 10048 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:17:20.107968 17709 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:17:20.130079 17704 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.148990 10048 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.169348 10733 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.175276 10129 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 12 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.193581  9949 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b reported cstate change: config changed from index 12 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } attrs { replace: true } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.240139 10197 consensus_queue.cc:237] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:20.252990 10733 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:17:20.254783 17674 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:20.261647 10124 raft_consensus.cc:1275] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:17:20.264575 17674 consensus_queue.cc:1048] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:17:20.266314 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 74741.7us
I20260709 12:17:20.289707 17704 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.298806 10733 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.307544  9938 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48f4645742c44585a93863b12f58ba75 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:20.317687  9944 catalog_manager.cc:5697] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index 15 to 16, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:20.298094 10129 raft_consensus.cc:2955] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:20.350085 10037 tablet_service.cc:1558] Processing DeleteTablet for tablet 48f4645742c44585a93863b12f58ba75 with delete_type TABLET_DATA_TOMBSTONED (TS 1c0050fa6eee4a0183cbe41a3f72c62b not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:40172
I20260709 12:17:20.380611 17725 tablet_replica.cc:333] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:20.392956 17725 raft_consensus.cc:2243] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:20.399132 17725 raft_consensus.cc:2272] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:20.410894 10124 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:17:20.414155 17725 ts_tablet_manager.cc:1916] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:20.417624 17672 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:17:20.425101 10048 raft_consensus.cc:1275] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:17:20.432456 17672 consensus_queue.cc:1048] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:17:20.474967 17725 ts_tablet_manager.cc:1929] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 12:17:20.476588 17725 log.cc:1199] T 48f4645742c44585a93863b12f58ba75 P 1c0050fa6eee4a0183cbe41a3f72c62b: Deleting WAL directory at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/wals/48f4645742c44585a93863b12f58ba75
I20260709 12:17:20.479053  9939 catalog_manager.cc:5028] TS 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): tablet 48f4645742c44585a93863b12f58ba75 (table test-workload [id=369d49ec57244946a73ad2b48cea684c]) successfully deleted
I20260709 12:17:20.898118  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:20.984164 10197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08"
dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
mode: GRACEFUL
new_leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:45090
I20260709 12:17:20.984810 10197 raft_consensus.cc:606] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Received request to transfer leadership to TS 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:20.987393  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:17:20.989270  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:20.990144  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:21.103410 17674 raft_consensus.cc:993] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: : Instructing follower 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:21.103974 17674 raft_consensus.cc:1081] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Signalling peer 4b3390fbbe574de7bf154b5a6cc35677 to start an election
I20260709 12:17:21.105895 10730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08"
dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
 from {username='slave'} at 127.0.0.1:52036
I20260709 12:17:21.106470 10730 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:21.106812 10730 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:21.118773 10730 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:21.127518 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:21.128116 10127 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:21.135675 10127 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:21.142983 10730 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:21.145815 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:21.155954 10702 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:21.157163 17711 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:21.157706 17711 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:21.158667 17711 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:21.153649 10197 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:21.179440 10197 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:21.180275 10197 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:21.181622 10197 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:21.197664 10048 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:21.253428  9953 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:21.265818 10197 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:21.338141 10127 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:21.339104 10197 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:17:21.340803 17566 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:21.341756 17710 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:17:21.352320 10019 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b -> Peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867): Couldn't send request to peer 4b3390fbbe574de7bf154b5a6cc35677. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76e7629206124e6390a9baab062635eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:21.410889 17566 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:21.433905 10204 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:21.459105  9953 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
I20260709 12:17:21.483090 10127 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } } }
W20260709 12:17:21.621621 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 85659.7us
W20260709 12:17:21.647930 17733 log.cc:927] Time spent T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:21.727275 10204 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:17:21.720386 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 85384.8us
I20260709 12:17:21.770829 17672 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:21.932291 10127 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:21.991833 17739 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:17:22.008494 17751 ts_tablet_manager.cc:933] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Initiating tablet copy from peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801)
I20260709 12:17:22.049134 17751 tablet_copy_client.cc:323] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Beginning tablet copy session from remote peer at address 127.8.178.193:45801
I20260709 12:17:22.052871 10064 tablet_copy_service.cc:140] P 1c0050fa6eee4a0183cbe41a3f72c62b: Received BeginTabletCopySession request for tablet 76e7629206124e6390a9baab062635eb from peer 4b3390fbbe574de7bf154b5a6cc35677 ({username='slave'} at 127.0.0.1:53880)
I20260709 12:17:22.053582 10064 tablet_copy_service.cc:161] P 1c0050fa6eee4a0183cbe41a3f72c62b: Beginning new tablet copy session on tablet 76e7629206124e6390a9baab062635eb from peer 4b3390fbbe574de7bf154b5a6cc35677 at {username='slave'} at 127.0.0.1:53880: session id = 4b3390fbbe574de7bf154b5a6cc35677-76e7629206124e6390a9baab062635eb
I20260709 12:17:22.072542 10064 tablet_copy_source_session.cc:215] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:22.078936 17751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e7629206124e6390a9baab062635eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:22.102944  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.148288 17751 tablet_copy_client.cc:806] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:22.153761 17751 tablet_copy_client.cc:670] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:22.165556 17751 tablet_copy_client.cc:538] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:22.230755 17751 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap starting.
I20260709 12:17:22.327610  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:22.329497  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:22.362721  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.491998  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.561685 17751 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:22.563040 17751 tablet_bootstrap.cc:492] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Bootstrap complete.
I20260709 12:17:22.563890 17751 ts_tablet_manager.cc:1403] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Time spent bootstrapping tablet: real 0.367s	user 0.043s	sys 0.022s
I20260709 12:17:22.579257 17751 raft_consensus.cc:359] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:22.586690 17751 raft_consensus.cc:740] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Initialized, Role: LEARNER
I20260709 12:17:22.591301 17751 consensus_queue.cc:260] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: NON_VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: true } }
I20260709 12:17:22.594771  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
I20260709 12:17:22.602833 17751 ts_tablet_manager.cc:1434] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
W20260709 12:17:22.607240 10702 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:17:22.645488 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.719532 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 44672.1us
W20260709 12:17:22.723187 10095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 84313.7us
W20260709 12:17:22.734323 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.735495 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 45074.1us
W20260709 12:17:22.736066 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.740808 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59599.1us
W20260709 12:17:22.741793 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.749228 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.770553 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.775065 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.775990 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.780097 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.801678 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 47993.6us
W20260709 12:17:22.811254 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:22.816594  8907 tablet_copy_service.cc:362] P 1c0050fa6eee4a0183cbe41a3f72c62b: Destroying tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-76e7629206124e6390a9baab062635eb due to service shutdown
I20260709 12:17:22.817085  8907 tablet_copy_service.cc:434] P 1c0050fa6eee4a0183cbe41a3f72c62b: ending tablet copy session 4b3390fbbe574de7bf154b5a6cc35677-76e7629206124e6390a9baab062635eb on tablet 76e7629206124e6390a9baab062635eb with peer 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:22.840054 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.842043 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.847709 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.851327 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.857059 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.856995 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.863775 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.861310 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.870956 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.877318 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.881314 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:22.899250 10732 raft_consensus.cc:1217] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
W20260709 12:17:22.935349 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.941286 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.942618 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.958588 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.982052 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:22.982385 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:22.993535  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:22.997556  8907 tablet_replica.cc:333] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
W20260709 12:17:22.999032 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.000833  8907 raft_consensus.cc:2243] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.001871  8907 raft_consensus.cc:2272] T 567b4adc73ba4d2ea946e154ebd94129 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:23.011587 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.024348  8907 tablet_replica.cc:333] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.025219  8907 raft_consensus.cc:2243] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.025831  8907 raft_consensus.cc:2272] T 59c6c24fd7e14d1b8d5545bce723ad27 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.039162  8907 tablet_replica.cc:333] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.040174  8907 raft_consensus.cc:2243] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.041049  8907 raft_consensus.cc:2272] T 9c14882e1876454ba455dbe6212f6ab6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:23.041977 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.043995  8907 tablet_replica.cc:333] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.044965  8907 raft_consensus.cc:2243] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.046226  8907 raft_consensus.cc:2272] T 98ca581ce0e64e44a04efbd2710adbf8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.057386  8907 tablet_replica.cc:333] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.058385  8907 raft_consensus.cc:2243] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.059360  8907 raft_consensus.cc:2272] T 1b4f71cfc2d1484aa7a37c6943e8196f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.089440  8907 tablet_replica.cc:333] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.103729  8907 raft_consensus.cc:2243] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.111722  8907 raft_consensus.cc:2272] T acc41bbfb3c94637814837eb2cfad80f P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.126520  8907 tablet_replica.cc:333] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.128739  8907 raft_consensus.cc:2243] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.129554  8907 raft_consensus.cc:2272] T c49badfb58494d79890f98353e487b55 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.142671  8907 tablet_replica.cc:333] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
W20260709 12:17:23.137758 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.170207  8907 raft_consensus.cc:2243] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.173292  8907 raft_consensus.cc:2272] T efb9d4efacd143a6bbb65eb25d52093d P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.185482  8907 tablet_replica.cc:333] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.189005  8907 raft_consensus.cc:2243] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.210379  8907 raft_consensus.cc:2272] T aedf82824d3c4883ad33ed154a6a08a1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.267131  8907 tablet_replica.cc:333] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.278946  8907 raft_consensus.cc:2243] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.285216  8907 raft_consensus.cc:2272] T f85bc37908cc412eb5ffe5d0318140ee P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.288681  8907 tablet_replica.cc:333] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.295161  8907 raft_consensus.cc:2243] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.298970  8907 raft_consensus.cc:2272] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.303561  8907 tablet_replica.cc:333] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.312547  8907 raft_consensus.cc:2243] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.323210  8907 raft_consensus.cc:2272] T add21891a8334a65adf1e2611b794222 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.331272  8907 tablet_replica.cc:333] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.332213  8907 raft_consensus.cc:2243] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.333047  8907 raft_consensus.cc:2272] T e42a5811b7f7484186df2c558a4f6769 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.343461  8907 tablet_replica.cc:333] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.344506  8907 raft_consensus.cc:2243] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.345925  8907 raft_consensus.cc:2272] T 56431c97132141908463e11690f7ba09 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.379290  8907 tablet_replica.cc:333] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.394321  8907 raft_consensus.cc:2243] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.409251 17736 raft_consensus.cc:1064] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: attempting to promote NON_VOTER 4b3390fbbe574de7bf154b5a6cc35677 to VOTER
I20260709 12:17:23.411368  8907 raft_consensus.cc:2272] T 3687623d905944cb972fbfff21e2d729 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.415872  8907 tablet_replica.cc:333] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.427651 17736 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.429185  8907 raft_consensus.cc:2243] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.430699  8907 raft_consensus.cc:2272] T eb932976ca8b44ffb6eab1f93c14a4bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.437391  8907 tablet_replica.cc:333] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.476567 10197 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:17:23.477598  8907 raft_consensus.cc:2243] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.483552  8907 raft_consensus.cc:2272] T 27f26165888546baaae16d413e9601c5 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.483305 17710 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:23.493438 10737 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEARNER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:17:23.494686  8907 tablet_replica.cc:333] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.499918 17710 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:23.501381 17736 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:23.503742  8907 raft_consensus.cc:2243] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.504470  8907 raft_consensus.cc:2272] T 29ce21faad84430d93ec2445ba64030b P 1c0050fa6eee4a0183cbe41a3f72c62b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.502207 17736 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.512770  8907 tablet_replica.cc:333] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.513638  8907 raft_consensus.cc:2243] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.520318  8907 raft_consensus.cc:2272] T 03eb59a6c9c6418299ed25e8330b2cef P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.524588 17710 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.543310 17736 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.545198 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.555413  8907 tablet_replica.cc:333] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.556418  8907 raft_consensus.cc:2243] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.574918 17710 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.579587 17710 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.599193 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.603502 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.607183 10019 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:23.608954 17775 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:23.618049 17775 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:23.618669 17775 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:23.640766 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.647089 17775 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:23.653102  8907 raft_consensus.cc:2272] T 35b1b33f7d314aa08131a968c515f3c6 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.665099  8907 tablet_replica.cc:333] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.665934  8907 raft_consensus.cc:2243] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.666229 17771 raft_consensus.cc:493] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.669487 17771 raft_consensus.cc:515] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:23.673120 17771 leader_election.cc:290] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:23.674942 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.685627  8907 raft_consensus.cc:2272] T 6596abeb975142149ebfb7b9d1b7d100 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.685400 17771 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:23.688738  8907 tablet_replica.cc:333] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.689585  8907 raft_consensus.cc:2243] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.697624 10737 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:23.702972 10204 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:23.714447 17775 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:17:23.715059 10020 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 108837us
I20260709 12:17:23.715132 17775 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.717392 10127 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 1c0050fa6eee4a0183cbe41a3f72c62b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:17:23.718209 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.719041 17775 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.720937 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.721621 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.722299 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.723730 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e50f262594b84bcbdf34c6b162436" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.723794 10019 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:23.726300 17775 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:23.725665  9949 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:23.727509 10020 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.728430 17775 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:23.731244 10020 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.732805 10020 leader_election.cc:304] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.733632 17779 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:23.734377 17779 raft_consensus.cc:2749] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:23.690248  8907 raft_consensus.cc:2272] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.738538 17771 raft_consensus.cc:2706] T a6031fe457e54869a9b512abf1d54183 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 13 FOLLOWER]: Received pre-election callback for term 14 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:17:23.745405  8907 tablet_replica.cc:333] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.753516 17771 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.754393 17771 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:23.760035 17771 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:23.760914 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.763409 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.765959 10019 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.767434 17771 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:23.777837  8907 raft_consensus.cc:2243] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.778878 17771 raft_consensus.cc:493] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:23.779614 17771 raft_consensus.cc:515] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.781837 17771 leader_election.cc:290] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.783454  8907 raft_consensus.cc:2272] T a0518529c52b4f2ca715288c1fcccbaa P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.784000 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.784431 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7d9d50250941bf80c7399e949d802c" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.785946 10019 leader_election.cc:304] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:23.787209 17771 raft_consensus.cc:2749] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:23.788779  8907 tablet_replica.cc:333] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.789680  8907 raft_consensus.cc:2243] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.808517  8907 raft_consensus.cc:2272] T 505b084a723d46f28d06230c6bb0c5bb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.812424 17775 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:23.808135 10129 raft_consensus.cc:2955] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } } }
I20260709 12:17:23.814822 17775 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:23.818356 17775 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:23.820160 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.809051 17771 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:23.827569 17771 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:23.829690 17771 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:23.832147 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.861096  8907 tablet_replica.cc:333] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.861969  8907 raft_consensus.cc:2243] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.837872 17775 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.862938 17775 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.865788 17775 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.866670 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.871120 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.873250 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.875018 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.876616 10019 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.878352 17771 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:23.878857 17779 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:23.879613 10019 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:23.879442 17779 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.880841 17771 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:23.882413 10019 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.883500 17736 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:23.883424 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.884850  8907 raft_consensus.cc:2272] T 3496631dbf3b49519fbc5604f6834f3e P 1c0050fa6eee4a0183cbe41a3f72c62b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.884708 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.882323 17779 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.888648 10019 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.889506 17779 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:23.883780 17771 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.890956 17771 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.893198 17771 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.894142 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.896425 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.897994  8907 tablet_replica.cc:333] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.898299 10019 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:23.899096  8907 raft_consensus.cc:2243] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.926659 17779 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:23.927354 17779 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.929670 17779 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.930348 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.932536 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.934527 10019 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:23.919533 17771 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:23.936558 17779 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:23.941709  8907 raft_consensus.cc:2272] T 7ed6facad3f04ffd8eb02fda673b5455 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.942622 17779 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.943388 17779 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:23.949470  8907 tablet_replica.cc:333] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.950394  8907 raft_consensus.cc:2243] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.959098 17779 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:23.973090 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.959475  8907 raft_consensus.cc:2272] T 89ebc329a9274f3595e703104efa64c0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.981484 17779 raft_consensus.cc:493] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:23.982795  8907 tablet_replica.cc:333] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.982098 17779 raft_consensus.cc:515] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:23.983668  8907 raft_consensus.cc:2243] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.985000  8907 raft_consensus.cc:2272] T 4e741e9b5dcb4305b7be8692e35b1441 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.987355 17779 leader_election.cc:290] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:23.989718 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:23.990232 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:23.995532  8907 tablet_replica.cc:333] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:23.995918 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03425333a9b0484fbf7c273e6499e2cf" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:23.996572  8907 raft_consensus.cc:2243] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:17:23.997859  8907 raft_consensus.cc:2272] T 51714cf4d10d45a685fc2c669f03df9c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.001006  8907 tablet_replica.cc:333] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.001773  8907 raft_consensus.cc:2243] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.002488  8907 raft_consensus.cc:2272] T 7c0e50f262594b84bcbdf34c6b162436 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.010105 17749 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:24.010749 17749 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:24.013715 10019 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:24.018590 10095 leader_election.cc:336] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:24.019270 17749 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:24.020051 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:24.021607 10094 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:24.022950 17749 raft_consensus.cc:2749] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:17:24.023118  8907 tablet_replica.cc:333] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.024397  8907 raft_consensus.cc:2243] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:24.026472 17779 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:24.028004 10019 leader_election.cc:304] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:24.030369 17779 raft_consensus.cc:2749] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:24.033007 17779 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:24.033558 17779 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:24.034811 17771 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:24.035669 17779 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:24.035419 17771 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:24.036324  8907 raft_consensus.cc:2272] T 77943463ebc54e5183b2d6477b6de047 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.037786 17771 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:24.039680 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:24.042075 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:24.042740 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:24.079373  8907 tablet_replica.cc:333] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.087477 10019 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:24.089731  8907 raft_consensus.cc:2243] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.095046 17779 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:24.095469  8907 raft_consensus.cc:2272] T 03425333a9b0484fbf7c273e6499e2cf P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.103771 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:24.105434 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 49783.8us
I20260709 12:17:24.117894 10019 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c0050fa6eee4a0183cbe41a3f72c62b; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:24.122123 17779 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:24.152839  8907 tablet_replica.cc:333] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.153764  8907 raft_consensus.cc:2243] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:17:24.155006  8907 raft_consensus.cc:2272] T 5ad3dc473b284687afcc907cd7aea9ea P 1c0050fa6eee4a0183cbe41a3f72c62b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.157964  8907 tablet_replica.cc:333] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.181442  8907 raft_consensus.cc:2243] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.188283  8907 raft_consensus.cc:2272] T a7109c20f60c433bbfea17052252d2e4 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.189023 17707 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:24.190377 17707 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:24.192600 17707 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:24.194619 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:24.195358 10123 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 24.
I20260709 12:17:24.196775 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:24.197654 17707 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:17:24.198046 17707 raft_consensus.cc:493] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:24.198390 17707 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:17:24.202417 10169 leader_election.cc:336] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:24.213544  8907 tablet_replica.cc:333] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.228514  8907 raft_consensus.cc:2243] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:24.231329  8907 raft_consensus.cc:2272] T 76e7629206124e6390a9baab062635eb P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.229447 17707 raft_consensus.cc:515] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
W20260709 12:17:24.240844 10169 leader_election.cc:336] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:24.243427 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ca581ce0e64e44a04efbd2710adbf8" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:24.244109 10123 raft_consensus.cc:3060] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:24.244838  8907 tablet_replica.cc:333] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.245867  8907 raft_consensus.cc:2243] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.246625  8907 raft_consensus.cc:2272] T f0eadcb623c84a7daa48999c60decbe2 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.249621  8907 tablet_replica.cc:333] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.250545  8907 raft_consensus.cc:2243] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.251283  8907 raft_consensus.cc:2272] T 47e2925796cf4be4ab9f040c07bf6dd8 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.252637 10123 raft_consensus.cc:2468] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 25.
I20260709 12:17:24.254743 10169 leader_election.cc:304] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:24.255659 17766 raft_consensus.cc:2804] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:17:24.256178 17766 raft_consensus.cc:697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:24.257098 17766 consensus_queue.cc:237] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:24.253159 17707 leader_election.cc:290] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 25 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:24.272946  8907 tablet_replica.cc:333] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.273833  8907 raft_consensus.cc:2243] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.274581  8907 raft_consensus.cc:2272] T 03649ca7b822435188aa9ef044bc52b0 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.277434  8907 tablet_replica.cc:333] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.278249  8907 raft_consensus.cc:2243] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.283113  8907 raft_consensus.cc:2272] T bc69f8e7f4804e73bc970c103ca90e60 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.286249  8907 tablet_replica.cc:333] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.302858  8907 raft_consensus.cc:2243] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.303587  8907 raft_consensus.cc:2272] T 64c7a23860d1449c94c3bf85f8dee617 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.306281  8907 tablet_replica.cc:333] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.317510  8907 raft_consensus.cc:2243] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.318094  8907 raft_consensus.cc:2272] T ea142dcb28a347418ddf5a7c14fc8885 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.321004  8907 tablet_replica.cc:333] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.321782  8907 raft_consensus.cc:2243] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.322342  8907 raft_consensus.cc:2272] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.340095 17784 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:24.340760 17784 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:24.347961  8907 tablet_replica.cc:333] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:24.351091 17784 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:24.353421 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:24.349027  8907 raft_consensus.cc:2243] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.383885  8907 raft_consensus.cc:2272] T 6b7d9d50250941bf80c7399e949d802c P 1c0050fa6eee4a0183cbe41a3f72c62b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.387315  9944 catalog_manager.cc:5697] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 24 to 25, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 25 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.364260  8907 tablet_replica.cc:333] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:25.365283  8907 raft_consensus.cc:2243] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:17:25.533314  9984 debug-util.cc:398] Leaking SignalData structure 0x7b0800240b60 after lost signal to thread 8910
W20260709 12:17:25.534729  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08003575a0 after lost signal to thread 9987
I20260709 12:17:25.681878  8907 raft_consensus.cc:2272] T eb4fb909f689401989cfc1a22c46c6cd P 1c0050fa6eee4a0183cbe41a3f72c62b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.975054 17792 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:25.975908 17792 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:25.979382 17792 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:25.981204  8907 tablet_replica.cc:333] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b: stopping tablet replica
I20260709 12:17:25.983393 17788 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:25.984190  8907 raft_consensus.cc:2243] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.985294  8907 raft_consensus.cc:2272] T 4aaadb6c64c344b186ed9c3e3630b660 P 1c0050fa6eee4a0183cbe41a3f72c62b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.990504 17790 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:25.991194 17790 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:25.993695 17790 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:25.984280 17788 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:25.998142 17788 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:25.994299 17790 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:17:26.004210 10169 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.005488 17747 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.006451 17747 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.007136 17792 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.004724 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:26.020457 17796 raft_consensus.cc:493] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.023237 17796 raft_consensus.cc:515] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.027362 17796 leader_election.cc:290] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.015916 17794 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.037400 17747 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.011920 17749 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.007702 17792 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.012285 17790 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.045177 17749 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.047667 17749 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.008589 17788 raft_consensus.cc:493] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.108794 17747 raft_consensus.cc:493] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.109829 17747 raft_consensus.cc:515] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.111714 17747 leader_election.cc:290] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.044330 17792 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.123416 17789 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.124049 17789 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.129043 17765 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.117879 17792 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:26.133857 17792 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.134476 17792 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.136962 17792 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.138990 17747 raft_consensus.cc:493] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.139618 17747 raft_consensus.cc:515] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.141775 17747 leader_election.cc:290] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.115068 17788 raft_consensus.cc:515] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.148880 17788 leader_election.cc:290] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.150398 17793 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.151053 17793 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.153353 17793 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.154402 17765 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.157044 17765 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.040422 17794 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.178009 17763 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.178759 17763 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.181480 17763 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.182889 17795 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.183591 17795 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.185987 17795 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.194312 17790 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.195611 17789 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.213742 17790 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.214555 17790 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.216245 17794 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.216861 17794 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.217224 17790 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.218349 17795 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.234802 17806 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.235441 17806 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.237784 17806 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.217327 17794 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.231549 17795 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.241882 17747 raft_consensus.cc:493] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.250916 17802 raft_consensus.cc:493] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.255649 17796 raft_consensus.cc:493] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.238287 17806 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.277731 17806 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.279894 17806 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.252087 17799 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.263618 17788 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.265295 17792 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.267302 17765 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.291033 17801 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.293043 17806 raft_consensus.cc:493] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.293298 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.293742 17807 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.267132 17747 raft_consensus.cc:515] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.304613 17707 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.304200 10127 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:17:26.306083 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.276944 17796 raft_consensus.cc:515] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.305545 17707 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.299999 17795 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.266655 17802 raft_consensus.cc:515] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.316906 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.317852 17707 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.320708 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.320945 10123 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:17:26.296466 17788 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.300539 17765 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.326117 17808 raft_consensus.cc:493] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.326891 17808 raft_consensus.cc:515] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.329268 17808 leader_election.cc:290] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.329577 17794 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.329883 17808 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.330514 17800 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.331177 17800 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.333678 17800 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.307889 17763 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.334874 17763 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.337323 17763 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.339371 17810 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.340078 17810 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.297909 17792 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.296711 17799 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.343461 17792 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.346730 17788 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.349432 17802 leader_election.cc:290] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.352614 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.353364 10122 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 16.
I20260709 12:17:26.354075 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.356390 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.357013 10128 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:17:26.358000 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.334288 17798 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.358747 10122 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 26.
I20260709 12:17:26.358888 17798 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.359916 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.361047 17796 leader_election.cc:290] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.361447 17798 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.353410 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.363183 10124 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:17:26.344822 17799 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.373301 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.376904 17747 leader_election.cc:290] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.372505 17784 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.378041 17784 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.379657 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.380028 17784 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.381412 17784 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.307377 17807 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.384958 17812 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.385558 17812 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.386551 17784 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.306874 17806 raft_consensus.cc:515] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.388434 17812 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.389449 17806 leader_election.cc:290] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.385946 17807 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.383791 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.383078 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.391018 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed6facad3f04ffd8eb02fda673b5455" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.380252 10197 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 25.
I20260709 12:17:26.400202 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c14882e1876454ba455dbe6212f6ab6" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.400482 17804 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.401152 17804 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.402571 17805 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.403239 17804 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.403090 17805 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.405336 17805 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.394104 10201 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:26.406379 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.406544 17816 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.407357 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.407752 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.408373 10196 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:26.407150 17816 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.410705 10199 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:26.411746 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc69f8e7f4804e73bc970c103ca90e60" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.412003 17816 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.410100 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.412884 10195 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:17:26.412364 17784 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.415721 17817 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.416221 17807 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.416445 17798 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.416742 17807 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.416920 17798 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.418879 17798 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.419373 17798 raft_consensus.cc:493] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.419831 17798 raft_consensus.cc:515] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.421754 17805 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.422140 17806 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.422330 17805 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.422730 17806 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.424403 17813 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.424610 17805 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.424942 17806 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.430596  9944 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.031s	user 0.008s	sys 0.016s
W20260709 12:17:26.430986  9944 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.031s	user 0.008s	sys 0.016s
I20260709 12:17:26.432428 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.433152 10195 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:17:26.424971 17802 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.435248 17802 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.435708 17813 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.437548 17802 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.437884 17813 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.434568 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.431002 17807 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.371693 17810 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.450359 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 88623.3us
I20260709 12:17:26.453244 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.307003 17801 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.371793 17808 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.422173 17798 leader_election.cc:290] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.467417 10169 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:26.471089 10169 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:26.472366 10169 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:26.460322 17816 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:17:26.456049 17800 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.473127 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.475158 17707 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.475996 17707 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.473497 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:26.476876 17707 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.480119 17808 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.475497 17816 raft_consensus.cc:493] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.480852 17803 raft_consensus.cc:493] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.481109 17816 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:26.458366 17817 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.489477 17707 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.487296 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:26.496011 17707 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.478053 17798 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.480593 17801 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.477686 17795 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:17:26.494522 10701 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.476243 17792 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:26.480681 17808 raft_consensus.cc:493] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.503656 17801 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.503851 17805 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:17:26.504354 17817 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.511559 17805 raft_consensus.cc:493] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.511548 17801 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.512152 17805 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:26.514015 17801 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.503561 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.518100 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505b084a723d46f28d06230c6bb0c5bb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.518781 17819 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.518990 10195 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:17:26.519436 17763 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:26.519855 17763 raft_consensus.cc:493] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.520087 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.520238 17763 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.492976 17747 raft_consensus.cc:493] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.521072 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.521752 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.493683 17803 raft_consensus.cc:515] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.522362 10199 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 12.
I20260709 12:17:26.521719 10203 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:17:26.523904 17803 leader_election.cc:290] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.494647 17794 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:17:26.524525 17794 raft_consensus.cc:493] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.525019 17794 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:17:26.525691 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.526314 10200 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:17:26.521253 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8783323a2d554a0ca5fb7d1c9cf54ac1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.527977 17763 raft_consensus.cc:515] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.529760 17817 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:26.530575 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:26.532263 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 54053.9us
I20260709 12:17:26.532359 10200 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:26.525108 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.494274 17818 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.542694 17818 raft_consensus.cc:493] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.543262 17818 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.497944 17800 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.548491 17800 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.539810 17808 raft_consensus.cc:515] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.537577 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.502993 17795 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.551083 17795 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:26.551499 17808 leader_election.cc:290] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.552280 17822 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:17:26.552773 17822 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.554067 17765 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.502758 17792 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.540270 17790 raft_consensus.cc:493] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.520396 17810 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.521147 17747 raft_consensus.cc:515] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.575222 17810 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.576776 17747 leader_election.cc:290] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.555467 17784 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:17:26.519359 17819 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.577303 17810 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.577947 17790 raft_consensus.cc:515] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.578562  9944 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42618 (request call id 393) took 2226 ms. Trace:
I20260709 12:17:26.579293 17819 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.579859 17819 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.580144 17790 leader_election.cc:290] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.556612 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.580346 17819 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:26.580966 10198 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:26.556911 17803 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.553889 17822 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:26.559556  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08002baea0 after lost signal to thread 10079
W20260709 12:17:26.582782  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080008bfa0 after lost signal to thread 10154
I20260709 12:17:26.583773 17804 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.584327 17804 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.584611 17817 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.585342 17817 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.586570 17802 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.587128 17802 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.587575 17817 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.588389 17817 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.588845 17777 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.588982 17817 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.589452 17807 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.589394 17777 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.590059 17807 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.581248 17784 raft_consensus.cc:493] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.591424 17784 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:26.591660 17777 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.592128 17807 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:26.592811 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 55388.5us
I20260709 12:17:26.590595 17813 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:26.594198 17813 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.582319 17803 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.597437 17822 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.571020 17792 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.598120 17803 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:26.584244  9984 debug-util.cc:398] Leaking SignalData structure 0x7b0800220e00 after lost signal to thread 10228
I20260709 12:17:26.589186 17802 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.596364 17813 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.610392 17749 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
W20260709 12:17:26.606760 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 71495.1us
I20260709 12:17:26.611096 17749 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.611572 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.612449 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.613284 17749 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.613510 17778 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:26.614050 17810 raft_consensus.cc:493] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:26.614022 17778 raft_consensus.cc:493] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.614606 17810 raft_consensus.cc:515] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.615147 17778 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.612305 17795 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.617336 17810 leader_election.cc:290] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.497790 17798 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.618758 17798 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:17:26.607601  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080026a6c0 after lost signal to thread 10229
I20260709 12:17:26.618997 17801 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:26.610615 17802 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:26.619460 17801 raft_consensus.cc:493] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.619892 17801 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.624543 17792 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.628834 17805 raft_consensus.cc:515] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.619789 17802 raft_consensus.cc:493] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:26.630355 17802 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.632447 17794 raft_consensus.cc:515] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.612305 17816 raft_consensus.cc:515] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.579104  9944 rpcz_store.cc:276] 0709 12:17:24.352487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.353202 (+   715us) service_pool.cc:224] Handling call
0709 12:17:26.578488 (+2225286us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:25.962678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:25.986120 (+ 23442us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:25.986164 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:17:25.986188 (+    24us) tablet.cc:662] Decoding operations
0709 12:17:25.986652 (+   464us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:25.986718 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:25.986746 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:25.986963 (+   217us) tablet.cc:701] Row locks acquired
0709 12:17:25.986980 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:17:25.987154 (+   174us) write_op.cc:270] Start()
0709 12:17:25.987298 (+   144us) write_op.cc:276] Timestamp: P: 1783599445987093 usec, L: 0
0709 12:17:25.987319 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:25.988114 (+   795us) log.cc:844] Serialized 541 byte log entry
0709 12:17:26.291629 (+303515us) op_driver.cc:464] REPLICATION: finished
0709 12:17:26.450156 (+158527us) write_op.cc:301] APPLY: starting
0709 12:17:26.456303 (+  6147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:26.482360 (+ 26057us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:26.482488 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:26.483220 (+   732us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:26.483409 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:17:26.483450 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:26.483636 (+   186us) log.cc:844] Serialized 25 byte log entry
0709 12:17:26.483816 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:26.483896 (+    80us) write_op.cc:454] Released schema lock
0709 12:17:26.483935 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:26.484317 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:26.484342 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":83353,"apply.run_cpu_time_us":3532,"apply.run_wall_time_us":85308,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":1561573,"prepare.run_cpu_time_us":3452,"prepare.run_wall_time_us":25846,"replication_time_us":304142,"thread_start_us":2038971,"threads_started":2}]]}
W20260709 12:17:26.658205  9984 debug-util.cc:398] Leaking SignalData structure 0x7b080034d720 after lost signal to thread 10761
W20260709 12:17:26.658797  9984 debug-util.cc:398] Leaking SignalData structure 0x7b08002a36a0 after lost signal to thread 17783
I20260709 12:17:26.633754 17801 raft_consensus.cc:515] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.653060 17818 raft_consensus.cc:515] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.740439 17818 leader_election.cc:290] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.741415 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.657943 17804 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.715760 17816 leader_election.cc:290] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.716655 17763 leader_election.cc:290] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.717314 17792 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:26.718024 17817 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.720861 17802 raft_consensus.cc:515] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.744117 10730 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:26.724453 17778 raft_consensus.cc:515] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.726143 17805 leader_election.cc:290] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.727519 10169 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.745630 17798 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.745277 17794 leader_election.cc:290] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.747651 17778 leader_election.cc:290] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.661281 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.618304 17795 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:26.748559 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 87332.6us
I20260709 12:17:26.749060 17819 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.749464 10701 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.750298 17778 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.750751 17778 raft_consensus.cc:493] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.751138 17778 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.745333 17802 leader_election.cc:290] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.753800 10169 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.751219 17805 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:26.754491 17805 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:17:26.754546 10169 leader_election.cc:336] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.755782 10169 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.756168 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:26.756700 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.756910 17795 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:17:26.758327 10169 leader_election.cc:336] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.758644 17784 raft_consensus.cc:515] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:26.759265 17778 raft_consensus.cc:515] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.759317 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.760520 10197 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:26.760717 17784 leader_election.cc:290] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:26.759598 17805 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:26.761485 17778 leader_election.cc:290] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.759279 10169 leader_election.cc:336] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.763417 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:26.764081 10169 leader_election.cc:336] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.766127 10169 leader_election.cc:336] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.766732 10169 leader_election.cc:336] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.771420 10169 leader_election.cc:336] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.773118 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.773402 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.773780 10201 raft_consensus.cc:3060] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:26.773902 10200 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.774598 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.774737 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.775162 10203 raft_consensus.cc:3060] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.775312 10204 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:26.777027 17798 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.774056 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47e2925796cf4be4ab9f040c07bf6dd8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.779042 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.779610 10195 raft_consensus.cc:3060] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.781219 10201 raft_consensus.cc:2468] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 26.
I20260709 12:17:26.782819 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.783010 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.783655 10202 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:26.783558 10199 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:26.788846 10203 raft_consensus.cc:2468] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:17:26.791390 10195 raft_consensus.cc:2468] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:26.794620 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.795117 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:26.795292 10195 raft_consensus.cc:3060] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.795742 10197 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.799700 10203 raft_consensus.cc:1240] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:17:26.801679 10730 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:26.804862 10730 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:26.807564 10204 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:17:26.811587 10202 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:26.804746 10200 raft_consensus.cc:2468] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:26.811723 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42a5811b7f7484186df2c558a4f6769" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.816483 17805 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.818202 10197 raft_consensus.cc:2468] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
W20260709 12:17:26.819845 10169 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.820890 10701 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:17:26.821174 10169 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.821856 10701 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:17:26.822077 10169 leader_election.cc:336] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.822981 10169 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.826099 10169 leader_election.cc:336] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.750161 17801 leader_election.cc:290] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:26.826810 10169 leader_election.cc:336] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.827445 10169 leader_election.cc:336] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.830835 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.831823 10199 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:17:26.833597 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.836009 10730 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 22. Current term is 23. Ops: []
I20260709 12:17:26.836165 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.837790 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48f4645742c44585a93863b12f58ba75" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.841130 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d0b2763b8154a7392dcbe6c6acfec0c" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:26.841391 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 59623.5us
W20260709 12:17:26.844689 10702 leader_election.cc:336] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.846490 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.847191 10202 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 19.
I20260709 12:17:26.847506 17798 raft_consensus.cc:2804] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:17:26.849954 17798 raft_consensus.cc:697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.851112 17798 consensus_queue.cc:237] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 25.21, Last appended by leader: 21, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.847960 17778 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.852511 17778 raft_consensus.cc:493] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.852916 17778 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:17:26.855227 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.855887 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:26.859716 10701 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.860508 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.860769 10701 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.861536 17813 raft_consensus.cc:2804] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:26.862149 17802 raft_consensus.cc:2804] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:26.862645 17802 raft_consensus.cc:697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.863529 17802 consensus_queue.cc:237] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.864428 17813 raft_consensus.cc:697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.865372 17813 consensus_queue.cc:237] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.866880 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.867588 10125 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:17:26.868945 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.869601 10737 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 18.
I20260709 12:17:26.870040 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.870476 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.871071 10123 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:26.871274 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.871721 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6ec4c2ee75449d8ab4f971e9de7e77" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.871894 10124 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:26.873982 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3687623d905944cb972fbfff21e2d729" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.874347 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.876132 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ee41f44fe24909bc0f087cbbc6213e" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.878772 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ce21faad84430d93ec2445ba64030b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.880638 10202 raft_consensus.cc:1240] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 12. Current term is 13. Ops: []
I20260709 12:17:26.882591 17778 raft_consensus.cc:515] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.885382 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.885900 17805 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:26.886754 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add21891a8334a65adf1e2611b794222" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.887879 10195 raft_consensus.cc:2468] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:17:26.895298 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.901583 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eadcb623c84a7daa48999c60decbe2" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.904098 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.906018 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "567b4adc73ba4d2ea946e154ebd94129" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.908265 10701 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
W20260709 12:17:26.908685 10095 leader_election.cc:336] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.909205 17801 consensus_queue.cc:1059] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:17:26.909492 10095 leader_election.cc:336] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.910391 17817 raft_consensus.cc:2804] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:17:26.910482 10095 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.911000 17817 raft_consensus.cc:697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.911067 17801 raft_consensus.cc:3055] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:17:26.911430 10095 leader_election.cc:336] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.911994 17817 consensus_queue.cc:237] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:26.912643 10095 leader_election.cc:336] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.913360 10095 leader_election.cc:336] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.913810 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:17:26.913934 10095 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.914671 10095 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.914884 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:26.915365 10095 leader_election.cc:336] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.915963 10095 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.916673 10095 leader_election.cc:336] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.917222 10095 leader_election.cc:336] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.925733 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedf82824d3c4883ad33ed154a6a08a1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.927578 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.928284 10124 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 24.
I20260709 12:17:26.930696 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:17:26.931839 10095 leader_election.cc:336] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.934104 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 88483.5us
I20260709 12:17:26.936094 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4f71cfc2d1484aa7a37c6943e8196f" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.936309 10701 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:26.939134 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0518529c52b4f2ca715288c1fcccbaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.939985 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:17:26.940197 10702 leader_election.cc:336] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:26.937273 10095 leader_election.cc:336] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.933708 10730 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 22.
I20260709 12:17:26.943653 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:26.944416 10737 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:17:26.944793 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea142dcb28a347418ddf5a7c14fc8885" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.946458 10202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.947052 10202 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:17:26.940629 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:26.949101 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.949057 10123 raft_consensus.cc:1275] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 12:17:26.950474 10199 raft_consensus.cc:1240] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:26.950635 17763 raft_consensus.cc:2804] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:26.951615 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.952418 10195 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
I20260709 12:17:26.953819 10127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.955698 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:26.956058 10127 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
W20260709 12:17:26.956938 10702 leader_election.cc:336] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.957450 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:26.959311 10202 raft_consensus.cc:1240] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 22. Current term is 23. Ops: []
I20260709 12:17:26.960428 10200 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:17:26.961757 10195 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:26.963434 10094 leader_election.cc:304] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:26.965222 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:26.952267 10095 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.965880 10200 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 21.
W20260709 12:17:26.966481 10095 leader_election.cc:336] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:26.967308 17825 raft_consensus.cc:2749] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:26.971341 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:26.972201 17825 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:26.972581 17825 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:26.972940 17825 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:26.966739 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6c24fd7e14d1b8d5545bce723ad27" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:26.911595 17801 raft_consensus.cc:740] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
W20260709 12:17:26.984900 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:26.985844 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:26.984026 17763 raft_consensus.cc:697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:26.987175 10730 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:26.987221 17826 consensus_queue.cc:1059] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:17:26.989207 17826 raft_consensus.cc:3055] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:17:26.989531 17826 raft_consensus.cc:740] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:26.987646 17763 consensus_queue.cc:237] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.990401 17826 consensus_queue.cc:260] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.991643 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e741e9b5dcb4305b7be8692e35b1441" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:26.990835 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f26165888546baaae16d413e9601c5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:26.990409 17801 consensus_queue.cc:260] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:26.998308 10121 raft_consensus.cc:3060] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:17:27.011322 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.013856 10094 leader_election.cc:304] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:27.017843 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:27.015465 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 66787.6us
I20260709 12:17:27.023341 17810 raft_consensus.cc:2749] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:27.024130 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.025352 10732 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
W20260709 12:17:27.025805 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.025995 17819 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:27.026921 10701 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:27.027729 17802 raft_consensus.cc:2804] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:17:27.028031 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:27.028239 17802 raft_consensus.cc:697] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.028597 17825 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.029284 17802 consensus_queue.cc:237] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.032938 10701 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:27.012444 17826 raft_consensus.cc:3060] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:27.028703 10129 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:17:27.012425 17805 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:17:27.035204 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.035558 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.021696 10094 leader_election.cc:304] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.012297 17801 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:17:27.042024 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.044584 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.045682 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.046684 17810 consensus_queue.cc:1059] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:27.047220 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b1b33f7d314aa08131a968c515f3c6" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.047785 17810 raft_consensus.cc:3055] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:27.048163 17810 raft_consensus.cc:740] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:27.048977 17810 consensus_queue.cc:260] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.047796 10128 raft_consensus.cc:3060] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:27.043826 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.042196 10701 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:27.058127 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.058838 10733 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 24.
I20260709 12:17:27.055546 17765 consensus_queue.cc:1048] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:17:27.042783 17816 raft_consensus.cc:2804] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:27.050230 17810 raft_consensus.cc:3060] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:27.060813 10121 raft_consensus.cc:2468] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 27.
I20260709 12:17:27.059214 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6031fe457e54869a9b512abf1d54183" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.064270 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.067797 17824 raft_consensus.cc:2749] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.057718 17749 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.059430 17794 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.070065 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.070535 10701 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:27.075047 10737 raft_consensus.cc:2393] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:27.075837 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7109c20f60c433bbfea17052252d2e4" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.059022 17805 raft_consensus.cc:2804] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:27.079166 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.080665 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3496631dbf3b49519fbc5604f6834f3e" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.083353 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.084442 10200 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:27.084724 10730 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:17:27.086658 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.072206 17816 raft_consensus.cc:697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.075392 17794 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.081918 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.088016 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51714cf4d10d45a685fc2c669f03df9c" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.090301 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77943463ebc54e5183b2d6477b6de047" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.085733 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.071960 17749 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.090927 10195 raft_consensus.cc:3060] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:27.072168 17778 leader_election.cc:290] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:27.074854 17747 consensus_queue.cc:1059] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 12:17:27.091614 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c49badfb58494d79890f98353e487b55" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.093823 17707 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:27.094892 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.092708 17749 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.084861 17817 raft_consensus.cc:2804] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:27.085143 17805 raft_consensus.cc:697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.101323 17803 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.092886 17794 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.104156  9944 catalog_manager.cc:5697] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 25 to 26, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 26 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.090723 17825 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:27.108673 10169 leader_election.cc:304] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:17:27.111004 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.106256 17803 raft_consensus.cc:493] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.109840 17824 raft_consensus.cc:3055] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:17:27.120230 10195 raft_consensus.cc:2468] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:17:27.125260 10701 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:27.118098 17803 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.109154 17817 raft_consensus.cc:697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.125327 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a59e68139a465c858046fab6d14aaa" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.132532 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.117726 17792 raft_consensus.cc:2804] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:17:27.140308 10735 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 19: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
W20260709 12:17:27.142536 10095 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.117560 17816 consensus_queue.cc:237] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.131392 17777 raft_consensus.cc:2804] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:27.144306 17777 raft_consensus.cc:697] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.145238 17777 consensus_queue.cc:237] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.146701 17817 consensus_queue.cc:237] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.121618 17805 consensus_queue.cc:237] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.156970 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.157861 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb0ac432438495091e62290dd19b812" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.124301 17824 raft_consensus.cc:740] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:27.158572 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.159516 17824 consensus_queue.cc:260] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.160940 17792 raft_consensus.cc:697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 27 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:27.161897 17792 consensus_queue.cc:237] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.164433 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85bc37908cc412eb5ffe5d0318140ee" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.166569 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebc329a9274f3595e703104efa64c0" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.167404 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc41bbfb3c94637814837eb2cfad80f" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:27.171547 17794 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.173804 17794 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:27.178921 10128 raft_consensus.cc:2468] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 21.
I20260709 12:17:27.201241 10731 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 20.
I20260709 12:17:27.202569 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.115913 17763 consensus_queue.cc:1059] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:17:27.206313 17803 raft_consensus.cc:515] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.208791 17803 leader_election.cc:290] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:27.216852 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0075e506a7e41288c8c852a9911174c" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.218277 10128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c7a23860d1449c94c3bf85f8dee617" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:27.220045 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fc66fb7de4405ba4a4ef0ea5ca5ba1" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.221822 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.217011 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.232321 17813 raft_consensus.cc:3055] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:27.231340 10195 raft_consensus.cc:1240] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer 4b3390fbbe574de7bf154b5a6cc35677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:27.230275 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff855a4bf854fbd9207ae909021d6bf" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.234782 17813 raft_consensus.cc:740] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:27.235888 17813 consensus_queue.cc:260] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.237169 17813 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:17:27.227499 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 112245us
W20260709 12:17:27.242070 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.242398 10129 raft_consensus.cc:2468] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 13.
I20260709 12:17:27.254917 10122 raft_consensus.cc:2468] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:27.256385 10733 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 17.
I20260709 12:17:27.261584 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb932976ca8b44ffb6eab1f93c14a4bb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.262307 10125 raft_consensus.cc:3060] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.271642 10169 leader_election.cc:304] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.276283 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:27.281787 17819 raft_consensus.cc:2804] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:27.282600 17819 raft_consensus.cc:697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:27.283492 17819 consensus_queue.cc:237] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.297648 10125 raft_consensus.cc:2468] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:17:27.310935 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:17:27.324374 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.321509 10168 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:17:27.328474 10702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.328881 10168 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.332887 10168 leader_election.cc:304] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.332566 10169 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:27.335080 17707 raft_consensus.cc:2804] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:17:27.336192 10168 leader_election.cc:304] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.340973 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 280562us
I20260709 12:17:27.331266 17803 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.335131 17765 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:27.338634 17795 raft_consensus.cc:2749] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.327868 17749 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.381470 10094 leader_election.cc:304] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.382575 10702 leader_election.cc:304] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.385614 10129 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:27.384967 17749 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:27.394059 17707 raft_consensus.cc:697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:27.354998 17803 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.385877 17819 raft_consensus.cc:2749] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:27.412361 10702 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:27.416601 17707 consensus_queue.cc:237] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.425870 17804 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.410755 17803 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.378368 17825 consensus_queue.cc:1059] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:17:27.394482 17822 raft_consensus.cc:2749] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:27.430497 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:27.444427 10702 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.395195 17826 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:17:27.416141 17749 raft_consensus.cc:2764] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 12:17:27.456598 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 120485us
I20260709 12:17:27.458042 10168 leader_election.cc:304] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.441267 17804 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.459360 10168 leader_election.cc:304] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.453059 17802 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:17:27.463100 10168 leader_election.cc:304] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.461189 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79798us
I20260709 12:17:27.464417 10094 leader_election.cc:304] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:27.465019 10095 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.465241 10168 leader_election.cc:304] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.467439 10168 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.461985 17804 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.475294 17841 raft_consensus.cc:2749] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:17:27.476987 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.478492 10096 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.483834 10702 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.488652 17707 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:27.467007 17819 raft_consensus.cc:2749] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:17:27.466742 17765 raft_consensus.cc:2749] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:27.467412 17802 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.502492 17707 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:17:27.503086 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.503895 10168 leader_election.cc:304] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.469642 17798 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:27.505632 17707 raft_consensus.cc:2749] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:27.475575 17824 raft_consensus.cc:3060] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:27.506632 10168 leader_election.cc:304] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.469200 17844 raft_consensus.cc:2749] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:17:27.471720 17794 raft_consensus.cc:2749] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:17:27.519433 17837 log.cc:927] Time spent T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:17:27.527531 17843 log.cc:927] Time spent T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:27.528326 17841 consensus_queue.cc:1059] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:17:27.530037 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.535998 10094 leader_election.cc:304] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.537536 10702 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:27.508160 17802 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:17:27.529070 17839 log.cc:927] Time spent T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:17:27.510447 17763 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:27.509526 17798 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:27.567231 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:27.573534 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 66974.3us
I20260709 12:17:27.574499 10168 leader_election.cc:304] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.575769 10168 leader_election.cc:304] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.577553 17793 raft_consensus.cc:2749] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:27.576640 17798 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:27.587164 17850 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:17:27.587700 17850 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.588184 17850 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:27.589696 17845 raft_consensus.cc:2749] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:27.572688 17857 raft_consensus.cc:2749] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:27.592629 17765 raft_consensus.cc:2749] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:27.594036 10168 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.541242 17826 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:27.595876 10168 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.594938 17846 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:27.596752 17851 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:17:27.596889 17846 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:27.598013 17846 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.607043 17747 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:17:27.607507 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 271086us
I20260709 12:17:27.607569 17747 raft_consensus.cc:493] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:27.607992 10094 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.609442 17860 raft_consensus.cc:2749] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:27.611465 10094 leader_election.cc:304] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.613596 10169 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 225 similar messages]
W20260709 12:17:27.629045 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 91562.5us
I20260709 12:17:27.630002 10094 leader_election.cc:304] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.614610 17747 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:27.636260 10702 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.636261 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
W20260709 12:17:27.641948 17835 log.cc:927] Time spent T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:17:27.646078 10168 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.646215 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.647289 17826 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:17:27.647817 17826 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.648216 17826 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:27.648720 10168 leader_election.cc:304] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.649472 17795 raft_consensus.cc:2749] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:17:27.649196 17857 consensus_queue.cc:1059] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:17:27.633402 17841 raft_consensus.cc:2749] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.651224 10168 leader_election.cc:304] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.639780 17852 raft_consensus.cc:2749] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:27.659224 10200 raft_consensus.cc:1275] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 25 index: 21. Preceding OpId from leader: term: 26 index: 22. (index mismatch)
I20260709 12:17:27.663794 10202 raft_consensus.cc:1275] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:17:27.664722 10195 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 12:17:27.668401 10702 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.669479 10702 leader_election.cc:336] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.669850 10702 leader_election.cc:304] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.666249 10200 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:27.670697 17817 raft_consensus.cc:2749] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:17:27.671221 10702 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.679039 10200 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:17:27.679665 17784 raft_consensus.cc:2749] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:27.669946 17747 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.684427 17747 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:27.686529 17849 raft_consensus.cc:3055] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:17:27.691514 17849 raft_consensus.cc:740] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:27.691896 17848 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:17:27.692411 17849 consensus_queue.cc:260] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.693486 17849 raft_consensus.cc:3060] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:27.693545 17850 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.647220 17859 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:17:27.651492 17860 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:17:27.695206 17860 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.695600 17860 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:17:27.699798 17749 raft_consensus.cc:3055] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:27.651717 17804 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.700291 17749 raft_consensus.cc:740] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:27.701148 17749 consensus_queue.cc:260] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.690860 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.702782 17804 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:27.707044 17747 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:17:27.679462 17803 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:27.708540 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 93049.9us
W20260709 12:17:27.709293 10169 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.709879 10169 leader_election.cc:336] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.710997 17850 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:27.691591 17798 raft_consensus.cc:515] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.715369 10732 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:27.715289 10199 raft_consensus.cc:1275] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:17:27.716522 17825 raft_consensus.cc:3055] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:17:27.716987 17825 raft_consensus.cc:740] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
W20260709 12:17:27.719619 17834 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 12:17:27.693964 17802 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.731379 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.732672 10094 leader_election.cc:304] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.733807 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.734052 10094 leader_election.cc:304] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.734489 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.736668 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.741595 17747 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:17:27.742118 17747 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1c0050fa6eee4a0183cbe41a3f72c62b)
I20260709 12:17:27.742525 17747 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:17:27.742715 17810 raft_consensus.cc:2749] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:17:27.739899  9949 catalog_manager.cc:5697] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 26 to 27, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 27 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.745808 17810 raft_consensus.cc:2749] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:17:27.745721 17850 consensus_queue.cc:1048] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:17:27.718015 17825 consensus_queue.cc:260] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.747499 17825 raft_consensus.cc:3060] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:17:27.745061 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:27.750053 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.752270 17798 leader_election.cc:290] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:27.753127 17802 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:27.756245 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.756870 10124 raft_consensus.cc:2468] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:17:27.757400 17859 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.757767 17802 consensus_queue.cc:1048] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:17:27.672645 10702 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.760445 17777 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:27.760383 17850 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
W20260709 12:17:27.760488 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 89287.1us
W20260709 12:17:27.768564 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.769480 10702 leader_election.cc:336] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.769845 10702 leader_election.cc:304] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.770804 17777 raft_consensus.cc:2749] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:17:27.770921 10702 leader_election.cc:336] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.771407 17798 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:27.779500 17803 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:27.771425 10702 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:17:27.784610 10702 leader_election.cc:336] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.785059 10702 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:27.785636 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.788062 10121 raft_consensus.cc:1275] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 27 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:17:27.756805 17749 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:27.789319 17802 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:17:27.786629 17826 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.790992 10121 raft_consensus.cc:1240] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:27.792261 17826 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:27.795992 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56431c97132141908463e11690f7ba09" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.796620 10199 raft_consensus.cc:3060] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:27.796937 10200 raft_consensus.cc:1240] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19. Ops: []
I20260709 12:17:27.798899 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.799625 10200 raft_consensus.cc:2393] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:17:27.777868 17747 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.809845 10199 raft_consensus.cc:2468] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
W20260709 12:17:27.818817 10702 leader_election.cc:336] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.819761 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.820168 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.820875 17850 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:17:27.810541 17802 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:27.811221 17798 consensus_queue.cc:1048] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:27.812783 17777 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:27.821223 10702 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.823091 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:17:27.823957 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.824636 10095 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.824796 10702 leader_election.cc:336] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.825434 10095 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.825212  9949 catalog_manager.cc:5697] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 20 to 21, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 21 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.831939 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.832801 10733 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 23: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:27.832684 10200 raft_consensus.cc:1240] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 17. Current term is 18. Ops: []
I20260709 12:17:27.831324  9949 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 19 to 20, leader changed from 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 20 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.818634 17747 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:27.831698 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.834584 10195 raft_consensus.cc:1240] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Rejecting Update request from peer a29bed9eb81541dba9ec7a447986e01e for earlier term 19. Current term is 20. Ops: []
I20260709 12:17:27.835897 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.836309  9949 catalog_manager.cc:5697] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 21 to 22, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 22 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.842527 17803 consensus_queue.cc:1048] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:27.845854 17859 consensus_queue.cc:1059] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:27.847548 10195 raft_consensus.cc:1275] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:17:27.848263 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.847606 17803 raft_consensus.cc:3055] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:17:27.848820 17803 raft_consensus.cc:740] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:27.849625 17803 consensus_queue.cc:260] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:27.850893 17803 raft_consensus.cc:3060] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:27.855255 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.856086 10195 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 22: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:17:27.857594 10195 raft_consensus.cc:1275] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:17:27.859061 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.825264 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.860697 10195 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:17:27.861706 10093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.861002 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.787460  9944 catalog_manager.cc:5697] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 20 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.863662 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.863265  9944 catalog_manager.cc:5697] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 18 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.864692 10732 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 25: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:27.866089 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:27.868867 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 44095.3us
I20260709 12:17:27.869108 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:17:27.869853 10702 leader_election.cc:336] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.871877 17850 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.870396 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.865540  9944 catalog_manager.cc:5697] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 20, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 20 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:27.878662 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:27.882238 10169 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:27.883124 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:27.878507  9944 catalog_manager.cc:5697] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 18 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:27.884191 10702 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.884650 17777 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:17:27.883771 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:27.889430 17860 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:27.891822 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:27.886335  9944 catalog_manager.cc:5697] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 22 to 23, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 23 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.888486 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.903362 10121 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:27.900027  9944 catalog_manager.cc:5697] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 20 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.885556 17849 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:17:27.910796  9944 catalog_manager.cc:5697] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 18, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 18 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.917271  9944 catalog_manager.cc:5697] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 12 to 13, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 13 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.918342 17825 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:17:27.919606  9944 catalog_manager.cc:5697] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 19 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 20 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.922942 10094 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.923767 17747 raft_consensus.cc:2749] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.924355 10094 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:27.925487 17749 raft_consensus.cc:2804] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:27.926000 17749 raft_consensus.cc:697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:27.926940 17749 consensus_queue.cc:237] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:27.927789 10094 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:27.928531 17841 raft_consensus.cc:2749] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:17:27.912151 10702 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.936322 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:17:27.938345 10702 leader_election.cc:336] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.938858 10702 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:27.939922 10702 leader_election.cc:336] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.940310 10702 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:27.945066 17860 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:27.946290 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.947135 10733 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:27.953976 17862 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.954826 17862 raft_consensus.cc:2749] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.955173 10199 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:17:27.955428 17862 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:27.956089 17862 consensus_queue.cc:1048] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:17:27.965871 10095 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:27.966418 10095 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:27.969113 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:27.972520 10196 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 22: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:17:27.972371 17852 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.987550 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:27.988391 10728 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 22: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:27.992745 17802 consensus_queue.cc:1048] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:17:27.994573 17804 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:28.005478 10195 raft_consensus.cc:2468] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:28.006959 10168 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:28.009518 17707 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:17:27.993207 17862 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:17:28.026017 10127 raft_consensus.cc:1275] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:17:28.026225 10129 raft_consensus.cc:1275] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:17:28.026777 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:28.027196 10128 raft_consensus.cc:1275] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:17:28.027501 10125 raft_consensus.cc:2393] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 22: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:28.031157 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:28.031955 10122 raft_consensus.cc:1275] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:28.032780 10121 raft_consensus.cc:1275] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:17:28.044991 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:28.045871 10126 raft_consensus.cc:2393] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 23: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:28.047395 10130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370d155a067d4428a676aa10078366b8" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
W20260709 12:17:28.049045 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:28.048803 17844 consensus_queue.cc:1048] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:17:28.078820 10123 raft_consensus.cc:2393] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 25: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:28.112275 10121 raft_consensus.cc:1275] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:17:28.130820 10701 leader_election.cc:304] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:28.132265 10733 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:17:28.151806 17707 consensus_queue.cc:1048] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:28.176280 17817 raft_consensus.cc:2804] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:17:28.189481 10702 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:28.197149 17850 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:17:28.197891 17850 consensus_queue.cc:1048] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:28.199275 17863 consensus_queue.cc:1048] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:17:28.201658 17805 consensus_queue.cc:1048] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:17:28.240811 10702 leader_election.cc:336] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:28.241780 10702 leader_election.cc:336] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:28.246213 10702 leader_election.cc:336] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:28.249521 10702 leader_election.cc:336] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:17:28.237587 17777 consensus_queue.cc:1048] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:17:28.291682  9944 catalog_manager.cc:5697] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 19 to 20, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 20 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:28.270534 17817 raft_consensus.cc:697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:28.310878 17817 consensus_queue.cc:237] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:28.325309 10702 leader_election.cc:336] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:17:28.327392 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 52672.5us
I20260709 12:17:28.329661 10122 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:17:28.336612 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.337698 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:28.353608 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.348372 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:28.355901 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:28.356691 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.359731 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:28.366546 10122 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:17:28.375193 10124 raft_consensus.cc:1275] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:17:28.365767 10702 connection.cc:769] client connection to 127.8.178.193:45801 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:17:28.388814 10702 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:17:28.370275 17857 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:28.503085 17896 log.cc:927] Time spent T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:17:28.409284 17857 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:28.545533 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 163659us
I20260709 12:17:28.434115 17859 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.104s
I20260709 12:17:28.535688 17848 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.594547 17749 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:28.617769 17749 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:28.619855 17749 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:28.597049 17848 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:28.651896 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:28.652667 10199 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:28.653084  9944 catalog_manager.cc:5697] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 18 to 19, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.667658 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:28.671696 17763 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:17:28.674794 17848 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:28.675449 17763 raft_consensus.cc:493] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:28.717917 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 76411.6us
I20260709 12:17:28.674326 17857 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:28.721846 17763 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:28.735204 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:28.739893 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:28.740716 10199 raft_consensus.cc:2393] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 18: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:17:28.743656 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:28.744437 10728 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 20.
I20260709 12:17:28.766461 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:28.778079 17749 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:17:28.778672 17749 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.779198 17749 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:28.766700 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:28.787499 17858 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:17:28.785923 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:28.805802 17763 raft_consensus.cc:515] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:28.827029 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.830981 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.835609 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:28.841205 10200 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:17:28.841745 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:28.845654 10122 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:17:28.846669 10733 raft_consensus.cc:2368] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
W20260709 12:17:28.841215 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:28.847532 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:17:28.850787 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:28.851761 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:28.855080 10702 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:17:28.833760 17751 tablet_copy_client.cc:1131] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:28.851085 17863 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:17:28.865681 10122 raft_consensus.cc:1275] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:17:28.863318 17805 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:17:28.890319 10094 leader_election.cc:400] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:17:28.894032 10094 leader_election.cc:403] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:28.882174 17863 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.900875 17863 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:28.903225 17863 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:28.890655 17862 consensus_queue.cc:1048] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:17:28.911934 17749 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:28.921339 10199 raft_consensus.cc:1275] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:17:28.934628 17857 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:17:28.937296 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 60739.3us
W20260709 12:17:28.938803 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 52246.6us
I20260709 12:17:28.970372 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:28.971190 10200 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 17.
I20260709 12:17:28.976406 17861 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:17:28.979043 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:28.979094 17861 consensus_queue.cc:1048] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:17:28.987496 17763 leader_election.cc:290] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:28.990195 17909 consensus_queue.cc:1048] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:17:28.993913 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:29.003890 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:29.025695 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:29.027626 17890 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:17:29.028116 17890 raft_consensus.cc:493] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.028460 17890 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:29.032688 10122 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:17:29.033685 17749 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Requested vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:29.037616 17857 raft_consensus.cc:2749] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867) with higher term. Message: Invalid argument: T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e for earlier term 18. Current term is 19.
I20260709 12:17:29.040966 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:29.037413 17890 raft_consensus.cc:515] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.047739 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:29.048416 10122 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 16.
I20260709 12:17:29.063401 10203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:29.063665 10201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:29.064088 10203 raft_consensus.cc:3060] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:17:29.064353 10201 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:17:29.064487 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:29.066394 10094 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:29.084966 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 192114us
I20260709 12:17:29.089648 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ade9b09dbd4c1e8ef7fb9e1f22c472" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:29.093209 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e133f56c04b492fbfac52f65ed6fe2b" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:29.098465 10126 raft_consensus.cc:3060] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:17:29.099381 10168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 119161us
I20260709 12:17:29.104532 10203 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:29.105645 10701 leader_election.cc:304] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:29.072613 17890 leader_election.cc:290] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:29.109825 10129 raft_consensus.cc:2468] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:29.112900 17816 raft_consensus.cc:2804] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:17:29.132432 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:29.101998 17857 raft_consensus.cc:2749] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:17:29.138684 10201 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:29.138049 17816 raft_consensus.cc:697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:29.147198 10701 leader_election.cc:304] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:29.148376 17763 raft_consensus.cc:2804] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:17:29.148949 17763 raft_consensus.cc:697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:29.158034 17816 consensus_queue.cc:237] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:29.172868 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 56181.1us
I20260709 12:17:29.178181 17858 consensus_queue.cc:1059] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:17:29.186949 10126 raft_consensus.cc:2468] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 18.
I20260709 12:17:29.152608 17763 consensus_queue.cc:237] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.273358 17858 raft_consensus.cc:3055] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:17:29.273972 17858 raft_consensus.cc:740] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:29.274919 17858 consensus_queue.cc:260] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.276026 17858 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:17:29.291020 17913 log.cc:927] Time spent T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:17:29.296940 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 61474us
I20260709 12:17:29.260890  9949 catalog_manager.cc:5697] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.315485 10122 raft_consensus.cc:1240] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Rejecting Update request from peer 7c74f73af6ac4ce394a0ae7a2eefbeae for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:17:29.377957 17846 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.405321 17917 log.cc:927] Time spent T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:17:29.403451 17922 log.cc:927] Time spent T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:29.402724 17928 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.422068 17919 log.cc:927] Time spent T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:29.394644 17846 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.435844 17846 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:29.450975 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
W20260709 12:17:29.467381 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:29.472520 17816 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.473050 17816 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.475061 17816 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:29.478747 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:29.479614 10733 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:17:29.481372 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:29.501014 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:29.501942 10204 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 19.
I20260709 12:17:29.506516 10701 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:29.507604 17865 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:29.508054 17865 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.508383 17865 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:29.428292 17928 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.510597 10123 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 19.
I20260709 12:17:29.514710 17928 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:29.516098 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:29.520047 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:29.525724 17901 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.526340 17901 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:29.528498 17901 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:29.525724 10168 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:29.530413 17894 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:17:29.530826 17894 raft_consensus.cc:493] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.531152 17894 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:29.532239 17865 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.534762 10733 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29bed9eb81541dba9ec7a447986e01e in current term 20: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:29.536238 10204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:29.537436 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:29.542274 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:29.542904 10122 raft_consensus.cc:3060] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:17:29.543483 10094 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:29.546711 17865 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:29.550961 10122 raft_consensus.cc:2468] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 20.
I20260709 12:17:29.551582 17928 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:17:29.564348 10702 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:29.565284 17863 raft_consensus.cc:2804] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:17:29.565840 17863 raft_consensus.cc:697] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:29.566789 10126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:29.567490 10126 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 22.
I20260709 12:17:29.568564 17863 consensus_queue.cc:237] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.541790 17894 raft_consensus.cc:515] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.582453 10204 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 20: Already voted for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in this term.
I20260709 12:17:29.582203 10197 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:29.592057 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:29.594655 17858 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:17:29.595088 17858 raft_consensus.cc:493] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.595427 17858 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:17:29.607062 10169 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:29.609826 17861 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:29.613559 10197 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:17:29.617482 17894 leader_election.cc:290] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:29.617316 17861 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:17:29.618840 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:29.625631 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95fdf558c4914764bc33fc57324bdaf5" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:29.626567 10122 raft_consensus.cc:2393] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in current term 20: Already voted for candidate 4b3390fbbe574de7bf154b5a6cc35677 in this term.
I20260709 12:17:29.626585 17858 raft_consensus.cc:515] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:29.633160 10169 leader_election.cc:304] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:29.633984 17894 raft_consensus.cc:2749] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:17:29.622805 17749 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.645635 17749 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:29.654664 10095 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:29.655323 17858 leader_election.cc:290] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:29.657778 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4fb909f689401989cfc1a22c46c6cd" candidate_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:29.658488 10122 raft_consensus.cc:3060] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:29.659940 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:29.660588 10733 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 25.
I20260709 12:17:29.661830 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:29.662736 17928 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:17:29.663108 17928 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.663446 17928 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:17:29.663130 10169 leader_election.cc:336] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:29.671190 10122 raft_consensus.cc:2468] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c74f73af6ac4ce394a0ae7a2eefbeae in term 23.
I20260709 12:17:29.671775 17749 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:29.672497 10169 leader_election.cc:304] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:29.685660 17856 raft_consensus.cc:2804] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:17:29.686309 17856 raft_consensus.cc:697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Becoming Leader. State: Replica: 7c74f73af6ac4ce394a0ae7a2eefbeae, State: Running, Role: LEADER
I20260709 12:17:29.681259 10122 raft_consensus.cc:1275] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:17:29.687314 17856 consensus_queue.cc:237] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:29.689366 17928 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.695674 17861 consensus_queue.cc:1048] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:17:29.699720  8907 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10076)
I20260709 12:17:29.719128 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad3dc473b284687afcc907cd7aea9ea" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:29.719837 10733 raft_consensus.cc:3060] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:17:29.726416 10126 raft_consensus.cc:1275] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:17:29.727880 17928 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:29.729817 10095 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:29.730413 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:29.732692 10733 raft_consensus.cc:2468] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 26.
I20260709 12:17:29.736296 17862 consensus_queue.cc:1048] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:17:29.737346 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:29.747078  9949 catalog_manager.cc:5697] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.776484  9949 catalog_manager.cc:5697] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 18 to 20, leader changed from a29bed9eb81541dba9ec7a447986e01e (127.8.178.194) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 20 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.797312 10094 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:29.798461 17825 raft_consensus.cc:2804] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:17:29.799013 17825 raft_consensus.cc:697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 26 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:29.800089 17825 consensus_queue.cc:237] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.820396  9953 catalog_manager.cc:5697] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae reported cstate change: term changed from 21 to 23, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195). New cstate: current_term: 23 leader_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:29.869793 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:29.919212 17890 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.919800 17890 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.931989 17890 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:29.930533 17909 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.933243 17909 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:29.935683  9949 catalog_manager.cc:5697] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 24 to 26, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 26 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:29.942977 17909 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:29.947860 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:29.956600 10733 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 23.
W20260709 12:17:29.951154 10095 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:29.955041 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:29.959275 10122 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:29.963546 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:29.971801 17909 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:17:29.972373 17909 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.972803 17909 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:17:29.955840 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:29.976254 10199 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 22.
I20260709 12:17:29.978165 10702 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 
I20260709 12:17:29.985353 17861 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:17:29.985808 17861 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.986158 17861 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:17:29.995527 10702 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:30.005987 17861 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:30.009023 17909 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:30.010161 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
I20260709 12:17:30.012966 17861 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:30.014815 10197 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:30.022182 10197 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:17:30.028692 17909 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 election: Requested vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:30.029701 10702 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:30.032680 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6596abeb975142149ebfb7b9d1b7d100" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677"
I20260709 12:17:30.033300 10733 raft_consensus.cc:3060] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:17:30.039058 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.041282 10197 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:17:30.041863 10095 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:30.043120 17890 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:17:30.049865 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:30.053457 10129 raft_consensus.cc:3060] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:17:30.058712 10733 raft_consensus.cc:2468] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29bed9eb81541dba9ec7a447986e01e in term 24.
I20260709 12:17:30.070307 10094 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:30.071581 17909 raft_consensus.cc:2804] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:17:30.072091 17909 raft_consensus.cc:697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 24 LEADER]: Becoming Leader. State: Replica: a29bed9eb81541dba9ec7a447986e01e, State: Running, Role: LEADER
I20260709 12:17:30.072918 17909 consensus_queue.cc:237] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:30.069044 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.089761 10129 raft_consensus.cc:2468] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 23.
I20260709 12:17:30.094946 10702 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b
I20260709 12:17:30.104285 17861 raft_consensus.cc:2804] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:17:30.104890 17861 raft_consensus.cc:697] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:30.105819 17861 consensus_queue.cc:237] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:30.109373 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.115654 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.156695 10129 raft_consensus.cc:1275] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:17:30.181638 17890 consensus_queue.cc:1048] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:17:30.210505 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.211748  9949 catalog_manager.cc:5697] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e reported cstate change: term changed from 22 to 24, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to a29bed9eb81541dba9ec7a447986e01e (127.8.178.194). New cstate: current_term: 24 leader_uuid: "a29bed9eb81541dba9ec7a447986e01e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:30.222071 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.222388 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.228857 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.229512 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.242825  9949 catalog_manager.cc:5697] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 21 to 23, leader changed from 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 23 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.263402 10122 raft_consensus.cc:1275] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 7c74f73af6ac4ce394a0ae7a2eefbeae: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:17:30.281848 17894 consensus_queue.cc:1048] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:17:30.328413 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.352100 10731 raft_consensus.cc:1275] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:17:30.355023 17909 consensus_queue.cc:1048] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:17:30.394992 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.448908 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:30.457528 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.461150 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.513284 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.529618 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.531764 10731 raft_consensus.cc:1275] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Refusing update from remote peer a29bed9eb81541dba9ec7a447986e01e: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:17:30.533139 17860 consensus_queue.cc:1048] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:17:30.566159 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.572969 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:30.593185 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.642131 10197 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:17:30.644065 17865 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:17:30.653476 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.655295 17861 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:30.659014 17861 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:30.665470 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:30.666150 10199 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:17:30.668025 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 
I20260709 12:17:30.669487 17861 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:30.669620 17865 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:17:30.682704 17865 raft_consensus.cc:493] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:30.683178 17865 raft_consensus.cc:3060] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:17:30.683615 10122 raft_consensus.cc:1275] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:17:30.688647 10122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e" is_pre_election: true
I20260709 12:17:30.690297 10122 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 21: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
I20260709 12:17:30.694826 17861 consensus_queue.cc:1048] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:17:30.700269  8907 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:30.708047 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:30.717412 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.706070 17865 raft_consensus.cc:515] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:30.732215 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae"
W20260709 12:17:30.733830 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:30.739257 10129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f08623f87ec8442c961120bdd44e9b08" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a29bed9eb81541dba9ec7a447986e01e"
I20260709 12:17:30.740002 10129 raft_consensus.cc:2393] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b3390fbbe574de7bf154b5a6cc35677 in current term 21: Already voted for candidate a29bed9eb81541dba9ec7a447986e01e in this term.
W20260709 12:17:30.761018 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:30.763517 10197 raft_consensus.cc:2468] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b3390fbbe574de7bf154b5a6cc35677 in term 21.
I20260709 12:17:30.770978 10701 leader_election.cc:304] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:30.784404 17890 raft_consensus.cc:2804] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:17:30.784967 17890 raft_consensus.cc:697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Becoming Leader. State: Replica: 4b3390fbbe574de7bf154b5a6cc35677, State: Running, Role: LEADER
I20260709 12:17:30.785825 17890 consensus_queue.cc:237] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:30.787770 17865 leader_election.cc:290] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 election: Requested vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:30.796105 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:30.841574 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:30.900501 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:17:30.902994  9953 catalog_manager.cc:5697] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 reported cstate change: term changed from 20 to 21, leader changed from 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195) to 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196). New cstate: current_term: 21 leader_uuid: "4b3390fbbe574de7bf154b5a6cc35677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:30.907153 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.928892 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.939392 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:30.939388 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.016959 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.017490 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.025162 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.034577 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.058379 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:31.188688 10197 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:17:31.190253 17890 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:17:31.216060 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:31.226282 10129 raft_consensus.cc:1275] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Refusing update from remote peer 4b3390fbbe574de7bf154b5a6cc35677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:17:31.230258 17861 consensus_queue.cc:1048] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:17:31.259712 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.380749 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:31.482089 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:31.701418  8907 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:31.926040 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 53190.2us
W20260709 12:17:31.967057 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:32.131610 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 44351.4us
W20260709 12:17:32.156981 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.160466 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.201505 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.371049 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.440925 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:32.566555 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.633970 10095 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111) [suppressed 413 similar messages]
W20260709 12:17:32.637241 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.654203 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.667977 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.682312 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.703032  8907 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:32.703969 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.765484 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.767575 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.809296 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:32.870383 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:32.892241 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.011317 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.035005 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.045544 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.104842 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.128974 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.137912 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.144295 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.173382 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.185632 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.302235 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.340710 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.358006 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.400452 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:33.403855 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.412334 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.421782 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.427640 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.449055 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.594857 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.597741 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.633468 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.642987 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.649444 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.704468  8907 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:33.737708 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.795614 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:33.806342 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:33.852144 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:34.273033 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:34.514667 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:34.632969 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:34.704952  8907 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:34.840488 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:34.937456 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:34.963317 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.074995 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.140252 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.182345 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.204921 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.280794 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.291600 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.342131 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.342746 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.390022 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.425086 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.452801 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.458128 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.466357 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.501395 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.524526 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.532109 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.543795 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.646147 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.698381 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.705430  8907 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:35.715615 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.725989 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:35.816408 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:35.828824 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.839332 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.858361 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.924808 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:35.942468 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.007716 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:36.008359 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.074697 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.107369 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.110662 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.133930 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.206395 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.226303 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:36.277837 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.288070 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:36.296730 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:36.378754 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:36.705932  8907 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:37.049412 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:37.072940 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:37.144186 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.326267 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.357664 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.144019 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 71136.6us
W20260709 12:17:37.560660 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.638588 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:37.639164 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.639760 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.643793 10095 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111) [suppressed 430 similar messages]
W20260709 12:17:37.666074 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.677840 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.706658  8907 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:37.708693 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.729588 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 55084.8us
W20260709 12:17:37.829713 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.842096 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.873726 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.915576 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.931412 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.939917 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:37.970482 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:37.979787 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.080363 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:38.078584 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.174623 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080027ed00 after lost signal to thread 8910
W20260709 12:17:38.176031 10151 debug-util.cc:398] Leaking SignalData structure 0x7b0800164940 after lost signal to thread 9987
W20260709 12:17:38.177444 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0d40 after lost signal to thread 10154
W20260709 12:17:38.179126 10151 debug-util.cc:398] Leaking SignalData structure 0x7b08003282a0 after lost signal to thread 10228
W20260709 12:17:38.180565 10151 debug-util.cc:398] Leaking SignalData structure 0x7b080017c900 after lost signal to thread 10761
W20260709 12:17:38.226981 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.264240 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.319311 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.346997 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.351661 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.398739 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.411460 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.445725 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.468197 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.511231 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.587423 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.595050 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.623063 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.627285 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:38.707168  8907 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:38.781953 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.814043 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.819890 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:38.966401 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:39.171123 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:39.217468 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:39.240593 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:17:39.258771 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:39.285017 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:39.643210 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:39.653232 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:39.687563 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:39.707674  8907 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:39.711851 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.035981 10701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 95499us
W20260709 12:17:40.593871 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 267228us
W20260709 12:17:40.708310  8907 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:40.835749 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:40.838815 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.848204 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.848843 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.849390 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.850219 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:40.850823 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:40.865186 17963 raft_consensus.cc:493] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:40.866192 17963 raft_consensus.cc:515] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } attrs { replace: true } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
W20260709 12:17:40.871657 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.019s	sys 0.028s
W20260709 12:17:40.872126 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.019s	sys 0.028s
W20260709 12:17:40.874075 10095 leader_election.cc:336] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:40.884871 17963 leader_election.cc:290] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:40.926848 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:17:40.927881 10169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.003s	sys 0.015s
W20260709 12:17:40.928265 10169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.015s
W20260709 12:17:40.928534 10169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:34999, user_credentials={real_user=slave}} blocked reactor thread for 644023us
I20260709 12:17:40.949827 10200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e7629206124e6390a9baab062635eb" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
W20260709 12:17:40.957413 10702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:45801, user_credentials={real_user=slave}} blocked reactor thread for 84296.6us
I20260709 12:17:40.977104 17999 raft_consensus.cc:493] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
W20260709 12:17:40.977737 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:33595, user_credentials={real_user=slave}} blocked reactor thread for 79788.4us
I20260709 12:17:40.979460 17963 raft_consensus.cc:493] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:40.980077 17963 raft_consensus.cc:515] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:40.978492 17999 raft_consensus.cc:515] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:40.981961 17963 leader_election.cc:290] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:40.999485 17963 raft_consensus.cc:493] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4b3390fbbe574de7bf154b5a6cc35677)
I20260709 12:17:41.000399 17963 raft_consensus.cc:515] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:41.002243 17963 leader_election.cc:290] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
W20260709 12:17:41.007452 10095 leader_election.cc:336] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:41.013391 17999 leader_election.cc:290] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 4b3390fbbe574de7bf154b5a6cc35677 (127.8.178.196:38867)
I20260709 12:17:41.017266 17991 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
W20260709 12:17:41.018114 10095 leader_election.cc:336] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:41.017961 17991 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:41.051065 17991 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:41.057155 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 71996.6us
I20260709 12:17:41.058277 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03649ca7b822435188aa9ef044bc52b0" candidate_uuid: "4b3390fbbe574de7bf154b5a6cc35677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:41.063827 10094 leader_election.cc:304] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:41.066249 18004 raft_consensus.cc:2749] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:41.080057 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" is_pre_election: true
I20260709 12:17:41.080854 10731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efb9d4efacd143a6bbb65eb25d52093d" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:41.079703 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bc6e523dd94755bf6815dd2f89cd0a" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
W20260709 12:17:41.082624 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:17:41.082738 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aaadb6c64c344b186ed9c3e3630b660" candidate_uuid: "a29bed9eb81541dba9ec7a447986e01e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "4b3390fbbe574de7bf154b5a6cc35677" is_pre_election: true
I20260709 12:17:41.085517 10094 leader_election.cc:304] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 4b3390fbbe574de7bf154b5a6cc35677, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:41.087317 18004 raft_consensus.cc:2749] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:17:41.094528 10094 leader_election.cc:304] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
W20260709 12:17:41.095471 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:17:41.096150 18006 raft_consensus.cc:2749] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:17:41.098244 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.098855 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:41.097079 10094 leader_election.cc:304] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29bed9eb81541dba9ec7a447986e01e; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 4b3390fbbe574de7bf154b5a6cc35677
I20260709 12:17:41.103742 18006 raft_consensus.cc:2749] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:17:41.102903 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.122202 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.129150 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.130863 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.131443 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.136412 10702 leader_election.cc:336] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:41.136955 10702 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:41.137969 17991 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:17:41.275977 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:41.288964 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:41.322697 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:41.362735 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:41.433775 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.475376 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.544714 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.663136 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.709015  8907 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 10076)
W20260709 12:17:41.759012 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.820076 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.894529 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08003e27e0 after lost signal to thread 8910
W20260709 12:17:41.895726 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08003aad00 after lost signal to thread 9987
W20260709 12:17:41.897169 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0960 after lost signal to thread 10154
W20260709 12:17:41.898362 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3600 after lost signal to thread 10228
W20260709 12:17:41.899860 10758 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2000 after lost signal to thread 10761
W20260709 12:17:41.935019 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:41.940235 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:41.949975 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:41.953364 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.000727 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.008075 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.036707 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.059329 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.335351 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.389815 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.390337 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.427172 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:17:42.470126 10095 consensus_peers.cc:597] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.492642 10095 consensus_peers.cc:597] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:42.645330 10169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111) [suppressed 396 similar messages]
W20260709 12:17:42.656841 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.704862 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:42.737668 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:42.805817 10095 consensus_peers.cc:597] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.041184 10095 consensus_peers.cc:597] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.066380 10095 consensus_peers.cc:597] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.093429 10095 consensus_peers.cc:597] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.116880 10095 consensus_peers.cc:597] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.135639 10094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:38867, user_credentials={real_user=slave}} blocked reactor thread for 57945.4us
W20260709 12:17:43.148239 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.176512 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:43.262302 10095 consensus_peers.cc:597] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.285243 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.346035 10095 consensus_peers.cc:597] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.356174 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.357189 10095 consensus_peers.cc:597] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.461439 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.556380 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.622148 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:43.675128 10095 consensus_peers.cc:597] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:43.678061 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:43.723587  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
W20260709 12:17:43.756299 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:43.793023 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.794163 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:43.829386 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:43.841107 10095 consensus_peers.cc:597] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:43.899781  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
W20260709 12:17:43.923447 10702 consensus_peers.cc:597] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:43.932586 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:43.982877 10702 consensus_peers.cc:597] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:43.984145 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:43.984825 10702 consensus_peers.cc:597] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:43.998739 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.039132 10702 consensus_peers.cc:597] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.041240 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:44.042836 10169 consensus_peers.cc:597] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.049777 10702 consensus_peers.cc:597] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.062618 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.063416 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.064067 10169 consensus_peers.cc:597] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.077359 10702 consensus_peers.cc:597] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.101668 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.107067 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.107944 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.111867 10702 consensus_peers.cc:597] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.112833 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.114537 10702 consensus_peers.cc:597] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.117877 10702 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.133538 10702 consensus_peers.cc:597] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.141616  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:44.144513  8907 tablet_replica.cc:333] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.145609  8907 raft_consensus.cc:2243] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:44.146610 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.147442  8907 raft_consensus.cc:2272] T 48f4645742c44585a93863b12f58ba75 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.150803  8907 tablet_replica.cc:333] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.151774  8907 raft_consensus.cc:2243] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.152473  8907 raft_consensus.cc:2272] T 567b4adc73ba4d2ea946e154ebd94129 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.168006  8907 tablet_replica.cc:333] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.168941  8907 raft_consensus.cc:2243] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.169602  8907 raft_consensus.cc:2272] T 59c6c24fd7e14d1b8d5545bce723ad27 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.172591  8907 tablet_replica.cc:333] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.173466  8907 raft_consensus.cc:2243] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.174141  8907 raft_consensus.cc:2272] T 1b4f71cfc2d1484aa7a37c6943e8196f P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.182103  8907 tablet_replica.cc:333] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.183050  8907 raft_consensus.cc:2243] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.183734  8907 raft_consensus.cc:2272] T 98ca581ce0e64e44a04efbd2710adbf8 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.186810  8907 tablet_replica.cc:333] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.187739  8907 raft_consensus.cc:2243] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.188388  8907 raft_consensus.cc:2272] T 63a59e68139a465c858046fab6d14aaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.191416  8907 tablet_replica.cc:333] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.192274  8907 raft_consensus.cc:2243] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.192905  8907 raft_consensus.cc:2272] T c49badfb58494d79890f98353e487b55 P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.195847  8907 tablet_replica.cc:333] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.196714  8907 raft_consensus.cc:2243] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.197337  8907 raft_consensus.cc:2272] T efb9d4efacd143a6bbb65eb25d52093d P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.198712 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.201033  8907 tablet_replica.cc:333] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.201962  8907 raft_consensus.cc:2243] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.202628  8907 raft_consensus.cc:2272] T 12bc6e523dd94755bf6815dd2f89cd0a P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.213431  8907 tablet_replica.cc:333] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.214362  8907 raft_consensus.cc:2243] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.215651  8907 raft_consensus.cc:2272] T bd6ec4c2ee75449d8ab4f971e9de7e77 P a29bed9eb81541dba9ec7a447986e01e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.218644  8907 tablet_replica.cc:333] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.219414  8907 raft_consensus.cc:2243] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.220094  8907 raft_consensus.cc:2272] T add21891a8334a65adf1e2611b794222 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.220522 10702 consensus_peers.cc:597] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.223304 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.225451  8907 tablet_replica.cc:333] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.226333  8907 raft_consensus.cc:2243] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.226965  8907 raft_consensus.cc:2272] T 95fdf558c4914764bc33fc57324bdaf5 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.231063  8907 tablet_replica.cc:333] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.231844  8907 raft_consensus.cc:2243] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.232491  8907 raft_consensus.cc:2272] T 4ff855a4bf854fbd9207ae909021d6bf P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.251791 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.254249  8907 tablet_replica.cc:333] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.255223  8907 raft_consensus.cc:2243] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:17:44.255466 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.256451  8907 raft_consensus.cc:2272] T aedf82824d3c4883ad33ed154a6a08a1 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.256811 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.259336  8907 tablet_replica.cc:333] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.260186  8907 raft_consensus.cc:2243] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.260852  8907 raft_consensus.cc:2272] T eb932976ca8b44ffb6eab1f93c14a4bb P a29bed9eb81541dba9ec7a447986e01e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.282537  8907 tablet_replica.cc:333] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.283488  8907 raft_consensus.cc:2243] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.284310  8907 raft_consensus.cc:2272] T 27f26165888546baaae16d413e9601c5 P a29bed9eb81541dba9ec7a447986e01e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.287140  8907 tablet_replica.cc:333] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.289212  8907 raft_consensus.cc:2243] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.289958  8907 raft_consensus.cc:2272] T f08623f87ec8442c961120bdd44e9b08 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.294589  8907 tablet_replica.cc:333] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.295444  8907 raft_consensus.cc:2243] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.296355  8907 raft_consensus.cc:2272] T e42a5811b7f7484186df2c558a4f6769 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.302389 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.303329 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.304109  8907 tablet_replica.cc:333] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.305025  8907 raft_consensus.cc:2243] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:17:44.305280 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:44.306249  8907 raft_consensus.cc:2272] T 56431c97132141908463e11690f7ba09 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.306722 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.308928 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.312243  8907 tablet_replica.cc:333] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.334753  8907 raft_consensus.cc:2243] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.338128  8907 raft_consensus.cc:2272] T 3687623d905944cb972fbfff21e2d729 P a29bed9eb81541dba9ec7a447986e01e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.340970  8907 tablet_replica.cc:333] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
W20260709 12:17:44.344221 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.347698 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:44.348276  8907 raft_consensus.cc:2243] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.353322  8907 raft_consensus.cc:2272] T 370d155a067d4428a676aa10078366b8 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.356436  8907 tablet_replica.cc:333] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.357323  8907 raft_consensus.cc:2243] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.358283  8907 raft_consensus.cc:2272] T e0075e506a7e41288c8c852a9911174c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.361073  8907 tablet_replica.cc:333] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.361867  8907 raft_consensus.cc:2243] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.363793  8907 raft_consensus.cc:2272] T 5ad3dc473b284687afcc907cd7aea9ea P a29bed9eb81541dba9ec7a447986e01e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.366688  8907 tablet_replica.cc:333] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.367539  8907 raft_consensus.cc:2243] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.368366  8907 raft_consensus.cc:2272] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.373423  8907 tablet_replica.cc:333] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.381598  8907 raft_consensus.cc:2243] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.388828  8907 raft_consensus.cc:2272] T 4aaadb6c64c344b186ed9c3e3630b660 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.402689 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:44.405036 10702 consensus_peers.cc:597] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.422173  8907 tablet_replica.cc:333] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.423141  8907 raft_consensus.cc:2243] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.423933  8907 raft_consensus.cc:2272] T 35b1b33f7d314aa08131a968c515f3c6 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.425653 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:44.433079  8907 tablet_replica.cc:333] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.434144  8907 raft_consensus.cc:2243] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.435492  8907 raft_consensus.cc:2272] T 6596abeb975142149ebfb7b9d1b7d100 P a29bed9eb81541dba9ec7a447986e01e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.438665  8907 tablet_replica.cc:333] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.439486  8907 raft_consensus.cc:2243] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.443708  8907 raft_consensus.cc:2272] T 29ce21faad84430d93ec2445ba64030b P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.446010 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.454828 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:44.469188  8907 tablet_replica.cc:333] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.470212  8907 raft_consensus.cc:2243] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.470942  8907 raft_consensus.cc:2272] T a6031fe457e54869a9b512abf1d54183 P a29bed9eb81541dba9ec7a447986e01e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.476719  8907 tablet_replica.cc:333] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.479244  8907 raft_consensus.cc:2243] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.480607  8907 raft_consensus.cc:2272] T a0518529c52b4f2ca715288c1fcccbaa P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.485270  8907 tablet_replica.cc:333] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.486099  8907 raft_consensus.cc:2243] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.486963  8907 raft_consensus.cc:2272] T 01ee41f44fe24909bc0f087cbbc6213e P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.493016  8907 tablet_replica.cc:333] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.494171  8907 raft_consensus.cc:2243] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:44.496357 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.496400  8907 raft_consensus.cc:2272] T 6d0b2763b8154a7392dcbe6c6acfec0c P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.522864  8907 tablet_replica.cc:333] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.527617  8907 raft_consensus.cc:2243] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.528918  8907 raft_consensus.cc:2272] T 4e741e9b5dcb4305b7be8692e35b1441 P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.532217  8907 tablet_replica.cc:333] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.538398  8907 raft_consensus.cc:2243] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.540705  8907 raft_consensus.cc:2272] T 7c0e50f262594b84bcbdf34c6b162436 P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.550896  8907 tablet_replica.cc:333] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.552065  8907 raft_consensus.cc:2243] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.558593  8907 raft_consensus.cc:2272] T 7ed6facad3f04ffd8eb02fda673b5455 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.561431  8907 tablet_replica.cc:333] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.562252  8907 raft_consensus.cc:2243] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.563402  8907 raft_consensus.cc:2272] T f0eadcb623c84a7daa48999c60decbe2 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.567399 10169 consensus_peers.cc:597] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:44.572952  8907 tablet_replica.cc:333] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
W20260709 12:17:44.577687 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:44.575035  8907 raft_consensus.cc:2243] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.581705  8907 raft_consensus.cc:2272] T 2e133f56c04b492fbfac52f65ed6fe2b P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.588387  8907 tablet_replica.cc:333] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.590987  8907 raft_consensus.cc:2243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.591955  8907 raft_consensus.cc:2272] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P a29bed9eb81541dba9ec7a447986e01e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.600265 10169 consensus_peers.cc:597] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:17:44.604305  8907 tablet_replica.cc:333] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.605161  8907 raft_consensus.cc:2243] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:44.612818  8907 raft_consensus.cc:2272] T 64c7a23860d1449c94c3bf85f8dee617 P a29bed9eb81541dba9ec7a447986e01e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.621076  8907 tablet_replica.cc:333] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.624516  8907 raft_consensus.cc:2243] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.625330  8907 raft_consensus.cc:2272] T ea142dcb28a347418ddf5a7c14fc8885 P a29bed9eb81541dba9ec7a447986e01e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.631564  8907 tablet_replica.cc:333] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.633991  8907 raft_consensus.cc:2243] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:44.634883 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:44.635927  8907 raft_consensus.cc:2272] T 5cb0ac432438495091e62290dd19b812 P a29bed9eb81541dba9ec7a447986e01e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.647442  8907 tablet_replica.cc:333] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.648224  8907 raft_consensus.cc:2243] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.673902  8907 raft_consensus.cc:2272] T eb4fb909f689401989cfc1a22c46c6cd P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.692991  8907 tablet_replica.cc:333] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.695004  8907 raft_consensus.cc:2243] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.701401  8907 raft_consensus.cc:2272] T 03425333a9b0484fbf7c273e6499e2cf P a29bed9eb81541dba9ec7a447986e01e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:44.704886  8907 tablet_replica.cc:333] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e: stopping tablet replica
I20260709 12:17:44.715889  8907 raft_consensus.cc:2243] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:44.718779  8907 raft_consensus.cc:2272] T 76e7629206124e6390a9baab062635eb P a29bed9eb81541dba9ec7a447986e01e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:44.847769 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:44.919533 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:44.995608 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.052500 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:45.299101 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:17:45.302484 10169 consensus_peers.cc:597] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:45.351550 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:45.539556 18018 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.540108 18018 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.542695 18018 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.550788 10169 consensus_peers.cc:597] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:45.554134 18014 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.554847 18014 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.557044 18014 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.579283 10702 leader_election.cc:336] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.597885 18010 raft_consensus.cc:493] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.598542 18010 raft_consensus.cc:515] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:45.601456 18010 leader_election.cc:290] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:45.603334 18014 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.603940 18014 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.606071 18014 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.611735 10169 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:45.612639 10169 leader_election.cc:336] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.613211 10169 leader_election.cc:304] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.614487 18010 raft_consensus.cc:2749] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:17:45.618700 10702 leader_election.cc:336] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.619256 10702 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.620065 18014 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:17:45.621136 10702 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:45.626812 10702 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.627341 10702 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.628124 18014 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:45.634632 10702 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
W20260709 12:17:45.636261 10702 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.636750 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.637507 18014 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:17:45.650511 10702 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:17:45.709672 18014 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.710227 18014 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.714767 18014 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:45.728004 18010 raft_consensus.cc:493] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.728832 18010 raft_consensus.cc:515] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:45.740291 18010 leader_election.cc:290] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.742640 10169 consensus_peers.cc:597] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:45.768846 10169 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.770455 18014 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.777446 18014 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.779613 18014 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.782382 10169 leader_election.cc:336] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.782948 10169 leader_election.cc:304] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.785884 18010 raft_consensus.cc:2749] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:17:45.791478 10702 leader_election.cc:336] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.791556 18014 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:17:45.792703 10702 leader_election.cc:336] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.792397 18014 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.793162 10702 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.794615 18018 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:45.800446 18010 raft_consensus.cc:493] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.801142 18010 raft_consensus.cc:515] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } }
I20260709 12:17:45.803364 18010 leader_election.cc:290] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.808936 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:45.810128 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.809785 18014 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:45.810695 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.811648 18015 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:45.826891 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:45.833012 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.835284 10702 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.836099 18018 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:17:45.844604 10169 leader_election.cc:336] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
W20260709 12:17:45.847430 10169 leader_election.cc:336] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.848174 10169 leader_election.cc:304] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.848943 18010 raft_consensus.cc:2749] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:17:45.898962 18014 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.899565 18014 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.901855 18014 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:45.913911 18010 raft_consensus.cc:493] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.914652 18010 raft_consensus.cc:515] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } }
I20260709 12:17:45.916953 18010 leader_election.cc:290] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.933722 10169 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:45.938498 10169 leader_election.cc:336] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:45.945426 10169 leader_election.cc:304] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c74f73af6ac4ce394a0ae7a2eefbeae; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.947573 18010 raft_consensus.cc:2749] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:45.954727 18014 raft_consensus.cc:493] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:45.955940 18014 raft_consensus.cc:515] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:45.958917 18014 leader_election.cc:290] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:45.975912 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
W20260709 12:17:45.991456 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:45.991989 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:45.992697 18014 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:17:45.998155 10702 leader_election.cc:336] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
W20260709 12:17:45.999704 10702 leader_election.cc:336] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:46.000102 10702 leader_election.cc:304] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:46.000774 18014 raft_consensus.cc:2749] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:17:46.020143 10169 consensus_peers.cc:597] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.058158 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.068216 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.089018 10169 consensus_peers.cc:597] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.089498 10702 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:46.112788 10702 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:46.223624 10169 consensus_peers.cc:597] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.237176 10702 consensus_peers.cc:597] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.253693 10169 consensus_peers.cc:597] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:46.301066 10169 consensus_peers.cc:597] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:46.328125 10169 consensus_peers.cc:597] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.345817 10702 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.355875 10169 consensus_peers.cc:597] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.372720 10225 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8d80 after lost signal to thread 8910
W20260709 12:17:46.373922 10225 debug-util.cc:398] Leaking SignalData structure 0x7b0800345ce0 after lost signal to thread 9987
W20260709 12:17:46.375262 10225 debug-util.cc:398] Leaking SignalData structure 0x7b080017e400 after lost signal to thread 10228
W20260709 12:17:46.376417 10225 debug-util.cc:398] Leaking SignalData structure 0x7b080036caa0 after lost signal to thread 10761
W20260709 12:17:46.416674 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.450229 10169 consensus_peers.cc:597] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.459568 10702 consensus_peers.cc:597] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.503412 10702 consensus_peers.cc:597] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.519392 10702 consensus_peers.cc:597] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.544221 10702 consensus_peers.cc:597] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.548257 10169 consensus_peers.cc:597] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.555290  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
W20260709 12:17:46.573720 10169 consensus_peers.cc:597] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.581915 10702 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.584661 10702 consensus_peers.cc:597] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.614778 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.663205 10702 consensus_peers.cc:597] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.678270 10702 consensus_peers.cc:597] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.682071 10702 consensus_peers.cc:597] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.688426  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
W20260709 12:17:46.690894 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.698025 10701 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.709631 10702 consensus_peers.cc:597] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.710259 10702 consensus_peers.cc:597] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.725184 10701 consensus_peers.cc:597] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.735409 10701 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.737457 10169 consensus_peers.cc:597] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:46.740466 10702 consensus_peers.cc:597] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.749768 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.751497 10169 consensus_peers.cc:597] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:46.764201 10701 consensus_peers.cc:597] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.781059  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:46.782169  8907 tablet_replica.cc:333] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.783105  8907 raft_consensus.cc:2243] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.784247  8907 raft_consensus.cc:2272] T 59c6c24fd7e14d1b8d5545bce723ad27 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.786370  8907 tablet_replica.cc:333] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.787117  8907 raft_consensus.cc:2243] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.787973  8907 raft_consensus.cc:2272] T 48f4645742c44585a93863b12f58ba75 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.790005  8907 tablet_replica.cc:333] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.790586  8907 raft_consensus.cc:2243] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.791451  8907 raft_consensus.cc:2272] T 98ca581ce0e64e44a04efbd2710adbf8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.793812  8907 tablet_replica.cc:333] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.794340  8907 raft_consensus.cc:2243] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.795326  8907 raft_consensus.cc:2272] T 9c14882e1876454ba455dbe6212f6ab6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.800019  8907 tablet_replica.cc:333] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
W20260709 12:17:46.800377 10701 consensus_peers.cc:597] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.800876  8907 raft_consensus.cc:2243] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.801504  8907 raft_consensus.cc:2272] T 63a59e68139a465c858046fab6d14aaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.803586  8907 tablet_replica.cc:333] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.804303  8907 raft_consensus.cc:2243] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.804833  8907 raft_consensus.cc:2272] T 12bc6e523dd94755bf6815dd2f89cd0a P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.808013  8907 tablet_replica.cc:333] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.808775  8907 raft_consensus.cc:2243] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:17:46.809456 10701 consensus_peers.cc:597] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.809837  8907 raft_consensus.cc:2272] T add21891a8334a65adf1e2611b794222 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.813522 10701 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.815973  8907 tablet_replica.cc:333] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.816808  8907 raft_consensus.cc:2243] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.817538  8907 raft_consensus.cc:2272] T 95fdf558c4914764bc33fc57324bdaf5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.819429  8907 tablet_replica.cc:333] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.819947  8907 raft_consensus.cc:2243] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.820451  8907 raft_consensus.cc:2272] T 4ff855a4bf854fbd9207ae909021d6bf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.822358  8907 tablet_replica.cc:333] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.823004  8907 raft_consensus.cc:2243] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.823530  8907 raft_consensus.cc:2272] T f85bc37908cc412eb5ffe5d0318140ee P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.825642  8907 tablet_replica.cc:333] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.827207  8907 raft_consensus.cc:2243] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.827829  8907 raft_consensus.cc:2272] T acc41bbfb3c94637814837eb2cfad80f P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.830678  8907 tablet_replica.cc:333] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.832269  8907 raft_consensus.cc:2243] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.832886  8907 raft_consensus.cc:2272] T 370d155a067d4428a676aa10078366b8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.835489  8907 tablet_replica.cc:333] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.836345  8907 raft_consensus.cc:2243] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.837096  8907 raft_consensus.cc:2272] T 5cb0ac432438495091e62290dd19b812 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.839176  8907 tablet_replica.cc:333] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.839699  8907 raft_consensus.cc:2243] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.841347  8907 raft_consensus.cc:2272] T 47e2925796cf4be4ab9f040c07bf6dd8 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.844030  8907 tablet_replica.cc:333] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.844794  8907 raft_consensus.cc:2243] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.845881  8907 raft_consensus.cc:2272] T eb932976ca8b44ffb6eab1f93c14a4bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.846439 10169 consensus_peers.cc:597] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.848529  8907 tablet_replica.cc:333] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.849669  8907 raft_consensus.cc:2243] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.850908  8907 raft_consensus.cc:2272] T 27f26165888546baaae16d413e9601c5 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.853083  8907 tablet_replica.cc:333] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.853636  8907 raft_consensus.cc:2243] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.854125  8907 raft_consensus.cc:2272] T f08623f87ec8442c961120bdd44e9b08 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.856153  8907 tablet_replica.cc:333] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.856698  8907 raft_consensus.cc:2243] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.857564  8907 raft_consensus.cc:2272] T e42a5811b7f7484186df2c558a4f6769 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.860062  8907 tablet_replica.cc:333] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.860893  8907 raft_consensus.cc:2243] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.861588  8907 raft_consensus.cc:2272] T 56431c97132141908463e11690f7ba09 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.864076  8907 tablet_replica.cc:333] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.864789  8907 raft_consensus.cc:2243] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.865696  8907 raft_consensus.cc:2272] T 03eb59a6c9c6418299ed25e8330b2cef P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.865783 10169 consensus_peers.cc:597] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:46.868793  8907 tablet_replica.cc:333] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.869629  8907 raft_consensus.cc:2243] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.870901  8907 raft_consensus.cc:2272] T 35b1b33f7d314aa08131a968c515f3c6 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.874302  8907 tablet_replica.cc:333] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.875581  8907 raft_consensus.cc:2243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.877444  8907 raft_consensus.cc:2272] T 6d0b2763b8154a7392dcbe6c6acfec0c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.880131  8907 tablet_replica.cc:333] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.880682  8907 raft_consensus.cc:2243] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.881165  8907 raft_consensus.cc:2272] T 3496631dbf3b49519fbc5604f6834f3e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.883188  8907 tablet_replica.cc:333] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.883709  8907 raft_consensus.cc:2243] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.884582  8907 raft_consensus.cc:2272] T bc69f8e7f4804e73bc970c103ca90e60 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.887040  8907 tablet_replica.cc:333] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.887790  8907 raft_consensus.cc:2243] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.888615  8907 raft_consensus.cc:2272] T a0518529c52b4f2ca715288c1fcccbaa P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.891270  8907 tablet_replica.cc:333] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.892012  8907 raft_consensus.cc:2243] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.893118  8907 raft_consensus.cc:2272] T 03649ca7b822435188aa9ef044bc52b0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.895818  8907 tablet_replica.cc:333] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.896654  8907 raft_consensus.cc:2243] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.897356  8907 raft_consensus.cc:2272] T 4e741e9b5dcb4305b7be8692e35b1441 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.898658 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:46.899788  8907 tablet_replica.cc:333] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.900446  8907 raft_consensus.cc:2243] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.901005  8907 raft_consensus.cc:2272] T 51714cf4d10d45a685fc2c669f03df9c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.903036  8907 tablet_replica.cc:333] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.903697  8907 raft_consensus.cc:2243] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.904686  8907 raft_consensus.cc:2272] T 7c0e50f262594b84bcbdf34c6b162436 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.907116  8907 tablet_replica.cc:333] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.907830  8907 raft_consensus.cc:2243] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.908564  8907 raft_consensus.cc:2272] T 7ed6facad3f04ffd8eb02fda673b5455 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.911578  8907 tablet_replica.cc:333] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
W20260709 12:17:46.908494 10701 consensus_peers.cc:597] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.912340  8907 raft_consensus.cc:2243] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.912974  8907 raft_consensus.cc:2272] T 89ebc329a9274f3595e703104efa64c0 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.915498  8907 tablet_replica.cc:333] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.916206  8907 raft_consensus.cc:2243] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.917201  8907 raft_consensus.cc:2272] T ea142dcb28a347418ddf5a7c14fc8885 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.919785  8907 tablet_replica.cc:333] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.920506  8907 raft_consensus.cc:2243] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.921507  8907 raft_consensus.cc:2272] T 505b084a723d46f28d06230c6bb0c5bb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.923036 10701 consensus_peers.cc:597] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.923930  8907 tablet_replica.cc:333] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.924743  8907 raft_consensus.cc:2243] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.925829  8907 raft_consensus.cc:2272] T 01ee41f44fe24909bc0f087cbbc6213e P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.927074 10701 consensus_peers.cc:597] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.928450  8907 tablet_replica.cc:333] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.929221  8907 raft_consensus.cc:2243] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.929912  8907 raft_consensus.cc:2272] T 77943463ebc54e5183b2d6477b6de047 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.932559  8907 tablet_replica.cc:333] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.933282  8907 raft_consensus.cc:2243] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.934031  8907 raft_consensus.cc:2272] T 2e133f56c04b492fbfac52f65ed6fe2b P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.937773  8907 tablet_replica.cc:333] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.938632  8907 raft_consensus.cc:2243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.939230  8907 raft_consensus.cc:2272] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.939270 10702 consensus_peers.cc:597] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:46.941803  8907 tablet_replica.cc:333] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.942494  8907 raft_consensus.cc:2243] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.943195  8907 raft_consensus.cc:2272] T e0075e506a7e41288c8c852a9911174c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.945176  8907 tablet_replica.cc:333] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.945688  8907 raft_consensus.cc:2243] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.946561  8907 raft_consensus.cc:2272] T 03425333a9b0484fbf7c273e6499e2cf P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.949071  8907 tablet_replica.cc:333] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.949745  8907 raft_consensus.cc:2243] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.950472  8907 raft_consensus.cc:2272] T a7109c20f60c433bbfea17052252d2e4 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.952456 10701 consensus_peers.cc:597] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:46.953099  8907 tablet_replica.cc:333] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.953794  8907 raft_consensus.cc:2243] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.954329  8907 raft_consensus.cc:2272] T 76e7629206124e6390a9baab062635eb P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.957062  8907 tablet_replica.cc:333] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.957717  8907 raft_consensus.cc:2243] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.958385  8907 raft_consensus.cc:2272] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.960928  8907 tablet_replica.cc:333] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.961557  8907 raft_consensus.cc:2243] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.962714  8907 raft_consensus.cc:2272] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.965219  8907 tablet_replica.cc:333] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.965859  8907 raft_consensus.cc:2243] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.966594  8907 raft_consensus.cc:2272] T 6b7d9d50250941bf80c7399e949d802c P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.969045  8907 tablet_replica.cc:333] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae: stopping tablet replica
I20260709 12:17:46.969633  8907 raft_consensus.cc:2243] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:46.970924  8907 raft_consensus.cc:2272] T eb4fb909f689401989cfc1a22c46c6cd P 7c74f73af6ac4ce394a0ae7a2eefbeae [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:46.970343 10701 consensus_peers.cc:597] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.981227 10701 consensus_peers.cc:597] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.987669 10701 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:46.991384 10702 consensus_peers.cc:597] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.002497 10701 consensus_peers.cc:597] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.013435 10701 consensus_peers.cc:597] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.024116 10701 consensus_peers.cc:597] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.041570 10701 consensus_peers.cc:597] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.060847 10701 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.138759 10702 consensus_peers.cc:597] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.147521 10702 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:17:47.154814 10702 consensus_peers.cc:597] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:17:47.160229 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Couldn't send request to peer a29bed9eb81541dba9ec7a447986e01e. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:47.166464 10702 consensus_peers.cc:597] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:47.167639 10701 consensus_peers.cc:597] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.210907 10701 consensus_peers.cc:597] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:47.259564 10701 consensus_peers.cc:597] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Couldn't send request to peer 7c74f73af6ac4ce394a0ae7a2eefbeae. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:47.401165 18018 raft_consensus.cc:493] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.401697 18018 raft_consensus.cc:515] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.404865 18018 leader_election.cc:290] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.415808 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
W20260709 12:17:47.416535 10702 leader_election.cc:336] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:47.416913 10702 leader_election.cc:304] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
W20260709 12:17:47.417779 10702 consensus_peers.cc:597] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:47.417657 18018 raft_consensus.cc:2749] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:17:47.495343 10702 consensus_peers.cc:597] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:47.648139 10701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111) [suppressed 627 similar messages]
W20260709 12:17:47.691231 10702 consensus_peers.cc:597] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:47.709040 18031 raft_consensus.cc:493] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.709710 18031 raft_consensus.cc:515] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.712126 18031 leader_election.cc:290] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.717306 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:47.719285 10702 leader_election.cc:336] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.719707 10702 leader_election.cc:304] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.720443 18031 raft_consensus.cc:2749] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:17:47.720932 18018 raft_consensus.cc:493] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.721553 18018 raft_consensus.cc:515] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.723585 18018 leader_election.cc:290] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.729384 10702 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:47.731621 10702 leader_election.cc:336] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.732062 10702 leader_election.cc:304] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.732812 18018 raft_consensus.cc:2749] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:17:47.748906 10702 consensus_peers.cc:597] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:17:47.770200 18018 raft_consensus.cc:493] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.770685 18018 raft_consensus.cc:515] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.773533 18018 leader_election.cc:290] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.774045 10702 consensus_peers.cc:597] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 -> Peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Couldn't send request to peer 1c0050fa6eee4a0183cbe41a3f72c62b. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:17:47.782974 10702 leader_election.cc:336] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:47.785694 18014 raft_consensus.cc:493] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
W20260709 12:17:47.786346 10702 leader_election.cc:336] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.786276 18014 raft_consensus.cc:515] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.786856 10702 leader_election.cc:304] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.787914 18018 raft_consensus.cc:2749] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:47.788975 18014 leader_election.cc:290] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
I20260709 12:17:47.796278  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
W20260709 12:17:47.808621 10702 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:47.811048 10702 leader_election.cc:336] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.811496 10702 leader_election.cc:304] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.812822 18031 raft_consensus.cc:2749] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:47.865063 18031 raft_consensus.cc:493] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.865808 18031 raft_consensus.cc:515] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.868188 18031 leader_election.cc:290] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.874356 10702 leader_election.cc:336] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:47.875335 10702 leader_election.cc:336] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.875758 10702 leader_election.cc:304] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.876508 18031 raft_consensus.cc:2749] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:17:47.909889 18033 raft_consensus.cc:493] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a29bed9eb81541dba9ec7a447986e01e)
I20260709 12:17:47.910589 18033 raft_consensus.cc:515] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.913103 18033 leader_election.cc:290] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999)
W20260709 12:17:47.918649 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
W20260709 12:17:47.919485 10702 leader_election.cc:336] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:47.919880 10702 leader_election.cc:304] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:47.920883 18033 raft_consensus.cc:2749] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:17:47.926997  8907 tablet_server.cc:179] TabletServer@127.8.178.196:0 shutting down...
I20260709 12:17:47.936471 18031 raft_consensus.cc:493] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:47.937042 18031 raft_consensus.cc:515] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:47.939441 18031 leader_election.cc:290] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
W20260709 12:17:47.944414 10701 leader_election.cc:336] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111)
W20260709 12:17:47.945576 10702 leader_election.cc:336] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:47.945911 10702 leader_election.cc:304] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:47.946517 18031 raft_consensus.cc:2749] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:17:47.979738  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:47.981026  8907 tablet_replica.cc:333] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:47.982036  8907 raft_consensus.cc:2243] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.982961  8907 raft_consensus.cc:2272] T 3687623d905944cb972fbfff21e2d729 P 4b3390fbbe574de7bf154b5a6cc35677 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.986285  8907 tablet_replica.cc:333] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:47.987146  8907 raft_consensus.cc:2243] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.988082  8907 raft_consensus.cc:2272] T 48f4645742c44585a93863b12f58ba75 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.991456  8907 tablet_replica.cc:333] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:47.992543  8907 raft_consensus.cc:2243] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:47.994092  8907 raft_consensus.cc:2272] T 77943463ebc54e5183b2d6477b6de047 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.997303  8907 tablet_replica.cc:333] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:47.998128  8907 raft_consensus.cc:2243] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.999013  8907 raft_consensus.cc:2272] T 5ad3dc473b284687afcc907cd7aea9ea P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.002115  8907 tablet_replica.cc:333] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.002990  8907 raft_consensus.cc:2243] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.003544  8907 raft_consensus.cc:2272] T 8783323a2d554a0ca5fb7d1c9cf54ac1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.006529  8907 tablet_replica.cc:333] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.007367  8907 raft_consensus.cc:2243] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.008119  8907 raft_consensus.cc:2272] T bd6ec4c2ee75449d8ab4f971e9de7e77 P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.011083  8907 tablet_replica.cc:333] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.011848  8907 raft_consensus.cc:2243] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.013221  8907 raft_consensus.cc:2272] T 76e7629206124e6390a9baab062635eb P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.016086  8907 tablet_replica.cc:333] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.016844  8907 raft_consensus.cc:2243] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.017918  8907 raft_consensus.cc:2272] T e0075e506a7e41288c8c852a9911174c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.020793  8907 tablet_replica.cc:333] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.021596  8907 raft_consensus.cc:2243] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.022753  8907 raft_consensus.cc:2272] T a7109c20f60c433bbfea17052252d2e4 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.025609  8907 tablet_replica.cc:333] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.026508  8907 raft_consensus.cc:2243] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.027034 18031 raft_consensus.cc:493] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:48.027572  8907 raft_consensus.cc:2272] T 95fdf558c4914764bc33fc57324bdaf5 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.027490 18031 raft_consensus.cc:515] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:48.028257 18033 raft_consensus.cc:493] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:48.028754 18033 raft_consensus.cc:515] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a29bed9eb81541dba9ec7a447986e01e" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34999 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:48.029788 18031 leader_election.cc:290] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:48.030706 18033 leader_election.cc:290] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:48.030797  8907 tablet_replica.cc:333] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.031695  8907 raft_consensus.cc:2243] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.032837  8907 raft_consensus.cc:2272] T 370d155a067d4428a676aa10078366b8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.035643  8907 tablet_replica.cc:333] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
W20260709 12:17:48.035836 10702 leader_election.cc:336] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:48.036465  8907 raft_consensus.cc:2243] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.037101  8907 raft_consensus.cc:2272] T 29ce21faad84430d93ec2445ba64030b P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.037714 10702 leader_election.cc:336] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a29bed9eb81541dba9ec7a447986e01e (127.8.178.194:34999): Network error: Client connection negotiation failed: client connection to 127.8.178.194:34999: connect: Connection refused (error 111)
I20260709 12:17:48.039835  8907 tablet_replica.cc:333] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
W20260709 12:17:48.040525 10701 leader_election.cc:336] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111)
I20260709 12:17:48.040632  8907 raft_consensus.cc:2243] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.040907 10701 leader_election.cc:304] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:48.041574 18033 raft_consensus.cc:2749] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:17:48.041772 10701 leader_election.cc:336] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111)
I20260709 12:17:48.041787  8907 raft_consensus.cc:2272] T efb9d4efacd143a6bbb65eb25d52093d P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.042264 10701 leader_election.cc:304] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 7c74f73af6ac4ce394a0ae7a2eefbeae, a29bed9eb81541dba9ec7a447986e01e
I20260709 12:17:48.042975 18033 raft_consensus.cc:2749] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:17:48.044821  8907 tablet_replica.cc:333] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.045680  8907 raft_consensus.cc:2243] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.046357  8907 raft_consensus.cc:2272] T 03649ca7b822435188aa9ef044bc52b0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.049150  8907 tablet_replica.cc:333] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.049873  8907 raft_consensus.cc:2243] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.050915  8907 raft_consensus.cc:2272] T f85bc37908cc412eb5ffe5d0318140ee P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.053347  8907 tablet_replica.cc:333] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.054121  8907 raft_consensus.cc:2243] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.054925  8907 raft_consensus.cc:2272] T bc69f8e7f4804e73bc970c103ca90e60 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.058287  8907 tablet_replica.cc:333] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.059249  8907 raft_consensus.cc:2243] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.060303  8907 raft_consensus.cc:2272] T 567b4adc73ba4d2ea946e154ebd94129 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.062935  8907 tablet_replica.cc:333] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.063710  8907 raft_consensus.cc:2243] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.064428 18033 raft_consensus.cc:493] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:48.064812  8907 raft_consensus.cc:2272] T 89ebc329a9274f3595e703104efa64c0 P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.064963 18033 raft_consensus.cc:515] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:48.067497 18033 leader_election.cc:290] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:48.067617  8907 tablet_replica.cc:333] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.068638  8907 raft_consensus.cc:2243] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.069656  8907 raft_consensus.cc:2272] T 1b4f71cfc2d1484aa7a37c6943e8196f P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.073367  8907 tablet_replica.cc:333] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.074087  8907 raft_consensus.cc:2243] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:48.074172 10702 leader_election.cc:336] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:48.074802  8907 raft_consensus.cc:2272] T f0eadcb623c84a7daa48999c60decbe2 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.077639  8907 tablet_replica.cc:333] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.078385  8907 raft_consensus.cc:2243] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.079370  8907 raft_consensus.cc:2272] T 52fc66fb7de4405ba4a4ef0ea5ca5ba1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.080093 10701 leader_election.cc:336] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111)
I20260709 12:17:48.080624 10701 leader_election.cc:304] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
I20260709 12:17:48.080777 18033 raft_consensus.cc:493] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7c74f73af6ac4ce394a0ae7a2eefbeae)
I20260709 12:17:48.081437 18031 raft_consensus.cc:2749] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:17:48.081348 18033 raft_consensus.cc:515] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1c0050fa6eee4a0183cbe41a3f72c62b" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 45801 } } peers { permanent_uuid: "7c74f73af6ac4ce394a0ae7a2eefbeae" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 33595 } } peers { permanent_uuid: "4b3390fbbe574de7bf154b5a6cc35677" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 38867 } attrs { promote: false } }
I20260709 12:17:48.082142  8907 tablet_replica.cc:333] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.083007  8907 raft_consensus.cc:2243] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.083478 18033 leader_election.cc:290] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801), 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595)
I20260709 12:17:48.084136  8907 raft_consensus.cc:2272] T 4aaadb6c64c344b186ed9c3e3630b660 P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.087096  8907 tablet_replica.cc:333] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.087896  8907 raft_consensus.cc:2243] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:48.088114 10702 leader_election.cc:336] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1c0050fa6eee4a0183cbe41a3f72c62b (127.8.178.193:45801): Network error: Client connection negotiation failed: client connection to 127.8.178.193:45801: connect: Connection refused (error 111)
I20260709 12:17:48.088730  8907 raft_consensus.cc:2272] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:48.088939 10701 leader_election.cc:336] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7c74f73af6ac4ce394a0ae7a2eefbeae (127.8.178.195:33595): Network error: Client connection negotiation failed: client connection to 127.8.178.195:33595: connect: Connection refused (error 111)
I20260709 12:17:48.089358 10701 leader_election.cc:304] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b3390fbbe574de7bf154b5a6cc35677; no voters: 1c0050fa6eee4a0183cbe41a3f72c62b, 7c74f73af6ac4ce394a0ae7a2eefbeae
W20260709 12:17:48.089942 10701 raft_consensus.cc:2686] T 47e2925796cf4be4ab9f040c07bf6dd8 P 4b3390fbbe574de7bf154b5a6cc35677: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:17:48.091881  8907 tablet_replica.cc:333] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.092504  8907 raft_consensus.cc:2243] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.093374  8907 raft_consensus.cc:2272] T f08623f87ec8442c961120bdd44e9b08 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.095767  8907 tablet_replica.cc:333] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.096392  8907 raft_consensus.cc:2243] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.097322  8907 raft_consensus.cc:2272] T 12bc6e523dd94755bf6815dd2f89cd0a P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.099646  8907 tablet_replica.cc:333] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.100183  8907 raft_consensus.cc:2243] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.101071  8907 raft_consensus.cc:2272] T 51714cf4d10d45a685fc2c669f03df9c P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.103215  8907 tablet_replica.cc:333] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.103740  8907 raft_consensus.cc:2243] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.104524  8907 raft_consensus.cc:2272] T 5cb0ac432438495091e62290dd19b812 P 4b3390fbbe574de7bf154b5a6cc35677 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.106583  8907 tablet_replica.cc:333] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.107122  8907 raft_consensus.cc:2243] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.107601  8907 raft_consensus.cc:2272] T 01ee41f44fe24909bc0f087cbbc6213e P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.110083  8907 tablet_replica.cc:333] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.110659  8907 raft_consensus.cc:2243] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.111469  8907 raft_consensus.cc:2272] T 2e133f56c04b492fbfac52f65ed6fe2b P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.113729  8907 tablet_replica.cc:333] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.114276  8907 raft_consensus.cc:2243] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.115181  8907 raft_consensus.cc:2272] T 4ff855a4bf854fbd9207ae909021d6bf P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.117626  8907 tablet_replica.cc:333] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.118251  8907 raft_consensus.cc:2243] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.119064  8907 raft_consensus.cc:2272] T 6d0b2763b8154a7392dcbe6c6acfec0c P 4b3390fbbe574de7bf154b5a6cc35677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.121155  8907 tablet_replica.cc:333] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.121686  8907 raft_consensus.cc:2243] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.122212  8907 raft_consensus.cc:2272] T 505b084a723d46f28d06230c6bb0c5bb P 4b3390fbbe574de7bf154b5a6cc35677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.124361  8907 tablet_replica.cc:333] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.124929  8907 raft_consensus.cc:2243] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.125864  8907 raft_consensus.cc:2272] T 3496631dbf3b49519fbc5604f6834f3e P 4b3390fbbe574de7bf154b5a6cc35677 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.128187  8907 tablet_replica.cc:333] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.128751  8907 raft_consensus.cc:2243] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.129359  8907 raft_consensus.cc:2272] T 64c7a23860d1449c94c3bf85f8dee617 P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.131681  8907 tablet_replica.cc:333] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.132261  8907 raft_consensus.cc:2243] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.132740  8907 raft_consensus.cc:2272] T 9c14882e1876454ba455dbe6212f6ab6 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.134956  8907 tablet_replica.cc:333] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.135541  8907 raft_consensus.cc:2243] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.136030  8907 raft_consensus.cc:2272] T 6596abeb975142149ebfb7b9d1b7d100 P 4b3390fbbe574de7bf154b5a6cc35677 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.138222  8907 tablet_replica.cc:333] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.138813  8907 raft_consensus.cc:2243] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.139691  8907 raft_consensus.cc:2272] T 03eb59a6c9c6418299ed25e8330b2cef P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.141883  8907 tablet_replica.cc:333] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.142381  8907 raft_consensus.cc:2243] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.143260  8907 raft_consensus.cc:2272] T c49badfb58494d79890f98353e487b55 P 4b3390fbbe574de7bf154b5a6cc35677 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.145191  8907 tablet_replica.cc:333] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.145675  8907 raft_consensus.cc:2243] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.146534  8907 raft_consensus.cc:2272] T 60ade9b09dbd4c1e8ef7fb9e1f22c472 P 4b3390fbbe574de7bf154b5a6cc35677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.148882  8907 tablet_replica.cc:333] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.149631  8907 raft_consensus.cc:2243] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.150732  8907 raft_consensus.cc:2272] T a6031fe457e54869a9b512abf1d54183 P 4b3390fbbe574de7bf154b5a6cc35677 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.152791  8907 tablet_replica.cc:333] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.153333  8907 raft_consensus.cc:2243] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:48.154008  8907 raft_consensus.cc:2272] T aedf82824d3c4883ad33ed154a6a08a1 P 4b3390fbbe574de7bf154b5a6cc35677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.156086  8907 tablet_replica.cc:333] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.156571  8907 raft_consensus.cc:2243] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.157374  8907 raft_consensus.cc:2272] T acc41bbfb3c94637814837eb2cfad80f P 4b3390fbbe574de7bf154b5a6cc35677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.159695  8907 tablet_replica.cc:333] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.160180  8907 raft_consensus.cc:2243] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.160946  8907 raft_consensus.cc:2272] T 6b7d9d50250941bf80c7399e949d802c P 4b3390fbbe574de7bf154b5a6cc35677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.163362  8907 tablet_replica.cc:333] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677: stopping tablet replica
I20260709 12:17:48.163793  8907 raft_consensus.cc:2243] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.164621  8907 raft_consensus.cc:2272] T 63a59e68139a465c858046fab6d14aaa P 4b3390fbbe574de7bf154b5a6cc35677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.547016  8907 tablet_server.cc:196] TabletServer@127.8.178.196:0 shutdown complete.
I20260709 12:17:48.630153  8907 master.cc:562] Master@127.8.178.254:37497 shutting down...
W20260709 12:17:48.666947 10001 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:17:48.667222 10001 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:17:48.667421 10001 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:17:48.670214  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:48.670826  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:48.671136  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P f9411c2085cc41508a7b355517791fc1: stopping tablet replica
I20260709 12:17:48.811355  8907 master.cc:584] Master@127.8.178.254:37497 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (246774 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:17:48.904980  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:34201
I20260709 12:17:48.906062  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:48.911768 18036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:48.911849 18035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:48.912580 18038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:48.914659  8907 server_base.cc:1061] running on GCE node
I20260709 12:17:48.917788  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:48.917984  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:48.918123  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599468918106 us; error 0 us; skew 500 ppm
I20260709 12:17:48.918690  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:48.921006  8907 webserver.cc:533] Webserver started at http://127.8.178.254:44421/ using document root <none> and password file <none>
I20260709 12:17:48.921470  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:48.921651  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:48.921900  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:48.923056  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "ad2bca390f7040c2b77960e7cf1e4c5c"
format_stamp: "Formatted at 2026-07-09 12:17:48 on dist-test-slave-jlx4"
I20260709 12:17:48.927340  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:48.930631 18043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:48.931308  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:48.931576  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "ad2bca390f7040c2b77960e7cf1e4c5c"
format_stamp: "Formatted at 2026-07-09 12:17:48 on dist-test-slave-jlx4"
I20260709 12:17:48.931865  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:48.953946  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:48.955214  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:48.992767  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:34201
I20260709 12:17:48.992851 18094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:34201 every 8 connection(s)
I20260709 12:17:48.996745 18095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.008127 18095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: Bootstrap starting.
I20260709 12:17:49.012914 18095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:49.017073 18095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: No bootstrap required, opened a new log
I20260709 12:17:49.019322 18095 raft_consensus.cc:359] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER }
I20260709 12:17:49.019721 18095 raft_consensus.cc:385] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:49.019927 18095 raft_consensus.cc:740] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2bca390f7040c2b77960e7cf1e4c5c, State: Initialized, Role: FOLLOWER
I20260709 12:17:49.020583 18095 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER }
I20260709 12:17:49.021032 18095 raft_consensus.cc:399] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:49.021256 18095 raft_consensus.cc:493] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:49.021486 18095 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:49.025796 18095 raft_consensus.cc:515] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER }
I20260709 12:17:49.026304 18095 leader_election.cc:304] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad2bca390f7040c2b77960e7cf1e4c5c; no voters: 
I20260709 12:17:49.027376 18095 leader_election.cc:290] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:49.027647 18098 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:49.028990 18098 raft_consensus.cc:697] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 1 LEADER]: Becoming Leader. State: Replica: ad2bca390f7040c2b77960e7cf1e4c5c, State: Running, Role: LEADER
I20260709 12:17:49.029659 18098 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER }
I20260709 12:17:49.030112 18095 sys_catalog.cc:565] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:49.034641 18099 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER } }
I20260709 12:17:49.035300 18099 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:49.035422 18100 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad2bca390f7040c2b77960e7cf1e4c5c. Latest consensus state: current_term: 1 leader_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad2bca390f7040c2b77960e7cf1e4c5c" member_type: VOTER } }
I20260709 12:17:49.035923 18100 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:49.037151 18105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:49.041792 18105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:49.045360  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:49.050038 18105 catalog_manager.cc:1383] Generated new cluster ID: 80fc2d53e46444d5b1ccf4fe101c966d
I20260709 12:17:49.050343 18105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:49.080793 18105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:49.082214 18105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:49.093734 18105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: Generated new TSK 0
I20260709 12:17:49.094389 18105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:49.111788  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:49.117816 18116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.119164 18117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.120661 18119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.120826  8907 server_base.cc:1061] running on GCE node
I20260709 12:17:49.123430  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:49.123634  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.123801  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599469123781 us; error 0 us; skew 500 ppm
I20260709 12:17:49.124310  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.126581  8907 webserver.cc:533] Webserver started at http://127.8.178.193:45943/ using document root <none> and password file <none>
I20260709 12:17:49.127035  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.127207  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.127455  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.128456  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "4758217c33d3483eac425c4d24d74bf5"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.132800  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:49.136117 18124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.136819  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:17:49.137096  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "4758217c33d3483eac425c4d24d74bf5"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.137393  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.155589  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.156752  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.158157  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:49.160336  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:49.160537  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.160759  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:49.160921  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.199424  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:38641
I20260709 12:17:49.199527 18186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:38641 every 8 connection(s)
I20260709 12:17:49.204259  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:49.211376 18191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.212067 18192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.213335 18194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.214360  8907 server_base.cc:1061] running on GCE node
I20260709 12:17:49.216876  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:49.217105  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.217284  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599469217261 us; error 0 us; skew 500 ppm
I20260709 12:17:49.217293 18187 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34201
I20260709 12:17:49.217795 18187 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:49.218014  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.218658 18187 heartbeater.cc:507] Master 127.8.178.254:34201 requested a full tablet report, sending...
I20260709 12:17:49.220794  8907 webserver.cc:533] Webserver started at http://127.8.178.194:37967/ using document root <none> and password file <none>
I20260709 12:17:49.220875 18060 ts_manager.cc:194] Registered new tserver with Master: 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:49.221359  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.221582  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.221827  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.222855 18060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34312
I20260709 12:17:49.222993  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "3d5db60b70564b85afdb88b4c7984ca5"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.227423  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:17:49.230566 18199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.231335  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:49.231609  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "3d5db60b70564b85afdb88b4c7984ca5"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.231870  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.252372  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.253546  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.254956  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:49.257087  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:49.257279  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.257493  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:49.257642  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.294889  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:45865
I20260709 12:17:49.295001 18261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:45865 every 8 connection(s)
I20260709 12:17:49.299574  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:49.307022 18265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.308197 18266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.310310  8907 server_base.cc:1061] running on GCE node
W20260709 12:17:49.311043 18268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.311878 18262 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34201
I20260709 12:17:49.312078  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:17:49.312243 18262 heartbeater.cc:461] Registering TS with master...
W20260709 12:17:49.312353  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.312635  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599469312621 us; error 0 us; skew 500 ppm
I20260709 12:17:49.313179 18262 heartbeater.cc:507] Master 127.8.178.254:34201 requested a full tablet report, sending...
I20260709 12:17:49.313288  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.315354 18060 ts_manager.cc:194] Registered new tserver with Master: 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:49.315977  8907 webserver.cc:533] Webserver started at http://127.8.178.195:34015/ using document root <none> and password file <none>
I20260709 12:17:49.316505  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.316691  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.316922  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.316877 18060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34320
I20260709 12:17:49.318535  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "c0771afef8984a5e9edd45be358960a2"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.322966  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:17:49.326227 18273 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.326985  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:49.327284  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "c0771afef8984a5e9edd45be358960a2"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.327548  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.350667  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.351876  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.353288  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:49.355608  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:49.355813  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.356034  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:49.356196  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.395133  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:41061
I20260709 12:17:49.395249 18335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:41061 every 8 connection(s)
I20260709 12:17:49.399693  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:49.406742 18339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:49.408314 18340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.411244  8907 server_base.cc:1061] running on GCE node
W20260709 12:17:49.411413 18342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:49.412602 18336 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34201
I20260709 12:17:49.412642  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:49.413028  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:49.413089 18336 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:49.413198  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599469413186 us; error 0 us; skew 500 ppm
I20260709 12:17:49.413887  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:49.413995 18336 heartbeater.cc:507] Master 127.8.178.254:34201 requested a full tablet report, sending...
I20260709 12:17:49.416301 18060 ts_manager.cc:194] Registered new tserver with Master: c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:49.416515  8907 webserver.cc:533] Webserver started at http://127.8.178.196:37557/ using document root <none> and password file <none>
I20260709 12:17:49.417078  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:49.417240  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:49.417440  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:49.417901 18060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34336
I20260709 12:17:49.418466  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-3-root/instance:
uuid: "ef7fc80e188b4c458d42ec37740468df"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.423105  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:49.426553 18347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.427307  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:17:49.427611  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
uuid: "ef7fc80e188b4c458d42ec37740468df"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:17:49.427906  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:49.457425  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:49.458720  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:49.460142  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:49.462348  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:49.462591  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.462815  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:49.462965  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:49.501830  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.196:33469
I20260709 12:17:49.501915 18409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.196:33469 every 8 connection(s)
I20260709 12:17:49.515178 18410 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34201
I20260709 12:17:49.515552 18410 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:49.516326 18410 heartbeater.cc:507] Master 127.8.178.254:34201 requested a full tablet report, sending...
I20260709 12:17:49.518370 18060 ts_manager.cc:194] Registered new tserver with Master: ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:49.519539  8907 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014723954s
I20260709 12:17:49.519980 18060 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34342
I20260709 12:17:49.545099 18060 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34354:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:17:49.788196 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 3231bb7672254b5c82246040d42fdae4 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:49.789626 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3231bb7672254b5c82246040d42fdae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.791534 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab54a9a3cb1444999d60e40d2852633 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:49.792238 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 37db4f6fedfc49e4a401670153431564 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:49.792912 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab54a9a3cb1444999d60e40d2852633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.792686 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 385d18f3f52b4e1a9032cbef00cf99af (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:49.793998 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385d18f3f52b4e1a9032cbef00cf99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.794447 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37db4f6fedfc49e4a401670153431564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.795468 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 012abbd307bb440c93b80adee8541719 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:49.795585 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 012abbd307bb440c93b80adee8541719 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:49.796837 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012abbd307bb440c93b80adee8541719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.797963 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 95597fb4497541e298059186c9a44a77 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:49.799592 18300 tablet_service.cc:1511] Processing CreateTablet for tablet f7ae7664b5ab484caea3e423a1e9289f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:49.799592 18375 tablet_service.cc:1511] Processing CreateTablet for tablet 3231bb7672254b5c82246040d42fdae4 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:49.800947 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ae7664b5ab484caea3e423a1e9289f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.803609 18370 tablet_service.cc:1511] Processing CreateTablet for tablet de26469791e8437793e0833ab312e266 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:49.804958 18368 tablet_service.cc:1511] Processing CreateTablet for tablet 9b921fdab84e49f79157326d18a70aa7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:49.805907 18369 tablet_service.cc:1511] Processing CreateTablet for tablet bedab17c8fe245b69ad728111f1caf37 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:49.806243 18293 tablet_service.cc:1511] Processing CreateTablet for tablet d1a349f30cd4492389e44ee0d27ce020 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:49.807483 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a349f30cd4492389e44ee0d27ce020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.808569 18367 tablet_service.cc:1511] Processing CreateTablet for tablet d1a349f30cd4492389e44ee0d27ce020 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:49.811224 18366 tablet_service.cc:1511] Processing CreateTablet for tablet ffbfc451de634f81ac9f6aaf022cf4d9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:49.812071 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 5912d4ca89fd4924a83b748aeecca9f2 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:49.789244 18296 tablet_service.cc:1511] Processing CreateTablet for tablet de26469791e8437793e0833ab312e266 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:49.791011 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 95597fb4497541e298059186c9a44a77 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:49.804842 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 3a12161578fc412fa63fc5ab2b1f73fc (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:49.803609 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 9b921fdab84e49f79157326d18a70aa7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:49.796838 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012abbd307bb440c93b80adee8541719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.817628 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a349f30cd4492389e44ee0d27ce020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.818257 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbfc451de634f81ac9f6aaf022cf4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.818887 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de26469791e8437793e0833ab312e266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.819729 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b921fdab84e49f79157326d18a70aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.813381 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5912d4ca89fd4924a83b748aeecca9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.823314 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3231bb7672254b5c82246040d42fdae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.824455 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95597fb4497541e298059186c9a44a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.826263 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b921fdab84e49f79157326d18a70aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.829401 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de26469791e8437793e0833ab312e266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.834787 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a12161578fc412fa63fc5ab2b1f73fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.838840 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95597fb4497541e298059186c9a44a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.846935 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedab17c8fe245b69ad728111f1caf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.866915 18227 tablet_service.cc:1511] Processing CreateTablet for tablet f7ae7664b5ab484caea3e423a1e9289f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:49.868376 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ae7664b5ab484caea3e423a1e9289f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.870244 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab54a9a3cb1444999d60e40d2852633 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:49.871634 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab54a9a3cb1444999d60e40d2852633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.873487 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 012abbd307bb440c93b80adee8541719 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:49.874826 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012abbd307bb440c93b80adee8541719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.876669 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 385d18f3f52b4e1a9032cbef00cf99af (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:49.877985 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385d18f3f52b4e1a9032cbef00cf99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.879604 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 37db4f6fedfc49e4a401670153431564 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:49.880915 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37db4f6fedfc49e4a401670153431564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.882889 18222 tablet_service.cc:1511] Processing CreateTablet for tablet de26469791e8437793e0833ab312e266 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:49.884218 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de26469791e8437793e0833ab312e266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.944149 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 3a12161578fc412fa63fc5ab2b1f73fc (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:49.945626 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a12161578fc412fa63fc5ab2b1f73fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.945348 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 5912d4ca89fd4924a83b748aeecca9f2 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:49.946949 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5912d4ca89fd4924a83b748aeecca9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.947624 18219 tablet_service.cc:1511] Processing CreateTablet for tablet d1a349f30cd4492389e44ee0d27ce020 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:49.949026 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a349f30cd4492389e44ee0d27ce020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.951619 18220 tablet_service.cc:1511] Processing CreateTablet for tablet bedab17c8fe245b69ad728111f1caf37 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:49.952982 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedab17c8fe245b69ad728111f1caf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.956249 18428 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:49.964864 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 1c31e3a96fa847adb12c5d3632d3f3fe (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:49.966341 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c31e3a96fa847adb12c5d3632d3f3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.965318 18428 tablet_bootstrap.cc:654] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.002257 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 7adc6e964f384c6fba8dd6b7f1d978c5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:50.003726 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adc6e964f384c6fba8dd6b7f1d978c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.006268 18152 tablet_service.cc:1511] Processing CreateTablet for tablet 3231bb7672254b5c82246040d42fdae4 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:50.007730 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3231bb7672254b5c82246040d42fdae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.011071 18150 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab54a9a3cb1444999d60e40d2852633 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:50.012401 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab54a9a3cb1444999d60e40d2852633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.015578 18149 tablet_service.cc:1511] Processing CreateTablet for tablet 385d18f3f52b4e1a9032cbef00cf99af (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:50.016920 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385d18f3f52b4e1a9032cbef00cf99af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.019491 18148 tablet_service.cc:1511] Processing CreateTablet for tablet 37db4f6fedfc49e4a401670153431564 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:50.030006 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37db4f6fedfc49e4a401670153431564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.007597 18151 tablet_service.cc:1511] Processing CreateTablet for tablet f7ae7664b5ab484caea3e423a1e9289f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:50.031790 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ae7664b5ab484caea3e423a1e9289f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:50.041584 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:50.044381 18299 tablet_service.cc:1511] Processing CreateTablet for tablet d1d5fb2105e4453aa1d8b1b3758aade5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:50.045807 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5fb2105e4453aa1d8b1b3758aade5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.020928 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 3a12161578fc412fa63fc5ab2b1f73fc (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:50.021313 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 1c31e3a96fa847adb12c5d3632d3f3fe (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:50.055830 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c31e3a96fa847adb12c5d3632d3f3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.022131 18147 tablet_service.cc:1511] Processing CreateTablet for tablet 95597fb4497541e298059186c9a44a77 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:50.023844 18145 tablet_service.cc:1511] Processing CreateTablet for tablet bedab17c8fe245b69ad728111f1caf37 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:50.061355 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a12161578fc412fa63fc5ab2b1f73fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.026587 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 5912d4ca89fd4924a83b748aeecca9f2 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:50.062364 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5912d4ca89fd4924a83b748aeecca9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.025053 18144 tablet_service.cc:1511] Processing CreateTablet for tablet 9b921fdab84e49f79157326d18a70aa7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:50.063725 18144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b921fdab84e49f79157326d18a70aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.066815 18145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedab17c8fe245b69ad728111f1caf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.067966 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95597fb4497541e298059186c9a44a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.026144 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 2670be13282d47d992a2899032fa7f00 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:50.080084 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2670be13282d47d992a2899032fa7f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.082985 18299 tablet_service.cc:1511] Processing CreateTablet for tablet a2af9ea4e43c413080fda28b17c3869f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:50.081532 18366 tablet_service.cc:1511] Processing CreateTablet for tablet 7adc6e964f384c6fba8dd6b7f1d978c5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:50.084481 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2af9ea4e43c413080fda28b17c3869f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.085495 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adc6e964f384c6fba8dd6b7f1d978c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.019624 18427 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:50.100667 18428 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:50.103935 18428 ts_tablet_manager.cc:1403] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.148s	user 0.020s	sys 0.037s
I20260709 12:17:50.105476 18431 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:50.109673 18149 tablet_service.cc:1511] Processing CreateTablet for tablet fe6de44e11a344e98fce7f3ac41604e9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:50.109884 18218 tablet_service.cc:1511] Processing CreateTablet for tablet a2af9ea4e43c413080fda28b17c3869f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:50.113288 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2af9ea4e43c413080fda28b17c3869f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.117005 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 1c31e3a96fa847adb12c5d3632d3f3fe (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:50.126864 18152 tablet_service.cc:1511] Processing CreateTablet for tablet 2670be13282d47d992a2899032fa7f00 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:50.127458 18148 tablet_service.cc:1511] Processing CreateTablet for tablet ffbfc451de634f81ac9f6aaf022cf4d9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:50.131713 18427 tablet_bootstrap.cc:654] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.133824 18430 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:50.135201 18220 tablet_service.cc:1511] Processing CreateTablet for tablet ffbfc451de634f81ac9f6aaf022cf4d9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:50.139523 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbfc451de634f81ac9f6aaf022cf4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.137920 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 7adc6e964f384c6fba8dd6b7f1d978c5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:50.141928 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adc6e964f384c6fba8dd6b7f1d978c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.151963 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 2670be13282d47d992a2899032fa7f00 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:50.153360 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2670be13282d47d992a2899032fa7f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.153940 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c31e3a96fa847adb12c5d3632d3f3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.154804 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6de44e11a344e98fce7f3ac41604e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.162783 18372 tablet_service.cc:1511] Processing CreateTablet for tablet a2af9ea4e43c413080fda28b17c3869f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:50.164121 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2af9ea4e43c413080fda28b17c3869f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.171590 18223 tablet_service.cc:1511] Processing CreateTablet for tablet ade29f5a49df44369d1a6e667d19c105 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:50.172945 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade29f5a49df44369d1a6e667d19c105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.173921 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbfc451de634f81ac9f6aaf022cf4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.179512 18428 raft_consensus.cc:359] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:50.180312 18428 raft_consensus.cc:385] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.180608 18428 raft_consensus.cc:740] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.181020 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 739f249d075b46c393cd456fe4f93ea0 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:50.181393 18428 consensus_queue.cc:260] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:50.182574 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f249d075b46c393cd456fe4f93ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.186959 18367 tablet_service.cc:1511] Processing CreateTablet for tablet ade29f5a49df44369d1a6e667d19c105 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:50.188382 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade29f5a49df44369d1a6e667d19c105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.195602 18222 tablet_service.cc:1511] Processing CreateTablet for tablet fe6de44e11a344e98fce7f3ac41604e9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:50.197000 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6de44e11a344e98fce7f3ac41604e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.202839 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2670be13282d47d992a2899032fa7f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.202680 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 739f249d075b46c393cd456fe4f93ea0 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:50.204059 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f249d075b46c393cd456fe4f93ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.207227 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 25582256f10b4d31b2add593456d964e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:50.208640 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25582256f10b4d31b2add593456d964e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.209043 18297 tablet_service.cc:1511] Processing CreateTablet for tablet fe6de44e11a344e98fce7f3ac41604e9 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:50.211359 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1e241eba1b4006923e669f4a48efec (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:50.215145 18430 tablet_bootstrap.cc:654] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.131997 18374 tablet_service.cc:1511] Processing CreateTablet for tablet d1d5fb2105e4453aa1d8b1b3758aade5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:50.225165 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5fb2105e4453aa1d8b1b3758aade5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.225497 18187 heartbeater.cc:499] Master 127.8.178.254:34201 was elected leader, sending a full tablet report...
I20260709 12:17:50.223712 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 25582256f10b4d31b2add593456d964e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:50.246232 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 25582256f10b4d31b2add593456d964e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:50.247694 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25582256f10b4d31b2add593456d964e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.251474 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6de44e11a344e98fce7f3ac41604e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.255486 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 057782f021104153860c7f1a52634265 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:50.256884 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057782f021104153860c7f1a52634265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.258098 18431 tablet_bootstrap.cc:654] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.262969 18299 tablet_service.cc:1511] Processing CreateTablet for tablet abdcb3150843428e970fa883d21b1894 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:50.264422 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdcb3150843428e970fa883d21b1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.267004 18151 tablet_service.cc:1511] Processing CreateTablet for tablet ade29f5a49df44369d1a6e667d19c105 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:50.268406 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade29f5a49df44369d1a6e667d19c105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.271019 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1e241eba1b4006923e669f4a48efec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.285102 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25582256f10b4d31b2add593456d964e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.267482 18227 tablet_service.cc:1511] Processing CreateTablet for tablet abdcb3150843428e970fa883d21b1894 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:50.305512 18427 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:50.242164 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1e241eba1b4006923e669f4a48efec (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:50.321123 18262 heartbeater.cc:499] Master 127.8.178.254:34201 was elected leader, sending a full tablet report...
I20260709 12:17:50.322626 18146 tablet_service.cc:1511] Processing CreateTablet for tablet d1d5fb2105e4453aa1d8b1b3758aade5 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:50.330358 18427 ts_tablet_manager.cc:1403] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.311s	user 0.019s	sys 0.000s
I20260709 12:17:50.348147 18147 tablet_service.cc:1511] Processing CreateTablet for tablet abdcb3150843428e970fa883d21b1894 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:50.349726 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 739f249d075b46c393cd456fe4f93ea0 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:50.353963 18150 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1e241eba1b4006923e669f4a48efec (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:50.354594 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d5fb2105e4453aa1d8b1b3758aade5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.357606 18336 heartbeater.cc:499] Master 127.8.178.254:34201 was elected leader, sending a full tablet report...
I20260709 12:17:50.360855 18427 raft_consensus.cc:359] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.361716 18427 raft_consensus.cc:385] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.367290 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1e241eba1b4006923e669f4a48efec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.365468 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdcb3150843428e970fa883d21b1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.364084 18427 raft_consensus.cc:740] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.373164 18148 tablet_service.cc:1511] Processing CreateTablet for tablet 057782f021104153860c7f1a52634265 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:50.373893 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdcb3150843428e970fa883d21b1894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.387800 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057782f021104153860c7f1a52634265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.372423 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1e241eba1b4006923e669f4a48efec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.391098 18430 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:50.391709 18430 ts_tablet_manager.cc:1403] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.258s	user 0.029s	sys 0.033s
I20260709 12:17:50.394954 18428 ts_tablet_manager.cc:1434] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.289s	user 0.016s	sys 0.005s
I20260709 12:17:50.396013 18428 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:50.396756 18430 raft_consensus.cc:359] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.397589 18430 raft_consensus.cc:385] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.397923 18430 raft_consensus.cc:740] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
W20260709 12:17:50.399585 18337 tablet.cc:2406] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:50.398887 18430 consensus_queue.cc:260] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.407117 18427 consensus_queue.cc:260] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.409322 18369 tablet_service.cc:1511] Processing CreateTablet for tablet afcea13cb6af475ea953aefa36c4cce7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:50.422890 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739f249d075b46c393cd456fe4f93ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.425033 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcea13cb6af475ea953aefa36c4cce7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:50.426802 18046 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 51091.9us
I20260709 12:17:50.432813 18299 tablet_service.cc:1511] Processing CreateTablet for tablet afcea13cb6af475ea953aefa36c4cce7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:50.434402 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcea13cb6af475ea953aefa36c4cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.436069 18428 tablet_bootstrap.cc:654] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.438237 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 057782f021104153860c7f1a52634265 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:50.469121 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057782f021104153860c7f1a52634265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.483733 18433 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.484432 18433 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:50.502481 18046 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 44949.1us
I20260709 12:17:50.506979 18431 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:50.507371 18410 heartbeater.cc:499] Master 127.8.178.254:34201 was elected leader, sending a full tablet report...
I20260709 12:17:50.507524 18431 ts_tablet_manager.cc:1403] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.402s	user 0.016s	sys 0.009s
I20260709 12:17:50.507611 18147 tablet_service.cc:1511] Processing CreateTablet for tablet afcea13cb6af475ea953aefa36c4cce7 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:50.509074 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcea13cb6af475ea953aefa36c4cce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.512028 18427 ts_tablet_manager.cc:1434] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.160s	user 0.000s	sys 0.013s
I20260709 12:17:50.511934 18430 ts_tablet_manager.cc:1434] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.120s	user 0.037s	sys 0.024s
I20260709 12:17:50.513124 18430 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:50.513075 18427 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:50.520409 18433 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:50.507375 18438 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.527047 18431 raft_consensus.cc:359] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.527845 18431 raft_consensus.cc:385] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.528132 18431 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.529878 18431 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.532264 18428 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:50.532879 18428 ts_tablet_manager.cc:1403] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.003s
I20260709 12:17:50.527042 18438 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.536067 18428 raft_consensus.cc:359] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:50.536870 18428 raft_consensus.cc:385] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.537205 18428 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.541309 18430 tablet_bootstrap.cc:654] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.545217 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 2aacfc26793e4bf28e5827e26159662b (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:50.545508 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0b214e224f41628a28b5c153d8a384 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:50.546569 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aacfc26793e4bf28e5827e26159662b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.549341 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0b214e224f41628a28b5c153d8a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.553048 18438 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:50.558145 18427 tablet_bootstrap.cc:654] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.569067 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 2aacfc26793e4bf28e5827e26159662b (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:50.538200 18428 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:50.570497 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aacfc26793e4bf28e5827e26159662b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.572091 18428 ts_tablet_manager.cc:1434] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:17:50.572273 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef6dbd8d5ca409da3ff154edacb0d96 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:50.573549 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef6dbd8d5ca409da3ff154edacb0d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.575910 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 2aacfc26793e4bf28e5827e26159662b (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:50.577775 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aacfc26793e4bf28e5827e26159662b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.578490 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef6dbd8d5ca409da3ff154edacb0d96 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:50.581923 18431 ts_tablet_manager.cc:1434] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.012s
I20260709 12:17:50.583129 18431 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:50.579692 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef6dbd8d5ca409da3ff154edacb0d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.590098 18431 tablet_bootstrap.cc:654] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.582460 18430 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:50.607112 18428 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:50.610576 18436 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.611286 18436 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.613907 18436 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:50.610677 18430 ts_tablet_manager.cc:1403] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.001s
I20260709 12:17:50.618170 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0b214e224f41628a28b5c153d8a384 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:50.619573 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0b214e224f41628a28b5c153d8a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.632478 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef6dbd8d5ca409da3ff154edacb0d96 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:50.629494 18430 raft_consensus.cc:359] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.635099 18430 raft_consensus.cc:385] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.635423 18430 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.636165 18430 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.642114 18430 ts_tablet_manager.cc:1434] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:17:50.646214 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:50.648497 18276 leader_election.cc:343] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.655009 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 961c55a402cb45c38eeed153e21184da (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:50.657550 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 961c55a402cb45c38eeed153e21184da (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:50.658268 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef6dbd8d5ca409da3ff154edacb0d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.658973 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961c55a402cb45c38eeed153e21184da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.659971 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 4e56147159e647d280beddd4d51e778a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:50.661278 18444 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.661788 18444 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.664459 18444 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:50.658655 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 305a8559734b417591ff6ac5f0609a2e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:50.658907 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961c55a402cb45c38eeed153e21184da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.668090 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e56147159e647d280beddd4d51e778a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.668309 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305a8559734b417591ff6ac5f0609a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.675856 18430 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:50.690258 18430 tablet_bootstrap.cc:654] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.700639 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 4e56147159e647d280beddd4d51e778a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:50.692817 18428 tablet_bootstrap.cc:654] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.706252 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 305a8559734b417591ff6ac5f0609a2e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:50.713512 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e56147159e647d280beddd4d51e778a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.731323 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0b214e224f41628a28b5c153d8a384 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:50.745652 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 4e56147159e647d280beddd4d51e778a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:50.746850 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e56147159e647d280beddd4d51e778a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.748272 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0b214e224f41628a28b5c153d8a384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.757143 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 94dc42a44c014b24a25ddcaad4075300 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:50.758893 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 305a8559734b417591ff6ac5f0609a2e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:50.760407 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305a8559734b417591ff6ac5f0609a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.763506 18436 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.764072 18436 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.766976 18430 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:50.767530 18430 ts_tablet_manager.cc:1403] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.005s
I20260709 12:17:50.769361 18436 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:50.770550 18430 raft_consensus.cc:359] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.779980 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305a8559734b417591ff6ac5f0609a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.775017 18430 raft_consensus.cc:385] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.788064 18427 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:50.799357 18147 tablet_service.cc:1511] Processing CreateTablet for tablet 94dc42a44c014b24a25ddcaad4075300 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:50.800608 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dc42a44c014b24a25ddcaad4075300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.795630 18427 ts_tablet_manager.cc:1403] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.283s	user 0.006s	sys 0.040s
I20260709 12:17:50.803130 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 94dc42a44c014b24a25ddcaad4075300 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:50.804504 18431 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:50.805102 18431 ts_tablet_manager.cc:1403] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.025s
I20260709 12:17:50.805635 18427 raft_consensus.cc:359] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.795890 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dc42a44c014b24a25ddcaad4075300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.808115 18431 raft_consensus.cc:359] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.808861 18431 raft_consensus.cc:385] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.809134 18431 raft_consensus.cc:740] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.809870 18431 consensus_queue.cc:260] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.788409 18430 raft_consensus.cc:740] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.811179 18430 consensus_queue.cc:260] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.812336 18431 ts_tablet_manager.cc:1434] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:50.813373 18431 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:50.813846 18430 ts_tablet_manager.cc:1434] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.001s
I20260709 12:17:50.814550 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 961c55a402cb45c38eeed153e21184da (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:50.804488 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94dc42a44c014b24a25ddcaad4075300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.817687 18428 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:50.818323 18428 ts_tablet_manager.cc:1403] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.005s
I20260709 12:17:50.819675 18431 tablet_bootstrap.cc:654] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.839561 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961c55a402cb45c38eeed153e21184da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.850939 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:50.853237 18428 raft_consensus.cc:359] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:50.853807 18202 leader_election.cc:343] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.854127 18428 raft_consensus.cc:385] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.854583 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:50.868988 18202 leader_election.cc:343] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.869807 18430 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:50.806357 18427 raft_consensus.cc:385] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.862010 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:50.863976 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:50.877219 18161 raft_consensus.cc:2468] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
W20260709 12:17:50.879274 18275 leader_election.cc:343] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.879786 18275 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:50.880955 18433 raft_consensus.cc:2749] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.879448 18350 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:50.891809 18438 raft_consensus.cc:2804] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.892207 18438 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.892534 18438 raft_consensus.cc:3060] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.892704 18430 tablet_bootstrap.cc:654] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.892951 18433 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.893528 18433 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:50.897783 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:50.899565 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:17:50.901173 18275 leader_election.cc:343] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.905416 18143 tablet_service.cc:1511] Processing CreateTablet for tablet dfff73c71c1a49b3986f395d27a699a8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:50.875957 18427 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.906850 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfff73c71c1a49b3986f395d27a699a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.907132 18433 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:50.907346 18427 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.909869 18427 ts_tablet_manager.cc:1434] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.000s
I20260709 12:17:50.910974 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:50.914197 18438 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:50.915232 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:50.916785 18438 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:17:50.917032 18276 leader_election.cc:343] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.917572 18276 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:50.860569 18428 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.924007 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:50.924744 18202 leader_election.cc:343] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.924455 18297 tablet_service.cc:1511] Processing CreateTablet for tablet dfff73c71c1a49b3986f395d27a699a8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:50.925305 18202 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:50.926379 18436 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.925335 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 37231cb8219f456f99b2043efccec059 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:50.920233 18433 raft_consensus.cc:2749] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:50.930629 18431 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:50.931167 18431 ts_tablet_manager.cc:1403] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.043s
I20260709 12:17:50.934172 18431 raft_consensus.cc:359] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.934963 18431 raft_consensus.cc:385] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.935266 18431 raft_consensus.cc:740] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.935695 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:50.935995 18431 consensus_queue.cc:260] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.936091 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 37231cb8219f456f99b2043efccec059 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:50.937650 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37231cb8219f456f99b2043efccec059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.938524 18431 ts_tablet_manager.cc:1434] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:50.939592 18431 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:50.944162 18147 tablet_service.cc:1511] Processing CreateTablet for tablet dd927b9f8b7a45cdb1851ae9060a9c69 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:50.945429 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd927b9f8b7a45cdb1851ae9060a9c69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:50.946056 18201 leader_election.cc:343] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.938576 18427 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:50.949568 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:50.950311 18292 tablet_service.cc:1511] Processing CreateTablet for tablet dd927b9f8b7a45cdb1851ae9060a9c69 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:50.951956 18431 tablet_bootstrap.cc:654] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:50.955901 18161 raft_consensus.cc:3060] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.950875 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfff73c71c1a49b3986f395d27a699a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.957211 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37231cb8219f456f99b2043efccec059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.957785 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd927b9f8b7a45cdb1851ae9060a9c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.951941 18428 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:50.953521 18373 tablet_service.cc:1511] Processing CreateTablet for tablet b1f319baf6bd4d04bd7e15bd2123cbed (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:17:50.953799 18127 leader_election.cc:343] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:50.965669 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f319baf6bd4d04bd7e15bd2123cbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.970937 18151 tablet_service.cc:1511] Processing CreateTablet for tablet b1f319baf6bd4d04bd7e15bd2123cbed (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:50.972290 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f319baf6bd4d04bd7e15bd2123cbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.983315 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 37231cb8219f456f99b2043efccec059 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:50.984756 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37231cb8219f456f99b2043efccec059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:50.986835 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:50.987525 18311 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:50.988377 18430 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:50.988898 18430 ts_tablet_manager.cc:1403] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.119s	user 0.034s	sys 0.014s
I20260709 12:17:50.988898 18127 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:50.990258 18444 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:50.990694 18444 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.991024 18444 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:50.992262 18430 raft_consensus.cc:359] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:50.992995 18430 raft_consensus.cc:385] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:50.994395 18430 raft_consensus.cc:740] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:50.995172 18428 ts_tablet_manager.cc:1434] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.176s	user 0.007s	sys 0.000s
I20260709 12:17:50.995332 18430 consensus_queue.cc:260] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:50.998943 18444 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.002106 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
W20260709 12:17:51.004082 18127 leader_election.cc:343] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.004805 18372 tablet_service.cc:1511] Processing CreateTablet for tablet dfff73c71c1a49b3986f395d27a699a8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:51.006232 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfff73c71c1a49b3986f395d27a699a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.008066 18430 ts_tablet_manager.cc:1434] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:17:51.009208 18430 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:50.961393 18201 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.009922 18436 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:51.010900 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 65007.4us
W20260709 12:17:51.012542 18350 leader_election.cc:343] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.015938 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 98944.9us
I20260709 12:17:51.017515 18430 tablet_bootstrap.cc:654] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.018198 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:50.978303 18427 tablet_bootstrap.cc:654] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.020582 18223 tablet_service.cc:1511] Processing CreateTablet for tablet dd927b9f8b7a45cdb1851ae9060a9c69 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:51.022018 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd927b9f8b7a45cdb1851ae9060a9c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.022792 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:51.023449 18311 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.024474 18428 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:51.002660 18161 raft_consensus.cc:2468] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
W20260709 12:17:51.031530 18350 leader_election.cc:343] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.032632 18350 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:51.033763 18438 raft_consensus.cc:2804] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.034248 18438 raft_consensus.cc:697] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:51.035064 18438 consensus_queue.cc:237] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:51.035567 18311 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:51.036928 18127 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
W20260709 12:17:51.044449 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:51.044186 18225 tablet_service.cc:1511] Processing CreateTablet for tablet b1f319baf6bd4d04bd7e15bd2123cbed (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:51.045336 18444 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:51.045812 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f319baf6bd4d04bd7e15bd2123cbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.046731 18292 tablet_service.cc:1511] Processing CreateTablet for tablet f73019155e63498984aba01ac4d3df0f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:51.047936 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73019155e63498984aba01ac4d3df0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.051477 18369 tablet_service.cc:1511] Processing CreateTablet for tablet f73019155e63498984aba01ac4d3df0f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:51.052817 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73019155e63498984aba01ac4d3df0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.052991 18428 tablet_bootstrap.cc:654] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.066182 18468 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.067189 18468 raft_consensus.cc:697] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:51.078045 18143 tablet_service.cc:1511] Processing CreateTablet for tablet f73019155e63498984aba01ac4d3df0f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:51.082389 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73019155e63498984aba01ac4d3df0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.083308 18430 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.083890 18430 ts_tablet_manager.cc:1403] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.000s
I20260709 12:17:51.088671 18297 tablet_service.cc:1511] Processing CreateTablet for tablet a7e33101322f4ceb8f0ba80bb561f699 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:51.088896 18221 tablet_service.cc:1511] Processing CreateTablet for tablet a7e33101322f4ceb8f0ba80bb561f699 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:51.090274 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e33101322f4ceb8f0ba80bb561f699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.092437 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e33101322f4ceb8f0ba80bb561f699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.092283 18430 raft_consensus.cc:359] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.093091 18430 raft_consensus.cc:385] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.093669 18430 raft_consensus.cc:740] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.088649 18059 catalog_manager.cc:5697] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.094561 18430 consensus_queue.cc:260] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.096633 18431 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:51.096836 18430 ts_tablet_manager.cc:1434] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:51.097208 18431 ts_tablet_manager.cc:1403] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.158s	user 0.025s	sys 0.014s
I20260709 12:17:51.097923 18430 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.100256 18431 raft_consensus.cc:359] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.100972 18431 raft_consensus.cc:385] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.101269 18431 raft_consensus.cc:740] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.104233 18430 tablet_bootstrap.cc:654] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.104660 18147 tablet_service.cc:1511] Processing CreateTablet for tablet c282b6d8fe394885b2058ecbef26a541 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:51.106015 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282b6d8fe394885b2058ecbef26a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.111771 18431 consensus_queue.cc:260] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.114400 18431 ts_tablet_manager.cc:1434] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:17:51.116185 18430 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.115849 18372 tablet_service.cc:1511] Processing CreateTablet for tablet a7e33101322f4ceb8f0ba80bb561f699 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:51.117185 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e33101322f4ceb8f0ba80bb561f699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.123874 18430 ts_tablet_manager.cc:1403] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 12:17:51.132951 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:51.135028 18428 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:51.135574 18428 ts_tablet_manager.cc:1403] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.011s
I20260709 12:17:51.135421 18374 tablet_service.cc:1511] Processing CreateTablet for tablet d4cbd36b69f445ad8ef1f859eb1ddb41 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:51.134347 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.138394 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cbd36b69f445ad8ef1f859eb1ddb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.140039 18431 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:51.139509 18428 raft_consensus.cc:359] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.141180 18428 raft_consensus.cc:385] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.141472 18428 raft_consensus.cc:740] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.142345 18428 consensus_queue.cc:260] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.090153 18468 consensus_queue.cc:237] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.143795 18222 tablet_service.cc:1511] Processing CreateTablet for tablet c282b6d8fe394885b2058ecbef26a541 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:51.145152 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282b6d8fe394885b2058ecbef26a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.146989 18299 tablet_service.cc:1511] Processing CreateTablet for tablet c282b6d8fe394885b2058ecbef26a541 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:51.148132 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c282b6d8fe394885b2058ecbef26a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.148355 18428 ts_tablet_manager.cc:1434] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:51.149395 18428 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:51.161607 18427 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:51.162971 18427 ts_tablet_manager.cc:1403] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.225s	user 0.015s	sys 0.003s
I20260709 12:17:51.167452 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:51.167812 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 2da0bd128e3a412fb2096d9bced6a731 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:51.168818 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.169986 18151 tablet_service.cc:1511] Processing CreateTablet for tablet d4cbd36b69f445ad8ef1f859eb1ddb41 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:51.171305 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cbd36b69f445ad8ef1f859eb1ddb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.173424 18428 tablet_bootstrap.cc:654] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.165956 18427 raft_consensus.cc:359] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.174899 18427 raft_consensus.cc:385] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.175225 18427 raft_consensus.cc:740] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.176723 18430 raft_consensus.cc:359] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:51.179461 18430 raft_consensus.cc:385] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.179855 18430 raft_consensus.cc:740] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.182588 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 2da0bd128e3a412fb2096d9bced6a731 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:51.184665 18299 tablet_service.cc:1511] Processing CreateTablet for tablet d4cbd36b69f445ad8ef1f859eb1ddb41 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:51.180817 18430 consensus_queue.cc:260] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:51.187970 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da0bd128e3a412fb2096d9bced6a731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.188463 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da0bd128e3a412fb2096d9bced6a731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.197710 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 2da0bd128e3a412fb2096d9bced6a731 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:51.199225 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da0bd128e3a412fb2096d9bced6a731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.200510 18431 tablet_bootstrap.cc:654] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.201676 18464 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.202313 18464 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.202716 18436 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.203310 18436 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.205811 18464 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.206633 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:51.206837 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.209311 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.211534 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:17:51.214080 18276 leader_election.cc:343] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.215148 18202 leader_election.cc:343] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.216535 18275 leader_election.cc:343] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.217078 18275 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.223956 18427 consensus_queue.cc:260] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.223459 18464 raft_consensus.cc:2749] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.225101 18385 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:51.221812 18436 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.224557 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:51.230316 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cbd36b69f445ad8ef1f859eb1ddb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.232861 18201 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:51.233631 18436 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.234004 18436 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.235435 18436 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.235829 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2d49deb2a6475590075e98db484a4a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:51.236002 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2d49deb2a6475590075e98db484a4a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:51.237334 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2d49deb2a6475590075e98db484a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.241932 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 7e2d49deb2a6475590075e98db484a4a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:51.243427 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2d49deb2a6475590075e98db484a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.247876 18369 tablet_service.cc:1511] Processing CreateTablet for tablet f47eddc3680748a6af9175de327137b8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:51.249078 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47eddc3680748a6af9175de327137b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.253093 18227 tablet_service.cc:1511] Processing CreateTablet for tablet f47eddc3680748a6af9175de327137b8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:51.254766 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:51.255822 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.256507 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47eddc3680748a6af9175de327137b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.258996 18430 ts_tablet_manager.cc:1434] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.001s
I20260709 12:17:51.258790 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:51.252422 18146 tablet_service.cc:1511] Processing CreateTablet for tablet f47eddc3680748a6af9175de327137b8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:51.263517 18430 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.263633 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.263392 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b89f14ea9fa4acaa3818c68cc4a1d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.269333 18150 tablet_service.cc:1511] Processing CreateTablet for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:51.271100 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 62389b333b65412ba48dd69a80e8be14 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:51.272320 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62389b333b65412ba48dd69a80e8be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.272027 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 62389b333b65412ba48dd69a80e8be14 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:51.273345 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62389b333b65412ba48dd69a80e8be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.273083 18148 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba7643c4e6d4a459dc5fe06baf0092d (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:51.275036 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 62389b333b65412ba48dd69a80e8be14 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:51.276155 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62389b333b65412ba48dd69a80e8be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.291092 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba7643c4e6d4a459dc5fe06baf0092d (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:51.292522 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba7643c4e6d4a459dc5fe06baf0092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.294556 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba7643c4e6d4a459dc5fe06baf0092d (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:51.295948 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba7643c4e6d4a459dc5fe06baf0092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.297046 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47eddc3680748a6af9175de327137b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.298974 18150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1bbd2de5294bb49cdcd14a71bb0a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.303280 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba7643c4e6d4a459dc5fe06baf0092d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.314917 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e2d49deb2a6475590075e98db484a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.350160 18428 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:51.350802 18428 ts_tablet_manager.cc:1403] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.202s	user 0.025s	sys 0.021s
I20260709 12:17:51.353636 18428 raft_consensus.cc:359] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.359227 18427 ts_tablet_manager.cc:1434] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.196s	user 0.008s	sys 0.002s
I20260709 12:17:51.354326 18428 raft_consensus.cc:385] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.360314 18428 raft_consensus.cc:740] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.363266 18438 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.363473 18057 catalog_manager.cc:5697] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.329160 18436 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.360337 18427 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:51.379069 18225 tablet_service.cc:1511] Processing CreateTablet for tablet ecddc502cf58477d8c38c13f8d405f7f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:51.380476 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecddc502cf58477d8c38c13f8d405f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.366827 18438 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:51.383822 18438 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:51.385667 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:51.385668 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:51.387411 18350 leader_election.cc:343] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.388090 18350 leader_election.cc:343] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.388494 18350 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:51.350831 18152 tablet_service.cc:1511] Processing CreateTablet for tablet ecddc502cf58477d8c38c13f8d405f7f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:51.390381 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecddc502cf58477d8c38c13f8d405f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.397892 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 5293f684a321421795eb6139805ef39f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:51.398586 18438 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.400462 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293f684a321421795eb6139805ef39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.405689 18427 tablet_bootstrap.cc:654] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.371891 18428 consensus_queue.cc:260] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.408080 18428 ts_tablet_manager.cc:1434] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:17:51.409128 18428 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:51.410224 18430 tablet_bootstrap.cc:654] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.412441 18464 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.412977 18464 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.416781 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:51.418292 18276 leader_election.cc:343] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.420318 18464 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:51.422730 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.425562 18468 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.426095 18468 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:51.431686 18275 leader_election.cc:343] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.433208 18275 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.436285 18444 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.444630 18373 tablet_service.cc:1511] Processing CreateTablet for tablet ecddc502cf58477d8c38c13f8d405f7f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:51.446120 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecddc502cf58477d8c38c13f8d405f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.448397 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 5293f684a321421795eb6139805ef39f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:51.449362 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293f684a321421795eb6139805ef39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.450881 18225 tablet_service.cc:1511] Processing CreateTablet for tablet c4ce96c35374410ba64078605ab401ef (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:51.452162 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ce96c35374410ba64078605ab401ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.445179 18444 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.440277 18464 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.462401 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:51.463244 18479 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.463800 18299 tablet_service.cc:1511] Processing CreateTablet for tablet c4ce96c35374410ba64078605ab401ef (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:51.465010 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ce96c35374410ba64078605ab401ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.466604 18430 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.467137 18430 ts_tablet_manager.cc:1403] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.019s
I20260709 12:17:51.463792 18479 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.469236 18236 raft_consensus.cc:3060] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.470700 18430 raft_consensus.cc:359] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.471441 18430 raft_consensus.cc:385] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.471757 18430 raft_consensus.cc:740] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.472545 18430 consensus_queue.cc:260] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.471549 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.478591 18468 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:51.478966 18438 consensus_queue.cc:1048] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:51.479190 18202 leader_election.cc:343] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.479832 18479 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:51.480649 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:51.463178 18237 raft_consensus.cc:2468] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
W20260709 12:17:51.482146 18202 leader_election.cc:343] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.482649 18202 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:51.484058 18479 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.495411 18127 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:51.498883 18468 raft_consensus.cc:2804] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.499320 18468 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.499639 18468 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.505208 18223 tablet_service.cc:1511] Processing CreateTablet for tablet c4e099ccbe3143b0b277c1a9cd4df141 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:51.506604 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e099ccbe3143b0b277c1a9cd4df141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.507133 18431 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:51.507648 18431 ts_tablet_manager.cc:1403] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.377s	user 0.013s	sys 0.014s
I20260709 12:17:51.508858 18374 tablet_service.cc:1511] Processing CreateTablet for tablet c4ce96c35374410ba64078605ab401ef (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:51.510113 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ce96c35374410ba64078605ab401ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.511407 18444 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.512859 18428 tablet_bootstrap.cc:654] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.516860 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:51.518584 18436 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.519191 18436 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.519610 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:51.520190 18385 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.517880 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 5293f684a321421795eb6139805ef39f (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:51.526736 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.527974 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.527889 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5293f684a321421795eb6139805ef39f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:51.532735 18127 leader_election.cc:343] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:51.533670 18127 leader_election.cc:343] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.535126 18430 ts_tablet_manager.cc:1434] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.068s	user 0.012s	sys 0.001s
I20260709 12:17:51.535485 18151 tablet_service.cc:1511] Processing CreateTablet for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:51.537554 18143 tablet_service.cc:1511] Processing CreateTablet for tablet c4e099ccbe3143b0b277c1a9cd4df141 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:51.538878 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e099ccbe3143b0b277c1a9cd4df141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.507289 18479 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.553627 18436 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.554207 18436 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:51.535987 18385 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:51.556521 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:51.557312 18436 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:51.557869 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.559546 18479 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.525058 18301 tablet_service.cc:1511] Processing CreateTablet for tablet c4e099ccbe3143b0b277c1a9cd4df141 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:51.557907 18438 consensus_queue.cc:1048] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:51.565003 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.563004 18430 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.571005 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.575922 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e099ccbe3143b0b277c1a9cd4df141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.579937 18431 raft_consensus.cc:359] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.580843 18431 raft_consensus.cc:385] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.581163 18431 raft_consensus.cc:740] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.582751 18151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.586375 18427 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
W20260709 12:17:51.562803 18202 leader_election.cc:343] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.590667 18201 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:51.591811 18482 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.592507 18482 raft_consensus.cc:697] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:51.593429 18482 consensus_queue.cc:237] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.593942 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:17:51.591881 18201 leader_election.cc:343] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.594703 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:51.595520 18202 leader_election.cc:343] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.573437 18468 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.595990 18202 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.596925 18436 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.595798 18427 ts_tablet_manager.cc:1403] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.008s
I20260709 12:17:51.611459 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:51.612867 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e39a3f16bd4d5cbe1eba372cb7e3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.613299 18430 tablet_bootstrap.cc:654] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.628433 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 051db7f6af1d40de85352437916770f1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:51.628659 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 051db7f6af1d40de85352437916770f1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:51.629983 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051db7f6af1d40de85352437916770f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.630278 18300 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6dbbbb353448c88878a019afcd95a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:51.631508 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6dbbbb353448c88878a019afcd95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.633890 18152 tablet_service.cc:1511] Processing CreateTablet for tablet efd81066a96b4346ab78ad395259fcc8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:51.635224 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd81066a96b4346ab78ad395259fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.640120 18373 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6dbbbb353448c88878a019afcd95a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:51.641433 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051db7f6af1d40de85352437916770f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.581981 18431 consensus_queue.cc:260] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.641402 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6dbbbb353448c88878a019afcd95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.649842 18431 ts_tablet_manager.cc:1434] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.000s
I20260709 12:17:51.642592 18202 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.659727 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.665465 18436 raft_consensus.cc:2749] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:51.666011 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:51.668678 18224 tablet_service.cc:1511] Processing CreateTablet for tablet efd81066a96b4346ab78ad395259fcc8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:51.669485 18299 tablet_service.cc:1511] Processing CreateTablet for tablet efd81066a96b4346ab78ad395259fcc8 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:51.669618 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 217d661eba0249388484125571f7c38e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:17:51.670569 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 63683.4us
I20260709 12:17:51.670681 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd81066a96b4346ab78ad395259fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.671880 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:51.672485 18237 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.670020 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd81066a96b4346ab78ad395259fcc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.662591 18468 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:17:51.671089 18127 leader_election.cc:343] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.670994 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217d661eba0249388484125571f7c38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.683262 18225 tablet_service.cc:1511] Processing CreateTablet for tablet a6c6dbbbb353448c88878a019afcd95a (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:51.684561 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c6dbbbb353448c88878a019afcd95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.686179 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 217d661eba0249388484125571f7c38e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:51.707329 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217d661eba0249388484125571f7c38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.688424 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 217d661eba0249388484125571f7c38e (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:51.689437 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 051db7f6af1d40de85352437916770f1 (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:51.690367 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 388fffe591be477388e1e844d43d1cda (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:51.710738 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051db7f6af1d40de85352437916770f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.710873 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388fffe591be477388e1e844d43d1cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.674165 18427 raft_consensus.cc:359] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.714783 18427 raft_consensus.cc:385] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.715123 18427 raft_consensus.cc:740] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.715860 18427 consensus_queue.cc:260] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.721380 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 388fffe591be477388e1e844d43d1cda (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:51.722820 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388fffe591be477388e1e844d43d1cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.699028 18237 raft_consensus.cc:2468] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
W20260709 12:17:51.674145 18126 leader_election.cc:343] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.724356 18126 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:51.702230 18428 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:51.703102 18431 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:51.725258 18127 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:51.727046 18428 ts_tablet_manager.cc:1403] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.318s	user 0.040s	sys 0.010s
I20260709 12:17:51.727779 18483 raft_consensus.cc:2804] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.728302 18483 raft_consensus.cc:697] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:51.729099 18483 consensus_queue.cc:237] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.726595 18468 raft_consensus.cc:2749] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:51.745878 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217d661eba0249388484125571f7c38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.746086 18143 tablet_service.cc:1511] Processing CreateTablet for tablet 388fffe591be477388e1e844d43d1cda (DEFAULT_TABLE table=test-workload [id=08b9f2bf631446f8ac1dd1b3013aa07f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:51.747479 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 388fffe591be477388e1e844d43d1cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:51.736756 18428 raft_consensus.cc:359] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:51.740818 18126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 78665.3us
I20260709 12:17:51.765512 18428 raft_consensus.cc:385] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.770466 18428 raft_consensus.cc:740] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.771358 18428 consensus_queue.cc:260] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.775905 18428 ts_tablet_manager.cc:1434] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:17:51.777009 18428 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:51.758155 18059 catalog_manager.cc:5697] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.783795 18428 tablet_bootstrap.cc:654] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.789566 18430 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.790154 18430 ts_tablet_manager.cc:1403] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.006s
W20260709 12:17:51.768318 18127 consensus_peers.cc:597] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:51.796459 18431 tablet_bootstrap.cc:654] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.799328 18482 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.799953 18482 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.802284 18482 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:51.803475 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.804188 18385 raft_consensus.cc:2468] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:51.805385 18430 raft_consensus.cc:359] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.806116 18430 raft_consensus.cc:385] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.805647 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:51.806663 18201 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:51.808490 18483 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:17:51.810847 18202 leader_election.cc:343] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.813197 18482 raft_consensus.cc:2804] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.813647 18482 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.813977 18482 raft_consensus.cc:3060] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.806398 18430 raft_consensus.cc:740] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.815132 18430 consensus_queue.cc:260] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.817299 18430 ts_tablet_manager.cc:1434] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.003s
I20260709 12:17:51.818713 18430 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.813910 18427 ts_tablet_manager.cc:1434] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.211s	user 0.005s	sys 0.018s
I20260709 12:17:51.836510 18427 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:51.839526 18057 catalog_manager.cc:5697] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.843663 18482 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.844190 18430 tablet_bootstrap.cc:654] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.846679 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:51.847294 18385 raft_consensus.cc:3060] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.851064 18427 tablet_bootstrap.cc:654] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.854352 18385 raft_consensus.cc:2468] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:51.855667 18201 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:51.856525 18436 raft_consensus.cc:2804] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.856980 18436 raft_consensus.cc:697] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:51.857765 18436 consensus_queue.cc:237] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.860051 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
W20260709 12:17:51.861469 18202 leader_election.cc:343] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.862416 18482 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:51.866204 18482 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.866648 18482 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.867574 18428 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:51.868114 18428 ts_tablet_manager.cc:1403] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.000s
I20260709 12:17:51.870695 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.871349 18310 raft_consensus.cc:2468] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:51.872568 18202 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:51.871706 18428 raft_consensus.cc:359] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.873437 18479 raft_consensus.cc:2804] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.873898 18479 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.874256 18479 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.881321 18479 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.882994 18482 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.873505 18428 raft_consensus.cc:385] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.883569 18428 raft_consensus.cc:740] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.884063 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:51.884464 18428 consensus_queue.cc:260] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:51.885396 18201 leader_election.cc:343] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.888077 18431 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:51.887166 18058 catalog_manager.cc:5697] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.888644 18431 ts_tablet_manager.cc:1403] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.027s
I20260709 12:17:51.889070 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:51.889640 18310 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.891773 18431 raft_consensus.cc:359] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.892534 18431 raft_consensus.cc:385] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.892825 18431 raft_consensus.cc:740] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.893571 18431 consensus_queue.cc:260] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.896101 18431 ts_tablet_manager.cc:1434] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:17:51.897156 18431 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:51.897358 18310 raft_consensus.cc:2468] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:51.898713 18202 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:51.899619 18482 raft_consensus.cc:2804] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:51.900120 18482 raft_consensus.cc:697] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:51.900964 18482 consensus_queue.cc:237] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.903195 18428 ts_tablet_manager.cc:1434] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:17:51.903709 18431 tablet_bootstrap.cc:654] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.904310 18428 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:51.907100 18479 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:51.908222 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:51.909103 18430 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.909583 18430 ts_tablet_manager.cc:1403] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.011s
W20260709 12:17:51.909708 18201 leader_election.cc:343] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.917928 18430 raft_consensus.cc:359] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.919025 18430 raft_consensus.cc:385] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.919323 18430 raft_consensus.cc:740] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.921043 18431 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:51.921636 18431 ts_tablet_manager.cc:1403] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 12:17:51.924667 18431 raft_consensus.cc:359] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.925424 18431 raft_consensus.cc:385] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.925700 18431 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.920719 18430 consensus_queue.cc:260] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.926714 18427 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:51.927279 18427 ts_tablet_manager.cc:1403] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.029s
I20260709 12:17:51.928045 18430 ts_tablet_manager.cc:1434] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:17:51.929013 18430 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.926390 18431 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.931383 18428 tablet_bootstrap.cc:654] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.933883 18427 raft_consensus.cc:359] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.934716 18427 raft_consensus.cc:385] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.934849 18431 ts_tablet_manager.cc:1434] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:17:51.935953 18431 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:51.936061 18427 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.937042 18427 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.938872 18060 catalog_manager.cc:5697] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.939591 18427 ts_tablet_manager.cc:1434] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:51.943787 18427 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:51.946830 18431 tablet_bootstrap.cc:654] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.942759 18430 tablet_bootstrap.cc:654] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.949957 18427 tablet_bootstrap.cc:654] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.956336 18431 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:51.956885 18431 ts_tablet_manager.cc:1403] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 12:17:51.963153 18430 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:51.963800 18430 ts_tablet_manager.cc:1403] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.005s
I20260709 12:17:51.964845 18431 raft_consensus.cc:359] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.965606 18431 raft_consensus.cc:385] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.965896 18431 raft_consensus.cc:740] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.967746 18430 raft_consensus.cc:359] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.968549 18430 raft_consensus.cc:385] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.969575 18444 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.973829 18430 raft_consensus.cc:740] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.974149 18444 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:51.969969 18431 consensus_queue.cc:260] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.974747 18430 consensus_queue.cc:260] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.976244 18444 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:51.976676 18431 ts_tablet_manager.cc:1434] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:17:51.971266 18428 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:51.977291 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:51.973145 18427 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:51.977970 18236 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:51.978204 18427 ts_tablet_manager.cc:1403] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 12:17:51.979820 18431 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:51.980437 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:51.981389 18427 raft_consensus.cc:359] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.982115 18427 raft_consensus.cc:385] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.982402 18427 raft_consensus.cc:740] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.982946 18430 ts_tablet_manager.cc:1434] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:17:51.983229 18427 consensus_queue.cc:260] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:51.983928 18430 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:51.985543 18427 ts_tablet_manager.cc:1434] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
W20260709 12:17:51.983299 18127 leader_election.cc:343] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:51.977516 18428 ts_tablet_manager.cc:1403] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.000s
I20260709 12:17:51.987200 18127 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:51.988345 18444 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:51.988693 18444 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.989022 18444 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:51.989446 18428 raft_consensus.cc:359] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.990151 18428 raft_consensus.cc:385] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:51.990415 18430 tablet_bootstrap.cc:654] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.991827 18431 tablet_bootstrap.cc:654] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:51.992873 18428 raft_consensus.cc:740] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:51.993743 18428 consensus_queue.cc:260] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:51.995997 18428 ts_tablet_manager.cc:1434] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:17:51.997078 18428 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.000777 18431 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.001387 18431 ts_tablet_manager.cc:1403] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 12:17:51.986563 18427 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.005180 18428 tablet_bootstrap.cc:654] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.010831 18444 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.013808 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:52.014447 18236 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.021301 18236 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.022447 18127 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:52.023435 18468 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.023563 18444 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.004174 18431 raft_consensus.cc:359] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.024400 18431 raft_consensus.cc:385] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.024691 18431 raft_consensus.cc:740] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.023975 18468 raft_consensus.cc:697] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:52.025369 18431 consensus_queue.cc:260] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.025846 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:52.025977 18468 consensus_queue.cc:237] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.027048 18427 tablet_bootstrap.cc:654] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.027439 18430 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
W20260709 12:17:52.027578 18127 leader_election.cc:343] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.027923 18430 ts_tablet_manager.cc:1403] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.020s
I20260709 12:17:52.030820 18430 raft_consensus.cc:359] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.031453 18430 raft_consensus.cc:385] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.031718 18430 raft_consensus.cc:740] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.033141 18479 consensus_queue.cc:1048] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.033682 18431 ts_tablet_manager.cc:1434] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:17:52.033452 18430 consensus_queue.cc:260] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.034375 18427 tablet_bootstrap.cc:492] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.034824 18431 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.034951 18427 ts_tablet_manager.cc:1403] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.002s
I20260709 12:17:52.035837 18430 ts_tablet_manager.cc:1434] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:52.037024 18430 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.038205 18427 raft_consensus.cc:359] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.039109 18427 raft_consensus.cc:385] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.039445 18427 raft_consensus.cc:740] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.040346 18427 consensus_queue.cc:260] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.042732 18427 ts_tablet_manager.cc:1434] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:52.043821 18427 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.044179 18430 tablet_bootstrap.cc:654] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.040858 18431 tablet_bootstrap.cc:654] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:52.047276 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:52.048588 18493 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.049093 18493 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.050199 18427 tablet_bootstrap.cc:654] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.051465 18493 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.052223 18428 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.052716 18428 ts_tablet_manager.cc:1403] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.007s
I20260709 12:17:52.055737 18428 raft_consensus.cc:359] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.056439 18428 raft_consensus.cc:385] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.056699 18428 raft_consensus.cc:740] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.057453 18428 consensus_queue.cc:260] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.062444 18428 ts_tablet_manager.cc:1434] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:17:52.063580 18428 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.073616 18431 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.074254 18431 ts_tablet_manager.cc:1403] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.001s
I20260709 12:17:52.077200 18431 raft_consensus.cc:359] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.078020 18431 raft_consensus.cc:385] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.082316 18428 tablet_bootstrap.cc:654] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.078284 18431 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
W20260709 12:17:52.085260 18202 consensus_peers.cc:597] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.085820 18431 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.088382 18431 ts_tablet_manager.cc:1434] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:17:52.089454 18431 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.094820 18468 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.095491 18468 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.098742 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.099473 18309 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:52.099745 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.100390 18161 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:52.100710 18127 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:52.101579 18483 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.101603 18350 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:52.102111 18483 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.102538 18483 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.103386 18058 catalog_manager.cc:5697] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.104787 18493 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.105172 18493 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.105508 18493 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.107080 18468 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.108225 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.108881 18384 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:52.114931 18483 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.118379 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:52.119310 18309 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.128192 18309 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.127979 18493 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.140586 18127 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:52.142145 18468 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.143409 18431 tablet_bootstrap.cc:654] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.145351 18427 tablet_bootstrap.cc:492] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.145864 18427 ts_tablet_manager.cc:1403] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.102s	user 0.066s	sys 0.027s
I20260709 12:17:52.146886 18430 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:52.147380 18430 ts_tablet_manager.cc:1403] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.000s
I20260709 12:17:52.142720 18468 raft_consensus.cc:697] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:52.148401 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:52.149031 18161 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.149264 18483 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.150223 18430 raft_consensus.cc:359] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.150969 18430 raft_consensus.cc:385] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.151235 18430 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.152034 18430 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.153280 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:52.154055 18385 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.156733 18161 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:52.159431 18428 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.159950 18428 ts_tablet_manager.cc:1403] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.097s	user 0.004s	sys 0.011s
I20260709 12:17:52.142745 18493 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.158905 18350 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:52.149041 18468 consensus_queue.cc:237] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.163858 18438 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.164369 18438 raft_consensus.cc:697] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:52.165234 18438 consensus_queue.cc:237] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.219621 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:52.221745 18311 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.222998 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.232010 18058 catalog_manager.cc:5697] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.239632 18427 raft_consensus.cc:359] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.240737 18427 raft_consensus.cc:385] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.241117 18427 raft_consensus.cc:740] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.242164 18427 consensus_queue.cc:260] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.162547 18428 raft_consensus.cc:359] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.244266 18428 raft_consensus.cc:385] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.244638 18428 raft_consensus.cc:740] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.245594 18428 consensus_queue.cc:260] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.248652 18527 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.249557 18527 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.250926 18311 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:52.251406 18428 ts_tablet_manager.cc:1434] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.091s	user 0.003s	sys 0.008s
I20260709 12:17:52.159366 18430 ts_tablet_manager.cc:1434] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:52.255373 18430 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.256764 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.258929 18385 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.261899 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.262214 18527 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:52.263098 18236 raft_consensus.cc:2393] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:52.264658 18428 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.265954 18436 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.273581 18428 tablet_bootstrap.cc:654] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.277552 18427 ts_tablet_manager.cc:1434] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.001s
I20260709 12:17:52.278723 18436 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.281860 18430 tablet_bootstrap.cc:654] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.282683 18431 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.283179 18276 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:52.284392 18436 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.283493 18431 ts_tablet_manager.cc:1403] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.194s	user 0.009s	sys 0.003s
I20260709 12:17:52.286903 18427 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.286919 18468 consensus_queue.cc:1048] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:52.291114 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.291412 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.292531 18436 consensus_queue.cc:1048] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:52.294317 18202 leader_election.cc:343] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:52.295279 18202 leader_election.cc:343] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.296350 18483 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.297106 18483 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.298334 18427 tablet_bootstrap.cc:654] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.299549 18527 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.308597 18385 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.312080 18431 raft_consensus.cc:359] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.295728 18202 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:52.318264 18468 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.319651 18436 consensus_queue.cc:1048] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.324785 18468 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.327359 18468 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:52.328676 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.330041 18464 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.330639 18464 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.331528 18436 raft_consensus.cc:2749] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.323971 18527 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.333070 18483 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.334214 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.334364 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.334370 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.346221 18235 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:52.346884 18236 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:52.347771 18527 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.348011 18127 leader_election.cc:343] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.320848 18431 raft_consensus.cc:385] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.348380 18527 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.343106 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:52.344636 18126 leader_election.cc:343] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.349398 18234 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:52.349391 18483 consensus_queue.cc:1048] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:52.345639 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.350778 18161 raft_consensus.cc:3060] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.333094 18464 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.351678 18276 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:52.348819 18430 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
W20260709 12:17:52.352612 18275 leader_election.cc:343] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.352811 18430 ts_tablet_manager.cc:1403] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.016s
I20260709 12:17:52.335901 18060 catalog_manager.cc:5697] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.353147 18431 raft_consensus.cc:740] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.354533 18427 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.354988 18427 ts_tablet_manager.cc:1403] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.004s
I20260709 12:17:52.357831 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.357882 18427 raft_consensus.cc:359] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.358747 18427 raft_consensus.cc:385] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.359026 18427 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
W20260709 12:17:52.359616 18275 leader_election.cc:343] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.355054 18127 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.359802 18427 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.360647 18464 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.361052 18464 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.361397 18464 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.362135 18427 ts_tablet_manager.cc:1434] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:52.363438 18427 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.364239 18127 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:52.365108 18483 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.365486 18483 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.365793 18483 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.368971 18431 consensus_queue.cc:260] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.372124 18427 tablet_bootstrap.cc:654] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.367467 18468 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.374871 18468 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.375243 18468 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.377616 18431 ts_tablet_manager.cc:1434] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 12:17:52.379483 18431 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.382593 18527 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.383894 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.384534 18162 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:52.385701 18276 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.387128 18527 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.387573 18527 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.387950 18527 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.393380 18430 raft_consensus.cc:359] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.396765 18436 consensus_queue.cc:1048] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.394311 18430 raft_consensus.cc:385] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.399562 18430 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.409482 18527 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.410887 18430 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.426157 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:17:52.428125 18275 leader_election.cc:343] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.430969 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:52.431737 18162 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.437582 18436 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.438233 18436 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.440515 18464 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.441159 18479 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.441663 18479 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.409139 18483 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.443830 18479 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.444386 18483 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:52.446346 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:52.446995 18428 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.447525 18428 ts_tablet_manager.cc:1403] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.183s	user 0.025s	sys 0.008s
I20260709 12:17:52.448364 18436 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.450664 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:52.451512 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.443861 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:52.453902 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.454718 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.455457 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:52.453797 18126 leader_election.cc:343] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.456984 18430 ts_tablet_manager.cc:1434] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.001s
I20260709 12:17:52.458729 18428 raft_consensus.cc:359] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.461254 18309 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:52.461895 18383 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:52.436691 18527 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.462805 18427 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.463505 18428 raft_consensus.cc:385] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.460666 18236 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.462293 18234 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.466261 18384 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
W20260709 12:17:52.467748 18202 leader_election.cc:343] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.468083 18431 tablet_bootstrap.cc:654] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.465370 18428 raft_consensus.cc:740] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.465505 18427 ts_tablet_manager.cc:1403] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.026s
I20260709 12:17:52.465425 18464 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.472843 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:17:52.474261 18275 leader_election.cc:343] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.474802 18428 consensus_queue.cc:260] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.475414 18201 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:52.476500 18428 ts_tablet_manager.cc:1434] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:17:52.475689 18468 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.476526 18201 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:52.477751 18428 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.478220 18482 raft_consensus.cc:2804] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.478641 18482 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.478962 18482 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.481806 18468 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.486876 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:52.487598 18309 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.489818 18234 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:52.492205 18427 raft_consensus.cc:359] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.492944 18427 raft_consensus.cc:385] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.493189 18427 raft_consensus.cc:740] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.489825 18428 tablet_bootstrap.cc:654] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.497120 18430 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.476681 18436 raft_consensus.cc:2804] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.498862 18436 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.510772 18427 consensus_queue.cc:260] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.499233 18436 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.518764 18236 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.527971 18427 ts_tablet_manager.cc:1434] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.003s
I20260709 12:17:52.525856 18309 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.526268 18276 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.533190 18527 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.533746 18527 raft_consensus.cc:697] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:52.534577 18527 consensus_queue.cc:237] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.535056 18127 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:52.538739 18444 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.539312 18444 raft_consensus.cc:697] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:52.540526 18444 consensus_queue.cc:237] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.548606 18162 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:52.556836 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:52.557524 18236 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.562176 18490 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:52.562808 18127 consensus_peers.cc:597] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.563025 18430 tablet_bootstrap.cc:654] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.563506 18127 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.564894 18539 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.565495 18539 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.565030 18483 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.566411 18483 raft_consensus.cc:697] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:52.566597 18060 catalog_manager.cc:5697] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.567481 18483 consensus_queue.cc:237] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.568014 18539 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.539197 18482 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.590494 18276 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.591405 18430 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:52.592026 18430 ts_tablet_manager.cc:1403] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.007s
I20260709 12:17:52.580430 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:52.594682 18427 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.596120 18436 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.598342 18436 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:52.602145 18236 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:52.602666 18527 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.603297 18527 raft_consensus.cc:697] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:52.604310 18527 consensus_queue.cc:237] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.606842 18436 consensus_queue.cc:1048] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.607905 18383 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:52.608429 18490 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.608884 18490 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.612818 18201 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:52.614490 18490 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:52.614706 18539 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.615248 18539 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.615454 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.616171 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:52.619165 18350 leader_election.cc:343] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.615595 18539 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.621467 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:52.622066 18384 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.624485 18428 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.625002 18428 ts_tablet_manager.cc:1403] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.148s	user 0.027s	sys 0.019s
I20260709 12:17:52.625187 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:52.625896 18311 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.618352 18431 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.626974 18431 ts_tablet_manager.cc:1403] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.248s	user 0.008s	sys 0.007s
I20260709 12:17:52.630481 18431 raft_consensus.cc:359] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.631702 18431 raft_consensus.cc:385] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.632042 18431 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.634449 18482 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.635752 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:52.636423 18383 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.633484 18431 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.637652 18468 consensus_queue.cc:1048] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.639295 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.636686 18427 tablet_bootstrap.cc:654] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.636521 18428 raft_consensus.cc:359] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.643564 18428 raft_consensus.cc:385] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.643774 18428 raft_consensus.cc:740] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.649889 18428 consensus_queue.cc:260] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.652189 18428 ts_tablet_manager.cc:1434] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:17:52.653442 18428 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.653522 18384 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:52.654018 18539 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.655128 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
W20260709 12:17:52.655236 18202 leader_election.cc:343] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.656661 18201 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:17:52.662110 18202 leader_election.cc:343] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.662730 18482 raft_consensus.cc:2804] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.663282 18482 raft_consensus.cc:697] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:52.664885 18482 consensus_queue.cc:237] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.679726 18431 ts_tablet_manager.cc:1434] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:17:52.682756 18236 raft_consensus.cc:2393] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:52.689951 18539 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.690503 18428 tablet_bootstrap.cc:654] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.681363 18058 catalog_manager.cc:5697] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.691903 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:52.697732 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:52.698482 18384 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.698773 18483 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.700160 18483 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.702404 18483 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.703445 18430 raft_consensus.cc:359] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.704144 18430 raft_consensus.cc:385] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.704407 18430 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.702719 18431 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.703145 18490 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:52.705847 18430 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:52.706058 18202 leader_election.cc:343] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.716153 18430 ts_tablet_manager.cc:1434] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 12:17:52.717326 18430 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.717480 18483 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:52.702852 18553 log.cc:927] Time spent T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:17:52.704869 18058 catalog_manager.cc:5697] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.708788 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:52.704784 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.734927 18311 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:52.728739 18464 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.737910 18127 leader_election.cc:343] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.738020 18464 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.742388 18464 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.746443 18057 catalog_manager.cc:5697] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.751319 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.751565 18383 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:52.752210 18161 raft_consensus.cc:2468] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:52.754742 18201 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:52.755966 18276 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:52.756022 18539 raft_consensus.cc:2804] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.757524 18539 raft_consensus.cc:697] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:52.758662 18539 consensus_queue.cc:237] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.760255 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.754878 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:17:52.762506 18275 leader_election.cc:343] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.763321 18427 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.763820 18427 ts_tablet_manager.cc:1403] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.006s
I20260709 12:17:52.764796 18464 raft_consensus.cc:2804] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.765224 18464 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.765559 18464 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.760136 18428 tablet_bootstrap.cc:492] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.766789 18428 ts_tablet_manager.cc:1403] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.012s
I20260709 12:17:52.729530 18384 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
W20260709 12:17:52.768386 18127 leader_election.cc:343] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.772871 18127 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:52.772987 18438 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.773864 18547 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.775427 18428 raft_consensus.cc:359] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.776213 18428 raft_consensus.cc:385] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.776494 18428 raft_consensus.cc:740] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.776875 18547 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:52.777212 18428 consensus_queue.cc:260] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.772794 18201 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:52.779735 18436 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.780256 18436 raft_consensus.cc:697] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:52.779516 18059 catalog_manager.cc:5697] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.781219 18436 consensus_queue.cc:237] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.781816 18464 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.784988 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:17:52.787451 18275 leader_election.cc:343] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.792426 18427 raft_consensus.cc:359] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.793283 18427 raft_consensus.cc:385] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.793566 18427 raft_consensus.cc:740] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.797626 18464 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.797835 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:52.798563 18161 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.803256 18427 consensus_queue.cc:260] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.807119 18556 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.808290 18556 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.818853 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.820783 18430 tablet_bootstrap.cc:654] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.824368 18161 raft_consensus.cc:2468] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:52.825830 18276 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:52.826275 18431 tablet_bootstrap.cc:654] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.826717 18428 ts_tablet_manager.cc:1434] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 12:17:52.826864 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.827337 18464 raft_consensus.cc:2804] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.827672 18161 raft_consensus.cc:2393] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:52.827911 18428 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.828197 18464 raft_consensus.cc:697] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:52.827158 18427 ts_tablet_manager.cc:1434] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 12:17:52.828688 18350 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:52.826206 18556 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:52.829694 18464 consensus_queue.cc:237] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:52.833648 18427 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.829777 18556 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.839876 18427 tablet_bootstrap.cc:654] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.846871 18430 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:52.847435 18430 ts_tablet_manager.cc:1403] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.004s
I20260709 12:17:52.847767 18556 raft_consensus.cc:2749] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:52.856866 18059 catalog_manager.cc:5697] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.859961 18428 tablet_bootstrap.cc:654] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.862902 18430 raft_consensus.cc:359] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.863672 18430 raft_consensus.cc:385] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.863922 18430 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.859156 18059 catalog_manager.cc:5697] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.864862 18430 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.867398 18430 ts_tablet_manager.cc:1434] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:17:52.868534 18430 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.880481 18427 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.881026 18427 ts_tablet_manager.cc:1403] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:17:52.882349 18430 tablet_bootstrap.cc:654] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.883884 18427 raft_consensus.cc:359] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.884657 18427 raft_consensus.cc:385] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.884925 18427 raft_consensus.cc:740] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.886305 18427 consensus_queue.cc:260] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.887068 18431 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.887579 18431 ts_tablet_manager.cc:1403] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.020s
I20260709 12:17:52.888840 18427 ts_tablet_manager.cc:1434] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:17:52.889982 18427 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.890559 18431 raft_consensus.cc:359] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.891324 18431 raft_consensus.cc:385] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.891577 18431 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.892373 18431 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.894748 18431 ts_tablet_manager.cc:1434] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:17:52.895869 18431 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.897001 18427 tablet_bootstrap.cc:654] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.901064 18234 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.905817 18431 tablet_bootstrap.cc:654] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.911890 18057 catalog_manager.cc:5697] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.917618 18428 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.918177 18428 ts_tablet_manager.cc:1403] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.017s
I20260709 12:17:52.920852 18428 raft_consensus.cc:359] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.921514 18428 raft_consensus.cc:385] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.921770 18428 raft_consensus.cc:740] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.922602 18428 consensus_queue.cc:260] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.925082 18428 ts_tablet_manager.cc:1434] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:52.926107 18428 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:52.932756 18430 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:52.933280 18430 ts_tablet_manager.cc:1403] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 12:17:52.936249 18430 raft_consensus.cc:359] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.936887 18430 raft_consensus.cc:385] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.937161 18430 raft_consensus.cc:740] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.937772 18430 consensus_queue.cc:260] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.940109 18430 ts_tablet_manager.cc:1434] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:52.941251 18430 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.942950 18428 tablet_bootstrap.cc:654] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.943624 18427 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:52.944206 18427 ts_tablet_manager.cc:1403] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.006s
I20260709 12:17:52.948462 18427 raft_consensus.cc:359] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.948851 18431 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:52.949172 18427 raft_consensus.cc:385] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.949440 18431 ts_tablet_manager.cc:1403] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.019s
I20260709 12:17:52.949935 18430 tablet_bootstrap.cc:654] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.949479 18427 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.952286 18431 raft_consensus.cc:359] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.953008 18431 raft_consensus.cc:385] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.952759 18427 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:52.953279 18431 raft_consensus.cc:740] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.953956 18431 consensus_queue.cc:260] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.954864 18427 ts_tablet_manager.cc:1434] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:17:52.957315 18482 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.958035 18431 ts_tablet_manager.cc:1434] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:52.957826 18482 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.959179 18431 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:52.960036 18482 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:52.960750 18464 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.961231 18464 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.963410 18464 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:52.965485 18431 tablet_bootstrap.cc:654] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:52.966892 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.965579 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:52.967589 18161 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:52.967941 18234 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:52.968619 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:52.969230 18276 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:17:52.970003 18202 leader_election.cc:343] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:52.971122 18430 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:52.972718 18430 ts_tablet_manager.cc:1403] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:17:52.967617 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:52.970044 18464 raft_consensus.cc:2804] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.974864 18162 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:52.974815 18464 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.975555 18464 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.975833 18428 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:52.976291 18428 ts_tablet_manager.cc:1403] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.007s
I20260709 12:17:52.976436 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:52.977736 18482 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:52.978142 18482 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.978581 18482 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.979018 18428 raft_consensus.cc:359] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.979696 18428 raft_consensus.cc:385] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.979935 18428 raft_consensus.cc:740] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.982174 18428 consensus_queue.cc:260] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.983877 18464 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:52.986781 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:52.987439 18162 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:52.981549 18430 raft_consensus.cc:359] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.990077 18430 raft_consensus.cc:385] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:52.990370 18430 raft_consensus.cc:740] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:52.991040 18430 consensus_queue.cc:260] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:52.993057 18430 ts_tablet_manager.cc:1434] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:17:52.994110 18430 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:52.987383 18427 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:52.999148 18482 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.005352 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
W20260709 12:17:53.007154 18202 leader_election.cc:343] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.007856 18482 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.009438 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:53.010057 18161 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.013643 18464 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.011083 18427 tablet_bootstrap.cc:654] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.017526 18431 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.017989 18431 ts_tablet_manager.cc:1403] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.059s	user 0.030s	sys 0.026s
I20260709 12:17:53.018086 18438 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.018921 18438 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.020712 18431 raft_consensus.cc:359] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.021075 18438 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.021364 18431 raft_consensus.cc:385] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.021713 18431 raft_consensus.cc:740] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.015503 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:53.022387 18431 consensus_queue.cc:260] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.022862 18234 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.024536 18431 ts_tablet_manager.cc:1434] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:17:53.025159 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.025913 18160 raft_consensus.cc:2393] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:53.026886 18427 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.027396 18427 ts_tablet_manager.cc:1403] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 12:17:53.027456 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.028741 18431 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.029381 18350 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:53.030754 18427 raft_consensus.cc:359] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.031499 18427 raft_consensus.cc:385] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.031900 18427 raft_consensus.cc:740] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.032420 18438 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.033628 18427 consensus_queue.cc:260] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.035569 18431 tablet_bootstrap.cc:654] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.035887 18427 ts_tablet_manager.cc:1434] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:53.041231 18234 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:53.042681 18276 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:53.042943 18468 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.043670 18464 raft_consensus.cc:2804] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.044214 18464 raft_consensus.cc:697] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:53.045121 18464 consensus_queue.cc:237] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.049089 18438 raft_consensus.cc:2749] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.051414 18468 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.052006 18468 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.057955 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.058715 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.059549 18383 raft_consensus.cc:2393] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:53.059963 18468 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.060878 18126 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.061151 18161 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:53.062348 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:53.062948 18427 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.063794 18468 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.068976 18427 tablet_bootstrap.cc:654] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.001602 18162 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:53.066202 18482 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:52.999776 18430 tablet_bootstrap.cc:654] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.072330 18578 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.071306 18428 ts_tablet_manager.cc:1434] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
W20260709 12:17:53.073931 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:53.079506 18431 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.074982 18578 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.074753 18482 raft_consensus.cc:697] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:53.081509 18482 consensus_queue.cc:237] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.082477 18578 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.083626 18431 ts_tablet_manager.cc:1403] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.055s	user 0.033s	sys 0.015s
I20260709 12:17:53.084067 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:53.085609 18276 leader_election.cc:343] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.080328 18309 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.079284 18428 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:53.086452 18431 raft_consensus.cc:359] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.074625 18468 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.087196 18431 raft_consensus.cc:385] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.087610 18431 raft_consensus.cc:740] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.088500 18431 consensus_queue.cc:260] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.090983 18431 ts_tablet_manager.cc:1434] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:53.092190 18428 tablet_bootstrap.cc:654] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.092361 18431 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.086001 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:17:53.097182 18275 leader_election.cc:343] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.097638 18275 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.098729 18431 tablet_bootstrap.cc:654] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.098759 18578 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.103787 18430 tablet_bootstrap.cc:492] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:53.104884 18468 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.106910 18430 ts_tablet_manager.cc:1403] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.001s
I20260709 12:17:53.109628 18427 tablet_bootstrap.cc:492] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.109754 18436 consensus_queue.cc:1048] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.110154 18427 ts_tablet_manager.cc:1403] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.005s
I20260709 12:17:53.112591 18058 catalog_manager.cc:5697] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.125633 18438 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.126209 18438 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.127137 18383 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.128270 18438 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.128396 18464 consensus_queue.cc:1048] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.129381 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.130820 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.131493 18311 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
W20260709 12:17:53.132521 18350 leader_election.cc:343] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.135980 18444 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.138998 18427 raft_consensus.cc:359] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.139945 18427 raft_consensus.cc:385] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.140476 18427 raft_consensus.cc:740] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.142189 18430 raft_consensus.cc:359] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.147641 18430 raft_consensus.cc:385] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.148000 18430 raft_consensus.cc:740] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.146529 18427 consensus_queue.cc:260] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:53.139055 18275 consensus_peers.cc:597] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 -> Peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Couldn't send request to peer ef7fc80e188b4c458d42ec37740468df. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.153028 18427 ts_tablet_manager.cc:1434] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:17:53.138393 18350 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:53.154708 18427 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.155465 18430 consensus_queue.cc:260] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.158444 18578 consensus_queue.cc:1048] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:17:53.179530 18430 ts_tablet_manager.cc:1434] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.015s
I20260709 12:17:53.180802 18430 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:53.154944 18438 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.157366 18444 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:17:53.186218 18058 catalog_manager.cc:5697] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.187407 18438 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.187758 18431 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.198850 18431 ts_tablet_manager.cc:1403] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.007s
I20260709 12:17:53.204306 18427 tablet_bootstrap.cc:654] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.205771 18430 tablet_bootstrap.cc:654] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.163097 18464 consensus_queue.cc:1048] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:17:53.202263 18438 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.229544 18482 consensus_queue.cc:1048] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.228619 18431 raft_consensus.cc:359] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.231597 18431 raft_consensus.cc:385] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.231912 18431 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.236452 18428 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:53.237047 18428 ts_tablet_manager.cc:1403] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.024s
I20260709 12:17:53.239545 18444 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.240065 18428 raft_consensus.cc:359] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.240852 18428 raft_consensus.cc:385] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.241142 18428 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.243722 18430 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:53.244235 18430 ts_tablet_manager.cc:1403] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.064s	user 0.005s	sys 0.008s
I20260709 12:17:53.247203 18428 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.248397 18430 raft_consensus.cc:359] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.248916 18430 raft_consensus.cc:385] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.249111 18430 raft_consensus.cc:740] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.247658 18431 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.251699 18430 consensus_queue.cc:260] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.254062 18430 ts_tablet_manager.cc:1434] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:17:53.256141 18464 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.256664 18464 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.236987 18427 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.261420 18427 ts_tablet_manager.cc:1403] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.002s
I20260709 12:17:53.271660 18468 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.272389 18468 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.279304 18431 ts_tablet_manager.cc:1434] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.003s
I20260709 12:17:53.240082 18444 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.284124 18428 ts_tablet_manager.cc:1434] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 12:17:53.282655 18464 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.296543 18428 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:53.296933 18436 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.308934 18436 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.311305 18436 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:17:53.309402 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 49452.1us
I20260709 12:17:53.316900 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.317871 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.323177 18431 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.327101 18430 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:53.329639 18468 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.326018 18539 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.330948 18539 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.333209 18539 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.333799 18427 raft_consensus.cc:359] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.334710 18427 raft_consensus.cc:385] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.335011 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:17:53.336649 18126 leader_election.cc:343] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.338603 18438 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.341950 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.342644 18438 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.344599 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.345319 18160 raft_consensus.cc:2468] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:53.335018 18427 raft_consensus.cc:740] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.347774 18427 consensus_queue.cc:260] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.346702 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:53.360474 18428 tablet_bootstrap.cc:654] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.359730 18444 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.360468 18310 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.365051 18431 tablet_bootstrap.cc:654] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.365103 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.366001 18385 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:53.369041 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.370106 18539 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:53.370795 18202 leader_election.cc:343] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.371656 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.371809 18482 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.370656 18539 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.375105 18539 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:53.359336 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:53.378779 18539 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:53.380844 18234 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.360090 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:53.382755 18427 ts_tablet_manager.cc:1434] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.002s
I20260709 12:17:53.371925 18202 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:53.388979 18201 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:53.389874 18482 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.390290 18482 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.390661 18482 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.391009 18527 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.391985 18599 consensus_queue.cc:1048] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.378360 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.398530 18482 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.403823 18383 raft_consensus.cc:2393] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:53.402670 18427 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.400085 18430 tablet_bootstrap.cc:654] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.404948 18482 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.407753 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.410612 18436 raft_consensus.cc:2804] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.413435 18234 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:53.415417 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:53.413645 18436 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.417827 18436 raft_consensus.cc:3060] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.421850 18126 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.423446 18468 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.424048 18350 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:17:53.424460 18201 leader_election.cc:343] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.425119 18490 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.425647 18490 raft_consensus.cc:697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:53.427157 18490 consensus_queue.cc:237] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.432361 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.437520 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:53.438156 18382 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.443861 18427 tablet_bootstrap.cc:654] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:53.445869 18201 leader_election.cc:343] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.461987 18382 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:53.455111 18430 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:53.458770 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.447110 18309 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.469049 18201 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:53.469144 18430 ts_tablet_manager.cc:1403] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.185s	user 0.009s	sys 0.008s
I20260709 12:17:53.470134 18607 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.463421 18606 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.470657 18607 raft_consensus.cc:697] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:53.472371 18599 consensus_queue.cc:1048] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.465091 18490 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.473568 18490 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.454209 18436 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.477403 18234 raft_consensus.cc:2393] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:53.479442 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.480578 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.482766 18444 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.483268 18444 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.483752 18436 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.414366 18310 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:53.482197 18490 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.485487 18431 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.485983 18431 ts_tablet_manager.cc:1403] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.163s	user 0.036s	sys 0.042s
I20260709 12:17:53.486171 18444 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.488657 18428 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:53.489218 18428 ts_tablet_manager.cc:1403] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.004s
I20260709 12:17:53.490128 18350 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:53.491393 18431 raft_consensus.cc:359] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.492126 18431 raft_consensus.cc:385] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.492450 18431 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.474124 18430 raft_consensus.cc:359] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.494314 18430 raft_consensus.cc:385] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.494653 18430 raft_consensus.cc:740] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.491894 18468 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.488869 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.498996 18431 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:53.501333 18127 leader_election.cc:343] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.501271 18430 consensus_queue.cc:260] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.503036 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:17:53.503844 18202 leader_election.cc:343] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.504328 18202 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.505069 18436 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:53.505491 18202 leader_election.cc:343] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.506956 18430 ts_tablet_manager.cc:1434] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:17:53.513530 18127 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.514364 18468 raft_consensus.cc:3060] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.515374 18427 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.515913 18427 ts_tablet_manager.cc:1403] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.000s
I20260709 12:17:53.516047 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:53.509115 18490 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.518359 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.519066 18237 raft_consensus.cc:2468] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:53.521580 18127 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:53.522723 18547 raft_consensus.cc:2804] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.522927 18468 raft_consensus.cc:2749] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.523103 18547 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.523540 18547 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.527043 18427 raft_consensus.cc:359] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.525722 18428 raft_consensus.cc:359] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.527820 18428 raft_consensus.cc:385] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.527676 18427 raft_consensus.cc:385] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.528419 18427 raft_consensus.cc:740] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.529197 18427 consensus_queue.cc:260] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:53.525964 18201 leader_election.cc:343] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.532009 18427 ts_tablet_manager.cc:1434] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:17:53.533238 18427 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.528097 18428 raft_consensus.cc:740] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.534893 18428 consensus_queue.cc:260] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.531872 18310 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.536851 18428 ts_tablet_manager.cc:1434] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:17:53.537876 18428 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:53.542724 18427 tablet_bootstrap.cc:654] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.544899 18428 tablet_bootstrap.cc:654] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.539757 18159 raft_consensus.cc:2468] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:53.497803 18607 consensus_queue.cc:237] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.549971 18431 ts_tablet_manager.cc:1434] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:17:53.551028 18431 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.552170 18430 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:53.554828 18436 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.556665 18202 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.558190 18436 raft_consensus.cc:2804] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.560150 18436 raft_consensus.cc:697] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:53.565156 18431 tablet_bootstrap.cc:654] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.562644 18436 consensus_queue.cc:237] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.571166 18058 catalog_manager.cc:5697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.571684 18547 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.585834 18427 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.586503 18427 ts_tablet_manager.cc:1403] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.005s
I20260709 12:17:53.578892 18464 consensus_queue.cc:1048] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:17:53.601126 18539 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:53.612084 18547 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:53.612241 18430 tablet_bootstrap.cc:654] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.612939 18464 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.613464 18464 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.619199 18431 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.619858 18431 ts_tablet_manager.cc:1403] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.002s
I20260709 12:17:53.629308 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:53.630004 18309 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.635025 18464 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.635566 18057 catalog_manager.cc:5697] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.636611 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:53.637203 18237 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.637908 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.641233 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.644343 18482 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.645262 18237 raft_consensus.cc:2468] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:53.636332 18427 raft_consensus.cc:359] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.653321 18427 raft_consensus.cc:385] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.653585 18427 raft_consensus.cc:740] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.659832 18428 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:53.660384 18428 ts_tablet_manager.cc:1403] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.007s
I20260709 12:17:53.663637 18431 raft_consensus.cc:359] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.664332 18431 raft_consensus.cc:385] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.664590 18431 raft_consensus.cc:740] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.665205 18431 consensus_queue.cc:260] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.666144 18428 raft_consensus.cc:359] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.666883 18428 raft_consensus.cc:385] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.667135 18428 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.667517 18427 consensus_queue.cc:260] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.667781 18428 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.669706 18427 ts_tablet_manager.cc:1434] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.000s
I20260709 12:17:53.669708 18428 ts_tablet_manager.cc:1434] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:17:53.673374 18427 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.676573 18058 catalog_manager.cc:5697] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:53.678278 18464 consensus_queue.cc:1048] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.691507 18431 ts_tablet_manager.cc:1434] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.004s
I20260709 12:17:53.670790 18160 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:53.692514 18127 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:53.695212 18444 raft_consensus.cc:2804] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.695739 18444 raft_consensus.cc:697] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:53.696537 18444 consensus_queue.cc:237] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.706241 18428 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:53.713902 18431 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.714133 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:53.715021 18578 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:53.715408 18578 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:17:53.715731 18578 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.705416 18309 raft_consensus.cc:2468] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:53.727128 18578 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.729984 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:53.732997 18428 tablet_bootstrap.cc:654] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.733163 18430 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:53.733696 18430 ts_tablet_manager.cc:1403] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.007s
I20260709 12:17:53.737941 18430 raft_consensus.cc:359] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.738662 18430 raft_consensus.cc:385] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.739017 18431 tablet_bootstrap.cc:654] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.738947 18430 raft_consensus.cc:740] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.739917 18430 consensus_queue.cc:260] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.740887 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:53.741421 18430 ts_tablet_manager.cc:1434] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:53.742498 18430 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:53.731607 18578 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.748529 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:53.751116 18430 tablet_bootstrap.cc:654] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.749581 18058 catalog_manager.cc:5697] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.757402 18382 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.750353 18578 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:53.763298 18309 raft_consensus.cc:1240] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:53.763960 18427 tablet_bootstrap.cc:654] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.769676 18607 consensus_queue.cc:1059] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.770635 18607 raft_consensus.cc:3055] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:53.770960 18607 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:53.780028 18428 tablet_bootstrap.cc:492] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:53.780597 18428 ts_tablet_manager.cc:1403] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.088s	user 0.006s	sys 0.009s
I20260709 12:17:53.785418 18428 raft_consensus.cc:359] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.786165 18428 raft_consensus.cc:385] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.786561 18444 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.772017 18607 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.787149 18444 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.789335 18607 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:53.790004 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.790839 18385 raft_consensus.cc:2393] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:53.795251 18490 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.795790 18490 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.796159 18444 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.791900 18428 raft_consensus.cc:740] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.797161 18428 consensus_queue.cc:260] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.798791 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.799443 18428 ts_tablet_manager.cc:1434] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:17:53.799654 18490 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.801972 18428 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:53.802002 18127 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.804719 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.805083 18547 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.805583 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.806232 18309 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:53.807518 18350 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:53.808475 18598 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.808851 18598 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.809167 18598 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.812147 18547 raft_consensus.cc:2749] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:53.809180 18350 leader_election.cc:343] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.802536 18444 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.822566 18431 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:53.823115 18431 ts_tablet_manager.cc:1403] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.009s
I20260709 12:17:53.820991 18444 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.832659 18598 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.836252 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.836946 18309 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:53.837575 18598 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:53.838711 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:53.839035 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:53.839506 18309 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.839975 18127 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:53.841183 18427 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:53.841686 18427 ts_tablet_manager.cc:1403] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.007s
I20260709 12:17:53.841838 18428 tablet_bootstrap.cc:654] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.836798 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.844394 18444 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:53.844544 18547 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:53.845512 18547 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.845709 18430 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:53.845986 18547 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.847038 18431 raft_consensus.cc:359] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.847733 18431 raft_consensus.cc:385] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.847991 18431 raft_consensus.cc:740] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.846226 18430 ts_tablet_manager.cc:1403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.013s
W20260709 12:17:53.848838 18126 leader_election.cc:343] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.848668 18431 consensus_queue.cc:260] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.860558 18161 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.886947 18309 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:53.887526 18430 raft_consensus.cc:359] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.891878 18598 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:53.902544 18428 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:53.906520 18430 raft_consensus.cc:385] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.906965 18428 ts_tablet_manager.cc:1403] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.003s
I20260709 12:17:53.907184 18430 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.908111 18430 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:53.901633 18161 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:53.911479 18350 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:53.910409 18431 ts_tablet_manager.cc:1434] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.003s
I20260709 12:17:53.902081 18547 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.909567 18607 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.913713 18607 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:53.903688 18126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 54860.2us
I20260709 12:17:53.915107 18431 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:53.917740 18607 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:53.902642 18427 raft_consensus.cc:359] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.918512 18427 raft_consensus.cc:385] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.920322 18427 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.921380 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:53.912477 18598 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.927109 18598 raft_consensus.cc:697] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:53.924755 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:53.927930 18598 consensus_queue.cc:237] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:53.928929 18202 leader_election.cc:343] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:53.930302 18201 leader_election.cc:343] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:53.910207 18430 ts_tablet_manager.cc:1434] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.061s	user 0.015s	sys 0.028s
I20260709 12:17:53.922226 18427 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.930773 18201 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:53.923520 18547 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:53.931792 18430 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:53.933167 18427 ts_tablet_manager.cc:1434] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.000s
I20260709 12:17:53.933009 18601 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:53.933943 18606 raft_consensus.cc:2749] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:53.934247 18427 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:53.924674 18431 tablet_bootstrap.cc:654] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.925071 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:53.943750 18382 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.909998 18428 raft_consensus.cc:359] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.926208 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:53.951483 18310 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.952579 18430 tablet_bootstrap.cc:654] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.953194 18598 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.953711 18598 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:53.955287 18382 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:53.949438 18427 tablet_bootstrap.cc:654] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:53.955955 18598 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:53.957580 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:53.958398 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:53.953209 18428 raft_consensus.cc:385] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:53.960143 18428 raft_consensus.cc:740] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:53.961198 18059 catalog_manager.cc:5697] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.958403 18161 raft_consensus.cc:2393] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:53.963971 18350 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:53.965667 18126 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:53.961309 18428 consensus_queue.cc:260] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.958405 18310 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:53.971261 18598 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.971836 18598 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:53.968221 18547 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:53.975075 18547 raft_consensus.cc:697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:53.976027 18547 consensus_queue.cc:237] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:53.968636 18601 raft_consensus.cc:3060] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:53.970402 18428 ts_tablet_manager.cc:1434] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:17:54.041505 18428 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.052074 18464 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.052606 18464 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.053822 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.054514 18234 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.055518 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.056090 18234 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:54.055709 18350 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.057269 18276 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:54.057591 18600 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.058058 18464 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.059613 18464 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:54.050534 18127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 76199.6us
I20260709 12:17:54.059809 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.057983 18600 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.062894 18600 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.066826 18607 consensus_queue.cc:1048] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.061019 18464 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.068008 18464 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.067207 18606 consensus_queue.cc:1048] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:54.071233 18428 tablet_bootstrap.cc:654] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.082882 18430 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.083433 18430 ts_tablet_manager.cc:1403] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.023s
I20260709 12:17:54.084209 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.086386 18430 raft_consensus.cc:359] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.090672 18430 raft_consensus.cc:385] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.090967 18430 raft_consensus.cc:740] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.091501 18600 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.091697 18430 consensus_queue.cc:260] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.092871 18384 raft_consensus.cc:2393] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:54.097043 18430 ts_tablet_manager.cc:1434] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:54.098240 18430 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.097965 18606 consensus_queue.cc:1048] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.101274 18464 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.079725 18598 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.104674 18430 tablet_bootstrap.cc:654] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.111792 18601 raft_consensus.cc:2749] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.123255 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:54.128621 18310 raft_consensus.cc:2393] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:54.131541 18606 consensus_queue.cc:1048] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:54.132699 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:54.133692 18234 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.137192 18606 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.137727 18606 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.140039 18606 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.141687 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.142470 18431 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.143019 18431 ts_tablet_manager.cc:1403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.228s	user 0.025s	sys 0.014s
I20260709 12:17:54.142362 18058 catalog_manager.cc:5697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:54.143849 18202 leader_election.cc:343] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.143144 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.144665 18427 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.145124 18427 ts_tablet_manager.cc:1403] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.022s
W20260709 12:17:54.145675 18202 leader_election.cc:343] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.146134 18202 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:54.147220 18606 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.140345 18547 consensus_queue.cc:1048] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:54.151626 18234 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:54.158202 18350 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.158506 18464 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.159405 18598 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.159801 18598 raft_consensus.cc:697] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:54.160584 18598 consensus_queue.cc:237] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.161538 18431 raft_consensus.cc:359] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.162211 18431 raft_consensus.cc:385] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.166394 18431 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.167340 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:54.165584 18427 raft_consensus.cc:359] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.167975 18427 raft_consensus.cc:385] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.154708 18600 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.168182 18237 raft_consensus.cc:2393] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:54.167235 18431 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.169783 18431 ts_tablet_manager.cc:1434] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.005s
I20260709 12:17:54.172304 18431 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.172185 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:54.173429 18310 raft_consensus.cc:2393] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:54.168228 18427 raft_consensus.cc:740] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.178452 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:54.208101 18444 consensus_queue.cc:1048] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.220602 18431 tablet_bootstrap.cc:654] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.223984 18427 consensus_queue.cc:260] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.230463 18427 ts_tablet_manager.cc:1434] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 12:17:54.242147 18427 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.236521 18275 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:54.246469 18464 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.249012 18427 tablet_bootstrap.cc:654] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.249212 18607 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.249770 18607 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.251894 18607 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.238656 18431 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.252600 18431 ts_tablet_manager.cc:1403] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.003s
I20260709 12:17:54.253077 18428 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.253619 18428 ts_tablet_manager.cc:1403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.273s	user 0.013s	sys 0.032s
I20260709 12:17:54.254388 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:54.256032 18202 leader_election.cc:343] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.256109 18431 raft_consensus.cc:359] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.256984 18431 raft_consensus.cc:385] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.257323 18431 raft_consensus.cc:740] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.257418 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.259550 18430 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.257138 18428 raft_consensus.cc:359] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.260490 18058 catalog_manager.cc:5697] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.262260 18428 raft_consensus.cc:385] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.262655 18428 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.262358 18430 ts_tablet_manager.cc:1403] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.164s	user 0.026s	sys 0.016s
I20260709 12:17:54.265687 18430 raft_consensus.cc:359] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.266306 18430 raft_consensus.cc:385] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.266851 18430 raft_consensus.cc:740] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
W20260709 12:17:54.267392 18202 leader_election.cc:343] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.267513 18430 consensus_queue.cc:260] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.267580 18428 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.268051 18202 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:54.269578 18606 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.270027 18430 ts_tablet_manager.cc:1434] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:54.271137 18427 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.271168 18430 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.269930 18428 ts_tablet_manager.cc:1434] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:17:54.272176 18431 consensus_queue.cc:260] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.272825 18428 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.271625 18427 ts_tablet_manager.cc:1403] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.001s
I20260709 12:17:54.274595 18431 ts_tablet_manager.cc:1434] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:17:54.275641 18431 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.283480 18427 raft_consensus.cc:359] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.284166 18427 raft_consensus.cc:385] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.284433 18427 raft_consensus.cc:740] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.279085 18428 tablet_bootstrap.cc:654] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.281003 18430 tablet_bootstrap.cc:654] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.289876 18431 tablet_bootstrap.cc:654] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.290352 18427 consensus_queue.cc:260] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.292564 18427 ts_tablet_manager.cc:1434] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:17:54.293619 18427 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.305632 18427 tablet_bootstrap.cc:654] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.307981 18430 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.308033 18428 tablet_bootstrap.cc:492] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.308738 18430 ts_tablet_manager.cc:1403] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 12:17:54.308804 18428 ts_tablet_manager.cc:1403] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:17:54.311648 18431 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.312381 18431 ts_tablet_manager.cc:1403] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 12:17:54.311959 18428 raft_consensus.cc:359] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.312813 18428 raft_consensus.cc:385] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.313097 18428 raft_consensus.cc:740] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.311648 18430 raft_consensus.cc:359] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.315197 18430 raft_consensus.cc:385] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.315557 18430 raft_consensus.cc:740] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.317945 18431 raft_consensus.cc:359] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.318867 18430 consensus_queue.cc:260] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.313897 18428 consensus_queue.cc:260] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.325915 18428 ts_tablet_manager.cc:1434] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:17:54.327035 18428 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.327804 18598 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.328349 18598 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.333073 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.333348 18598 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.333801 18310 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.335318 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.336016 18161 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.337041 18350 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.335319 18430 ts_tablet_manager.cc:1434] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:17:54.337602 18431 raft_consensus.cc:385] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.338369 18598 raft_consensus.cc:2804] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.338903 18598 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.339296 18598 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.339365 18430 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.341130 18427 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.341590 18427 ts_tablet_manager.cc:1403] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.012s
I20260709 12:17:54.344251 18427 raft_consensus.cc:359] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.344887 18427 raft_consensus.cc:385] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.345141 18427 raft_consensus.cc:740] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.345315 18431 raft_consensus.cc:740] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.345852 18427 consensus_queue.cc:260] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.346390 18598 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.347997 18427 ts_tablet_manager.cc:1434] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:54.338406 18428 tablet_bootstrap.cc:654] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.348456 18598 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.346334 18431 consensus_queue.cc:260] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.350243 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:54.350845 18161 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.351411 18431 ts_tablet_manager.cc:1434] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:17:54.352564 18427 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.355321 18430 tablet_bootstrap.cc:654] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.352388 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:54.357455 18161 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:54.357813 18310 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.359019 18431 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.360219 18350 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.361474 18601 raft_consensus.cc:2804] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.361925 18601 raft_consensus.cc:697] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:54.362980 18601 consensus_queue.cc:237] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.363610 18428 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.364094 18428 ts_tablet_manager.cc:1403] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:17:54.365095 18431 tablet_bootstrap.cc:654] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.366784 18428 raft_consensus.cc:359] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.367478 18428 raft_consensus.cc:385] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.367774 18428 raft_consensus.cc:740] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.370059 18427 tablet_bootstrap.cc:654] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.369942 18310 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:54.372496 18428 consensus_queue.cc:260] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.383769 18431 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.384512 18431 ts_tablet_manager.cc:1403] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:17:54.388348 18430 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.388935 18430 ts_tablet_manager.cc:1403] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.004s
I20260709 12:17:54.388765 18431 raft_consensus.cc:359] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.389623 18431 raft_consensus.cc:385] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.389917 18431 raft_consensus.cc:740] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.387652 18428 ts_tablet_manager.cc:1434] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:17:54.392138 18430 raft_consensus.cc:359] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.392921 18430 raft_consensus.cc:385] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.393239 18430 raft_consensus.cc:740] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.394029 18430 consensus_queue.cc:260] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.396473 18430 ts_tablet_manager.cc:1434] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:54.397639 18430 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.400053 18428 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.407347 18428 tablet_bootstrap.cc:654] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.387614 18601 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.409509 18601 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.410738 18431 consensus_queue.cc:260] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.412420 18430 tablet_bootstrap.cc:654] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.413142 18431 ts_tablet_manager.cc:1434] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.005s
I20260709 12:17:54.390107 18059 catalog_manager.cc:5697] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.425559 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.426317 18236 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.427717 18350 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.428583 18598 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.428992 18598 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.429344 18598 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.434520 18431 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.438076 18427 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.438678 18427 ts_tablet_manager.cc:1403] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.086s	user 0.026s	sys 0.031s
I20260709 12:17:54.439854 18598 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.441638 18427 raft_consensus.cc:359] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.442473 18427 raft_consensus.cc:385] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.442760 18427 raft_consensus.cc:740] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.443574 18427 consensus_queue.cc:260] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.446094 18427 ts_tablet_manager.cc:1434] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:54.447312 18427 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.448652 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.449434 18310 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.450969 18601 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.455463 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:54.452843 18431 tablet_bootstrap.cc:654] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.456877 18601 consensus_queue.cc:1048] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:17:54.456972 18598 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.453750 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:54.479081 18236 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.471410 18311 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.482457 18430 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.483132 18430 ts_tablet_manager.cc:1403] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.008s
I20260709 12:17:54.464346 18428 tablet_bootstrap.cc:492] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.485392 18428 ts_tablet_manager.cc:1403] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.022s
I20260709 12:17:54.485874 18430 raft_consensus.cc:359] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.486598 18430 raft_consensus.cc:385] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.486871 18430 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.488015 18428 raft_consensus.cc:359] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.488529 18428 raft_consensus.cc:385] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.488765 18428 raft_consensus.cc:740] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.467315 18427 tablet_bootstrap.cc:654] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.488884 18430 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.490588 18311 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:54.492309 18236 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:54.494311 18428 consensus_queue.cc:260] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.495540 18350 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.496673 18428 ts_tablet_manager.cc:1434] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:17:54.497952 18428 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.496592 18598 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.502800 18598 raft_consensus.cc:697] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:54.503697 18598 consensus_queue.cc:237] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.504937 18428 tablet_bootstrap.cc:654] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.508137 18430 ts_tablet_manager.cc:1434] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:17:54.509508 18483 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.509686 18444 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.510075 18483 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.510164 18444 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.512652 18430 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.513418 18483 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.513609 18490 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.514151 18490 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.515388 18444 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:54.516238 18490 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:54.517109 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.517802 18383 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:54.515656 18606 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.519052 18126 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.519282 18430 tablet_bootstrap.cc:654] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.519201 18606 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.519961 18444 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.520390 18444 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.520740 18444 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.521543 18606 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.519600 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.522908 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.523526 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.525184 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.525465 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.526114 18236 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
W20260709 12:17:54.527845 18202 leader_election.cc:343] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:54.529927 18127 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.530761 18309 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:54.532021 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.532841 18606 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.533551 18606 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.537451 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.542392 18431 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.542706 18127 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:54.542913 18431 ts_tablet_manager.cc:1403] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.006s
I20260709 12:17:54.542961 18606 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.544198 18483 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.544632 18483 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.544998 18483 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.547183 18444 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:17:54.549365 18350 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.549957 18161 raft_consensus.cc:2393] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:54.550077 18428 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.550561 18428 ts_tablet_manager.cc:1403] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.001s
I20260709 12:17:54.549377 18427 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.551849 18427 ts_tablet_manager.cc:1403] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.105s	user 0.024s	sys 0.021s
I20260709 12:17:54.553224 18350 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:54.547712 18431 raft_consensus.cc:359] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.553998 18431 raft_consensus.cc:385] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.554351 18431 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.555107 18431 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.556242 18490 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.557760 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:54.553172 18428 raft_consensus.cc:359] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.562538 18428 raft_consensus.cc:385] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.562845 18428 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.565730 18483 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:54.558082 18201 leader_election.cc:343] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.558513 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.566025 18428 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.566890 18383 raft_consensus.cc:2468] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:54.558947 18600 consensus_queue.cc:1048] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.568926 18201 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:54.569031 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:54.569921 18236 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.570600 18201 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.570772 18607 raft_consensus.cc:2749] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.571537 18607 raft_consensus.cc:2804] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.571930 18607 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.572252 18607 raft_consensus.cc:3060] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.573726 18490 raft_consensus.cc:2749] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:54.567756 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.576886 18311 raft_consensus.cc:2468] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:54.577718 18236 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:54.581528 18385 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:54.582576 18428 ts_tablet_manager.cc:1434] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:17:54.584102 18126 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.585063 18428 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.587754 18431 ts_tablet_manager.cc:1434] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:17:54.589471 18431 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.591012 18060 catalog_manager.cc:5697] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.592103 18428 tablet_bootstrap.cc:654] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.559727 18427 raft_consensus.cc:359] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.593869 18427 raft_consensus.cc:385] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.588155 18444 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:54.594257 18427 raft_consensus.cc:740] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.593999 18547 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:54.594370 18468 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.595165 18427 consensus_queue.cc:260] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.598866 18427 ts_tablet_manager.cc:1434] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:17:54.600452 18127 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:54.600716 18427 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.609887 18547 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.610527 18547 raft_consensus.cc:697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:54.611429 18547 consensus_queue.cc:237] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.603183 18431 tablet_bootstrap.cc:654] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.605772 18598 consensus_queue.cc:1048] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.608376 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:54.639245 18483 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:17:54.625458 18127 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.650645 18468 raft_consensus.cc:697] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:54.655851 18468 consensus_queue.cc:237] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.657027 18607 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.659497 18430 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.660153 18427 tablet_bootstrap.cc:654] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.661013 18598 consensus_queue.cc:1048] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.661999 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:54.666712 18430 ts_tablet_manager.cc:1403] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.011s
I20260709 12:17:54.672945 18430 raft_consensus.cc:359] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.673650 18430 raft_consensus.cc:385] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.675604 18428 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.676189 18428 ts_tablet_manager.cc:1403] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.016s
I20260709 12:17:54.674611 18430 raft_consensus.cc:740] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.673396 18308 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.678519 18430 consensus_queue.cc:260] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.688722 18428 raft_consensus.cc:359] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.690836 18428 raft_consensus.cc:385] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.690986 18430 ts_tablet_manager.cc:1434] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:17:54.691174 18428 raft_consensus.cc:740] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.700620 18428 consensus_queue.cc:260] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.704074 18431 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.704500 18431 ts_tablet_manager.cc:1403] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.007s
I20260709 12:17:54.705233 18430 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.709528 18428 ts_tablet_manager.cc:1434] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 12:17:54.709851 18427 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:54.710582 18427 ts_tablet_manager.cc:1403] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.009s
I20260709 12:17:54.714092 18431 raft_consensus.cc:359] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.724809 18607 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.726079 18673 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:54.714865 18431 raft_consensus.cc:385] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.728508 18431 raft_consensus.cc:740] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.729486 18431 consensus_queue.cc:260] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.730669 18308 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:54.732743 18428 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.738413 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:54.739176 18382 raft_consensus.cc:3060] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.731014 18431 ts_tablet_manager.cc:1434] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:17:54.750056 18427 raft_consensus.cc:359] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.750844 18427 raft_consensus.cc:385] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.751103 18427 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.754539 18427 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.743180 18464 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.742982 18627 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.762063 18427 ts_tablet_manager.cc:1434] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:17:54.767393 18431 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:54.770046 18427 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:54.764325 18464 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.774993 18607 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.783543 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:54.765769 18627 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.796876 18430 tablet_bootstrap.cc:654] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.801890 18468 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.803898 18468 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.806088 18468 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:54.803212 18310 raft_consensus.cc:3060] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:54.810267 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 51979.3us
I20260709 12:17:54.794275 18607 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.823804 18382 raft_consensus.cc:2468] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:54.827498 18428 tablet_bootstrap.cc:654] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.829200 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.829893 18307 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:54.833563 18684 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.833753 18600 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.834157 18684 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.834270 18600 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.836436 18684 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.837543 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.838253 18160 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:54.839644 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.840307 18234 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:54.841801 18627 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.842409 18607 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.839509 18600 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:54.840433 18276 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:54.846441 18431 tablet_bootstrap.cc:654] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.848860 18060 catalog_manager.cc:5697] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.849454 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.852294 18160 raft_consensus.cc:2468] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.852169 18060 catalog_manager.cc:5697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.833484 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.851912 18464 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:54.855005 18684 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.866882 18684 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.867277 18684 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.865284 18350 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:17:54.854316 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 78563.5us
I20260709 12:17:54.874624 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.874972 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.875675 18383 raft_consensus.cc:2468] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:54.878646 18201 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.878695 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.864156 18161 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:54.879817 18681 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.880646 18600 raft_consensus.cc:2804] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.880863 18310 raft_consensus.cc:2468] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:54.882584 18236 raft_consensus.cc:2468] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.892961 18430 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:54.895736 18430 ts_tablet_manager.cc:1403] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.004s
I20260709 12:17:54.889763 18681 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.890086 18600 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.894965 18598 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.891472 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:54.907928 18427 tablet_bootstrap.cc:654] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.899891 18430 raft_consensus.cc:359] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.912221 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:54.903407 18598 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.920600 18598 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:54.921257 18385 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:54.922188 18430 raft_consensus.cc:385] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.922657 18430 raft_consensus.cc:740] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.904007 18234 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:54.915803 18490 consensus_queue.cc:1048] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:17:54.901641 18600 raft_consensus.cc:3060] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.925201 18430 consensus_queue.cc:260] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:54.892697 18201 leader_election.cc:343] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:54.927155 18430 ts_tablet_manager.cc:1434] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:17:54.927975 18428 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:54.928535 18428 ts_tablet_manager.cc:1403] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.196s	user 0.021s	sys 0.007s
I20260709 12:17:54.900512 18276 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:54.930214 18464 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.930603 18464 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.930923 18464 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.902374 18681 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:54.931377 18201 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.891965 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.932153 18160 raft_consensus.cc:2468] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:54.933271 18607 raft_consensus.cc:2804] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.933722 18607 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.934062 18607 raft_consensus.cc:3060] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.934343 18428 raft_consensus.cc:359] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.935034 18428 raft_consensus.cc:385] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:54.935298 18428 raft_consensus.cc:740] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:54.888756 18685 raft_consensus.cc:2804] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:54.935912 18428 consensus_queue.cc:260] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:54.936422 18685 raft_consensus.cc:697] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:54.937270 18685 consensus_queue.cc:237] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:54.938400 18428 ts_tablet_manager.cc:1434] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:54.939405 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.940650 18428 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:54.909019 18127 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:54.928186 18430 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:54.912271 18431 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:54.945624 18431 ts_tablet_manager.cc:1403] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.004s
I20260709 12:17:54.945955 18468 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.943729 18464 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:54.956491 18468 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.961810 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.967782 18468 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.971364 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:54.978618 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:54.984779 18161 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:54.982213 18430 tablet_bootstrap.cc:654] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:54.994470 18350 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:54.995504 18598 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:54.995916 18598 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.996258 18598 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:54.997627 18600 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:54.998135 18683 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.998682 18683 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.001044 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.004143 18683 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:55.007110 18607 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.007561 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.008216 18236 raft_consensus.cc:2468] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:55.009243 18276 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.010154 18683 raft_consensus.cc:2804] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:55.011119 18202 leader_election.cc:343] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.011612 18202 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.012275 18431 raft_consensus.cc:359] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.012661 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.010630 18683 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.013986 18683 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.018772 18431 raft_consensus.cc:385] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.019408 18431 raft_consensus.cc:740] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.020114 18431 consensus_queue.cc:260] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.020525 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.021334 18236 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.010624 18464 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.024926 18627 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.026769 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.028410 18692 consensus_queue.cc:1048] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:55.028549 18275 leader_election.cc:343] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:55.030506 18201 leader_election.cc:343] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.013281 18468 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.032157 18161 raft_consensus.cc:2393] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:55.033298 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:55.034308 18693 consensus_queue.cc:1048] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:55.034359 18684 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.036051 18600 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.036273 18310 raft_consensus.cc:2393] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:55.036881 18385 raft_consensus.cc:2393] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:55.037674 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.038614 18234 raft_consensus.cc:2393] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:55.039165 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.039665 18468 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:17:55.040058 18202 leader_election.cc:343] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.040539 18202 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.041265 18627 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.041188 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.039875 18160 raft_consensus.cc:3060] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.037935 18598 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.023836 18607 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.043979 18202 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.044642 18428 tablet_bootstrap.cc:654] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.049804 18607 raft_consensus.cc:2749] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.050531 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.051290 18310 raft_consensus.cc:2393] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:55.053931 18683 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.056097 18468 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.057634 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.057916 18683 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:55.058390 18234 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.059350 18607 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.059885 18607 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.061022 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.061654 18162 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.061911 18607 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.062306 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:17:55.063683 18275 leader_election.cc:343] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.057639 18236 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:55.066308 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.066776 18276 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:55.067152 18237 raft_consensus.cc:2393] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:55.067814 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.046365 18598 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.072620 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.074028 18431 ts_tablet_manager.cc:1434] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.121s	user 0.004s	sys 0.002s
I20260709 12:17:55.075131 18431 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:55.075302 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.076646 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.078912 18427 tablet_bootstrap.cc:492] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:55.079473 18427 ts_tablet_manager.cc:1403] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.313s	user 0.014s	sys 0.004s
I20260709 12:17:55.066841 18684 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.087105 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:55.087740 18234 raft_consensus.cc:2468] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:55.088007 18385 raft_consensus.cc:2393] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:55.071100 18683 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.089835 18275 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.082162 18427 raft_consensus.cc:359] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.090272 18276 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.091198 18690 raft_consensus.cc:2749] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.090603 18427 raft_consensus.cc:385] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.092872 18427 raft_consensus.cc:740] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.093278 18689 raft_consensus.cc:2804] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.093806 18689 raft_consensus.cc:697] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:55.093618 18427 consensus_queue.cc:260] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.098014 18689 consensus_queue.cc:237] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.100301 18431 tablet_bootstrap.cc:654] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.090447 18683 raft_consensus.cc:697] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:55.101727 18600 consensus_queue.cc:1048] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.102797 18683 consensus_queue.cc:237] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.106307 18058 catalog_manager.cc:5697] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.094228 18162 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:55.113869 18430 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:55.114488 18430 ts_tablet_manager.cc:1403] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.010s
I20260709 12:17:55.117070 18427 ts_tablet_manager.cc:1434] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:17:55.121671 18427 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:55.126232 18350 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.127540 18600 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.128037 18600 raft_consensus.cc:697] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:55.128886 18600 consensus_queue.cc:237] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.142702 18430 raft_consensus.cc:359] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.143499 18430 raft_consensus.cc:385] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.143781 18430 raft_consensus.cc:740] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.144493 18430 consensus_queue.cc:260] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.150104 18430 ts_tablet_manager.cc:1434] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:17:55.161298 18430 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:55.165455 18427 tablet_bootstrap.cc:654] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.152607 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.169247 18685 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:55.170080 18428 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.170651 18428 ts_tablet_manager.cc:1403] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.230s	user 0.016s	sys 0.004s
I20260709 12:17:55.173346 18428 raft_consensus.cc:359] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.176154 18428 raft_consensus.cc:385] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.176445 18428 raft_consensus.cc:740] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.177455 18428 consensus_queue.cc:260] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.180658 18696 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:55.182468 18689 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.183063 18689 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.184051 18428 ts_tablet_manager.cc:1434] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:17:55.187356 18428 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:55.194610 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.197197 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.197907 18428 tablet_bootstrap.cc:654] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:55.199090 18275 leader_election.cc:343] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.190687 18689 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:17:55.200140 18276 leader_election.cc:343] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.200651 18276 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.202075 18683 raft_consensus.cc:2749] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.210798 18468 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:17:55.211498 18468 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.211618 18127 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.212611 18696 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.213963 18696 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.214546 18468 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.210762 18160 raft_consensus.cc:2468] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:55.225221 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.214496 18696 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.246990 18310 raft_consensus.cc:2393] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:55.251722 18430 tablet_bootstrap.cc:654] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.252941 18444 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:55.253561 18350 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
W20260709 12:17:55.246177 18704 log.cc:927] Time spent T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:17:55.253988 18058 catalog_manager.cc:5697] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.271514 18696 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.276552 18600 raft_consensus.cc:2804] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.282181 18600 raft_consensus.cc:697] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:55.283138 18600 consensus_queue.cc:237] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.284785 18427 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:55.285192 18427 ts_tablet_manager.cc:1403] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.164s	user 0.040s	sys 0.045s
I20260709 12:17:55.287791 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.288542 18310 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:55.289314 18427 raft_consensus.cc:359] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.290055 18427 raft_consensus.cc:385] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.289294 18234 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.291352 18127 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.297809 18607 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.298380 18607 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.299407 18428 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.299942 18428 ts_tablet_manager.cc:1403] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.025s
I20260709 12:17:55.300475 18607 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.301623 18696 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.302057 18696 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.302416 18696 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.302732 18428 raft_consensus.cc:359] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.303452 18428 raft_consensus.cc:385] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.303720 18428 raft_consensus.cc:740] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.304395 18428 consensus_queue.cc:260] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.290271 18427 raft_consensus.cc:740] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.308326 18427 consensus_queue.cc:260] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.311741 18428 ts_tablet_manager.cc:1434] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:55.312995 18428 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:55.314294 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.315034 18237 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:17:55.321173 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.337271 18427 ts_tablet_manager.cc:1434] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:17:55.346371 18058 catalog_manager.cc:5697] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.354151 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.355967 18427 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:55.356976 18431 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:55.357436 18431 ts_tablet_manager.cc:1403] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.027s
I20260709 12:17:55.357788 18127 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
W20260709 12:17:55.363415 18202 leader_election.cc:343] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.364091 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.365486 18310 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:55.367278 18202 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:55.368150 18607 raft_consensus.cc:2804] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.368526 18607 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.368848 18607 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.369827 18600 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.370349 18600 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.372323 18600 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.372471 18468 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:55.374954 18468 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:17:55.375286 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.375474 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.376120 18237 raft_consensus.cc:2393] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
W20260709 12:17:55.365844 18127 leader_election.cc:343] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.378916 18350 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.377856 18431 raft_consensus.cc:359] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.379803 18431 raft_consensus.cc:385] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.381287 18600 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.382861 18431 raft_consensus.cc:740] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.383193 18059 catalog_manager.cc:5697] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:55.384933 18431 consensus_queue.cc:260] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.387686 18696 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.387118 18059 catalog_manager.cc:5697] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.389925 18696 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.375378 18468 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.407131 18431 ts_tablet_manager.cc:1434] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:17:55.411818 18547 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:55.416249 18431 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:55.416949 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.417594 18310 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.414239 18430 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:55.421973 18430 ts_tablet_manager.cc:1403] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.265s	user 0.024s	sys 0.005s
I20260709 12:17:55.426625 18428 tablet_bootstrap.cc:654] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.426208 18430 raft_consensus.cc:359] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.427048 18430 raft_consensus.cc:385] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.427287 18430 raft_consensus.cc:740] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.431356 18427 tablet_bootstrap.cc:654] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.432186 18430 consensus_queue.cc:260] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.410413 18600 raft_consensus.cc:2749] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.438774 18431 tablet_bootstrap.cc:654] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.413698 18607 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.442203 18689 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.442730 18689 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.444756 18689 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.446568 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.446784 18607 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.447504 18468 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:55.448019 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:55.448617 18160 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:17:55.450397 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.450626 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.451082 18235 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:17:55.452335 18468 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.454113 18430 ts_tablet_manager.cc:1434] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:17:55.455067 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.455945 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.451327 18307 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.456851 18309 raft_consensus.cc:2393] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:55.458454 18689 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:55.458887 18689 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.459225 18689 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.459396 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.460101 18234 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.463289 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.464017 18310 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:55.464253 18307 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
W20260709 12:17:55.465266 18202 leader_election.cc:343] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.466130 18202 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:55.466355 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.466995 18607 raft_consensus.cc:2804] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.467484 18607 raft_consensus.cc:697] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:55.468336 18607 consensus_queue.cc:237] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.474870 18430 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:55.475550 18235 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:17:55.476805 18127 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.478531 18468 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:55.479215 18468 raft_consensus.cc:697] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:55.480073 18468 consensus_queue.cc:237] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.489481 18127 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.490312 18547 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.490839 18547 raft_consensus.cc:697] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:55.491639 18547 consensus_queue.cc:237] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.492956 18234 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:55.495060 18431 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:55.495720 18431 ts_tablet_manager.cc:1403] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.026s
I20260709 12:17:55.492986 18689 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.503491 18431 raft_consensus.cc:359] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.504287 18431 raft_consensus.cc:385] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.504555 18431 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.504616 18430 tablet_bootstrap.cc:654] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.505276 18431 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.507419 18431 ts_tablet_manager.cc:1434] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:55.519796 18431 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:55.521766 18059 catalog_manager.cc:5697] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.527927 18058 catalog_manager.cc:5697] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.532480 18428 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.533094 18428 ts_tablet_manager.cc:1403] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.220s	user 0.007s	sys 0.011s
I20260709 12:17:55.534607 18607 consensus_queue.cc:1048] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.536365 18428 raft_consensus.cc:359] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.537088 18428 raft_consensus.cc:385] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.537362 18428 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.538023 18428 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.541741 18428 ts_tablet_manager.cc:1434] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:55.549316 18689 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.554668 18428 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:55.557538 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.558243 18234 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.558360 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.559401 18059 catalog_manager.cc:5697] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.563907 18430 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:55.565631 18427 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:55.570504 18430 ts_tablet_manager.cc:1403] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.014s
I20260709 12:17:55.570844 18427 ts_tablet_manager.cc:1403] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.018s
I20260709 12:17:55.573215 18430 raft_consensus.cc:359] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.573951 18430 raft_consensus.cc:385] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.563068 18689 consensus_queue.cc:1048] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:17:55.574240 18430 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.574990 18430 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.578522 18430 ts_tablet_manager.cc:1434] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:55.579664 18430 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:55.575397 18427 raft_consensus.cc:359] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.581449 18427 raft_consensus.cc:385] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.581741 18427 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.582401 18427 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.584535 18427 ts_tablet_manager.cc:1434] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:17:55.585624 18427 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:55.588271 18234 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:17:55.590814 18431 tablet_bootstrap.cc:654] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.593811 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:55.597553 18428 tablet_bootstrap.cc:654] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.598322 18689 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:55.599340 18689 raft_consensus.cc:697] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:55.601351 18689 consensus_queue.cc:237] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.602618 18427 tablet_bootstrap.cc:654] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.611382 18685 consensus_queue.cc:1048] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:55.627851 18430 tablet_bootstrap.cc:654] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.618275 18683 consensus_queue.cc:1048] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:17:55.634233 18428 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.635957 18428 ts_tablet_manager.cc:1403] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.010s
I20260709 12:17:55.637452 18600 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.642573 18600 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.648100 18468 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.648694 18468 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.655460 18600 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.656131 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.656876 18307 raft_consensus.cc:2468] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:55.658733 18127 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.659552 18547 raft_consensus.cc:2804] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.659969 18547 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.660308 18547 raft_consensus.cc:3060] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.661643 18693 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.662912 18468 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:55.663810 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.664319 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.664925 18307 raft_consensus.cc:2468] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:55.665216 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.665827 18383 raft_consensus.cc:2468] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:55.669571 18350 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:55.673695 18600 raft_consensus.cc:2804] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.674192 18600 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.674628 18600 raft_consensus.cc:3060] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.698738 18428 raft_consensus.cc:359] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.702839 18428 raft_consensus.cc:385] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.705811 18060 catalog_manager.cc:5697] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:55.703262 18428 raft_consensus.cc:740] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.709404 18684 consensus_queue.cc:1048] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.710314 18547 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.682119 18600 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.716732 18428 consensus_queue.cc:260] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.727124 18430 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:55.727586 18430 ts_tablet_manager.cc:1403] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.148s	user 0.007s	sys 0.009s
W20260709 12:17:55.723832 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 86127us
I20260709 12:17:55.732998 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.736680 18428 ts_tablet_manager.cc:1434] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 12:17:55.733311 18600 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.737166 18307 raft_consensus.cc:3060] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.740444 18431 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:55.740674 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.739454 18160 raft_consensus.cc:2393] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:55.740868 18684 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.743158 18684 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.744397 18547 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:55.745415 18428 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:55.746759 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:55.747529 18383 raft_consensus.cc:2393] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:55.747416 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.745290 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:55.745630 18684 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:55.748426 18601 consensus_queue.cc:1048] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.740947 18431 ts_tablet_manager.cc:1403] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.004s
I20260709 12:17:55.750711 18126 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
W20260709 12:17:55.751257 18275 leader_election.cc:343] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.752730 18427 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:55.753238 18427 ts_tablet_manager.cc:1403] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.027s
I20260709 12:17:55.752839 18431 raft_consensus.cc:359] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.753640 18431 raft_consensus.cc:385] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.753912 18431 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.754151 18547 raft_consensus.cc:2749] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.756722 18601 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.756973 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.757617 18237 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:55.756778 18693 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.758524 18693 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.760069 18427 raft_consensus.cc:359] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.760768 18427 raft_consensus.cc:385] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.761014 18427 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.761693 18427 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.763336 18689 consensus_queue.cc:1048] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.764007 18307 raft_consensus.cc:2468] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:55.766552 18693 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.769066 18430 raft_consensus.cc:359] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.769842 18430 raft_consensus.cc:385] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.770103 18430 raft_consensus.cc:740] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.771718 18276 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.766623 18427 ts_tablet_manager.cc:1434] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:17:55.773380 18427 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:55.774893 18689 raft_consensus.cc:2804] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.775295 18689 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.775617 18689 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.777253 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:55.777935 18237 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:55.780627 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.781347 18162 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:55.783043 18428 tablet_bootstrap.cc:654] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.785744 18689 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.792133 18430 consensus_queue.cc:260] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.793062 18685 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.793577 18685 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.795921 18350 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:55.787248 18431 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.797832 18427 tablet_bootstrap.cc:654] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.797294 18600 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.799396 18600 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.799774 18600 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.803158 18431 ts_tablet_manager.cc:1434] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.003s
I20260709 12:17:55.802913 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.809090 18350 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:55.811009 18234 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.816298 18685 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:55.819391 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:55.821452 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.823076 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:55.812036 18689 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:17:55.824709 18202 leader_election.cc:343] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:55.825274 18202 leader_election.cc:343] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.825549 18202 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:55.810871 18601 raft_consensus.cc:2804] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.827271 18431 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
W20260709 12:17:55.828459 18275 leader_election.cc:343] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:55.830519 18430 ts_tablet_manager.cc:1434] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.005s
I20260709 12:17:55.828891 18600 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.837785 18600 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:55.826941 18685 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:55.842247 18234 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:55.849961 18276 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:55.850811 18689 raft_consensus.cc:2804] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.851303 18689 raft_consensus.cc:697] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:55.852120 18689 consensus_queue.cc:237] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.865577 18430 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:55.869517 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:55.871871 18235 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.872380 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.872833 18428 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.873035 18160 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.876550 18428 ts_tablet_manager.cc:1403] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.001s
I20260709 12:17:55.888722 18601 raft_consensus.cc:697] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:55.891047 18428 raft_consensus.cc:359] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.891573 18428 raft_consensus.cc:385] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.891779 18428 raft_consensus.cc:740] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.893342 18428 consensus_queue.cc:260] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.889783 18601 consensus_queue.cc:237] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.899374 18683 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.901226 18428 ts_tablet_manager.cc:1434] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:17:55.902102 18683 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.903275 18427 tablet_bootstrap.cc:492] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:55.903800 18427 ts_tablet_manager.cc:1403] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.007s
I20260709 12:17:55.904510 18428 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:55.890769 18598 consensus_queue.cc:1048] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:17:55.906596 18427 raft_consensus.cc:359] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.910072 18237 raft_consensus.cc:1240] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:55.911167 18427 raft_consensus.cc:385] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.911563 18427 raft_consensus.cc:740] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.912387 18427 consensus_queue.cc:260] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.916345 18428 tablet_bootstrap.cc:654] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.922011 18427 ts_tablet_manager.cc:1434] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:17:55.913043 18160 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:55.916108 18235 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:55.918807 18430 tablet_bootstrap.cc:654] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.924008 18431 tablet_bootstrap.cc:654] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.926311 18683 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.928377 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:55.929113 18160 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:55.930742 18276 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:55.931821 18732 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:55.932189 18732 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.932518 18732 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.938618 18468 consensus_queue.cc:1059] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.941358 18547 raft_consensus.cc:3055] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:55.941753 18547 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:55.942525 18547 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:55.942683 18732 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.945436 18427 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:55.946846 18350 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:55.947897 18598 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.948415 18598 raft_consensus.cc:697] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:55.949316 18547 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.949251 18598 consensus_queue.cc:237] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:55.954607 18732 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:55.955849 18058 catalog_manager.cc:5697] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.955904 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:55.957644 18160 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.959714 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:55.960377 18385 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:55.962517 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:55.963083 18385 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:55.964741 18468 consensus_queue.cc:1048] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.975286 18385 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:55.988207 18275 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:55.977463 18430 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:55.989302 18732 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:55.989655 18430 ts_tablet_manager.cc:1403] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 12:17:55.990418 18732 raft_consensus.cc:697] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:55.991379 18732 consensus_queue.cc:237] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:55.992520 18468 consensus_queue.cc:1048] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:55.979390 18428 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:55.993755 18428 ts_tablet_manager.cc:1403] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 12:17:55.996955 18428 raft_consensus.cc:359] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:55.997691 18428 raft_consensus.cc:385] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:55.997972 18428 raft_consensus.cc:740] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:55.986753 18427 tablet_bootstrap.cc:654] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:55.992942 18430 raft_consensus.cc:359] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.011701 18430 raft_consensus.cc:385] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.011998 18430 raft_consensus.cc:740] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.012683 18430 consensus_queue.cc:260] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.013921 18428 consensus_queue.cc:260] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.016106 18427 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.016628 18427 ts_tablet_manager.cc:1403] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.003s
I20260709 12:17:56.016829 18430 ts_tablet_manager.cc:1434] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 12:17:56.017884 18430 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:56.019304 18427 raft_consensus.cc:359] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.019994 18427 raft_consensus.cc:385] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.020258 18427 raft_consensus.cc:740] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.020598 18431 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.020936 18427 consensus_queue.cc:260] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.024772 18428 ts_tablet_manager.cc:1434] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:17:56.023487 18060 catalog_manager.cc:5697] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.025961 18428 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.026971 18430 tablet_bootstrap.cc:654] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.025924 18427 ts_tablet_manager.cc:1434] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:17:56.021116 18431 ts_tablet_manager.cc:1403] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.209s	user 0.029s	sys 0.012s
I20260709 12:17:56.034305 18428 tablet_bootstrap.cc:654] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.034332 18431 raft_consensus.cc:359] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.035332 18431 raft_consensus.cc:385] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.035631 18431 raft_consensus.cc:740] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.036372 18685 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.036334 18431 consensus_queue.cc:260] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.036482 18057 catalog_manager.cc:5697] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.033545 18427 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.037128 18685 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.039376 18431 ts_tablet_manager.cc:1434] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:17:56.041730 18685 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.040601 18161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:56.046360 18202 leader_election.cc:343] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.042842 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:56.047706 18431 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
W20260709 12:17:56.048095 18201 leader_election.cc:343] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.048600 18201 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:56.049033 18427 tablet_bootstrap.cc:654] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.049741 18685 raft_consensus.cc:2749] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.035751 18234 raft_consensus.cc:1275] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:56.052120 18732 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:56.053973 18428 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:56.054483 18428 ts_tablet_manager.cc:1403] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:17:56.057281 18428 raft_consensus.cc:359] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.057907 18428 raft_consensus.cc:385] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.058146 18428 raft_consensus.cc:740] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.059733 18428 consensus_queue.cc:260] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.062312 18427 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.062871 18427 ts_tablet_manager.cc:1403] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:17:56.065872 18428 ts_tablet_manager.cc:1434] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:17:56.066924 18428 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.072639 18428 tablet_bootstrap.cc:654] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.075122 18431 tablet_bootstrap.cc:654] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.075778 18427 raft_consensus.cc:359] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.082139 18427 raft_consensus.cc:385] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.082485 18427 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.083184 18427 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.085233 18427 ts_tablet_manager.cc:1434] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:17:56.086198 18427 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.090716 18159 raft_consensus.cc:1275] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:56.091133 18159 pending_rounds.cc:85] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Aborting all ops after (but not including) 1
I20260709 12:17:56.091375 18159 pending_rounds.cc:107] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:56.091655 18159 raft_consensus.cc:2889] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:56.092034 18427 tablet_bootstrap.cc:654] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.093176 18732 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.078540 18059 catalog_manager.cc:5697] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:56.098766 18202 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.104430 18427 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.106339 18427 ts_tablet_manager.cc:1403] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:17:56.106482 18607 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.107075 18607 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.109314 18427 raft_consensus.cc:359] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.110008 18427 raft_consensus.cc:385] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.110257 18427 raft_consensus.cc:740] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.110914 18427 consensus_queue.cc:260] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.111187 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:56.112923 18427 ts_tablet_manager.cc:1434] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:56.113067 18607 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.113945 18427 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
W20260709 12:17:56.113718 18201 leader_election.cc:343] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.116616 18742 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.117128 18742 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.120647 18742 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.122997 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:56.123467 18685 consensus_queue.cc:1048] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:56.124264 18202 leader_election.cc:343] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.124707 18202 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:56.125042 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.034619 18160 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:56.134172 18427 tablet_bootstrap.cc:654] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.130841 18607 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.146361 18431 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.149734 18431 ts_tablet_manager.cc:1403] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.006s
I20260709 12:17:56.149010 18732 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.154945 18732 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.155593 18431 raft_consensus.cc:359] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.156282 18431 raft_consensus.cc:385] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.156533 18431 raft_consensus.cc:740] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.156963 18732 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:56.144366 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.157284 18431 consensus_queue.cc:260] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.158145 18235 raft_consensus.cc:2393] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:56.161900 18350 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:56.163363 18692 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.164059 18598 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.164623 18598 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.171684 18692 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.176257 18692 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.176331 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.176806 18692 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.177683 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:56.178968 18692 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:17:56.180550 18276 leader_election.cc:343] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.184917 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:56.186470 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.183626 18598 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.187193 18234 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
W20260709 12:17:56.188287 18350 leader_election.cc:343] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.187575 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:56.191218 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:56.193027 18431 ts_tablet_manager.cc:1434] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:17:56.193990 18601 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.197686 18601 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.198022 18601 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.200205 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.200896 18309 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:56.193243 18160 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:56.202456 18428 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:56.202975 18428 ts_tablet_manager.cc:1403] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.136s	user 0.045s	sys 0.038s
W20260709 12:17:56.203114 18275 leader_election.cc:343] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.203152 18350 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:56.203594 18275 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:56.208758 18598 raft_consensus.cc:2804] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.211958 18598 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.212304 18598 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.212500 18428 raft_consensus.cc:359] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.213186 18428 raft_consensus.cc:385] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.213433 18428 raft_consensus.cc:740] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.214360 18428 consensus_queue.cc:260] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.215946 18683 raft_consensus.cc:2749] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.216361 18428 ts_tablet_manager.cc:1434] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:17:56.237488 18601 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.239964 18431 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:56.240362 18684 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.243359 18684 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.251215 18684 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.253072 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:56.255869 18276 leader_election.cc:343] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.258033 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.259209 18430 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:56.259733 18430 ts_tablet_manager.cc:1403] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.242s	user 0.018s	sys 0.018s
I20260709 12:17:56.264438 18598 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:56.261801 18276 leader_election.cc:343] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.265518 18431 tablet_bootstrap.cc:654] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.265810 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:56.267388 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:56.268802 18601 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.269357 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:56.267606 18684 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.268078 18308 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:56.275844 18350 leader_election.cc:343] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.269706 18732 consensus_queue.cc:1048] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.261801 18427 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.276721 18427 ts_tablet_manager.cc:1403] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.163s	user 0.027s	sys 0.000s
I20260709 12:17:56.280639 18431 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.281337 18431 ts_tablet_manager.cc:1403] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.004s
I20260709 12:17:56.270881 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:56.265419 18430 raft_consensus.cc:359] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.271745 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:56.283401 18159 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.284595 18431 raft_consensus.cc:359] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.285292 18431 raft_consensus.cc:385] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.285557 18431 raft_consensus.cc:740] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.286393 18431 consensus_queue.cc:260] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.288573 18431 ts_tablet_manager.cc:1434] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:56.289063 18430 raft_consensus.cc:385] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.289211 18308 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:56.289407 18430 raft_consensus.cc:740] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.290256 18430 consensus_queue.cc:260] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.292362 18430 ts_tablet_manager.cc:1434] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:17:56.293219 18350 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:56.292452 18159 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:56.294090 18601 raft_consensus.cc:2804] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:56.272069 18598 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.293134 18234 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.295215 18601 raft_consensus.cc:697] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:56.295789 18430 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:56.296089 18601 consensus_queue.cc:237] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.301141 18431 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:56.301493 18547 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.302034 18547 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.292335 18428 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.306823 18547 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.308583 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.308868 18428 tablet_bootstrap.cc:654] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.309324 18237 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:56.312052 18127 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:56.320317 18431 tablet_bootstrap.cc:654] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.332042 18444 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.324679 18692 consensus_queue.cc:1048] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:17:56.332626 18444 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.315374 18234 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:56.333055 18444 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.317291 18427 raft_consensus.cc:359] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.336365 18427 raft_consensus.cc:385] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.336645 18427 raft_consensus.cc:740] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.337288 18427 consensus_queue.cc:260] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.339359 18427 ts_tablet_manager.cc:1434] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.004s
I20260709 12:17:56.329941 18732 consensus_queue.cc:1048] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:17:56.340382 18427 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.339437 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:56.346987 18692 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:56.347889 18692 raft_consensus.cc:697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:56.348754 18692 consensus_queue.cc:237] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.350592 18427 tablet_bootstrap.cc:654] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.357350 18444 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.366915 18732 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.372928 18732 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.376194 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:56.377758 18276 leader_election.cc:343] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.380229 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.380930 18234 raft_consensus.cc:2468] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 0.
I20260709 12:17:56.382593 18276 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:56.383559 18684 raft_consensus.cc:2804] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.383916 18732 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.386670 18742 consensus_queue.cc:1048] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:56.390166 18444 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.312376 18430 tablet_bootstrap.cc:654] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.383985 18684 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.398000 18684 raft_consensus.cc:3060] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.327876 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.405006 18308 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
W20260709 12:17:56.406811 18764 log.cc:927] Time spent T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:17:56.416066 18059 catalog_manager.cc:5697] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.427026 18430 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:56.427937 18430 ts_tablet_manager.cc:1403] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.002s
I20260709 12:17:56.435799 18431 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.435514 18430 raft_consensus.cc:359] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.436269 18430 raft_consensus.cc:385] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.436305 18431 ts_tablet_manager.cc:1403] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.027s
I20260709 12:17:56.436760 18430 raft_consensus.cc:740] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.437604 18430 consensus_queue.cc:260] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.439091 18431 raft_consensus.cc:359] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.441744 18431 raft_consensus.cc:385] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.442022 18431 raft_consensus.cc:740] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.443512 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:56.444206 18235 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.444741 18431 consensus_queue.cc:260] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.446861 18431 ts_tablet_manager.cc:1434] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:56.447840 18431 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:56.454025 18431 tablet_bootstrap.cc:654] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.465842 18235 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:56.467893 18430 ts_tablet_manager.cc:1434] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 12:17:56.468540 18428 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:56.468261 18742 consensus_queue.cc:1048] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.471035 18428 ts_tablet_manager.cc:1403] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.179s	user 0.063s	sys 0.056s
I20260709 12:17:56.472235 18427 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.472738 18427 ts_tablet_manager.cc:1403] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.022s
I20260709 12:17:56.473606 18428 raft_consensus.cc:359] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.474300 18428 raft_consensus.cc:385] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.474581 18428 raft_consensus.cc:740] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.475308 18427 raft_consensus.cc:359] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.476125 18427 raft_consensus.cc:385] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.475867 18428 consensus_queue.cc:260] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.476423 18427 raft_consensus.cc:740] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.477144 18427 consensus_queue.cc:260] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.478329 18428 ts_tablet_manager.cc:1434] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:56.479418 18428 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.482405 18427 ts_tablet_manager.cc:1434] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:17:56.483538 18427 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.485559 18428 tablet_bootstrap.cc:654] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.489084 18427 tablet_bootstrap.cc:654] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.490065 18430 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:56.504983 18427 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.505537 18427 ts_tablet_manager.cc:1403] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:17:56.497679 18689 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:56.507018 18732 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.510162 18430 tablet_bootstrap.cc:654] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.512295 18427 raft_consensus.cc:359] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.514189 18427 raft_consensus.cc:385] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.514477 18427 raft_consensus.cc:740] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.515164 18427 consensus_queue.cc:260] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.537895 18427 ts_tablet_manager.cc:1434] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:17:56.541348 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:56.542034 18309 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.548444 18127 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:56.549386 18468 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:56.550088 18059 catalog_manager.cc:5697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.557283 18684 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.559681 18684 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.560886 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:56.561733 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
W20260709 12:17:56.562278 18276 leader_election.cc:343] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.562815 18428 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:56.563735 18235 raft_consensus.cc:3060] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.564004 18428 ts_tablet_manager.cc:1403] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.040s
I20260709 12:17:56.566900 18428 raft_consensus.cc:359] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.568938 18428 raft_consensus.cc:385] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.573210 18430 tablet_bootstrap.cc:492] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:56.573740 18430 ts_tablet_manager.cc:1403] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.012s
I20260709 12:17:56.576792 18430 raft_consensus.cc:359] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.578892 18430 raft_consensus.cc:385] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.581377 18430 raft_consensus.cc:740] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.579206 18741 raft_consensus.cc:493] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.581480 18598 consensus_queue.cc:1048] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:56.581987 18741 raft_consensus.cc:515] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.582232 18430 consensus_queue.cc:260] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.583953 18430 ts_tablet_manager.cc:1434] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
W20260709 12:17:56.581051 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:56.581674 18444 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.584501 18427 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.584774 18444 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.587208 18444 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.569202 18428 raft_consensus.cc:740] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.597584 18428 consensus_queue.cc:260] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.604589 18427 tablet_bootstrap.cc:654] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.584007 18741 leader_election.cc:290] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.610095 18428 ts_tablet_manager.cc:1434] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:17:56.611433 18428 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.617136 18428 tablet_bootstrap.cc:654] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.619199 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:17:56.622037 18350 leader_election.cc:343] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.626711 18430 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:56.643905 18598 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.644549 18598 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.656620 18431 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.657358 18431 ts_tablet_manager.cc:1403] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.210s	user 0.030s	sys 0.017s
I20260709 12:17:56.660353 18431 raft_consensus.cc:359] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.662415 18431 raft_consensus.cc:385] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.671049 18431 raft_consensus.cc:740] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.668426 18468 raft_consensus.cc:697] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:56.673982 18431 consensus_queue.cc:260] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.672927 18468 consensus_queue.cc:237] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.687852 18430 tablet_bootstrap.cc:654] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.689386 18431 ts_tablet_manager.cc:1434] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:17:56.680109 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.680747 18598 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.696260 18431 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:56.698354 18309 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:56.698508 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.704066 18310 raft_consensus.cc:2468] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
W20260709 12:17:56.702317 18350 leader_election.cc:343] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.706359 18350 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:56.707857 18598 raft_consensus.cc:2804] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.708254 18598 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.708604 18598 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.719542 18428 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:56.720237 18428 ts_tablet_manager.cc:1403] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.011s
I20260709 12:17:56.694306 18235 raft_consensus.cc:2468] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:17:56.722384 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:56.723237 18159 raft_consensus.cc:2468] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:56.726902 18427 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:56.727456 18427 ts_tablet_manager.cc:1403] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.006s
I20260709 12:17:56.729415 18350 leader_election.cc:304] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:56.733381 18742 raft_consensus.cc:2804] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.735991 18742 raft_consensus.cc:493] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.736162 18162 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.733582 18784 consensus_queue.cc:1048] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:56.740971 18742 raft_consensus.cc:3060] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.749370 18276 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:56.750514 18741 consensus_queue.cc:1048] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:56.751056 18689 raft_consensus.cc:2804] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:56.751652 18689 raft_consensus.cc:697] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:17:56.752470 18689 consensus_queue.cc:237] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.755470 18598 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.757141 18431 tablet_bootstrap.cc:654] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.760802 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
W20260709 12:17:56.762123 18127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 203964us
I20260709 12:17:56.760394 18742 raft_consensus.cc:515] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.760430 18428 raft_consensus.cc:359] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.771988 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.774485 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:17:56.774484 18350 leader_election.cc:343] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.768400 18428 raft_consensus.cc:385] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.787818 18428 raft_consensus.cc:740] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.787814 18058 catalog_manager.cc:5697] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.788897 18428 consensus_queue.cc:260] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.795096 18427 raft_consensus.cc:359] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.796089 18427 raft_consensus.cc:385] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.794063 18127 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:56.797364 18427 raft_consensus.cc:740] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.798738 18427 consensus_queue.cc:260] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.802167 18598 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.816305 18601 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.816901 18601 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.819028 18601 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:56.819916 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.816457 18627 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.821154 18627 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.824056 18234 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:56.826741 18627 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:56.832747 18428 ts_tablet_manager.cc:1434] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.002s
I20260709 12:17:56.833992 18468 raft_consensus.cc:2749] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:56.848809 18427 ts_tablet_manager.cc:1434] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 12:17:56.830036 18598 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.837611 18689 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.859985 18430 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:56.860651 18430 ts_tablet_manager.cc:1403] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.255s	user 0.027s	sys 0.019s
I20260709 12:17:56.845449 18742 leader_election.cc:290] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.865128 18428 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:56.880210 18427 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:56.884361 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.884961 18431 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:56.885051 18307 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:56.885546 18431 ts_tablet_manager.cc:1403] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.012s
I20260709 12:17:56.887363 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:56.888008 18384 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:56.890733 18431 raft_consensus.cc:359] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.891952 18431 raft_consensus.cc:385] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.892211 18431 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.892846 18431 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.894537 18431 ts_tablet_manager.cc:1434] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:56.906793 18431 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:56.858980 18598 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.862947 18689 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:56.928601 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:56.929090 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:56.938933 18306 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:56.930228 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:56.939716 18689 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:56.939874 18308 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.941952 18468 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.931993 18598 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.934111 18627 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.942389 18468 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.942943 18627 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:56.944892 18627 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.945382 18468 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:56.945940 18684 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.946448 18684 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:56.936691 18430 raft_consensus.cc:359] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:56.947690 18430 raft_consensus.cc:385] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:56.947980 18430 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:56.948318 18684 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:56.948663 18430 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:17:56.937728 18791 log.cc:927] Time spent T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:17:56.957922 18431 tablet_bootstrap.cc:654] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:56.958339 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:56.958874 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.950258 18430 ts_tablet_manager.cc:1434] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.089s	user 0.004s	sys 0.001s
W20260709 12:17:56.967679 18276 leader_election.cc:343] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:56.968524 18276 leader_election.cc:343] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:56.967675 18430 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:56.974875 18350 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:56.972189 18202 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:56.979610 18598 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.982369 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:56.983047 18234 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:56.980434 18741 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.984190 18127 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:56.981132 18627 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:56.993891 18350 leader_election.cc:343] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.002202 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:57.002939 18158 raft_consensus.cc:3060] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:56.991168 18741 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.994310 18781 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:56.994553 18627 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.981861 18598 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.006641 18741 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.008544 18781 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.027655 18598 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:57.029038 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.010545 18627 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.029768 18781 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.045841 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.016522 18308 raft_consensus.cc:2468] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:57.046959 18159 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.014416 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.018226 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.050951 18381 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:57.052568 18059 catalog_manager.cc:5697] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.056366 18160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.041246 18427 tablet_bootstrap.cc:654] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.041471 18162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.051095 18236 raft_consensus.cc:2468] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:57.058104 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.066828 18350 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:57.078528 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.079319 18234 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:57.081199 18797 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.081563 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.082278 18376 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:57.077790 18601 raft_consensus.cc:2804] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.085208 18601 raft_consensus.cc:697] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:57.086071 18601 consensus_queue.cc:237] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.092379 18431 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:57.093006 18431 ts_tablet_manager.cc:1403] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.186s	user 0.026s	sys 0.021s
I20260709 12:17:57.079010 18741 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.098829 18427 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:57.099115 18741 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:57.099356 18427 ts_tablet_manager.cc:1403] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.008s
I20260709 12:17:57.099805 18158 raft_consensus.cc:2468] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:57.100080 18781 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.102002 18427 raft_consensus.cc:359] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.102720 18427 raft_consensus.cc:385] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.102972 18427 raft_consensus.cc:740] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
W20260709 12:17:57.103101 18275 leader_election.cc:343] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.103539 18275 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.104775 18428 tablet_bootstrap.cc:654] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.104389 18427 consensus_queue.cc:260] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.109387 18201 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:57.110641 18684 raft_consensus.cc:2749] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.110587 18681 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:57.111685 18681 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.112012 18681 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.116165 18431 raft_consensus.cc:359] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.116586 18427 ts_tablet_manager.cc:1434] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:17:57.118608 18427 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:57.121861 18430 tablet_bootstrap.cc:654] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.116932 18431 raft_consensus.cc:385] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.123567 18431 raft_consensus.cc:740] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.122603 18162 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
W20260709 12:17:57.124989 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 49193us
W20260709 12:17:57.126883 18350 leader_election.cc:343] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.106904 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:57.129087 18350 leader_election.cc:304] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:17:57.132498 18807 raft_consensus.cc:2804] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.133040 18807 raft_consensus.cc:697] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:57.134087 18807 consensus_queue.cc:237] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:57.135039 18275 leader_election.cc:343] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.135552 18275 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.136252 18427 tablet_bootstrap.cc:654] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.136994 18800 raft_consensus.cc:2749] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.137763 18806 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:57.142623 18781 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:57.144065 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:57.146159 18376 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.147377 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:57.150902 18431 consensus_queue.cc:260] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.092306 18797 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.152477 18350 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:57.161123 18627 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.164041 18806 raft_consensus.cc:2804] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:57.164801 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:57.168372 18350 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:57.142330 18681 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.172941 18428 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:57.182899 18428 ts_tablet_manager.cc:1403] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.326s	user 0.009s	sys 0.006s
I20260709 12:17:57.185959 18308 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.187465 18428 raft_consensus.cc:359] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.188189 18428 raft_consensus.cc:385] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.188441 18428 raft_consensus.cc:740] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.191851 18431 ts_tablet_manager.cc:1434] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 12:17:57.189738 18428 consensus_queue.cc:260] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.181401 18806 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.201046 18806 raft_consensus.cc:3060] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.200645 18431 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:57.204181 18234 raft_consensus.cc:2393] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
W20260709 12:17:57.210378 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 49768.8us
I20260709 12:17:57.168830 18742 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:17:57.217165 18428 ts_tablet_manager.cc:1434] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:17:57.220114 18444 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.220750 18444 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.238787 18237 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:57.255705 18427 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:57.257350 18427 ts_tablet_manager.cc:1403] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.053s
I20260709 12:17:57.260171 18430 tablet_bootstrap.cc:492] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:57.260731 18430 ts_tablet_manager.cc:1403] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.293s	user 0.010s	sys 0.004s
I20260709 12:17:57.264029 18681 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:57.266791 18428 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:57.265897 18627 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.269238 18797 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:57.270717 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.276438 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.276739 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:57.277783 18444 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:57.282600 18800 consensus_queue.cc:1048] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.285109 18156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
W20260709 12:17:57.285436 18202 leader_election.cc:343] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.285997 18156 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:57.286592 18696 consensus_queue.cc:1048] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.287649 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.288431 18235 raft_consensus.cc:2393] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 1: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:17:57.295109 18308 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:57.297439 18350 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:57.297864 18376 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:57.298441 18692 raft_consensus.cc:2764] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:17:57.300578 18692 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.301047 18692 raft_consensus.cc:697] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
W20260709 12:17:57.304258 18202 leader_election.cc:343] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.304718 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:57.268863 18431 tablet_bootstrap.cc:654] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.301832 18692 consensus_queue.cc:237] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.302613 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.327015 18430 raft_consensus.cc:359] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.329017 18430 raft_consensus.cc:385] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.329324 18430 raft_consensus.cc:740] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.329852 18430 consensus_queue.cc:260] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.336316 18126 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:57.341399 18428 tablet_bootstrap.cc:654] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.343657 18444 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.344313 18444 raft_consensus.cc:697] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:57.345108 18444 consensus_queue.cc:237] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.349757 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:57.350296 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:57.351111 18376 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:17:57.354868 18430 ts_tablet_manager.cc:1434] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.094s	user 0.011s	sys 0.009s
I20260709 12:17:57.367174 18813 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.333256 18806 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.372105 18806 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:57.377604 18430 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:57.379709 18201 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.383829 18428 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:57.384730 18428 ts_tablet_manager.cc:1403] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.002s
I20260709 12:17:57.391201 18201 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.393517 18797 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.394106 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:57.394810 18236 raft_consensus.cc:3060] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.400544 18681 raft_consensus.cc:2749] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.421872 18427 raft_consensus.cc:359] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.422536 18427 raft_consensus.cc:385] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.422834 18427 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.434369 18236 raft_consensus.cc:2468] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:57.437422 18350 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:57.438359 18601 raft_consensus.cc:2804] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.438875 18601 raft_consensus.cc:697] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:57.439697 18601 consensus_queue.cc:237] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.441941 18782 consensus_queue.cc:1048] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.427791 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:57.465054 18162 raft_consensus.cc:3060] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:57.468372 18350 leader_election.cc:343] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.467326 18427 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.478562 18689 raft_consensus.cc:493] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.479118 18689 raft_consensus.cc:515] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.481200 18689 leader_election.cc:290] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:57.484787 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.485855 18157 raft_consensus.cc:2393] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:57.491225 18598 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.491919 18598 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.496426 18127 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:57.501396 18428 raft_consensus.cc:359] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.502197 18428 raft_consensus.cc:385] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.507563 18427 ts_tablet_manager.cc:1434] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.250s	user 0.009s	sys 0.000s
I20260709 12:17:57.509141 18431 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:57.512247 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.524065 18427 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:57.517197 18598 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:57.518113 18430 tablet_bootstrap.cc:654] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.520937 18428 raft_consensus.cc:740] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.530643 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.534222 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.534989 18308 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:57.535905 18468 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:57.537210 18350 leader_election.cc:343] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.540056 18275 leader_election.cc:304] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.541100 18683 raft_consensus.cc:3060] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.532517 18428 consensus_queue.cc:260] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.548662 18683 raft_consensus.cc:2749] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.523819 18431 ts_tablet_manager.cc:1403] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.010s
I20260709 12:17:57.538645 18689 consensus_queue.cc:1048] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.519937 18060 catalog_manager.cc:5697] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.562791 18430 tablet_bootstrap.cc:492] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:57.563316 18430 ts_tablet_manager.cc:1403] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.186s	user 0.007s	sys 0.004s
I20260709 12:17:57.566025 18430 raft_consensus.cc:359] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.580755 18430 raft_consensus.cc:385] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.545790 18428 ts_tablet_manager.cc:1434] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.000s
I20260709 12:17:57.571007 18427 tablet_bootstrap.cc:654] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.581261 18430 raft_consensus.cc:740] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.582832 18430 consensus_queue.cc:260] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.584630 18430 ts_tablet_manager.cc:1434] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:17:57.585793 18430 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:57.666853 18427 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:57.667460 18427 ts_tablet_manager.cc:1403] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.022s
I20260709 12:17:57.681360 18058 catalog_manager.cc:5697] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.683573 18058 catalog_manager.cc:5697] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.689050 18815 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.685544 18058 catalog_manager.cc:5697] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.689662 18815 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.691792 18815 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.694957 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.695858 18307 raft_consensus.cc:2393] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:57.696735 18430 tablet_bootstrap.cc:654] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.704583 18428 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:57.667308 18431 raft_consensus.cc:359] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.712723 18428 tablet_bootstrap.cc:654] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.712770 18431 raft_consensus.cc:385] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.713194 18431 raft_consensus.cc:740] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.713954 18431 consensus_queue.cc:260] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.718600 18431 ts_tablet_manager.cc:1434] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.167s	user 0.009s	sys 0.000s
I20260709 12:17:57.719640 18431 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:57.726089 18350 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:57.727823 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.730070 18742 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:57.730554 18742 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.730870 18815 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.731360 18815 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.732228 18232 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.733618 18815 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.730892 18742 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.743700 18201 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.743726 18427 raft_consensus.cc:359] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.749181 18427 raft_consensus.cc:385] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.745432 18430 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:57.750064 18430 ts_tablet_manager.cc:1403] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.002s
I20260709 12:17:57.752653 18430 raft_consensus.cc:359] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.753280 18430 raft_consensus.cc:385] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.753520 18430 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.749577 18427 raft_consensus.cc:740] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.742580 18742 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.756805 18742 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:57.746716 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.759665 18308 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:57.753871 18059 catalog_manager.cc:5697] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.747504 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.760783 18376 raft_consensus.cc:2393] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 1: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:17:57.758021 18427 consensus_queue.cc:260] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.761941 18799 consensus_queue.cc:1048] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.762630 18202 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:57.763509 18681 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:57.763881 18681 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.764189 18681 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.768579 18430 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.770689 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:57.771373 18309 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.771564 18681 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.773017 18601 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.773533 18601 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.774780 18815 raft_consensus.cc:2749] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.725689 18431 tablet_bootstrap.cc:654] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.777207 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:57.778031 18235 raft_consensus.cc:2393] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 1: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:17:57.778887 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:57.779698 18309 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:57.782706 18428 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:57.783231 18428 ts_tablet_manager.cc:1403] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 12:17:57.788149 18427 ts_tablet_manager.cc:1434] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.120s	user 0.020s	sys 0.010s
I20260709 12:17:57.788784 18430 ts_tablet_manager.cc:1434] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:17:57.789921 18598 consensus_queue.cc:1048] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.793274 18807 consensus_queue.cc:1048] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.794066 18350 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:57.800943 18807 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:57.801433 18807 raft_consensus.cc:697] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:57.802237 18807 consensus_queue.cc:237] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:57.799584 18430 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:57.808102 18681 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.810658 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:57.810847 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.812407 18201 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.813138 18815 raft_consensus.cc:2749] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.815676 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.816721 18799 consensus_queue.cc:1048] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.797194 18601 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:57.799508 18427 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:57.828104 18430 tablet_bootstrap.cc:654] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.830047 18427 tablet_bootstrap.cc:654] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:57.802325 18428 raft_consensus.cc:359] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.838572 18782 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:57.835848 18428 raft_consensus.cc:385] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.842213 18428 raft_consensus.cc:740] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.843302 18428 consensus_queue.cc:260] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.846347 18684 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.846858 18684 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:57.849244 18350 leader_election.cc:343] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.850251 18684 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.851295 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:57.852730 18276 leader_election.cc:343] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.858142 18431 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:57.858711 18431 ts_tablet_manager.cc:1403] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.004s
W20260709 12:17:57.863438 18350 leader_election.cc:343] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.863948 18350 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:57.864639 18598 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.865963 18427 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:57.866530 18427 ts_tablet_manager.cc:1403] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.001s
I20260709 12:17:57.869246 18427 raft_consensus.cc:359] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.869908 18427 raft_consensus.cc:385] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.870182 18427 raft_consensus.cc:740] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.870332 18781 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.870841 18781 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.873217 18781 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:57.873342 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.874130 18309 raft_consensus.cc:2468] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:57.875825 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.870865 18427 consensus_queue.cc:260] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:17:57.877619 18126 leader_election.cc:343] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.879799 18427 ts_tablet_manager.cc:1434] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:17:57.882612 18127 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.886328 18782 raft_consensus.cc:2804] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:57.886724 18782 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.887056 18782 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:57.897692 18799 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.898275 18799 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.899884 18428 ts_tablet_manager.cc:1434] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:17:57.900323 18799 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:57.904314 18780 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:57.904838 18431 raft_consensus.cc:359] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.905233 18689 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.923136 18689 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.910977 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:57.925983 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:57.927263 18689 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:57.915356 18427 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:57.918481 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:57.928241 18276 leader_election.cc:343] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.915274 18057 catalog_manager.cc:5697] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:57.929673 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:57.929976 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:17:57.931247 18276 leader_election.cc:343] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.931701 18276 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:57.932825 18684 raft_consensus.cc:2749] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.937378 18428 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:57.937520 18782 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:57.939030 18431 raft_consensus.cc:385] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.939409 18431 raft_consensus.cc:740] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:57.925154 18430 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:57.944461 18430 ts_tablet_manager.cc:1403] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.002s
I20260709 12:17:57.946130 18431 consensus_queue.cc:260] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.948712 18431 ts_tablet_manager.cc:1434] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 12:17:57.951017 18806 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.951594 18806 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:57.953565 18806 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:17:57.958014 18350 leader_election.cc:343] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.958602 18799 consensus_queue.cc:1048] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:57.961256 18275 leader_election.cc:343] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.961819 18275 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:57.963668 18684 raft_consensus.cc:2749] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.967800 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:57.968412 18234 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
W20260709 12:17:57.969280 18108 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:57.968086 18430 raft_consensus.cc:359] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:57.970554 18430 raft_consensus.cc:385] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:57.970767 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:17:57.976138 18350 leader_election.cc:343] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.976557 18350 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:57.977211 18806 raft_consensus.cc:2749] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:57.978085 18598 consensus_queue.cc:1048] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:57.980309 18350 leader_election.cc:343] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:57.970816 18430 raft_consensus.cc:740] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.023990 18350 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:58.027572 18427 tablet_bootstrap.cc:654] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.025352 18431 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.032423 18601 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.032852 18601 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.033192 18601 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.038455 18431 tablet_bootstrap.cc:654] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.039935 18158 raft_consensus.cc:3060] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.065512 18598 consensus_queue.cc:1048] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.025511 18430 consensus_queue.cc:260] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.077138 18815 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.077669 18815 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.101226 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.101760 18309 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.120646 18309 raft_consensus.cc:2468] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.122876 18430 ts_tablet_manager.cc:1434] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.178s	user 0.016s	sys 0.009s
I20260709 12:17:58.124011 18782 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:58.125715 18431 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.126231 18431 ts_tablet_manager.cc:1403] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.021s
I20260709 12:17:58.130918 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:58.100499 18806 consensus_queue.cc:1048] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:17:58.131150 18815 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:17:58.134085 18202 leader_election.cc:343] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.135042 18127 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:58.139356 18430 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:58.144454 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:58.162415 18427 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:58.163023 18427 ts_tablet_manager.cc:1403] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.248s	user 0.011s	sys 0.025s
W20260709 12:17:58.165940 18126 leader_election.cc:343] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.176358 18431 raft_consensus.cc:359] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.177443 18431 raft_consensus.cc:385] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.177841 18431 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.178851 18431 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.152195 18782 raft_consensus.cc:2804] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.181761 18427 raft_consensus.cc:359] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.182477 18427 raft_consensus.cc:385] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.182757 18427 raft_consensus.cc:740] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.189227 18601 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:17:58.157287 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 59466.4us
I20260709 12:17:58.191903 18782 raft_consensus.cc:697] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:58.193662 18782 consensus_queue.cc:237] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.195633 18428 tablet_bootstrap.cc:654] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.190680 18427 consensus_queue.cc:260] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.197036 18431 ts_tablet_manager.cc:1434] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:17:58.200747 18427 ts_tablet_manager.cc:1434] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:17:58.201720 18427 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:58.202003 18601 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:58.204701 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:58.206447 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:58.207118 18237 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.209218 18427 tablet_bootstrap.cc:654] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.214524 18468 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:17:58.215133 18468 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:17:58.216727 18350 leader_election.cc:343] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.220530 18431 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.234879 18430 tablet_bootstrap.cc:654] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.244740 18468 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:17:58.246757 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:58.248086 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:58.260308 18127 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:17:58.265619 18237 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:58.267027 18468 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.281735 18350 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:58.290674 18816 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.301635 18816 raft_consensus.cc:697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:58.310170 18816 consensus_queue.cc:237] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.315115 18431 tablet_bootstrap.cc:654] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.324533 18428 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:58.325884 18428 ts_tablet_manager.cc:1403] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.396s	user 0.017s	sys 0.011s
I20260709 12:17:58.333171 18059 catalog_manager.cc:5697] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:58.338248 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.340171 18306 raft_consensus.cc:2468] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:58.351152 18428 raft_consensus.cc:359] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.352547 18428 raft_consensus.cc:385] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.352828 18428 raft_consensus.cc:740] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.359735 18202 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:58.359421 18428 consensus_queue.cc:260] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.366046 18816 consensus_queue.cc:1048] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:58.370162 18856 raft_consensus.cc:2804] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.370594 18856 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.370930 18856 raft_consensus.cc:3060] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.383124 18856 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.386134 18060 catalog_manager.cc:5697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.392931 18428 ts_tablet_manager.cc:1434] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:17:58.396121 18856 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.396739 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.397217 18309 raft_consensus.cc:3060] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.395944 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:58.403149 18427 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:58.403702 18427 ts_tablet_manager.cc:1403] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.002s
W20260709 12:17:58.406930 18202 leader_election.cc:343] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.408630 18427 raft_consensus.cc:359] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.409353 18427 raft_consensus.cc:385] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.409605 18427 raft_consensus.cc:740] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.410254 18427 consensus_queue.cc:260] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.413789 18427 ts_tablet_manager.cc:1434] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:58.414856 18427 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: Bootstrap starting.
I20260709 12:17:58.415122 18601 consensus_queue.cc:1048] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:58.420742 18428 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:58.421205 18430 tablet_bootstrap.cc:492] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:58.421803 18309 raft_consensus.cc:2468] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:58.423419 18431 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.421736 18430 ts_tablet_manager.cc:1403] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.283s	user 0.022s	sys 0.008s
I20260709 12:17:58.432873 18431 ts_tablet_manager.cc:1403] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.010s
I20260709 12:17:58.433559 18202 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:17:58.426934 18799 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.434396 18799 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.435364 18431 raft_consensus.cc:359] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.436023 18431 raft_consensus.cc:385] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.436277 18431 raft_consensus.cc:740] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.436441 18799 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.436695 18854 raft_consensus.cc:2804] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.437206 18854 raft_consensus.cc:697] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:58.437964 18854 consensus_queue.cc:237] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.438388 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:58.439364 18430 raft_consensus.cc:359] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:17:58.439986 18350 leader_election.cc:343] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.440075 18431 consensus_queue.cc:260] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.439987 18430 raft_consensus.cc:385] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.441147 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.441733 18309 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 0.
I20260709 12:17:58.442821 18350 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:17:58.443876 18799 raft_consensus.cc:2804] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.444238 18799 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.444545 18799 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.431567 18428 tablet_bootstrap.cc:654] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.427865 18427 tablet_bootstrap.cc:654] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.444576 18431 ts_tablet_manager.cc:1434] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:17:58.448766 18431 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.458460 18430 raft_consensus.cc:740] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.459304 18430 consensus_queue.cc:260] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.460951 18431 tablet_bootstrap.cc:654] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.461494 18430 ts_tablet_manager.cc:1434] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:17:58.462553 18430 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: Bootstrap starting.
I20260709 12:17:58.466634 18427 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: No bootstrap required, opened a new log
I20260709 12:17:58.467149 18427 ts_tablet_manager.cc:1403] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:17:58.468371 18799 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.469689 18427 raft_consensus.cc:359] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.473273 18799 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.479646 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:58.479720 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.480505 18232 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.470482 18430 tablet_bootstrap.cc:654] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.483434 18431 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.480543 18309 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.483937 18431 ts_tablet_manager.cc:1403] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 12:17:58.489755 18309 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:58.478236 18427 raft_consensus.cc:385] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.489969 18431 raft_consensus.cc:359] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.491878 18427 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.492573 18232 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:17:58.492730 18427 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.495085 18427 ts_tablet_manager.cc:1434] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:17:58.496265 18431 raft_consensus.cc:385] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.496567 18431 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.498106 18431 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.505112 18431 ts_tablet_manager.cc:1434] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:17:58.506156 18431 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.506882 18806 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.507396 18806 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.509347 18806 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:58.524681 18350 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:58.525581 18806 raft_consensus.cc:2804] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.526074 18806 raft_consensus.cc:697] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:17:58.526958 18806 consensus_queue.cc:237] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:17:58.528903 18431 tablet_bootstrap.cc:654] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.531025 18057 catalog_manager.cc:5697] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.534672 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:58.536753 18428 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:58.537307 18428 ts_tablet_manager.cc:1403] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.008s
I20260709 12:17:58.541251 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:17:58.543319 18350 leader_election.cc:343] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.551368 18430 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: No bootstrap required, opened a new log
I20260709 12:17:58.559428 18430 ts_tablet_manager.cc:1403] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.018s
I20260709 12:17:58.553460 18428 raft_consensus.cc:359] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.560717 18428 raft_consensus.cc:385] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.561031 18428 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.556993 18431 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.561898 18431 ts_tablet_manager.cc:1403] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.000s
W20260709 12:17:58.569710 18350 leader_election.cc:343] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:58.562319 18430 raft_consensus.cc:359] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.570673 18350 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:58.564622 18431 raft_consensus.cc:359] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.569080 18428 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.571187 18431 raft_consensus.cc:385] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.570458 18430 raft_consensus.cc:385] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.571540 18431 raft_consensus.cc:740] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.572458 18430 raft_consensus.cc:740] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.573269 18428 ts_tablet_manager.cc:1434] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:17:58.573069 18431 consensus_queue.cc:260] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.567974 18057 catalog_manager.cc:5697] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 1 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:58.573451 18430 consensus_queue.cc:260] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.576325 18431 ts_tablet_manager.cc:1434] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:17:58.576499 18430 ts_tablet_manager.cc:1434] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:17:58.577271 18431 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.580258 18428 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Bootstrap starting.
I20260709 12:17:58.586041 18428 tablet_bootstrap.cc:654] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.588152 18431 tablet_bootstrap.cc:654] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.596916 18428 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: No bootstrap required, opened a new log
I20260709 12:17:58.597430 18428 ts_tablet_manager.cc:1403] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 12:17:58.597643 18431 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.598152 18431 ts_tablet_manager.cc:1403] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.001s
I20260709 12:17:58.599222 18781 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.599900 18781 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.601079 18431 raft_consensus.cc:359] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.601788 18431 raft_consensus.cc:385] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.602048 18431 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.602087 18781 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.602779 18431 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.604025 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:58.604843 18431 ts_tablet_manager.cc:1434] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:17:58.604673 18428 raft_consensus.cc:359] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.605381 18428 raft_consensus.cc:385] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.605655 18428 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.605850 18431 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:17:58.606374 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.606308 18428 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.607179 18306 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.608283 18127 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:58.604668 18232 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.609086 18781 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.609470 18781 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.609794 18781 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.615134 18431 tablet_bootstrap.cc:654] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:58.616777 18781 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.619390 18428 ts_tablet_manager.cc:1434] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:17:58.621279 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:17:58.621942 18232 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.622581 18780 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.623073 18780 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.571256 18806 raft_consensus.cc:2749] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:58.627018 18780 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:58.627614 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:58.628494 18385 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.630098 18781 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.631261 18232 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.631806 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.632360 18309 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.637238 18127 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:58.630330 18126 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:58.643177 18309 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.643772 18781 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.644842 18781 raft_consensus.cc:697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:58.629141 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.645748 18781 consensus_queue.cc:237] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.646412 18306 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.644222 18780 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.649798 18780 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.650135 18780 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.644135 18431 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: No bootstrap required, opened a new log
I20260709 12:17:58.651311 18431 ts_tablet_manager.cc:1403] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.006s
I20260709 12:17:58.653986 18431 raft_consensus.cc:359] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.654697 18431 raft_consensus.cc:385] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:58.655033 18431 raft_consensus.cc:740] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:17:58.656250 18431 consensus_queue.cc:260] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.657678 18780 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.658654 18431 ts_tablet_manager.cc:1434] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:58.659992 18780 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:58.660635 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.660905 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:58.661242 18306 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.661633 18385 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.666797 18385 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.667914 18126 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:58.666981 18306 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.668712 18781 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.669219 18781 raft_consensus.cc:697] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:58.670010 18781 consensus_queue.cc:237] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.670727 18780 consensus_queue.cc:1048] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.674336 18057 catalog_manager.cc:5697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.683199 18385 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.690975 18781 consensus_queue.cc:1048] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.698370 18059 catalog_manager.cc:5697] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:58.749194 18157 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.754910 18806 consensus_queue.cc:1048] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.756937 18806 consensus_queue.cc:1048] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.801069 18856 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.801510 18856 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.803299 18856 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:58.803889 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:58.804190 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:17:58.804502 18379 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:58.804780 18157 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 0.
I20260709 12:17:58.805445 18201 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:17:58.806073 18856 raft_consensus.cc:2804] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.806443 18856 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.806761 18856 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.812287 18856 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.815274 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:58.815914 18379 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.816519 18856 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:17:58.816972 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:17:58.817575 18157 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.824608 18157 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:58.825657 18202 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:17:58.826390 18854 raft_consensus.cc:2804] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.826586 18781 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.826987 18854 raft_consensus.cc:697] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:17:58.827097 18781 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.827831 18854 consensus_queue.cc:237] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:17:58.829211 18781 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:58.830760 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.831346 18309 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.832501 18127 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:58.832592 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:17:58.833192 18780 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:58.833619 18780 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.833947 18780 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.833267 18385 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 0.
I20260709 12:17:58.844939 18780 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.847323 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:17:58.847671 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:17:58.848003 18309 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.848357 18378 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.849458 18379 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:17:58.851030 18780 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:17:58.854801 18309 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.857371 18127 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:17:58.858062 18780 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:58.858639 18780 raft_consensus.cc:697] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:17:58.860513 18378 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:17:58.860229 18780 consensus_queue.cc:237] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:17:58.862576 18058 catalog_manager.cc:5697] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:58.872463 18057 catalog_manager.cc:5697] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:58.877084 18854 consensus_queue.cc:1048] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.885922 18780 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.886440 18780 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:17:58.888449 18780 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:17:58.894325 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:17:58.896973 18157 raft_consensus.cc:3060] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:58.901937 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:17:58.905764 18127 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:17:58.907220 18856 consensus_queue.cc:1048] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.909217 18444 raft_consensus.cc:2749] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:58.921859 18601 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:58.952438 18601 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:59.095764 18781 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.113194 18781 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.261106 18781 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.283032 18895 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.285104 18854 consensus_queue.cc:1048] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.299547 18895 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.309610 18627 consensus_queue.cc:1048] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:59.310070 18780 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:59.888183  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
W20260709 12:17:59.889693 18350 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 66 similar messages]
W20260709 12:17:59.895612 18350 consensus_peers.cc:597] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.932296 18350 consensus_peers.cc:597] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.937703 18350 consensus_peers.cc:597] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.948577 18202 consensus_peers.cc:597] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.951458 18202 consensus_peers.cc:597] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.952549 18202 consensus_peers.cc:597] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.956254 18350 consensus_peers.cc:597] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.957937 18276 consensus_peers.cc:597] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.961131 18276 consensus_peers.cc:597] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.962131 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:59.964010 18276 consensus_peers.cc:597] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:59.977769  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:59.978611  8907 tablet_replica.cc:333] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.979269  8907 raft_consensus.cc:2243] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:59.980029  8907 raft_consensus.cc:2272] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.982502  8907 tablet_replica.cc:333] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.983110  8907 raft_consensus.cc:2243] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:59.983502  8907 raft_consensus.cc:2272] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.985225  8907 tablet_replica.cc:333] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.985769  8907 raft_consensus.cc:2243] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:59.986650  8907 raft_consensus.cc:2272] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.989379  8907 tablet_replica.cc:333] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.990005  8907 raft_consensus.cc:2243] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:59.990372  8907 raft_consensus.cc:2272] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.992085  8907 tablet_replica.cc:333] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.992583  8907 raft_consensus.cc:2243] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:59.992906  8907 raft_consensus.cc:2272] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.994748  8907 tablet_replica.cc:333] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.995271  8907 raft_consensus.cc:2243] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:59.995613  8907 raft_consensus.cc:2272] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.997211  8907 tablet_replica.cc:333] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:17:59.997747  8907 raft_consensus.cc:2243] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:59.998085  8907 raft_consensus.cc:2272] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:59.999676  8907 tablet_replica.cc:333] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.000180  8907 raft_consensus.cc:2243] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.000873  8907 raft_consensus.cc:2272] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.002875  8907 tablet_replica.cc:333] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.003582  8907 raft_consensus.cc:2243] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.004369  8907 raft_consensus.cc:2272] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.007536  8907 tablet_replica.cc:333] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.008421  8907 raft_consensus.cc:2243] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.008940  8907 raft_consensus.cc:2272] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:00.011135 18202 consensus_peers.cc:597] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.011152  8907 tablet_replica.cc:333] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.012116  8907 raft_consensus.cc:2243] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.012557  8907 raft_consensus.cc:2272] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.014387  8907 tablet_replica.cc:333] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.014974  8907 raft_consensus.cc:2243] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.015355  8907 raft_consensus.cc:2272] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.017046  8907 tablet_replica.cc:333] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.017577  8907 raft_consensus.cc:2243] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.017954  8907 raft_consensus.cc:2272] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.019657  8907 tablet_replica.cc:333] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.020211  8907 raft_consensus.cc:2243] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.020605  8907 raft_consensus.cc:2272] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.022624  8907 tablet_replica.cc:333] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.023319  8907 raft_consensus.cc:2243] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.023792  8907 raft_consensus.cc:2272] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.026010  8907 tablet_replica.cc:333] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.026572  8907 raft_consensus.cc:2243] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.026994  8907 raft_consensus.cc:2272] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.029240  8907 tablet_replica.cc:333] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.030000  8907 raft_consensus.cc:2243] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.030912  8907 raft_consensus.cc:2272] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.032963  8907 tablet_replica.cc:333] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.033613  8907 raft_consensus.cc:2243] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.034303  8907 raft_consensus.cc:2272] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.036314  8907 tablet_replica.cc:333] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.036994  8907 raft_consensus.cc:2243] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.037957  8907 raft_consensus.cc:2272] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.040521  8907 tablet_replica.cc:333] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.041254  8907 raft_consensus.cc:2243] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.041703  8907 raft_consensus.cc:2272] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.043668  8907 tablet_replica.cc:333] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.044188  8907 raft_consensus.cc:2243] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.044559  8907 raft_consensus.cc:2272] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.046221  8907 tablet_replica.cc:333] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.046854  8907 raft_consensus.cc:2243] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.047339  8907 raft_consensus.cc:2272] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.049782  8907 tablet_replica.cc:333] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.050551  8907 raft_consensus.cc:2243] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.050947  8907 raft_consensus.cc:2272] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.052771  8907 tablet_replica.cc:333] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.053337  8907 raft_consensus.cc:2243] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.053709  8907 raft_consensus.cc:2272] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.055683  8907 tablet_replica.cc:333] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.056396  8907 raft_consensus.cc:2243] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.056851  8907 raft_consensus.cc:2272] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.059197  8907 tablet_replica.cc:333] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.059940  8907 raft_consensus.cc:2243] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.060858  8907 raft_consensus.cc:2272] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.063061  8907 tablet_replica.cc:333] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.063628  8907 raft_consensus.cc:2243] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.064126  8907 raft_consensus.cc:2272] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.065955  8907 tablet_replica.cc:333] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.066706  8907 raft_consensus.cc:2243] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.067137  8907 raft_consensus.cc:2272] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.069563  8907 tablet_replica.cc:333] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.070400  8907 raft_consensus.cc:2243] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.070935  8907 raft_consensus.cc:2272] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.073364  8907 tablet_replica.cc:333] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.074126  8907 raft_consensus.cc:2243] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.074703  8907 raft_consensus.cc:2272] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.078184  8907 tablet_replica.cc:333] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.078851  8907 raft_consensus.cc:2243] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.079279  8907 raft_consensus.cc:2272] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.081135  8907 tablet_replica.cc:333] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.081684  8907 raft_consensus.cc:2243] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.082463  8907 raft_consensus.cc:2272] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.084327  8907 tablet_replica.cc:333] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.084841  8907 raft_consensus.cc:2243] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.085564  8907 raft_consensus.cc:2272] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.087339  8907 tablet_replica.cc:333] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.087845  8907 raft_consensus.cc:2243] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.088706  8907 raft_consensus.cc:2272] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.090750  8907 tablet_replica.cc:333] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.091394  8907 raft_consensus.cc:2243] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.092152  8907 raft_consensus.cc:2272] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.094311  8907 tablet_replica.cc:333] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.094985  8907 raft_consensus.cc:2243] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.095813  8907 raft_consensus.cc:2272] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.097673  8907 tablet_replica.cc:333] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.098235  8907 raft_consensus.cc:2243] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.099004  8907 raft_consensus.cc:2272] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.100838  8907 tablet_replica.cc:333] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.101421  8907 raft_consensus.cc:2243] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.101796  8907 raft_consensus.cc:2272] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.103863  8907 tablet_replica.cc:333] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.104405  8907 raft_consensus.cc:2243] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.105111  8907 raft_consensus.cc:2272] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.106967  8907 tablet_replica.cc:333] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.107471  8907 raft_consensus.cc:2243] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.108145  8907 raft_consensus.cc:2272] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.109959  8907 tablet_replica.cc:333] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.110450  8907 raft_consensus.cc:2243] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.110821  8907 raft_consensus.cc:2272] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.112578  8907 tablet_replica.cc:333] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.113039  8907 raft_consensus.cc:2243] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.113407  8907 raft_consensus.cc:2272] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.115362  8907 tablet_replica.cc:333] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.116001  8907 raft_consensus.cc:2243] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.116448  8907 raft_consensus.cc:2272] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.118662  8907 tablet_replica.cc:333] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
I20260709 12:18:00.119164  8907 raft_consensus.cc:2243] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:00.120121  8907 raft_consensus.cc:2272] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:00.122462  8907 tablet_replica.cc:333] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: stopping tablet replica
W20260709 12:18:00.122730 18276 consensus_peers.cc:597] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.123006  8907 raft_consensus.cc:2243] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:00.123637  8907 raft_consensus.cc:2272] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:00.133665 18202 consensus_peers.cc:597] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.141182 18350 consensus_peers.cc:597] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.141952 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.189862 18350 consensus_peers.cc:597] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.194936 18350 consensus_peers.cc:597] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.199968  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
W20260709 12:18:00.208707 18202 consensus_peers.cc:597] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.218945 18276 consensus_peers.cc:597] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.224684 18276 consensus_peers.cc:597] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.233054 18350 consensus_peers.cc:597] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.264376  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:00.272302 18913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:00.272600 18914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:00.273620  8907 server_base.cc:1061] running on GCE node
W20260709 12:18:00.273903 18916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:00.278602  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:00.278911  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:00.279126  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599480279110 us; error 0 us; skew 500 ppm
I20260709 12:18:00.280218  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:18:00.282171 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.283509  8907 webserver.cc:533] Webserver started at http://127.8.178.193:45943/ using document root <none> and password file <none>
I20260709 12:18:00.284065  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:00.284227  8907 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:18:00.290668 18202 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.295779  8907 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.004s	sys 0.008s
W20260709 12:18:00.306788 18276 consensus_peers.cc:597] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.311503 18921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:00.312481  8907 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:18:00.312814  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "4758217c33d3483eac425c4d24d74bf5"
format_stamp: "Formatted at 2026-07-09 12:17:49 on dist-test-slave-jlx4"
I20260709 12:18:00.313360  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:00.338363  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:00.340039  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:00.345502  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:00.350515 18928 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:18:00.368808 18350 consensus_peers.cc:597] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.372028 18202 consensus_peers.cc:597] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:00.408631 18350 consensus_peers.cc:597] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.612483  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:18:00.612901  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.263s	user 0.008s	sys 0.001s
I20260709 12:18:00.613257  8907 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:18:00.617619 18928 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.631955 18928 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.632895 18928 tablet_bootstrap.cc:492] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.633590 18928 ts_tablet_manager.cc:1403] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:18:00.636008 18928 raft_consensus.cc:359] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.636677 18928 raft_consensus.cc:740] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.637357 18928 consensus_queue.cc:260] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.639658 18928 ts_tablet_manager.cc:1434] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:18:00.640491 18928 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.654295 18928 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.655217 18928 tablet_bootstrap.cc:492] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.655831 18928 ts_tablet_manager.cc:1403] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:18:00.658138 18928 raft_consensus.cc:359] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.658835 18928 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.659468 18928 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.661195 18928 ts_tablet_manager.cc:1434] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:00.661942 18928 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.676154 18928 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.677083 18928 tablet_bootstrap.cc:492] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.677690 18928 ts_tablet_manager.cc:1403] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:18:00.680074 18928 raft_consensus.cc:359] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.680744 18928 raft_consensus.cc:740] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.681519 18928 consensus_queue.cc:260] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.683346 18928 ts_tablet_manager.cc:1434] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:18:00.684119 18928 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.698880 18928 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.699783 18928 tablet_bootstrap.cc:492] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.700425 18928 ts_tablet_manager.cc:1403] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:18:00.702653 18928 raft_consensus.cc:359] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.703336 18928 raft_consensus.cc:740] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.703994 18928 consensus_queue.cc:260] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.705778 18928 ts_tablet_manager.cc:1434] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:00.706707 18928 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.748420 18928 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.749330 18928 tablet_bootstrap.cc:492] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.749954 18928 ts_tablet_manager.cc:1403] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 12:18:00.752617 18928 raft_consensus.cc:359] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.753284 18928 raft_consensus.cc:740] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.754140 18928 consensus_queue.cc:260] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.756021 18928 ts_tablet_manager.cc:1434] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:18:00.756803 18928 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.786840 18928 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.787719 18928 tablet_bootstrap.cc:492] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.788323 18928 ts_tablet_manager.cc:1403] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:18:00.790690 18928 raft_consensus.cc:359] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.791325 18928 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.792030 18928 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.794081 18928 ts_tablet_manager.cc:1434] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:18:00.794863 18928 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.820590 18928 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.821508 18928 tablet_bootstrap.cc:492] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.822096 18928 ts_tablet_manager.cc:1403] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 12:18:00.824520 18928 raft_consensus.cc:359] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.825101 18928 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.826011 18928 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.827834 18928 ts_tablet_manager.cc:1434] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:18:00.828459 18928 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.843043 18928 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.843765 18928 tablet_bootstrap.cc:492] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.844309 18928 ts_tablet_manager.cc:1403] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:18:00.846144 18928 raft_consensus.cc:359] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.846679 18928 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.847211 18928 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.848527 18928 ts_tablet_manager.cc:1434] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:00.849133 18928 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.860491 18928 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.861347 18928 tablet_bootstrap.cc:492] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.861949 18928 ts_tablet_manager.cc:1403] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:18:00.864006 18928 raft_consensus.cc:359] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.864673 18928 raft_consensus.cc:740] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.865404 18928 consensus_queue.cc:260] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.867241 18928 ts_tablet_manager.cc:1434] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:18:00.867993 18928 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.882791 18928 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.884183 18928 tablet_bootstrap.cc:492] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.885056 18928 ts_tablet_manager.cc:1403] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:18:00.887435 18928 raft_consensus.cc:359] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.888021 18928 raft_consensus.cc:740] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.888568 18928 consensus_queue.cc:260] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.890161 18928 ts_tablet_manager.cc:1434] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:00.890810 18928 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.891930  8907 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:18:00.892277  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.279s	user 0.238s	sys 0.000s
I20260709 12:18:00.904229 18928 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.905416 18928 tablet_bootstrap.cc:492] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.906052 18928 ts_tablet_manager.cc:1403] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 12:18:00.908507 18928 raft_consensus.cc:359] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.909145 18928 raft_consensus.cc:740] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.910115 18928 consensus_queue.cc:260] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.912103 18928 ts_tablet_manager.cc:1434] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:00.912923 18928 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.925865 18928 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.926692 18928 tablet_bootstrap.cc:492] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.927362 18928 ts_tablet_manager.cc:1403] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:18:00.929709 18928 raft_consensus.cc:359] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.930305 18928 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.931211 18928 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.933527 18928 ts_tablet_manager.cc:1434] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:00.934314 18928 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.946931 18928 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.947854 18928 tablet_bootstrap.cc:492] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.948540 18928 ts_tablet_manager.cc:1403] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:18:00.950917 18928 raft_consensus.cc:359] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.951433 18928 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.952039 18928 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:00.953969 18928 ts_tablet_manager.cc:1434] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:18:00.954774 18928 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.969830 18928 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.970806 18928 tablet_bootstrap.cc:492] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.971446 18928 ts_tablet_manager.cc:1403] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:18:00.973371 18928 raft_consensus.cc:359] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.973872 18928 raft_consensus.cc:740] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:00.974594 18928 consensus_queue.cc:260] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:00.976241 18928 ts_tablet_manager.cc:1434] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:00.977051 18928 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:00.994006 18928 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.995404 18928 tablet_bootstrap.cc:492] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:00.995458 18907 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:00.996059 18907 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:00.996317 18928 ts_tablet_manager.cc:1403] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:18:01.000101 18907 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.001716 18928 raft_consensus.cc:359] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.002610 18928 raft_consensus.cc:740] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.003592 18928 consensus_queue.cc:260] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.006309 18928 ts_tablet_manager.cc:1434] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:01.007321 18928 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.009331 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:01.019389 18276 leader_election.cc:336] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:01.020663 18276 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.021786 18907 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.034065 18928 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.035812 18928 tablet_bootstrap.cc:492] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.036506 18928 ts_tablet_manager.cc:1403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 12:18:01.039407 18928 raft_consensus.cc:359] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.040067 18928 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.040868 18928 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.043136 18928 ts_tablet_manager.cc:1434] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:01.043968 18928 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.046120  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:38641
I20260709 12:18:01.046242 19007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:38641 every 8 connection(s)
I20260709 12:18:01.075480 18854 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.076220 18854 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.082244 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.092864 18854 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.105954 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.107566 18978 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.111959 18202 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.113086 18854 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.113286 18928 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.113792 19009 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34201
I20260709 12:18:01.114274 18928 tablet_bootstrap.cc:492] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.114353 18854 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.115110 18854 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.115353 18928 ts_tablet_manager.cc:1403] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.072s	user 0.032s	sys 0.028s
I20260709 12:18:01.118142 18928 raft_consensus.cc:359] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.118846 18928 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.119501 18928 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.121142 18928 ts_tablet_manager.cc:1434] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:01.121951 18928 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.114269 19009 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:01.123415 19009 heartbeater.cc:507] Master 127.8.178.254:34201 requested a full tablet report, sending...
I20260709 12:18:01.126255 18854 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.130206 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.132791 18854 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.139961 18854 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.140156 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.140838 18978 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.141669 18854 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.143231 18928 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.144187 18928 tablet_bootstrap.cc:492] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.144198 18854 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.144857 18928 ts_tablet_manager.cc:1403] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:18:01.144855 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.146061 18977 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.147282 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:01.148114 18854 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.148496 18854 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.148310 18928 raft_consensus.cc:359] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.149036 18928 raft_consensus.cc:740] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.149739 18928 consensus_queue.cc:260] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.148908 18854 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.151976 18928 ts_tablet_manager.cc:1434] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:01.157214 18928 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.147189 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.158355 18854 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.165045 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.165686 18976 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.158545 18890 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.170744 18890 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.171108 18978 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.175694 18890 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.178496 18202 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.177295 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.177721 18059 ts_manager.cc:194] Re-registered known tserver with Master: 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.179414 18930 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.179921 18930 raft_consensus.cc:697] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.180686 18930 consensus_queue.cc:237] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.186902 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.187703 18974 raft_consensus.cc:2468] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.192605 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.194561 18854 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.192651 18350 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.196355 18890 raft_consensus.cc:2804] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.196952 18890 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.197337 18890 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.190238 18976 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.199947 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.201122 18854 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.201742 18854 raft_consensus.cc:697] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.202639 18854 consensus_queue.cc:237] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.205287 18937 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.206125 18937 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.208351 18937 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.212863 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.216492 18907 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.217291 18907 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.219789 18907 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.222141 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.223749 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.224920 18974 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
W20260709 12:18:01.226891 18276 leader_election.cc:343] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.228477 18928 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.229717 18928 tablet_bootstrap.cc:492] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.230047 18904 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.230404 18928 ts_tablet_manager.cc:1403] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.016s
I20260709 12:18:01.230726 18904 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.233349 18904 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.233407 18928 raft_consensus.cc:359] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.234239 18928 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.235059 18928 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.236826 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.238495 18928 ts_tablet_manager.cc:1434] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 12:18:01.238474 18276 leader_election.cc:343] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.239533 18928 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.240471 18907 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.241106 18907 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.242954 18938 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.243516 18938 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.245813 18938 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.243542 18907 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.247706 18907 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.248230 18907 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.251471 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.252166 18974 raft_consensus.cc:2468] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:01.253710 18276 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:01.254618 18904 raft_consensus.cc:2804] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.254966 18904 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.255290 18904 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.273957 18929 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.274644 18929 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.275914 18059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50296
I20260709 12:18:01.277062 18929 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.277606 18929 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.278064 18929 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.280256 18929 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.282244 19009 heartbeater.cc:499] Master 127.8.178.254:34201 was elected leader, sending a full tablet report...
I20260709 12:18:01.284934 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.287467 18928 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.287971 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.288435 18928 tablet_bootstrap.cc:492] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.289161 18928 ts_tablet_manager.cc:1403] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.012s
I20260709 12:18:01.289515 18907 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.289561 19021 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.290328 19021 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:01.290776 18276 leader_election.cc:343] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.291724 18928 raft_consensus.cc:359] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.292455 18928 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.293855 19021 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.294559 19021 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.294775 18928 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.295228 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.295118 19021 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.297097 18928 ts_tablet_manager.cc:1434] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:01.298017 18928 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.300179 19021 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.301849 18938 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.292594 18350 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.303179 18937 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.303534 18937 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.302536 18938 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.303881 18937 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.305537 18930 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.305531 18938 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.306352 18930 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.306730 18938 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.307503 18938 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.308598 18930 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.309623 18938 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.316496 18937 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.319052 18937 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.319876 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:01.321432 18202 leader_election.cc:343] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.324898 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.325627 18307 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.326736 18202 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:01.328301 18276 leader_election.cc:343] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.353915 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.331791 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.333145 18930 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.336227 18060 catalog_manager.cc:5697] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.340200 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.342375 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:01.354601 18276 leader_election.cc:343] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.343906 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.342754 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.302201 18890 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.349143 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.357666 18378 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:01.349493 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.358687 18379 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:01.358991 18890 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.350692 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.359714 18890 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
W20260709 12:18:01.352988 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 171901us
I20260709 12:18:01.355027 18930 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.354607 18978 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:01.344609 18928 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.354487 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.350907 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.325950 18904 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.362370 18385 raft_consensus.cc:2393] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:01.365501 18854 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.365693 18900 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.366093 18854 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.366294 18900 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.368312 18854 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.368491 18900 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.362085 18928 tablet_bootstrap.cc:492] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.369650 18928 ts_tablet_manager.cc:1403] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.008s
I20260709 12:18:01.352674 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.360743 18930 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.370532 18307 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.374536 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.380589 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.381422 18907 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.382200 18907 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.382473 18276 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:01.383469 19022 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.383865 19022 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.384200 19022 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.376895 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.377650 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.384934 18978 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
W20260709 12:18:01.385684 18202 leader_election.cc:343] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.386579 18202 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:01.387518 19016 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.387961 19016 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.388351 19016 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.379074 18904 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.391629 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.392325 18978 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.362668 18890 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.375646 18928 raft_consensus.cc:359] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.393698 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.394933 18928 raft_consensus.cc:740] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.392307 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.395844 18928 consensus_queue.cc:260] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.398749 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.399457 18309 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.399674 18890 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.401019 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.400986 19016 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.403050 18900 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.403805 18900 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.404335 18907 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.405735 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.405959 18900 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.406404 18975 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.406749 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.404899 18907 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.407418 18376 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.408993 18907 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.402570 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.409484 18928 ts_tablet_manager.cc:1434] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 12:18:01.409246 18201 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.410446 18900 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.410792 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.411481 19016 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.412489 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.410821 18900 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.413264 18976 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.406524 18930 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:01.413321 18202 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.414626 18234 raft_consensus.cc:2393] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.415656 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.413228 18900 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.417227 18978 raft_consensus.cc:2468] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:01.417300 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.418062 18976 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.383488 18276 leader_election.cc:343] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.419673 18202 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.419819 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:01.420985 19024 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.421516 19024 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.420848 19016 raft_consensus.cc:2749] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.423671 19024 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.425325 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.424360 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.426162 19022 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.428009 19024 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.428576 18275 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.428522 19024 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.428877 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.429792 18904 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.429811 18307 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.430593 18904 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.430971 19024 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.427667 18975 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.431033 18904 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.433476 18907 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.434103 18907 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.435935 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.435989 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.437682 18978 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
W20260709 12:18:01.427935 18202 leader_election.cc:343] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.439064 18202 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.427677 18900 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.443600 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.445134 19017 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.438982 18276 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.439642 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.439991 18928 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.441546 18275 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.446084 18306 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.446193 18309 raft_consensus.cc:2393] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:01.437997 18976 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:01.446691 19021 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.442869 18307 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.441572 18854 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.423764 18930 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.447801 18854 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.447090 19021 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.449445 19021 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.449956 18854 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.445662 19017 raft_consensus.cc:697] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.451211 19017 consensus_queue.cc:237] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.453707 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.453881 18306 raft_consensus.cc:2468] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:01.447149 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.454538 18973 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.456578 18929 raft_consensus.cc:2749] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.458263 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.459170 18376 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.462813 18900 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.468770 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.441164 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.469630 18972 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.469990 18978 raft_consensus.cc:3060] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.472289 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.473891 18202 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
W20260709 12:18:01.474781 18202 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.475673 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.476153 18904 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.474720 18900 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.478787 18900 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.479193 18900 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.440205 18907 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.481683 18907 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.482182 18907 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.483048 18929 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.484244 18907 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.447221 19022 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.485687 18350 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.487561 18937 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.487937 18937 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.488298 18937 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.489641 18854 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.490054 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.490417 18854 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.490784 18276 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:01.491014 18971 raft_consensus.cc:2393] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:01.492690 18854 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.480577 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.493664 18306 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.489446 18202 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.495851 18854 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.496726 18854 raft_consensus.cc:697] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.497466 18937 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.471997 19021 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.497622 18854 consensus_queue.cc:237] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.499687 18937 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.504104 18904 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.504441 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.504660 18376 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.499816 19021 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.507937 19017 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
W20260709 12:18:01.515587 18202 leader_election.cc:343] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.515969 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
W20260709 12:18:01.510454 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 62728.4us
I20260709 12:18:01.510643 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.500450 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.512220 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.518594 18309 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.514102 19029 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.509085 18900 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.515890 19017 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.519429 19029 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.519806 18350 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.521018 19024 raft_consensus.cc:2804] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.515029 18978 raft_consensus.cc:2468] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:01.518955 18890 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.521523 19024 raft_consensus.cc:697] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:01.521803 18890 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.522233 18890 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.518020 18306 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.523203 19024 consensus_queue.cc:237] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.524546 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:01.526543 18202 leader_election.cc:343] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.527240 18202 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.528466 19017 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.529089 19017 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.529446 19017 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.530267 19017 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.530473 18350 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.531344 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.515727 19030 raft_consensus.cc:2804] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.532132 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.536387 18234 raft_consensus.cc:2393] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.536150 19030 raft_consensus.cc:697] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:01.534093 18306 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.537832 18201 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.540556 18904 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.541579 18930 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.541927 18854 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.542102 18930 raft_consensus.cc:697] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.542491 18854 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.543143 18930 consensus_queue.cc:237] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.544869 18854 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.531622 18937 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.545554 18937 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.541958 18900 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.545957 18937 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.540612 18202 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.549422 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.541044 18904 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.550665 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.548909 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.552100 18974 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.531389 18350 leader_election.cc:343] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.521548 19029 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.554304 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.531121 18890 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.548022 18900 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.554970 18350 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.555673 18900 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.556124 18938 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.557024 18900 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.551203 18904 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.556636 18978 raft_consensus.cc:2393] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:01.545979 19017 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.568717 19017 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.568852 18938 raft_consensus.cc:2749] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:01.569307 18350 leader_election.cc:343] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.580925 18350 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.581735 18938 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.582190 18938 raft_consensus.cc:697] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:01.583055 18938 consensus_queue.cc:237] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.586309 18928 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.571123 18890 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.571988 19029 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.572402 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.578361 18900 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.572726 18937 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.575232 19016 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.575462 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.577479 19027 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
W20260709 12:18:01.578151 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 62779.1us
W20260709 12:18:01.587877 18350 leader_election.cc:343] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.605618 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.607697 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.608631 18309 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:01.595696 18928 tablet_bootstrap.cc:492] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.609766 18928 ts_tablet_manager.cc:1403] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.001s
I20260709 12:18:01.589041 18974 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.598953 18307 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.599344 19016 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.597023 19029 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.599093 19027 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.611874 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.612030 18900 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.612304 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.612568 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.589512 18904 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.612035 18937 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.607409 18058 catalog_manager.cc:5697] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 2 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.628793 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.631083 18309 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:01.628893 18307 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.627146 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.631923 18928 raft_consensus.cc:359] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.632478 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.632779 18928 raft_consensus.cc:740] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.633251 18385 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:01.539188 19030 consensus_queue.cc:237] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.634032 18928 consensus_queue.cc:260] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.638132 18928 ts_tablet_manager.cc:1434] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:18:01.641533 18236 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.653334 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.641156 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.655850 18306 raft_consensus.cc:2393] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:01.640564 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.660059 18350 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.653342 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:01.658974 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 79742.2us
I20260709 12:18:01.664536 18202 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:01.666708 18974 raft_consensus.cc:2393] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.669329 18930 raft_consensus.cc:3060] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.675397 19016 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.677875 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.679198 19027 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.681500 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.684494 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.687873 18930 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.669976 18904 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.663316 19024 raft_consensus.cc:2749] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.671105 19029 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.667717 18378 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
W20260709 12:18:01.665803 18202 leader_election.cc:343] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.658914 18311 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.693953 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.694911 18978 raft_consensus.cc:2393] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.695863 18928 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.698920 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.699672 18972 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:01.701975 18971 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.711086 18311 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
W20260709 12:18:01.711786 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 46026us
I20260709 12:18:01.712383 18971 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:01.712961 18202 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:01.713969 19027 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.714516 19027 raft_consensus.cc:697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.715365 19027 consensus_queue.cc:237] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.719250 18060 catalog_manager.cc:5697] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.720901 18060 catalog_manager.cc:5697] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.725447 18060 catalog_manager.cc:5697] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:01.720325 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 84337.2us
I20260709 12:18:01.722836 18058 catalog_manager.cc:5697] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 2 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.731738 18928 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.731961 18060 catalog_manager.cc:5697] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.734009 18928 tablet_bootstrap.cc:492] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.734563 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.735405 18971 raft_consensus.cc:2393] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:01.737752 18928 ts_tablet_manager.cc:1403] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 12:18:01.739197 18059 catalog_manager.cc:5697] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.741209 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.743853 18928 raft_consensus.cc:359] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.745934 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:01.746380 18928 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.744614 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:01.747152 18928 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.749274 18928 ts_tablet_manager.cc:1434] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:18:01.749491 18237 raft_consensus.cc:2468] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:01.750073 18928 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
W20260709 12:18:01.751058 18276 leader_election.cc:343] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.753716 18276 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.754443 19030 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.761989 18276 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.762810 18907 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.763325 18276 leader_election.cc:343] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.766809 18928 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.767717 18928 tablet_bootstrap.cc:492] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.768354 18928 ts_tablet_manager.cc:1403] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:18:01.768994 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.769732 19040 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.770884 18276 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.771063 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.771552 19040 raft_consensus.cc:2804] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.771925 19040 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.772275 19040 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.772150 18928 raft_consensus.cc:359] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.772852 18928 raft_consensus.cc:740] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.773638 19030 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.773545 18928 consensus_queue.cc:260] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:01.774555 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 110243us
I20260709 12:18:01.769749 18907 raft_consensus.cc:2749] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.775435 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:01.776266 18378 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.776407 18928 ts_tablet_manager.cc:1434] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:18:01.776697 18971 raft_consensus.cc:1275] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.777413 18928 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.778836 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.779196 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.779485 19040 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.777467 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.780598 18311 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.780735 18376 raft_consensus.cc:1275] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.781577 19040 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.784785 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:01.785135 19042 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.785414 18306 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.785665 19042 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.786185 19042 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.788975 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:01.789671 18237 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.792991 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:01.793260 18201 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.793756 18974 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:01.794088 19016 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.794516 19016 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.794898 19016 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.796837 18237 raft_consensus.cc:2468] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:01.799783 18276 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:01.800838 19040 raft_consensus.cc:2804] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.801355 19040 raft_consensus.cc:697] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:01.802179 19040 consensus_queue.cc:237] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.803593 19016 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.804250 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
W20260709 12:18:01.805713 18276 leader_election.cc:343] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.806099 19016 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:01.807595 19016 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.807906 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.808651 18971 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.814248 18974 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.817092 18202 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.817610 18275 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.820451 18275 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.822474 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:01.823681 18311 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.825322 19042 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:01.825600 19030 raft_consensus.cc:2749] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.826532 19030 raft_consensus.cc:2749] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.827491 18275 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.828119 19017 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.828655 19017 raft_consensus.cc:697] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.829484 19017 consensus_queue.cc:237] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.831084 19021 raft_consensus.cc:2749] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.834954 18202 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:01.836001 19038 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.836126 18202 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:01.836421 19038 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:01.836817 19038 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.840909 19042 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:01.840950 18376 raft_consensus.cc:2393] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:01.842353 18060 catalog_manager.cc:5697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.844862 18900 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.845443 18900 raft_consensus.cc:697] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.845988 18971 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:01.846252 18900 consensus_queue.cc:237] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.850943 18311 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.859954 18059 catalog_manager.cc:5697] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.868476 19038 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:01.873812 18275 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.874989 19040 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.881327 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.881992 18974 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.882241 18202 leader_election.cc:343] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:01.883715 18202 leader_election.cc:343] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.883636 19016 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.885952 19016 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.887619 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:01.899832 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:01.900482 18307 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.898842 18202 leader_election.cc:343] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:01.903905 18350 leader_election.cc:343] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:01.885427 19038 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:01.907287 18307 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.904172 18854 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:18:01.934250 18350 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.941511 18202 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:01.941905 18928 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:01.943775 18350 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:01.926925 18974 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:01.947048 19024 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.948789 18928 tablet_bootstrap.cc:492] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:01.949461 18928 ts_tablet_manager.cc:1403] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.172s	user 0.049s	sys 0.053s
I20260709 12:18:01.942222 19041 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.943773 19027 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.953621 18202 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:01.957196 18977 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.954586 19041 raft_consensus.cc:697] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:01.957412 18928 raft_consensus.cc:359] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.957901 18900 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.958163 18928 raft_consensus.cc:740] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:01.958509 18900 raft_consensus.cc:697] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:01.958906 18928 consensus_queue.cc:260] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.958551 19041 consensus_queue.cc:237] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:01.959432 18900 consensus_queue.cc:237] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:01.963114 19049 log.cc:927] Time spent T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 12:18:01.964493 18928 ts_tablet_manager.cc:1434] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:01.967871 18060 catalog_manager.cc:5697] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.969394 18928 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:01.969630 18060 catalog_manager.cc:5697] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.982151 18306 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.979938 19053 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:18:02.027318 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 80686us
I20260709 12:18:02.028048 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:02.028661 19060 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:02.014991 19027 raft_consensus.cc:697] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:02.029639 19024 raft_consensus.cc:697] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:02.019109 19017 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:18:02.046993 19027 consensus_queue.cc:237] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.055142 18379 raft_consensus.cc:1275] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.059942 18309 raft_consensus.cc:1275] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.073093 19053 consensus_queue.cc:1048] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.086047 19053 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:18:02.107687 19024 consensus_queue.cc:237] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:02.124442 18202 consensus_peers.cc:597] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:02.127918 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 91995.2us
W20260709 12:18:02.130168 18202 consensus_peers.cc:597] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.158176 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:02.167831 18060 catalog_manager.cc:5697] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 2 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.182876 18307 raft_consensus.cc:1275] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.187713 18976 raft_consensus.cc:1275] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.192876 18971 raft_consensus.cc:1275] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.199929 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:02.200798 18974 raft_consensus.cc:2393] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:02.207701 18236 raft_consensus.cc:1275] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.212590 19040 consensus_queue.cc:1048] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.214923 18974 raft_consensus.cc:1275] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.222587 19040 consensus_queue.cc:1048] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.241572 18928 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.243571 19041 consensus_queue.cc:1048] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.243690 18928 tablet_bootstrap.cc:492] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.247045 19041 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.249778 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:02.252161 19060 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:18:02.252236 18202 consensus_peers.cc:597] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.256415 19041 consensus_queue.cc:1048] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.257452 18058 catalog_manager.cc:5697] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.260159 18058 catalog_manager.cc:5697] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:02.268288 18060 catalog_manager.cc:5697] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 2, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 2 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.295078 18974 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.295928 18928 ts_tablet_manager.cc:1403] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.019s
I20260709 12:18:02.296798 19065 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.308578 18928 raft_consensus.cc:359] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:02.309662 18928 raft_consensus.cc:740] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
W20260709 12:18:02.319080 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 106714us
I20260709 12:18:02.332041 18928 consensus_queue.cc:260] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:02.337134 18309 raft_consensus.cc:1275] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:02.331012 18202 consensus_peers.cc:597] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:02.323567 18276 consensus_peers.cc:597] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.314205 18306 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.345985 18236 raft_consensus.cc:1275] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.347982 19065 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.347936 19076 consensus_queue.cc:1048] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:02.321409 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.357031 18350 consensus_peers.cc:597] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:02.363719 18928 ts_tablet_manager.cc:1434] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:18:02.364703 18928 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.371153 19042 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:02.379480 18350 consensus_peers.cc:597] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:02.462608 18928 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.464735 18928 tablet_bootstrap.cc:492] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.466346 18928 ts_tablet_manager.cc:1403] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.010s
I20260709 12:18:02.468885 18978 raft_consensus.cc:1275] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.480993 18306 raft_consensus.cc:1275] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.482928 18978 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.486485 19027 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.486033 18307 raft_consensus.cc:1275] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.491308 19024 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:18:02.501225 18854 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:02.510811 18307 raft_consensus.cc:1275] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.513230 18376 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.521723 19065 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.523970 18928 raft_consensus.cc:359] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.525063 18928 raft_consensus.cc:740] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.526082 18928 consensus_queue.cc:260] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.500787 19052 consensus_queue.cc:1048] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:18:02.535454 18928 ts_tablet_manager.cc:1434] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.003s
I20260709 12:18:02.555835 18928 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.570015 18305 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.578562 19060 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.553287 19017 consensus_queue.cc:1048] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:18:02.617944 18276 consensus_peers.cc:597] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.623770 18276 consensus_peers.cc:597] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.652251 18350 consensus_peers.cc:597] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.655004 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.724794 18202 consensus_peers.cc:597] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:02.725584 18202 consensus_peers.cc:597] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:02.741170 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:02.744258 18305 raft_consensus.cc:1275] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.777475 18974 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.778873 19037 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.786247 18928 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.788726 18928 tablet_bootstrap.cc:492] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.789428 18928 ts_tablet_manager.cc:1403] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.253s	user 0.015s	sys 0.008s
I20260709 12:18:02.802242 18928 raft_consensus.cc:359] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.803514 18928 raft_consensus.cc:740] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.804842 18928 consensus_queue.cc:260] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.813609 19060 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:02.815757 18928 ts_tablet_manager.cc:1434] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:18:02.816944 18928 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.829909 18971 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:02.865927 18928 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.867280 18928 tablet_bootstrap.cc:492] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.868146 18928 ts_tablet_manager.cc:1403] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.004s
I20260709 12:18:02.870868 18928 raft_consensus.cc:359] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.871554 18928 raft_consensus.cc:740] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.872956 18928 consensus_queue.cc:260] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.875569 18928 ts_tablet_manager.cc:1434] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:02.876762 18928 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.893250 18928 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.894099 18928 tablet_bootstrap.cc:492] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.894775 18928 ts_tablet_manager.cc:1403] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:18:02.897176 18928 raft_consensus.cc:359] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.897842 18928 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.898481 18928 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.900458 18928 ts_tablet_manager.cc:1434] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:02.901556 18928 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.914288 18928 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.915077 18928 tablet_bootstrap.cc:492] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.915645 18928 ts_tablet_manager.cc:1403] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 12:18:02.917486 18928 raft_consensus.cc:359] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:02.917938 18928 raft_consensus.cc:740] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.918531 18928 consensus_queue.cc:260] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:02.920048 18928 ts_tablet_manager.cc:1434] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:18:02.920957 18928 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.933844 18928 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.934744 18928 tablet_bootstrap.cc:492] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.935439 18928 ts_tablet_manager.cc:1403] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
W20260709 12:18:02.935833 18276 consensus_peers.cc:597] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:02.937357 18928 raft_consensus.cc:359] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.937917 18928 raft_consensus.cc:740] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.938621 18928 consensus_queue.cc:260] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.940629 18928 ts_tablet_manager.cc:1434] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:02.941625 18928 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.957257 18928 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.958263 18928 tablet_bootstrap.cc:492] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.959050 18928 ts_tablet_manager.cc:1403] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 12:18:02.961249 18928 raft_consensus.cc:359] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.961743 18928 raft_consensus.cc:740] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.962266 18928 consensus_queue.cc:260] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:02.963798 18928 ts_tablet_manager.cc:1434] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:18:02.964826 18928 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:02.982817 18928 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:02.983518 18928 tablet_bootstrap.cc:492] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:02.984056 18928 ts_tablet_manager.cc:1403] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:18:02.985960 18928 raft_consensus.cc:359] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.986471 18928 raft_consensus.cc:740] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:02.987012 18928 consensus_queue.cc:260] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:02.989091 18928 ts_tablet_manager.cc:1434] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:02.990327 18928 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.010003 18928 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.010818 18928 tablet_bootstrap.cc:492] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.011338 18928 ts_tablet_manager.cc:1403] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:18:03.013468 18928 raft_consensus.cc:359] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.013947 18928 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.014569 18928 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.016608 18928 ts_tablet_manager.cc:1434] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:03.017805 18928 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.048074 18928 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.049149 18928 tablet_bootstrap.cc:492] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.049882 18928 ts_tablet_manager.cc:1403] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 12:18:03.052558 18928 raft_consensus.cc:359] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.053181 18928 raft_consensus.cc:740] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.053886 18928 consensus_queue.cc:260] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.055977 18928 ts_tablet_manager.cc:1434] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:18:03.056869 18928 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.059721 18971 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.074868 18928 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.075711 18928 tablet_bootstrap.cc:492] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.076242 18928 ts_tablet_manager.cc:1403] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:18:03.078526 18928 raft_consensus.cc:359] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.079152 18928 raft_consensus.cc:740] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.080003 18928 consensus_queue.cc:260] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.081791 18928 ts_tablet_manager.cc:1434] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:03.082664 18928 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.096457 18928 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.097167 18928 tablet_bootstrap.cc:492] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.097687 18928 ts_tablet_manager.cc:1403] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:18:03.099758 18928 raft_consensus.cc:359] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.100255 18928 raft_consensus.cc:740] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.100903 18928 consensus_queue.cc:260] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.102749 18928 ts_tablet_manager.cc:1434] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:18:03.103968 18928 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.119297 18928 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.120563 18928 tablet_bootstrap.cc:492] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.121217 18928 ts_tablet_manager.cc:1403] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:18:03.123426 18928 raft_consensus.cc:359] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.123951 18928 raft_consensus.cc:740] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.124483 18928 consensus_queue.cc:260] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.126470 18928 ts_tablet_manager.cc:1434] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:18:03.127791 18928 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.143054 18928 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.143860 18928 tablet_bootstrap.cc:492] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.144418 18928 ts_tablet_manager.cc:1403] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:18:03.146791 18928 raft_consensus.cc:359] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.147372 18928 raft_consensus.cc:740] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.147943 18928 consensus_queue.cc:260] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.150034 18928 ts_tablet_manager.cc:1434] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:03.150926 18928 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.156237 18974 raft_consensus.cc:3060] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.187299 18928 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.188318 18928 tablet_bootstrap.cc:492] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.190057 18928 ts_tablet_manager.cc:1403] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.013s
I20260709 12:18:03.192785 18928 raft_consensus.cc:359] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.193428 18928 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.193878 18971 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.194021 18928 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.196027 18928 ts_tablet_manager.cc:1434] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:03.196890 18928 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.265739 18928 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.266707 18928 tablet_bootstrap.cc:492] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.267422 18928 ts_tablet_manager.cc:1403] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.020s
I20260709 12:18:03.270251 18928 raft_consensus.cc:359] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.270992 18928 raft_consensus.cc:740] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.271788 18928 consensus_queue.cc:260] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.273692 18928 ts_tablet_manager.cc:1434] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:03.277602 18928 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.289718 18928 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.290499 18928 tablet_bootstrap.cc:492] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.291045 18928 ts_tablet_manager.cc:1403] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 12:18:03.292984 18928 raft_consensus.cc:359] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.293579 18928 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.294108 18928 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.295463 18928 ts_tablet_manager.cc:1434] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:03.296653 18928 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.317644 18928 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.318730 18928 tablet_bootstrap.cc:492] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.319406 18928 ts_tablet_manager.cc:1403] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:18:03.321624 18928 raft_consensus.cc:359] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.322194 18928 raft_consensus.cc:740] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.322991 18928 consensus_queue.cc:260] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:03.324963 18928 ts_tablet_manager.cc:1434] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:03.326160 18928 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap starting.
I20260709 12:18:03.352741 18928 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:03.353729 18928 tablet_bootstrap.cc:492] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Bootstrap complete.
I20260709 12:18:03.354461 18928 ts_tablet_manager.cc:1403] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 12:18:03.357197 18928 raft_consensus.cc:359] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.357880 18928 raft_consensus.cc:740] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Initialized, Role: FOLLOWER
I20260709 12:18:03.358548 18928 consensus_queue.cc:260] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:03.360741 18928 ts_tablet_manager.cc:1434] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:03.370817 18970 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.745421 18971 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.860085 19076 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.860658 19076 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.862669 19042 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.863350 19042 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.863641 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:03.864410 18378 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:03.864837 19076 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:03.864672 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:03.865620 19042 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:03.865928 18970 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:03.866539 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:03.866866 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:03.867192 18310 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:03.867275 18276 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:03.867623 18971 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:03.868170 19076 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.868536 19076 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.868536 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:03.869020 19076 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.869524 19042 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.869997 19042 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.870348 19042 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.876088 19076 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.877924 19042 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.878681 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:03.879053 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:03.879506 18378 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:03.879806 18971 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.879984 19042 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:03.878295 19076 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:03.881362 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:03.882102 18310 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:03.882086 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:03.884028 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:03.886489 19042 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:03.887633 18971 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:03.888696 18276 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:03.889775 19076 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:03.890275 19076 raft_consensus.cc:697] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:03.891469 19076 consensus_queue.cc:237] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:03.904397 18060 catalog_manager.cc:5697] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:04.287107 18970 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:04.288408 19021 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:04.300853 18378 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:04.304428 19076 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:10.456151 19153 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.456668 19148 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.456885 19153 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.490603 19155 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.498797 19158 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.537017 19158 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:10.504078 19152 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.538589 19152 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.540162 19153 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.540596 19152 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.506712 19159 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.508527 19156 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.510196 19160 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.516667 19149 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.521319 19146 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.552279 19143 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.552763 19146 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.552927 19143 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:10.552373 19144 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.554502 19144 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.531538 19162 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.543979 19160 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.558303 19169 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.558931 19169 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.560527 19146 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.561107 19144 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.561527 19158 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:10.563282 19143 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:10.561168 19149 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.567411 19149 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.569645 19160 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.579335 19152 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.579968 19152 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.582119 19152 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.583636 19149 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.544855 19155 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.555883 19159 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:10.570230 19160 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.594555 19162 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:10.609366 19149 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.610037 19160 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.541077 19148 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.611565 19149 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.598323 19151 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.606376 19158 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.595374 19156 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:10.612275 19158 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.619611 19169 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.620313 19169 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.620842 19169 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:10.621606 19155 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.623077 19169 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.623448 19158 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.624224 19159 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:10.612115 19160 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.905892 19167 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.906749 19168 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.906656 19167 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.907351 19168 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.909085 19167 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.635524 19153 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.909564 19168 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.696516 19152 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.910923 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:10.915012 18385 raft_consensus.cc:2468] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:10.917462 19157 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.918862 19145 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.919277 19162 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.914130 19158 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.921574 19158 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.916085 19160 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.922542 19160 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:10.923733 19158 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.902657 19148 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.924291 19159 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.914445 19153 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.926363 19160 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.927314 19153 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.928051 19163 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.928602 19163 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:10.615460 19151 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:10.918006 19157 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:10.934813 19160 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.988350 19160 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:10.959693 19169 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:10.958815 19162 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:10.932005 19167 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:10.939100 19156 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:11.029264 19167 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:11.029435 19169 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:11.030651 19160 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:10.919405 19145 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:11.031476 19167 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:11.031653 19169 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.936586 19163 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:10.931578 19152 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:11.028239 19157 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:10.925805 19159 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:11.029171 19151 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:11.036772 19160 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:11.029161 19162 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:11.047135 19160 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:11.048868 19162 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:11.049306 19160 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:11.049460 19145 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:11.036530 19167 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:11.050765 19167 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:11.051828 19152 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:11.052912 19167 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:11.037933 19169 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:11.053989 19169 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:11.056217 19169 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:11.035426 19156 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:11.059122 19156 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:11.061290 19156 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:11.499328 19159 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:11.560427 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:11.986204  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:12.122107 18922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.007s	sys 0.030s
W20260709 12:18:12.123085 18922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.007s	sys 0.030s
I20260709 12:18:12.576862 19182 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.577529 19182 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.675313 19184 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.676262 19184 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.678586 19184 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.699919 19185 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.700933 19184 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.701104 19185 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.703344 19185 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.703896 19184 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.705402 19184 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.710094 19182 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.711532 19187 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.712147 19187 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.714295 19187 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.714561 19182 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.715318 19187 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.715193 19182 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.716135 19187 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.717638 19182 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.718200 19187 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:12.724553 18406 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0580 after lost signal to thread 8910
W20260709 12:18:12.726073 18406 debug-util.cc:398] Leaking SignalData structure 0x7b080012b760 after lost signal to thread 18094
I20260709 12:18:12.757611 19187 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.760664 19187 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.764816 19187 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:12.784209 19189 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.785521 19189 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.788905 19189 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:12.817449 18925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.027s	sys 0.033s
W20260709 12:18:12.818244 18925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.871s	user 0.028s	sys 0.033s
I20260709 12:18:12.819520 19182 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.820432 19182 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.823302 19182 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.824586 19186 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.825615 19186 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.826746 19182 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.827174 19184 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.827842 19182 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.828217 19184 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.830744 19182 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.831238 19184 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.828591 19186 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.832397 19184 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.833315 19185 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.833353 19184 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.834482 19185 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.835309 19186 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.836138 19186 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.836442 19184 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.836999 19185 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.837070 19184 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.838215 19184 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.838608 19186 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.840413 19184 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.840591 19182 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.841658 19182 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.844535 19182 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.847751 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:12.848233 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:12.849138 18309 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:12.853767 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:12.858764 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57252 (request call id 354) took 2222 ms. Trace:
I20260709 12:18:12.859580 18305 rpcz_store.cc:276] 0709 12:18:10.635807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.636383 (+   576us) service_pool.cc:224] Handling call
0709 12:18:10.912607 (+276224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.855847 (+1943240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.855918 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.856005 (+    87us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.856068 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.858090 (+  2022us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540016fb54. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:18:12.858172 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.858494 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4466628992}
I20260709 12:18:12.864140 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:12.866413 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57252 (request call id 350) took 2257 ms. Trace:
I20260709 12:18:12.867139 18308 rpcz_store.cc:276] 0709 12:18:10.609130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.609265 (+   135us) service_pool.cc:224] Handling call
0709 12:18:10.609607 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.623968 (+ 14361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.624003 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.624049 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:10.624081 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.865772 (+2241691us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400103454. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:18:12.865868 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.866180 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32545024}
I20260709 12:18:12.868414 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57252 (request call id 356) took 1953 ms. Trace:
I20260709 12:18:12.868813 18310 rpcz_store.cc:276] 0709 12:18:10.914770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.915164 (+   394us) service_pool.cc:224] Handling call
0709 12:18:12.867553 (+1952389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.868003 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.868022 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.868058 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.868119 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.868161 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.868252 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:12.871495 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.959s	user 0.017s	sys 0.056s
W20260709 12:18:12.872162 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.961s	user 0.018s	sys 0.056s
I20260709 12:18:12.877915 19189 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.878829 19189 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:12.879307 18923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.890s	user 0.041s	sys 0.048s
I20260709 12:18:12.881439 19189 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:12.882026 19189 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
W20260709 12:18:12.882332 18923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.893s	user 0.042s	sys 0.048s
I20260709 12:18:12.882876 19189 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.883616 19182 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.884681 19182 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.886103 19189 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:12.887598 19182 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.887941 19192 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.888729 19189 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.889127 19184 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.889101 19192 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.889984 19189 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.890386 19184 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:12.891011 18924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.853s	user 0.022s	sys 0.013s
I20260709 12:18:12.891215 19182 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.892288 19192 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:12.892814 19189 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:12.893915 18924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.858s	user 0.022s	sys 0.013s
I20260709 12:18:12.894349 19184 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.892040 19182 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.895385 19184 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.895732 19186 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:12.896226 19184 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:12.896548 19186 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.899046 19184 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.899176 18969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 324) took 2297 ms. Trace:
I20260709 12:18:12.899796 18969 rpcz_store.cc:276] 0709 12:18:10.604135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.897416 (+2293281us) service_pool.cc:224] Handling call
0709 12:18:12.898125 (+   709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.898560 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.898591 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.898659 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.898722 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.898800 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.898933 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:12.901823 18969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53966 (request call id 335) took 1977 ms (client timeout 1586 ms). Trace:
I20260709 12:18:12.902081 18973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 321) took 2301 ms. Trace:
W20260709 12:18:12.902288 18969 rpcz_store.cc:269] 0709 12:18:10.924174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.901449 (+1977275us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:12.901693 (+   244us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:18:12.902631 18973 rpcz_store.cc:276] 0709 12:18:10.600333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.900475 (+2300142us) service_pool.cc:224] Handling call
0709 12:18:12.901062 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.901501 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.901541 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.901618 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.901689 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.901760 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.901905 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:12.904227 18969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53966 (request call id 333) took 1980 ms (client timeout 1736 ms). Trace:
W20260709 12:18:12.904728 18969 rpcz_store.cc:269] 0709 12:18:10.923632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.903984 (+1980352us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:12.904161 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:18:12.899135 19186 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.905175 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:12.906453 18973 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:12.909543 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:12.919188 18275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.289s	user 0.021s	sys 0.026s
I20260709 12:18:12.923067 19186 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.924064 18969 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:12.924160 19186 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:12.925596 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:12.923472 18275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.294s	user 0.022s	sys 0.027s
I20260709 12:18:12.928422 18972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 318) took 2328 ms. Trace:
I20260709 12:18:12.924340 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 316) took 2325 ms. Trace:
I20260709 12:18:12.926296 19188 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.926486 18969 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:12.926612 19187 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.930792 18971 rpcz_store.cc:276] 0709 12:18:10.598837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.922880 (+2324043us) service_pool.cc:224] Handling call
0709 12:18:12.923437 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.923806 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.923832 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.923899 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.923963 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.924021 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.924166 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.934804 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:12.935691 18971 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:12.937063 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:12.937731 18971 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:12.938360 19190 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.930418 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 322) took 2329 ms. Trace:
I20260709 12:18:12.939301 19190 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.941165 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 325) took 2316 ms. Trace:
I20260709 12:18:12.941931 19190 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.939437 18972 rpcz_store.cc:276] 0709 12:18:10.599442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.926839 (+2327397us) service_pool.cc:224] Handling call
0709 12:18:12.927479 (+   640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.927912 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.927938 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.928006 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.928045 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.928125 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.928254 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.943423 19182 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.931442 19186 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:12.931511 19187 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.946183 19187 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:18:12.931667 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.319s	user 0.016s	sys 0.004s
I20260709 12:18:12.931350 19188 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:12.947482 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.335s	user 0.017s	sys 0.004s
I20260709 12:18:12.939541 18976 rpcz_store.cc:276] 0709 12:18:10.600652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.929199 (+2328547us) service_pool.cc:224] Handling call
0709 12:18:12.929622 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.929922 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.929953 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.930012 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.930046 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.930126 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.930239 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.931953 19184 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
W20260709 12:18:12.947932 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 2.33555e+06us
I20260709 12:18:12.948457 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 317) took 2349 ms. Trace:
I20260709 12:18:12.949096 18974 rpcz_store.cc:276] 0709 12:18:10.599142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.947295 (+2348153us) service_pool.cc:224] Handling call
0709 12:18:12.947713 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.947998 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.948031 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.948070 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.948115 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.948168 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.948278 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.950182 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 327) took 2320 ms. Trace:
I20260709 12:18:12.950723 18976 rpcz_store.cc:276] 0709 12:18:10.629280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.948973 (+2319693us) service_pool.cc:224] Handling call
0709 12:18:12.949441 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.949720 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.949761 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.949843 (+    82us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.949924 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.949989 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.950113 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.952313 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 328) took 2208 ms. Trace:
I20260709 12:18:12.953365 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 298) took 2047 ms. Trace:
I20260709 12:18:12.948530 19184 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.954145 18976 rpcz_store.cc:276] 0709 12:18:10.905906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.952035 (+2046129us) service_pool.cc:224] Handling call
0709 12:18:12.952501 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.952930 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.952966 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.953042 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.953105 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.953166 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.953297 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.955237 18977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 320) took 2355 ms. Trace:
I20260709 12:18:12.956372 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 299) took 2050 ms. Trace:
I20260709 12:18:12.956287 19184 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.952870 18974 rpcz_store.cc:276] 0709 12:18:10.743714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.950486 (+2206772us) service_pool.cc:224] Handling call
0709 12:18:12.951030 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.951812 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.951850 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.951936 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.952023 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.952107 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.952248 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.957022 18976 rpcz_store.cc:276] 0709 12:18:10.906219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.955406 (+2049187us) service_pool.cc:224] Handling call
0709 12:18:12.955805 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.956035 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.956063 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.956123 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.956151 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.956200 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.956304 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.959291 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 300) took 2052 ms. Trace:
I20260709 12:18:12.959441 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 301) took 2052 ms. Trace:
I20260709 12:18:12.948091 18971 rpcz_store.cc:276] 0709 12:18:10.624778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.938504 (+2313726us) service_pool.cc:224] Handling call
0709 12:18:12.940398 (+  1894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.940774 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.940798 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.940857 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.940906 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.940961 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.941076 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.962188 19188 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:12.962896 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 302) took 2055 ms. Trace:
I20260709 12:18:12.959717 18974 rpcz_store.cc:276] 0709 12:18:10.906491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.958071 (+2051580us) service_pool.cc:224] Handling call
0709 12:18:12.958541 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.958897 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.958932 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.958986 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.959050 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.959123 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.959235 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.946585 19187 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.964555 19149 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
W20260709 12:18:12.923074 18973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53966 (request call id 334) took 1999 ms (client timeout 2207 ms). Trace:
I20260709 12:18:12.964962 19187 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:12.965762 18973 rpcz_store.cc:269] 0709 12:18:10.923917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.904677 (+1980760us) service_pool.cc:224] Handling call
0709 12:18:12.922970 (+ 18293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.969458 19188 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:12.970438 19188 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:12.968317 19149 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:12.973253 19188 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.973851 19188 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.974457 19188 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:12.977243 19188 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:12.955698 18977 rpcz_store.cc:276] 0709 12:18:10.600044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.953855 (+2353811us) service_pool.cc:224] Handling call
0709 12:18:12.954353 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.954770 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.954802 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.954858 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.954919 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.954976 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.955080 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.970347 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 303) took 2063 ms. Trace:
I20260709 12:18:12.978919 18974 rpcz_store.cc:276] 0709 12:18:10.907263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.968957 (+2061694us) service_pool.cc:224] Handling call
0709 12:18:12.969466 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.969878 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.969911 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.969994 (+    83us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.970025 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.970095 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.970266 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.959955 18976 rpcz_store.cc:276] 0709 12:18:10.906754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.958442 (+2051688us) service_pool.cc:224] Handling call
0709 12:18:12.958863 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.959115 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.959144 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.959194 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.959225 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.959287 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.959391 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.974018 19149 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.932598 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:12.980113 18977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 305) took 2072 ms. Trace:
I20260709 12:18:12.979960 18973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 304) took 2072 ms. Trace:
I20260709 12:18:12.968255 19187 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:12.953227 18975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 323) took 2352 ms. Trace:
I20260709 12:18:12.981980 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 307) took 2073 ms. Trace:
I20260709 12:18:12.981316 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 306) took 2073 ms. Trace:
I20260709 12:18:12.982486 18976 rpcz_store.cc:276] 0709 12:18:10.908527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.980800 (+2072273us) service_pool.cc:224] Handling call
0709 12:18:12.981272 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.981575 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.981619 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.981662 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.981733 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.981790 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.981913 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.982900 18974 rpcz_store.cc:276] 0709 12:18:10.908245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.980227 (+2071982us) service_pool.cc:224] Handling call
0709 12:18:12.980659 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.980909 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.980940 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.981005 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.981062 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.981129 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.981257 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.982372 18975 rpcz_store.cc:276] 0709 12:18:10.600918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.951780 (+2350862us) service_pool.cc:224] Handling call
0709 12:18:12.952277 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.952563 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.952614 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.952704 (+    90us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.952780 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.952867 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.953017 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.985855 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 308) took 2077 ms. Trace:
I20260709 12:18:12.986404 18974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 309) took 2077 ms. Trace:
I20260709 12:18:12.981678 18977 rpcz_store.cc:276] 0709 12:18:10.907932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.978653 (+2070721us) service_pool.cc:224] Handling call
0709 12:18:12.979211 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.979627 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.979655 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.979729 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.979788 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.979942 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.980062 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.947932 18972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 326) took 2322 ms. Trace:
I20260709 12:18:12.988037 18975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 310) took 2078 ms. Trace:
I20260709 12:18:12.986366 18976 rpcz_store.cc:276] 0709 12:18:10.908822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.984490 (+2075668us) service_pool.cc:224] Handling call
0709 12:18:12.984986 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.985408 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.985441 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.985503 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.985589 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.985651 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.985792 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.983477 18969 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:12.963467 18971 rpcz_store.cc:276] 0709 12:18:10.907013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.961722 (+2054709us) service_pool.cc:224] Handling call
0709 12:18:12.962182 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.962476 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.962508 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.962578 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.962642 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.962708 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.962827 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:13.017695 18350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.105s	user 0.028s	sys 0.014s
W20260709 12:18:13.018314 18350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.106s	user 0.028s	sys 0.014s
I20260709 12:18:13.018481 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 329) took 2101 ms. Trace:
I20260709 12:18:13.018918 18971 rpcz_store.cc:276] 0709 12:18:10.916886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.017305 (+2100419us) service_pool.cc:224] Handling call
0709 12:18:13.017888 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.018126 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.018147 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.018199 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:13.018226 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.018281 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.018407 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.020920 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 330) took 2098 ms. Trace:
I20260709 12:18:13.021302 18971 rpcz_store.cc:276] 0709 12:18:10.922665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.019914 (+2097249us) service_pool.cc:224] Handling call
0709 12:18:13.020348 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.020559 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.020589 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.020651 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:13.020700 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.020757 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.020869 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.027833 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:13.029341 18379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33228 (request call id 433) took 2420 ms (client timeout 2207 ms). Trace:
I20260709 12:18:12.989691 18977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53970 (request call id 311) took 2079 ms. Trace:
W20260709 12:18:13.032235 18349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.121s	user 0.020s	sys 0.057s
W20260709 12:18:13.029848 18379 rpcz_store.cc:269] 0709 12:18:10.608840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.609587 (+   747us) service_pool.cc:224] Handling call
0709 12:18:13.027375 (+2417788us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b58000b5298. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:18:13.029154 (+  1779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6467968}
W20260709 12:18:13.032862 18349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.122s	user 0.020s	sys 0.057s
I20260709 12:18:13.038550 19192 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.039577 19192 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.045842 19188 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.046808 19188 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.048127 19189 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.048519 18978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 319) took 2448 ms. Trace:
I20260709 12:18:13.049219 19188 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.048991 18978 rpcz_store.cc:276] 0709 12:18:10.599758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.047343 (+2447585us) service_pool.cc:224] Handling call
0709 12:18:13.047817 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.048023 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.048054 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.048127 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:13.048180 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.048238 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.048359 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.055542 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.056317 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.056528 18378 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.057086 18376 raft_consensus.cc:2468] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.058840 19148 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.042286 19192 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.059276 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.059489 19148 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.059983 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.060894 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.048786 19189 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.062165 18978 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:13.031430 18977 rpcz_store.cc:276] 0709 12:18:10.909791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.988428 (+2078637us) service_pool.cc:224] Handling call
0709 12:18:12.988897 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.989261 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.989290 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.989368 (+    78us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.989433 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.989501 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.989628 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.046196 19197 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.062604 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.063638 19148 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.066211 19188 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:12.981980 18973 rpcz_store.cc:276] 0709 12:18:10.907494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.977904 (+2070410us) service_pool.cc:224] Handling call
0709 12:18:12.979023 (+  1119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.979447 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.979481 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.979539 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.979613 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.979677 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.979822 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.986984 18974 rpcz_store.cc:276] 0709 12:18:10.909172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.985141 (+2075969us) service_pool.cc:224] Handling call
0709 12:18:12.985651 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.985914 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.985938 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.986007 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.986064 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.986144 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.986336 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.034735 18972 rpcz_store.cc:276] 0709 12:18:10.628909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.946817 (+2317908us) service_pool.cc:224] Handling call
0709 12:18:12.947281 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.947519 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.947550 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.947620 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.947684 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.947739 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.947861 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.060901 18379 raft_consensus.cc:2468] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
W20260709 12:18:13.073658 18406 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2800 after lost signal to thread 19007
I20260709 12:18:13.072564 18971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 331) took 2148 ms. Trace:
I20260709 12:18:13.070806 19187 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.076459 19174 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.076714 19187 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.077313 19174 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.078681 19149 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.079130 19187 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.077323 18970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 315) took 2478 ms. Trace:
I20260709 12:18:13.075172 18971 rpcz_store.cc:276] 0709 12:18:10.923019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.022227 (+2099208us) service_pool.cc:224] Handling call
0709 12:18:13.050248 (+ 28021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.070759 (+ 20511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.070789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.070837 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:13.070870 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.070924 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.071062 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.071905 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.016158 18975 rpcz_store.cc:276] 0709 12:18:10.909494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.985693 (+2076199us) service_pool.cc:224] Handling call
0709 12:18:12.986176 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.987634 (+  1458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.987666 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.987735 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.987792 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.987862 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.987979 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.085137 19168 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.085479 19165 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.087333 19188 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.079380 19149 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.081699 18970 rpcz_store.cc:276] 0709 12:18:10.598534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.071752 (+2473218us) service_pool.cc:224] Handling call
0709 12:18:13.076603 (+  4851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.076849 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.076878 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.076932 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:13.076976 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.077039 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.077143 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.072988 19148 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.086900 19159 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.088230 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.090754 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.091006 19174 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:13.092363 18203 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 2.477s	user 0.022s	sys 0.047s
I20260709 12:18:13.095597 19193 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.099138 19189 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.099848 19157 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.100440 19153 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.124917 19157 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:13.102722 18923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.196:33469 timed out after 1.686s (SENT) [suppressed 67 similar messages]
I20260709 12:18:13.086145 18385 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.125314 19159 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.125519 19153 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.109901 19151 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.110229 19152 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
W20260709 12:18:13.124651 18203 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 2.510s	user 0.023s	sys 0.047s
I20260709 12:18:13.115289 19168 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.119071 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 332) took 2195 ms. Trace:
I20260709 12:18:13.128595 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.111945 19192 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.132290 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.126699 19151 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.130362 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.132956 18378 raft_consensus.cc:2468] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.134673 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.120915 19148 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.124588 19165 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.138903 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.141139 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.142112 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.142795 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.143051 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.143883 18380 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.144546 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.144958 19201 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.145252 18384 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.145597 19203 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.145865 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.147151 19148 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.147817 19148 raft_consensus.cc:493] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.147936 18276 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.149190 18276 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.150215 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.127038 19174 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.156052 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.156827 19149 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.158746 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.160161 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.160290 19151 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.160493 19188 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.160995 19151 raft_consensus.cc:2804] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.156251 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.164595 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.156096 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.165944 19174 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.166643 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.166854 18308 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.136636 19152 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.166137 19159 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.167327 19203 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.130998 19197 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.159171 19168 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.170811 19157 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.172320 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.172670 19174 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.161424 19151 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.180142 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.180995 19187 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.181246 19165 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.164866 19192 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.182348 19203 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.182839 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.183562 18311 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.167132 19153 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.184289 19197 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.130884 18976 rpcz_store.cc:276] 0709 12:18:10.923330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.064210 (+2140880us) service_pool.cc:224] Handling call
0709 12:18:13.073847 (+  9637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.074730 (+   883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.075842 (+  1112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:13.080464 (+  4622us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:13.086035 (+  5571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.108935 (+ 22900us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.118623 (+  9688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:13.181650 19187 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.189124 19187 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.163589 19193 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.191672 19148 raft_consensus.cc:515] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.194046 19193 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.174909 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.190917 19201 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.206898 18973 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:13.206974 19204 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.207139 19165 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.207527 19204 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.209714 19204 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.194281 19148 leader_election.cc:290] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.194500 19198 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.218545 19198 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.221455 19198 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.195845 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.222903 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.223182 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.196085 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.196862 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.225920 18384 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.197175 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.227020 18385 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.178846 19149 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.196138 19151 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.198700 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.228214 19149 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.200002 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.200755 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.228338 18380 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.231859 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.233038 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.233786 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.183734 19192 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.234292 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.234464 18309 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.235037 18307 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.235430 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.236011 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.236173 18310 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.236691 18302 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.237282 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.238220 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.238795 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.235047 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.235452 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.241042 19204 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.241483 18309 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.202896 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.197607 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.242811 18381 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:13.243798 18377 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.204101 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.207718 19165 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.244902 19165 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.245534 19149 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.247437 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.247922 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.248135 18303 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.248566 18309 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.249328 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.250056 18304 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.250015 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:13.208083 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 58051.7us
I20260709 12:18:13.208472 19201 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.182655 19152 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.252305 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.252334 18276 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.253654 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.253850 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.254411 19201 raft_consensus.cc:2804] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.254789 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.254894 19201 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.255275 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.253968 18276 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.255836 18924 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.256284 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.208961 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.256791 19184 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.257269 19184 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.254922 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.257735 19152 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.256218 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.258152 19152 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.255505 19201 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.257853 19184 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.257421 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.270681 18924 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.271659 19202 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.271713 19186 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.263020 19152 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.272436 19186 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.272349 19202 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.272989 19186 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.273250 19202 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.272015 18924 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.275849 19182 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.276293 19182 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.276680 19182 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.280994 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.281632 19186 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.257248 18311 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.284724 19165 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.285801 19186 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:13.264771 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 118054us
W20260709 12:18:13.297048 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 194362us
I20260709 12:18:13.299183 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.299399 19204 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.276060 18924 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.300904 19152 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.301760 19151 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.301997 18924 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.303061 19190 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.303507 19190 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.303681 19165 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.303184 18924 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.303936 19190 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:13.306402 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 168407us
I20260709 12:18:13.307585 19188 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.308213 19185 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.308538 18201 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.308657 19185 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.308274 19188 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.309473 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "012abbd307bb440c93b80adee8541719"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "c0771afef8984a5e9edd45be358960a2"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:13.310384 18237 raft_consensus.cc:606] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Received request to transfer leadership to TS c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.311432 19188 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.312134 19184 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.313896 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:13.313467 18924 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.315687 19206 raft_consensus.cc:2804] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.315405 19192 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.316655 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.321237 19182 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.316071 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.318542 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.379377 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.316936 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.317703 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.322602 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.321687 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.320142 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.319336 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.303599 19186 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.320932 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.378808 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.309204 19185 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.357947 18309 raft_consensus.cc:2393] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.368865 19152 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.387918 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.388171 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.389242 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.371462 18923 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.363368 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.373620 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.374835 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.375605 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.394649 18382 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.376202 19190 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.376341 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.377123 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.395785 18377 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.395985 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.396299 18380 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.383841 19186 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.396880 18977 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:13.397111 19186 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.397346 19190 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.395788 19182 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.400373 19182 raft_consensus.cc:2804] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.400795 19182 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.368168 18970 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.378896 19201 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.380592 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.401930 18306 raft_consensus.cc:2393] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.402266 19151 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.402920 19201 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.357448 18237 raft_consensus.cc:606] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.403748 19184 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.407255 19190 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.363444 19206 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.407992 19206 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.413165 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.413367 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.413854 18234 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.414189 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.409307 19190 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.409862 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.416203 18970 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.410694 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
W20260709 12:18:13.411168 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 154013us
I20260709 12:18:13.410245 19202 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.415408 18276 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.415021 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.418562 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.420831 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.407408 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.424153 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.424968 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.425335 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.426067 18232 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.426621 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.427011 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.427927 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.428555 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.428943 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.429378 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.430653 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.422588 18237 raft_consensus.cc:606] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.418243 19190 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.422799 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.438021 18234 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.438058 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.435055 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.435616 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.436326 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.436563 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.415941 19192 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.437059 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.401211 19182 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.434967 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.437237 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.447369 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:13.447973 18235 raft_consensus.cc:606] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.439419 18970 raft_consensus.cc:2468] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:13.442451 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.437306 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.443251 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:13.443173 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 71797.4us
I20260709 12:18:13.446086 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.441524 18201 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.440901 19201 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.457998 19201 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.458545 19201 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.451228 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.460497 19188 raft_consensus.cc:2804] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.460935 19188 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.461313 19188 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.455817 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.456457 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.464814 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.467598 18923 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.468834 19185 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.445981 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.459604 18201 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.454907 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.472421 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.479111 18972 raft_consensus.cc:1240] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.474638 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.475100 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.475560 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.481595 19212 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.482473 19212 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.458282 19192 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:13.481175 18977 raft_consensus.cc:1240] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.482945 19212 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.484867 18382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:41324
I20260709 12:18:13.485546 18382 raft_consensus.cc:606] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.487344 19202 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.488662 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:13.459214 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.488767 19206 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.488726 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.489950 19207 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.498327 19149 raft_consensus.cc:993] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:13.554255 19207 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.493759 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.554862 19207 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.495182 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.502545 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.495584 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.516709 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.494742 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.495263 19190 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.501544 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.561261 18202 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.561993 19190 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.553272 18231 raft_consensus.cc:1240] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.517308 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.565377 18229 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.559928 19149 raft_consensus.cc:1081] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:13.516295 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.567584 18236 raft_consensus.cc:2468] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.526840 19188 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.558254 18233 raft_consensus.cc:606] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.564061 18230 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.500196 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.517525 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.570238 19188 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.522936 19187 raft_consensus.cc:993] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
W20260709 12:18:13.454690 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 141347us
I20260709 12:18:13.570391  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:13.571599 18924 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.521656 19186 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.572729  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:13.573873  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:13.574309 19186 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.502079 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.580080 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.581274 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.576084 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.500432 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.582355 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.584236 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.565997 19207 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.508812 19185 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.562552 19193 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.482841 18923 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.583266 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.596590 19193 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.507066 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.499776 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.493500 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:13.598171 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 115437us
I20260709 12:18:13.568603 18309 raft_consensus.cc:1240] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.578817 19187 raft_consensus.cc:1081] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:13.559274 19201 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.578807 19213 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.509362 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.598171 19193 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.600176 19185 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.587448 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.495784 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.600386 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.599967 19213 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.602624 18304 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:13.602856 19213 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.579273 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.608489 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.611371 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.611819 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.611860 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.609232 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.595149 18236 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.566618 18276 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.613150 18302 raft_consensus.cc:2393] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.600713 19185 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.582803 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.586059 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.554206 19206 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.599759 19207 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.592140 19212 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.610991 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.616042 19202 raft_consensus.cc:2804] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:13.612726 18303 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.593751 19182 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.618556 19202 raft_consensus.cc:697] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:13.609207 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.619582 19202 consensus_queue.cc:237] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.620072 18308 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.620400 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.611191 18923 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.622525 18923 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.612066 18306 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.628403 19212 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.587270 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.583454 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.582894 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.635723 18229 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
W20260709 12:18:13.614012 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 47503us
I20260709 12:18:13.585824 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.614894 19185 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.617444 18305 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.645648 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.645795 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.648101 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.651925 18308 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:13.655071 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.621181 18309 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 3: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.625663 19201 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.627601 19190 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.635373 19213 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.652475 18305 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:13.562593 18971 raft_consensus.cc:1240] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.653158 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.655953 18924 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.653641 18303 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.656466 19190 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.659595 19212 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:13.654318 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.661474 19212 raft_consensus.cc:697] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:13.655243 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.662489 19212 consensus_queue.cc:237] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.627416 19182 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.660562 19190 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.654322 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.668082 18924 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.669034 19186 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:13.669531 19186 raft_consensus.cc:697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:13.669786 18276 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.668263 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.670895 18237 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:13.670338 19186 consensus_queue.cc:237] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:13.613709 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 50835.2us
I20260709 12:18:13.670584 19204 raft_consensus.cc:2749] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:13.605455 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 77239us
I20260709 12:18:13.674587 19190 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.675097 18924 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.675884 18973 raft_consensus.cc:1240] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.676205 19186 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:13.676745 19186 raft_consensus.cc:697] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:13.676996 19185 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.677678 19186 consensus_queue.cc:237] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.679373 19190 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.658494 19213 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.682327 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.683123 19214 raft_consensus.cc:993] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:13.683581 19206 raft_consensus.cc:1081] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:13.684103 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.685559 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.686833 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.688370 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.689815 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.691071 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.692438 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.693743 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.694536 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.694977 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.696250 18276 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.697022 19204 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.697386 19204 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.697746 19204 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.698549 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.703253 18306 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:13.704682 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.706368 18924 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:18:13.707108 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 84708.6us
I20260709 12:18:13.707459 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.709431 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.710005 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.710764 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.711174 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.711814 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.708906 19193 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.713078 18236 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.713572 19212 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:13.709015 18060 catalog_manager.cc:5697] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.710871 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.713249 19213 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.714155 19212 raft_consensus.cc:697] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:13.715070 18275 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.716248 19201 raft_consensus.cc:2749] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.714658 19202 consensus_queue.cc:1059] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:13.717500 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.717679 19201 raft_consensus.cc:3055] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:13.718050 19201 raft_consensus.cc:740] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:13.718636 19151 raft_consensus.cc:2749] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.719233 19213 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.719628 19213 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.719816 18275 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.719851 18059 catalog_manager.cc:5697] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.721135 19151 raft_consensus.cc:2749] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.718891 19201 consensus_queue.cc:260] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.723567 19201 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.715875 19212 consensus_queue.cc:237] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.727587 18923 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:13.728677 18923 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.734265 19190 raft_consensus.cc:2749] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.734344 19185 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.735041 18923 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.729486 19186 raft_consensus.cc:2804] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.714318 18276 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.722318 18275 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.705590 18202 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.736974 19193 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:13.737577 18237 raft_consensus.cc:2393] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:13.749027 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.742628 18275 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.750792 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.750959 19152 raft_consensus.cc:2749] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.752171 18275 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.752934 19152 raft_consensus.cc:2749] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.753118 18236 raft_consensus.cc:1240] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.753137 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.754608 18275 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.755391 19152 raft_consensus.cc:2749] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.743399 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.757175 18306 raft_consensus.cc:2468] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:13.744977 18202 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.738531 19186 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.747751 19202 raft_consensus.cc:2749] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.747778 19151 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.748626 18276 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.746519 19214 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.759547 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.760785 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.764736 18236 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 1.
I20260709 12:18:13.764933 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.762087 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.761461 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.758366 19204 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.762784 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.763069 18276 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.761812 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.763317 18202 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.761111 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.762739 19151 raft_consensus.cc:2804] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.762475 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.779080 19201 raft_consensus.cc:2804] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.779558 19201 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.779918 19201 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.769129 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.759785 19186 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.770045 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.778908 18276 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.784350 18276 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.784616 18924 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.786973 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.788069 19153 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.788429 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.760066 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.770766 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.790386 18234 raft_consensus.cc:2393] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:13.746256 19213 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.771471 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.772173 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:13.791074 19201 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.774057 19204 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.760751 19215 raft_consensus.cc:2749] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.778817 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.792376 19151 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.794075 19151 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.794587 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.795320 19202 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.795970 19190 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.795771 19186 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.796567 18276 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.795817 19148 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.794130 19212 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.797348 19202 raft_consensus.cc:2749] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.797628 19212 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.797866 19186 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.798120 19212 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.798666 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:13.795461 18924 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.801041 19202 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.801497 19185 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.802305 18276 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.802780 18924 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.803102 19202 raft_consensus.cc:2749] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.803122 19199 consensus_queue.cc:1059] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:13.804244 19185 raft_consensus.cc:2749] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.805415 18276 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:13.793545 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 58586.4us
I20260709 12:18:13.805364 19197 raft_consensus.cc:3055] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:13.807638 19197 raft_consensus.cc:740] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:13.808555 19197 consensus_queue.cc:260] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:13.811549 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 48319.2us
I20260709 12:18:13.792335 19213 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.812372 19201 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.815843 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:13.811077 19206 raft_consensus.cc:2749] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.816717 18923 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.815938 18924 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.819530 19151 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.820297 19185 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.820706 19185 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.820793 18923 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.821105 19185 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.821633 19186 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.822319 19186 raft_consensus.cc:2749] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.823535 18923 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:13.824505 19186 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.824854 19186 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:13.825176 19186 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.825825 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.812582 19204 raft_consensus.cc:2749] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.828598 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.829594 19207 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.833174 19207 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:13.833551 19207 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:13.834717 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 78172.4us
I20260709 12:18:13.840354 19185 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.849677 19185 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.845379 19212 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.846549 18276 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.847545 18924 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.856796 18276 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.857187 18924 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.842551 18275 leader_election.cc:304] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.858377 19202 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.858654 19201 raft_consensus.cc:2749] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.857702 18276 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:13.859798 18275 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.858173 19204 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.860622 19148 raft_consensus.cc:2749] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.860918 19204 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.851780 19186 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.852020 19151 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.863319 18971 raft_consensus.cc:1240] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.866098 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.867084 18237 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.860404 19201 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.869055 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.869696 18228 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.871935 18973 raft_consensus.cc:1240] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:13.857213 19212 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.874740 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:13.875249 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.875355 18234 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.861745 19202 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.876577 19202 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.866348 19213 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.875154 18969 raft_consensus.cc:1240] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.867615 19185 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.883708 18228 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:13.886257 19206 raft_consensus.cc:993] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower c0771afef8984a5e9edd45be358960a2 to start an election
I20260709 12:18:13.887794 19186 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:13.887956 19206 raft_consensus.cc:1081] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Signalling peer c0771afef8984a5e9edd45be358960a2 to start an election
I20260709 12:18:13.888255 18202 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.888990 19206 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.887230 18234 raft_consensus.cc:2468] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:13.890527 19201 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.890853 18202 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.891072 19201 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.892694 18924 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:13.895035 18924 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.862116 19204 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:13.903064 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 101576us
I20260709 12:18:13.906288 18202 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:13.907349 19004 debug-util.cc:398] Leaking SignalData structure 0x7b08000cba40 after lost signal to thread 8910
I20260709 12:18:13.908146 19206 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.908286 18202 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.908597 19206 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.909104 19206 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.909482 18202 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:13.910244 19149 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.910647 19149 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.911012 19149 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.911126 19197 raft_consensus.cc:3060] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.913791 19193 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.914228 19193 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:13.914618 19193 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.916755 19153 consensus_queue.cc:1059] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.917996 19148 raft_consensus.cc:3055] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:13.918341 19148 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:13.918725 19206 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.919243 19148 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.919881 19149 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.921001 19148 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.921980 19149 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.922539 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.924386 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:13.908507 19004 debug-util.cc:398] Leaking SignalData structure 0x7b0800168e60 after lost signal to thread 18094
I20260709 12:18:13.924827 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.926571 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.927417 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.928982 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.926604 19192 consensus_queue.cc:1059] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:13.904971 19215 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.929983 18306 raft_consensus.cc:2393] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.930373 19199 raft_consensus.cc:3055] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:13.930788 19199 raft_consensus.cc:740] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:13.926837 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.931933 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.931721 19199 consensus_queue.cc:260] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.933507 19199 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.933984 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.935745 19202 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.936525 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.936692 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.937886 19202 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.938859 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.939042 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:13.939767 18306 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:13.931545 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:13.941572 19192 consensus_queue.cc:1059] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.942584 18969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:13.942790 19211 raft_consensus.cc:3055] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:13.942868 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.943301 19211 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:13.944159 19211 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:13.945299 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.945868 19211 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:13.931629 19004 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6260 after lost signal to thread 19007
I20260709 12:18:13.941542 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.948128 18973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:13.948792 18973 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:13.949172 18973 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.951007 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:13.952541 18969 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:13.952968 18969 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.953570 18971 raft_consensus.cc:1240] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.949239 19204 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.956048 18975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:13.956655 18975 raft_consensus.cc:476] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:18:13.958997 19193 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:13.963302 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.964300 19193 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.906800 19186 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.964630 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.965171 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.965610 19204 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.965951 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.966881 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.970161 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.971541 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:13.972295 18376 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:13.976225 18973 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:13.977008 18308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "012abbd307bb440c93b80adee8541719"
dest_uuid: "c0771afef8984a5e9edd45be358960a2"
 from {username='slave'} at 127.0.0.1:57252
I20260709 12:18:13.977435 19186 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:13.860101 19207 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:13.901834 18237 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
W20260709 12:18:13.987542 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 71091.1us
I20260709 12:18:13.921031 19206 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:13.982519 18970 raft_consensus.cc:1240] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.978396 18972 raft_consensus.cc:1240] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.983094 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:13.992537 18303 raft_consensus.cc:2393] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:13.994582 18308 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:13.995090 18308 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.997504 19204 consensus_queue.cc:1059] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:13.998383 19202 consensus_queue.cc:1059] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:13.983497 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:13.999836 19202 consensus_queue.cc:1059] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:14.000787 19202 raft_consensus.cc:3055] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.001112 19202 raft_consensus.cc:740] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:13.987843 19186 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:14.002578 19151 raft_consensus.cc:3055] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.003029 19151 raft_consensus.cc:740] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.002636 19186 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.003825 19151 consensus_queue.cc:260] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.005084 19151 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.005362 19207 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:14.001214 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
W20260709 12:18:13.977384 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 82416.5us
I20260709 12:18:14.007735 18276 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:14.007931 19204 raft_consensus.cc:3055] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.008441 19204 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.008793 18924 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.009683 19185 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.010165 19152 raft_consensus.cc:2804] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:13.984254 19201 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.013413 19201 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:14.009315 19204 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.015044 19204 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.010684 19152 raft_consensus.cc:697] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.017544 18924 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.018457 19185 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.018216 19152 consensus_queue.cc:237] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.020483 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.021179 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.002027 19202 consensus_queue.cc:260] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.022723 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.022809 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.023303 18378 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.023406 18923 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.024293 19213 raft_consensus.cc:2749] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.025450 18923 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.026258 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.030915 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.022801 19202 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.032398 18308 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.033540 18969 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.036350 19185 raft_consensus.cc:2749] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.036661 19213 raft_consensus.cc:2749] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.056277 18382 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:14.035575 18973 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:14.008644 18276 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:18:14.063835 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 55268.1us
I20260709 12:18:13.988612 18306 raft_consensus.cc:2468] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
W20260709 12:18:14.064082 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 46641.8us
I20260709 12:18:14.043431 18970 raft_consensus.cc:1240] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.065196 18924 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.043606 18308 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:14.043768 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.066608 18378 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:14.066792 18304 raft_consensus.cc:2393] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
W20260709 12:18:14.038249 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 97500.8us
I20260709 12:18:14.045102 18972 raft_consensus.cc:1240] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.044275 18303 raft_consensus.cc:1240] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.067643 19185 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:14.068041 19185 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:14.045696 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.068392 19185 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.047565 18202 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.050854 18975 raft_consensus.cc:1240] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 3. Ops: []
I20260709 12:18:14.068951 18275 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.070293 19151 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.072238 19206 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.073115 18202 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.075208 18202 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.077306 18237 raft_consensus.cc:1240] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.052337 18969 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:14.032418 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.063076 18971 raft_consensus.cc:1240] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.063982 19204 raft_consensus.cc:2804] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.067144 18924 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.085963 18970 raft_consensus.cc:1240] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:14.045246 18274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.067309 18381 raft_consensus.cc:1240] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.089932 18970 raft_consensus.cc:1240] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.090354 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.094105 18234 raft_consensus.cc:1240] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.094695 18974 raft_consensus.cc:1240] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.095031 18228 raft_consensus.cc:1240] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.095595 18235 raft_consensus.cc:1240] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.095667 18304 raft_consensus.cc:1240] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.096725 18303 raft_consensus.cc:1240] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.099048 18309 raft_consensus.cc:1240] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.099581 18275 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.085433 19149 raft_consensus.cc:2749] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.079483 19206 raft_consensus.cc:2749] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.102636 19188 consensus_queue.cc:1059] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:14.107362 18306 raft_consensus.cc:1240] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:14.107527 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.035087 19186 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.094326 18975 raft_consensus.cc:1275] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:14.110608 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.104233 19204 raft_consensus.cc:697] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.116652 18970 raft_consensus.cc:1240] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.110867 19202 raft_consensus.cc:2749] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.109977 19213 raft_consensus.cc:2749] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.111169 19187 consensus_queue.cc:1059] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:18:14.113981 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 46931.7us
I20260709 12:18:14.131270 19204 consensus_queue.cc:237] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.132118 18303 raft_consensus.cc:1240] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.147619 18276 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:14.148603 19201 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.149117 19201 raft_consensus.cc:697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.150012 19201 consensus_queue.cc:237] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.150575 18237 raft_consensus.cc:1240] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.151100 18228 raft_consensus.cc:1240] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.151808 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.152539 18235 raft_consensus.cc:2393] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:14.152804 18228 raft_consensus.cc:1240] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:14.154663 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.154943 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.156360 19151 consensus_queue.cc:1059] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:14.157125 18237 raft_consensus.cc:3055] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.157547 18237 raft_consensus.cc:740] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.156543 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.114290 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:14.096771 18923 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.157195 19152 consensus_queue.cc:1048] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:18:14.167281 18237 consensus_queue.cc:260] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.112636 19214 consensus_queue.cc:1059] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:18:14.163969 18350 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:14.169974 18237 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:14.175068 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 51635.8us
I20260709 12:18:14.176644 19213 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.161301 19185 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.176859 19211 raft_consensus.cc:2749] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.172200 18350 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:14.234043 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.170022 18924 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.163326 19202 consensus_queue.cc:1059] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:18:14.236680 19149 consensus_queue.cc:1059] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:18:14.247684 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 75598.4us
I20260709 12:18:14.248999 18971 raft_consensus.cc:1240] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.243884 19228 consensus_queue.cc:1059] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:18:14.249886 18237 raft_consensus.cc:2468] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
W20260709 12:18:14.236539 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 139840us
I20260709 12:18:14.239115 19206 raft_consensus.cc:3055] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.264161 19226 consensus_queue.cc:1059] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:14.264647 19206 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.265802 19206 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.267102 19206 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.267439 19194 raft_consensus.cc:993] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:14.246527 19215 consensus_queue.cc:1059] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:18:14.268209 19215 consensus_queue.cc:1243] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer 4758217c33d3483eac425c4d24d74bf5 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:14.268751 19215 raft_consensus.cc:3055] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.269071 19215 raft_consensus.cc:740] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
W20260709 12:18:14.251538 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 95582us
I20260709 12:18:14.271492 18276 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:14.252002 19185 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:14.252501 19223 consensus_queue.cc:1059] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:14.252905 18350 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:14.249557 19197 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.254971 19186 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:14.280941 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:14.255950 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 92386.8us
I20260709 12:18:14.283632 18202 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.284571 19194 raft_consensus.cc:2749] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.257611 19230 consensus_queue.cc:1059] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:14.258736 19148 raft_consensus.cc:3055] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.285007 18202 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.267016 19228 consensus_queue.cc:1243] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer 4758217c33d3483eac425c4d24d74bf5 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:18:14.237654 19233 log.cc:927] Time spent T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.072s	user 0.004s	sys 0.003s
I20260709 12:18:14.285490 19148 raft_consensus.cc:740] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.285835 19194 raft_consensus.cc:2749] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.286345 18202 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.286580 19148 consensus_queue.cc:260] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.287168 19228 raft_consensus.cc:2749] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.274821 19188 raft_consensus.cc:1081] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:14.287668 18202 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.251441 19213 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.290902 18350 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:14.294405 19189 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.296595 19148 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.292932 19223 raft_consensus.cc:3055] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.299484 19223 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.300383 19223 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.301635 19223 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.264112 19236 consensus_queue.cc:1059] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:18:14.303351 19209 consensus_queue.cc:1059] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:14.303992 18923 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.302127 19199 consensus_queue.cc:1059] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:18:14.301651 19187 raft_consensus.cc:3055] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.307281 18923 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:14.275097 19234 consensus_queue.cc:1059] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:18:14.308003 19197 raft_consensus.cc:3055] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.307544 19209 raft_consensus.cc:3055] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.311249 19209 raft_consensus.cc:740] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.311697 19234 raft_consensus.cc:3055] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.280426 19202 raft_consensus.cc:2804] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.312125 19209 consensus_queue.cc:260] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.312628 19202 raft_consensus.cc:697] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.313405 19209 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.313603 19202 consensus_queue.cc:237] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.310041 19197 raft_consensus.cc:740] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.315522 19197 consensus_queue.cc:260] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.316701 19197 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.307299 19199 consensus_queue.cc:1059] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:18:14.293467 19192 raft_consensus.cc:2749] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.319557 19193 raft_consensus.cc:3055] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.307395 19187 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.321200 19214 raft_consensus.cc:3055] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.321610 19214 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.321697 19187 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.322528 19214 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.322942 18924 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.322966 19187 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.323962 19214 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.318449 19189 raft_consensus.cc:3055] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.275138 19215 consensus_queue.cc:260] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.325510 19189 raft_consensus.cc:740] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.326287 19215 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.308440 19212 raft_consensus.cc:2749] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.305002 19211 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.326473 19189 consensus_queue.cc:260] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.320511 19201 raft_consensus.cc:3055] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.312096 19234 raft_consensus.cc:740] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.335273 19234 consensus_queue.cc:260] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.336730 19234 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.319954 19193 raft_consensus.cc:740] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
W20260709 12:18:14.348541 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 60942.4us
I20260709 12:18:14.349462 18202 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.334169 19201 raft_consensus.cc:740] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:14.339339 19193 consensus_queue.cc:260] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.356971 19193 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.358994 19185 raft_consensus.cc:2749] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:14.373553 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 66337.2us
W20260709 12:18:14.375280 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.375535 19236 raft_consensus.cc:3055] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.375300 18923 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.375957 19236 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.376808 19236 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.352610 19238 raft_consensus.cc:2749] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.352670 19213 raft_consensus.cc:2764] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:14.378225 19236 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.369544 19202 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:14.388000 18202 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.387877 18305 raft_consensus.cc:1240] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.392773 19202 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:14.370173 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 47334.8us
I20260709 12:18:14.395066 18924 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.396404 18924 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.397393 19186 raft_consensus.cc:2749] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.398020 19186 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:14.399430 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 93392.9us
I20260709 12:18:14.386646 19228 raft_consensus.cc:2749] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.387725 19185 raft_consensus.cc:2749] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.405292 19201 consensus_queue.cc:260] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.406629 19201 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.409714 19202 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:14.412614 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:14.412989 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:14.415016 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:14.415774 19202 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:14.417603 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.417239 18059 catalog_manager.cc:5697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.418607 19228 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.421489 19194 raft_consensus.cc:3055] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.421937 19194 raft_consensus.cc:740] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.422778 19194 consensus_queue.cc:260] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.424007 19194 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.424747 18059 catalog_manager.cc:5697] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.426965 19232 raft_consensus.cc:3055] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.426340 18059 catalog_manager.cc:5697] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.427366 19232 raft_consensus.cc:740] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.428280 19232 consensus_queue.cc:260] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.428437 18060 catalog_manager.cc:5697] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.429641 19232 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.430001 18060 catalog_manager.cc:5697] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.432202 18923 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
W20260709 12:18:14.432938 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 45016.6us
I20260709 12:18:14.433768 18202 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.432375 18060 catalog_manager.cc:5697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.435335 18202 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.436474 18202 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.437220 19228 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.437659 18202 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.437821 19228 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.438406 19228 raft_consensus.cc:2749] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.436486 19187 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:14.439481 19187 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:14.439599 19148 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:14.440258 19148 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.441320 19187 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.442303 19148 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:14.435081 19212 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.443845 19212 raft_consensus.cc:697] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:14.444763 19212 consensus_queue.cc:237] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.447064 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:14.448804 19187 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.450138 18202 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.463928 18202 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.465770 18202 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.468196 19226 raft_consensus.cc:2749] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.444017 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:14.471710 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.472810 19226 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.475082 18305 raft_consensus.cc:1240] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.478807 18923 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:14.480149 18923 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.481175 19187 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:14.482084 18305 raft_consensus.cc:1240] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.482905 19185 raft_consensus.cc:2804] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.483454 19185 raft_consensus.cc:697] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:14.468442 19236 raft_consensus.cc:2804] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:14.484272 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.484759 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.484735 19236 raft_consensus.cc:697] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.485385 18381 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.484318 19185 consensus_queue.cc:237] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.488169 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.490625 18306 raft_consensus.cc:1240] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.487612 18276 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:14.496368 18970 raft_consensus.cc:1240] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 3. Ops: []
W20260709 12:18:14.487954 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 183326us
I20260709 12:18:14.499341 18306 raft_consensus.cc:1240] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.504365 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.505174 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.508771 18378 raft_consensus.cc:2393] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
W20260709 12:18:14.509325 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.484470 19186 raft_consensus.cc:2749] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.510756 19209 consensus_queue.cc:1059] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:18:14.518019 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.484360 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.512380 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.497603 19214 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.527849 18381 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:14.512687 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.485893 19236 consensus_queue.cc:237] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.533591 18381 raft_consensus.cc:1275] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.514235 18308 raft_consensus.cc:1240] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.514689 18973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:14.510548 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.511550 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.520778 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.522229 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.522109 19187 consensus_queue.cc:1059] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:14.559495 18383 raft_consensus.cc:3060] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.558358 18381 raft_consensus.cc:3055] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.559922 18381 raft_consensus.cc:740] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.560216 18973 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:14.560657 18973 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.560758 18381 consensus_queue.cc:260] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.561862 18381 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.522730 18376 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.529022 18350 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.513051 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:14.534364 18385 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:14.503062 19201 raft_consensus.cc:2749] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.513088 19189 raft_consensus.cc:3060] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.564481 18202 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.555724 18923 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:18:14.554067 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 157731us
I20260709 12:18:14.555610 18384 raft_consensus.cc:1275] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.546855 18306 raft_consensus.cc:1240] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.573464 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.559991 19187 raft_consensus.cc:3055] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.572522 19215 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.585014 18381 raft_consensus.cc:1275] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:14.607658 19187 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.608531 19187 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.599050 18382 raft_consensus.cc:3055] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.604430 19228 consensus_queue.cc:1059] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:18:14.597442 19223 raft_consensus.cc:3055] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.610538 19223 raft_consensus.cc:740] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.610780 19215 raft_consensus.cc:3055] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.611168 19215 raft_consensus.cc:740] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.584663 18376 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:14.611344 19223 consensus_queue.cc:260] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.590181 18383 raft_consensus.cc:2468] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:14.609855 18382 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.582589 19198 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.612609 19215 consensus_queue.cc:260] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.616464 18382 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.617506 18382 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.618407 19215 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.566859 19226 consensus_queue.cc:1059] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:18:14.572152 19193 consensus_queue.cc:1059] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:18:14.640003 18348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.640425 19193 raft_consensus.cc:3055] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.640851 19193 raft_consensus.cc:740] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.641657 19193 consensus_queue.cc:260] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:14.625694 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.646238 18348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.646993 19187 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.648427 19226 raft_consensus.cc:3055] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.648852 19226 raft_consensus.cc:740] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
W20260709 12:18:14.649937 18274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.649626 19226 consensus_queue.cc:260] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:14.622138 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 66497.4us
I20260709 12:18:14.651571 18237 raft_consensus.cc:1275] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.651793 18228 raft_consensus.cc:1275] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.638057 19212 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:14.654654 19186 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:14.578918 19243 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.654855 19212 raft_consensus.cc:697] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:14.656543 18923 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:14.656885 19212 consensus_queue.cc:237] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.657644 19186 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:14.658193 19186 raft_consensus.cc:697] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:14.659132 19186 consensus_queue.cc:237] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:14.659902 18973 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.661021 18975 raft_consensus.cc:1240] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.577713 18350 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.612836 19223 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:14.665217 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 87583.6us
I20260709 12:18:14.673802 18350 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.680469 18350 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.666754 19243 raft_consensus.cc:2749] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.668181 19226 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.666925 19148 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:18:14.734015 18348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.656535 18924 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.673079 19201 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:18:14.683274 19209 raft_consensus.cc:2749] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.748541 18237 raft_consensus.cc:1275] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:14.739739 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 59360.2us
I20260709 12:18:14.678735 19194 consensus_queue.cc:1059] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:18:14.735131 19198 raft_consensus.cc:2749] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.751561 18350 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
W20260709 12:18:14.754678 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.762775 18382 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.754019 19193 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.767809 19186 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:14.766530 18060 catalog_manager.cc:5697] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 2, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:14.770680 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.779260 19243 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.780973 18350 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:14.781847 19243 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:14.782217 19243 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:14.782589 19243 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.783516 18350 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.784319 19209 raft_consensus.cc:2749] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.785697 18350 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:14.786511 19199 raft_consensus.cc:2804] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:14.786865 19199 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:14.787388 19199 raft_consensus.cc:3060] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.761963 18059 catalog_manager.cc:5697] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.753677 19204 consensus_queue.cc:1048] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:18:14.767701 18973 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:14.786809 19215 raft_consensus.cc:3055] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.799842 19215 raft_consensus.cc:740] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:14.815687 19215 consensus_queue.cc:260] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:14.817112 19215 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:14.829041 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.834774 18235 raft_consensus.cc:1275] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:14.774519 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 101159us
I20260709 12:18:14.797919 18377 raft_consensus.cc:2468] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:14.843168 19204 consensus_queue.cc:1048] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:14.844229 19185 raft_consensus.cc:2749] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.856387 19223 consensus_queue.cc:1059] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:14.857775 19223 raft_consensus.cc:3055] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.859598 19223 raft_consensus.cc:740] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.860581 19223 consensus_queue.cc:260] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.862074 19223 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.862684 19243 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.866683 18383 raft_consensus.cc:1240] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.853626 19209 consensus_queue.cc:1059] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:18:14.869135 19209 raft_consensus.cc:3055] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:14.869477 19209 raft_consensus.cc:740] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.870296 19209 consensus_queue.cc:260] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.871687 19209 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.874243 18924 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.875633 18924 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:14.876775 18924 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.877465 19186 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.878122 19186 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.878607 19185 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.881032 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.794392 19199 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:14.879489 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.896852 18971 raft_consensus.cc:1240] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:14.897620  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:14.902129 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.912050 18275 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.913520 18275 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.917491 18275 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.920617 18275 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:14.924162 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.895552 19193 consensus_queue.cc:1059] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:18:14.945019 18306 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:14.924119 18058 catalog_manager.cc:5697] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.919652 19153 raft_consensus.cc:2749] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.919258 19234 raft_consensus.cc:2749] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.947691 18058 catalog_manager.cc:5697] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.924954 19201 raft_consensus.cc:2749] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.957257 19189 consensus_queue.cc:1059] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:14.946856 19204 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:18:14.939239 19148 consensus_queue.cc:1048] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:18:14.961257 18236 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:14.965004 18303 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:14.966943 18975 raft_consensus.cc:1240] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.970377 19189 raft_consensus.cc:3055] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.971410 19189 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:14.972091 18303 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.972287 19189 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:14.938805 19243 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:14.950222 18978 raft_consensus.cc:1240] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:14.939108 19211 consensus_queue.cc:1059] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:18:14.940881 19202 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:14.976835 18058 catalog_manager.cc:5697] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:14.997502 18058 catalog_manager.cc:5697] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.999082 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:14.999423 18303 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.000277 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.988576 18232 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:14.995494 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.988744 19232 raft_consensus.cc:3055] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.019321 19232 raft_consensus.cc:740] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:15.020243 19232 consensus_queue.cc:260] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.021396 19232 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.999569 18230 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.004071 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.975194 19189 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.006457 18303 raft_consensus.cc:1275] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:14.974346 18924 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.009788 18306 raft_consensus.cc:1275] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:14.966867 19255 log.cc:927] Time spent T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:18:14.990070 19211 raft_consensus.cc:3055] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.034272 19211 raft_consensus.cc:740] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:15.035208 19211 consensus_queue.cc:260] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.036531 19211 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:14.981365 19199 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:15.011416 18383 raft_consensus.cc:1275] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.013025 18304 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.029749 18236 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:14.994963 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:14.974699 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
W20260709 12:18:15.046595 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 72355.3us
I20260709 12:18:15.047465 18924 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:15.058763 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 92114us
I20260709 12:18:15.032521 18234 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:15.058915 19186 raft_consensus.cc:2749] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.058238 19212 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:15.071475 18228 raft_consensus.cc:1275] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.039924 19187 consensus_queue.cc:1048] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:18:15.065807 19223 consensus_queue.cc:1059] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:18:15.063230 19185 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:15.062914 19213 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:18:15.086827 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.068028 18304 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:15.078128 18231 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
W20260709 12:18:15.104722 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 62398.7us
I20260709 12:18:15.110630 19197 raft_consensus.cc:3055] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.111135 19197 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:15.111953 19197 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.140763 19197 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.101138 19244 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:18:15.134164 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 85209.1us
I20260709 12:18:15.164482 18382 raft_consensus.cc:1275] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.165457 18383 raft_consensus.cc:1275] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.165710 18376 raft_consensus.cc:1275] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.116194 19199 consensus_queue.cc:1059] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:18:15.166488 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217d661eba0249388484125571f7c38e"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:15.145043 19185 raft_consensus.cc:697] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:15.135902 19213 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:18:15.212625 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:15.213750 19212 raft_consensus.cc:697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:15.226367 19212 consensus_queue.cc:237] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.226883 19185 consensus_queue.cc:237] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.230518 18380 raft_consensus.cc:1275] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.231711 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:15.232163 19194 consensus_queue.cc:1048] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:18:15.235616 19270 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:18:15.219960 18233 raft_consensus.cc:606] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.223042 18924 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.257397 18924 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.258103 19270 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.258695 19270 raft_consensus.cc:697] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:15.259603 19270 consensus_queue.cc:237] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.260795 19267 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.262321 18311 raft_consensus.cc:1275] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:18:15.264400 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 43973us
I20260709 12:18:15.278045 18380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
 from {username='slave'} at 127.0.0.1:41324
I20260709 12:18:15.279089 18233 raft_consensus.cc:1275] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.279345 18380 raft_consensus.cc:606] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Received request to transfer leadership to TS 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:15.279964 18380 raft_consensus.cc:614] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:15.284761 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:15.285354 18237 raft_consensus.cc:606] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.234524 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:15.289778 18924 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.291378 18924 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:15.293605 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 80652.8us
I20260709 12:18:15.309305 19244 raft_consensus.cc:2749] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.308966 19267 raft_consensus.cc:697] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:15.326099 19151 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:18:15.332909 19273 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.317910 19148 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.313249 19186 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:18:15.322856 19262 consensus_queue.cc:1048] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:18:15.324849 19204 consensus_queue.cc:1048] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:18:15.341740 19148 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.356000 19148 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.355676 19267 consensus_queue.cc:237] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.359088 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.351073 19151 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.360018 19151 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.361984 19151 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:15.368718 19271 log.cc:927] Time spent T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.141s	user 0.003s	sys 0.000s
I20260709 12:18:15.370051 18233 raft_consensus.cc:1240] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:15.376245 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.376986 18972 raft_consensus.cc:2468] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:15.379558 18276 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.390328 19151 raft_consensus.cc:2804] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.399250 19151 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.399622 19151 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.390170 19244 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:15.388433 19270 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.423225 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 50099.7us
I20260709 12:18:15.390504 19269 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:18:15.430371 18237 raft_consensus.cc:1275] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:18:15.418545 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 91134.9us
I20260709 12:18:15.435588 19198 consensus_queue.cc:1059] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:15.418948 19270 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.436720 19198 raft_consensus.cc:3055] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.448019 19198 raft_consensus.cc:740] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:15.450042 19198 consensus_queue.cc:260] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.444464 19262 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.451174 19262 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.451720 19198 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.453164 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.453418 19262 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.455516 19209 raft_consensus.cc:3055] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:15.455938 19209 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:15.456756 19209 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.457727 19209 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.459177 19268 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.460918 18275 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.462033 19262 raft_consensus.cc:2749] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.459160 18975 raft_consensus.cc:1240] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:15.462247 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.472805 18308 raft_consensus.cc:1275] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.479478 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.483175 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:15.502619 18350 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:15.510623 19202 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.511176 18383 raft_consensus.cc:1275] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.511664 19262 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.512203 19262 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.515019 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.515599 18234 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:15.515254 19262 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:15.516906 18276 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.486727 18972 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:15.524266 19148 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.511207 19202 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.533105 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.520177 19211 raft_consensus.cc:2749] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.621896 19202 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:15.550905 19277 log.cc:927] Time spent T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:18:15.508028 18382 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:15.496464 19267 consensus_queue.cc:1048] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:18:15.506461 19228 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.642007 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.659018 18234 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:15.653491 19211 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.624109 19148 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.639672 18276 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:18:15.645856 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 117121us
I20260709 12:18:15.675711 19151 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.677636 19153 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.684588 19153 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.664657 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.665150 19211 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:15.686067 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 46497.6us
I20260709 12:18:15.662037 19148 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.683161 19201 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.699016 19215 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.711229 19287 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.711802 19287 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.711349 19215 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.713871 18228 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:15.713896 19215 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.721793 19215 raft_consensus.cc:993] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:15.706687 19234 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.722249 19215 raft_consensus.cc:1081] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:15.722023 19148 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.707851 19197 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.718531 19232 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.723690 19232 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.712323 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:15.724681 18975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:15.723419 19197 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.725304 18975 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:15.725703 18975 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.725901 19232 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.712277 19287 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.726614 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.726801 19197 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.710263 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.728487 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.729343 18977 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:15.730610 18202 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:15.730819 18304 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:15.731076 18350 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:15.731452 19236 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.731936 19236 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.732326 19236 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.732297 19234 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.737192 19234 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.713797 19211 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.738765 19286 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.739218 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.739398 19286 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.739974 18381 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
W20260709 12:18:15.741714 19288 log.cc:927] Time spent T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.003s
I20260709 12:18:15.706868 19202 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.743000 19286 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.728554 19204 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.727336 18376 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:15.718847 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.654296 19185 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:18:15.720021 19201 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.752477 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:15.662662 19228 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.757714 18234 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.732357 19197 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:15.763778 18379 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:15.782586 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.810652 18972 raft_consensus.cc:2393] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:15.811499 19197 raft_consensus.cc:697] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:15.811190 18201 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:15.812398 19197 consensus_queue.cc:237] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.787791 19151 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.813055 19232 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:15.813486 19232 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.791029 18975 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:15.792043 19294 log.cc:927] Time spent T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:18:15.792557 19201 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.797116 19209 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:15.797901 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.743230 19202 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.800423 18924 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.800689 19228 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.801694 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.803130 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:15.804775 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.805725 19236 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.807487 19153 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.749442 19204 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.840216 19204 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.840992 18975 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:15.842895 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:15.843647 18302 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:15.843984 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.844697 18972 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:15.845758 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.786804 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.846414 18976 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:15.791376 19287 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.809228 19148 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:15.809782 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:15.752182 19270 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:15.816828 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.848699 19202 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.825069 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:15.826684 18234 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:15.813858 19232 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:15.850073 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 49718.1us
W20260709 12:18:15.850589 19293 log.cc:927] Time spent T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:18:15.852294 19236 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.854561 19273 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.855078 19273 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.855410 19273 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.855924 19204 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.847380 18973 raft_consensus.cc:2393] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:15.832571 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.822551 19199 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:15.857961 19204 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:15.840875 19295 log.cc:927] Time spent T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:18:15.858073 18237 raft_consensus.cc:2393] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:15.858352 19199 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.860414 19199 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.864604 19244 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.865036 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.866964 18383 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:15.868593 18376 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:15.866307 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:15.869656 18381 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:15.871021 18384 raft_consensus.cc:1275] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:15.830614 19209 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.864486 18382 raft_consensus.cc:1275] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.877665 18977 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:15.879985 18383 raft_consensus.cc:1275] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:15.884231 19287 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.899103 19212 consensus_queue.cc:1048] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.886986 18202 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:15.888928 18237 raft_consensus.cc:1275] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:15.889827 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 64837.5us
I20260709 12:18:15.900049 19209 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.901779 18924 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.890604 19151 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.903059 19151 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:15.903483 19151 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.887776 19199 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.890586 19232 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.893316 18302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7"
dest_uuid: "c0771afef8984a5e9edd45be358960a2"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:58832
W20260709 12:18:15.885358 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 111996us
I20260709 12:18:15.918342 18302 raft_consensus.cc:606] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.918733 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.919468 18237 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:15.894919 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.895582 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:15.920832 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.896778 19213 consensus_queue.cc:1048] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.893225 18228 raft_consensus.cc:1275] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.892544 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:15.922816 18231 raft_consensus.cc:3055] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:15.923193 18231 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:15.924011 18231 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:15.925253 18231 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.902607 19270 raft_consensus.cc:2749] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:15.908818 19215 raft_consensus.cc:993] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:15.905179 19199 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:15.927088 19215 raft_consensus.cc:1081] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:15.907968 19228 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.928218 19228 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.928491 19199 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:15.929209 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:15.929901 18978 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.931610 19232 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:15.932708 18276 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:15.934589 19204 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.934960 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.935150 19204 raft_consensus.cc:697] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:15.936102 19204 consensus_queue.cc:237] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.936656 19267 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:15.938238 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.938882 18237 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:15.939957 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.940706 18228 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:15.929509 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:15.941874 18377 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.928591 19228 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.898095 19269 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.918895 18302 raft_consensus.cc:614] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:15.920994 18976 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.949112 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:15.949537 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:15.949791 18972 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.950218 18232 raft_consensus.cc:606] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.950592 18232 raft_consensus.cc:614] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:15.933879 18059 catalog_manager.cc:5697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 3 to 4, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 4 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.953500 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:15.954341 18969 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:15.953370 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:15.954841 19287 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.955138 18232 raft_consensus.cc:606] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.955402 19287 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:15.954650 18059 catalog_manager.cc:5697] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.961378 18976 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:15.961961 19232 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.912245 19273 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.955634 18232 raft_consensus.cc:614] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:15.968765 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.969450 18234 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:15.915740 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:15.965659 18202 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:15.913043 19151 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:15.967378 19232 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:15.979426 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 63786.7us
I20260709 12:18:15.981868 18350 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:18:15.970533 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 83096.7us
I20260709 12:18:15.988500 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:15.989017 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:15.989373 18237 raft_consensus.cc:2393] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:15.989691 18309 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.992580 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:15.955579 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:15.995909 18276 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:15.987100 19189 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.968068 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:15.978778 19199 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.981176 19193 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.981581 19201 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.969291 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 55028us
I20260709 12:18:15.985358 19287 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.001293 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.010397 19234 raft_consensus.cc:2804] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.028743 19234 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.029203 19234 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.030359 19201 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.032829 19201 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.033355 19193 raft_consensus.cc:697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:16.016505 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.034698 19215 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.035241 19215 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.035410 19269 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:16.015268 18303 raft_consensus.cc:1275] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:16.004002 19189 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.020488 18976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217d661eba0249388484125571f7c38e"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53966
I20260709 12:18:16.019759 19199 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.034365 19193 consensus_queue.cc:237] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.017138 18276 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.036773 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:15.999512 19153 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.037794 19189 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.033247 19151 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.034755 18230 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:16.056879 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 62065us
I20260709 12:18:16.046118 19232 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.046459 18978 raft_consensus.cc:2468] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.044355 19153 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.051656 19185 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:16.075235 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.077725 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.078004 18236 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:16.052134 18383 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.039963 18969 raft_consensus.cc:2393] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.042268 18232 raft_consensus.cc:606] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.080510 18232 raft_consensus.cc:614] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:16.057161 18276 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.044663 18976 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:16.060529 19153 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.060408 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.054550 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.067938 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.059787 19267 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:16.105229  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:18:16.071319 18231 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:16.082942 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.108976 18232 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.046324 19199 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.090109 18350 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.098058 18276 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:16.059522 19262 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.068711 18972 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.080288 19185 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.104517 18309 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:16.102715 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.096196 19151 raft_consensus.cc:2804] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.103955 18201 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.090703 18234 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:16.112289 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.095752 18976 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.111580 18350 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.121316  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:16.110834 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.073429 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.127307 18303 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
W20260709 12:18:16.128168 19308 log.cc:927] Time spent T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:18:16.122900 18276 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.125177 19273 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.125432 19185 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.114950 19197 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.132557 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.133318 18379 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:16.115620 18971 raft_consensus.cc:2393] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.121402 19201 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.134835 19201 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.135207 19201 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.105836 18384 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 1.
I20260709 12:18:16.137138 19197 raft_consensus.cc:2749] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:16.138173 19302 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.103062 19228 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.138638 19302 raft_consensus.cc:697] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.139446 19302 consensus_queue.cc:237] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.140057 19228 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.113823 18385 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.112982 19262 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.143553 18201 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.144083 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.145229 18385 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.114668 19148 raft_consensus.cc:2804] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.144122 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.116959 19151 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.118986 19226 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:16.153632 19226 raft_consensus.cc:697] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:16.154194 19148 raft_consensus.cc:697] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.146656 19262 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.155062 19148 consensus_queue.cc:237] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.145557 18305 raft_consensus.cc:1240] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:16.158635 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.159281 18972 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.161345 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.110666 19267 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.164098 19267 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.147398 19197 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.152913 19198 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:16.122215  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.166527 18350 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.168964 18385 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:16.170765 18201 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.174505 19211 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:16.171813 19198 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:16.175989 19198 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.146749 19185 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:16.149362 19232 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.149700 19151 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.196884 18230 raft_consensus.cc:2468] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:16.210367 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.211144 18382 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.184648 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.187052 19189 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.216724 19189 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.190241 19185 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.190923 19232 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.179534 18377 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:16.221194 18276 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.197105 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.178884 19188 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.219131 19185 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.154501 19226 consensus_queue.cc:237] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.195032 19234 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.202039 18924 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:16.167838 19197 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.227393 19228 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.228790 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:16.229032 18975 raft_consensus.cc:2393] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.202210 18972 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:16.225399 19232 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.229135 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.190950 18976 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.225739 19272 raft_consensus.cc:2764] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:16.227327 19202 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.235008 19209 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.243368 19197 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.265713 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:16.265790 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.266305 18302 raft_consensus.cc:1275] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.230706 19262 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.230093 19153 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.254797 19269 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.248910 18304 raft_consensus.cc:3060] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:16.253024 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 51094.8us
I20260709 12:18:16.271251 19202 raft_consensus.cc:697] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.281041 19274 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.247224 19228 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.283773 18973 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 4: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.263865 19209 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.274569 18303 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
W20260709 12:18:16.301872 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 79110.5us
I20260709 12:18:16.286448 19269 raft_consensus.cc:697] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:16.292162 19267 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.311057 19151 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.305135 19322 raft_consensus.cc:2804] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.322053 19322 raft_consensus.cc:697] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.323052 19322 consensus_queue.cc:237] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.323570 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.324420 18376 raft_consensus.cc:2393] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 4: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:16.327163 18976 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.311515 19312 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.290138 19274 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.304539 19302 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:16.349021 18202 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.357730 19328 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.358196 19328 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.358538 19328 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.361029 18304 raft_consensus.cc:2468] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:16.365113 19198 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.366585 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.369132 19262 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:16.369732 19311 log.cc:927] Time spent T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.348s	user 0.002s	sys 0.002s
I20260709 12:18:16.373615 18350 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:16.338766 19267 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.341939 19201 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.317526 19269 consensus_queue.cc:237] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.375480 19153 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.382653 19188 raft_consensus.cc:697] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:16.415647 19211 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:16.377254 19209 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.352644 19302 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.340065 19312 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.431030 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.441694 18971 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.428879 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.432487 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.442688 18234 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.442868 18232 raft_consensus.cc:3060] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.433737 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.443902 18236 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:16.444065 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 66769.3us
I20260709 12:18:16.412736 19272 raft_consensus.cc:2804] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.411312 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.458410 18234 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.462033 18236 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:16.465477 18973 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:16.351888 19202 consensus_queue.cc:237] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.466337 19272 raft_consensus.cc:697] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:16.473666 18232 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 5.
I20260709 12:18:16.425156 19151 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.463565 18228 raft_consensus.cc:1275] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:16.424472 19286 consensus_queue.cc:1048] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:18:16.470548 18376 raft_consensus.cc:1275] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:16.438349 19211 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.490026 19228 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.490507 19201 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.482065 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.491935 18976 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:16.494524 19323 log.cc:927] Time spent T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:18:16.487843 19273 raft_consensus.cc:476] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:16.497222 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.497959 18973 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:18:16.499889 19317 log.cc:927] Time spent T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:18:16.501874 18971 raft_consensus.cc:2468] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 5.
I20260709 12:18:16.504060 18976 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.508159 19215 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.509229 19302 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.510658 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.511437 18303 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.512943 18202 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:18:16.515442 19324 log.cc:927] Time spent T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:16.473160 19332 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.516971 19332 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.518859 19198 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.519539 19332 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.520120 19332 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.520454 19332 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.520812 19211 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.521575 19188 consensus_queue.cc:237] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.522254 19312 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.473958 18302 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 1.
I20260709 12:18:16.484581 19325 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:16.526453 19325 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.528509 19325 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.529141 18924 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:16.533207 18382 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.533914 18304 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:16.534207 19274 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.537971 18276 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.539175 18276 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.543252 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.543584 19153 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:16.542688 19236 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.545305 18232 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.535044 19185 raft_consensus.cc:2749] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.555270 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.556135 18237 raft_consensus.cc:2368] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:16.520774 19332 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.543690 19322 raft_consensus.cc:2804] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:16.545922 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.552165 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.542765 19270 consensus_queue.cc:1048] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:18:16.552589 19330 raft_consensus.cc:2804] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.566365 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.553555 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.568822 18385 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.555081 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.572399 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.573290 18385 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.559211 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.542658 19328 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.577948 18232 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:16.570576 18975 raft_consensus.cc:2393] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.586602 18380 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.586644 18303 raft_consensus.cc:2368] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:16.592412 19197 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.506217 19272 consensus_queue.cc:237] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.595861 19334 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.596431 19334 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.600028 19334 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.601799 19328 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.572582 19322 raft_consensus.cc:697] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 5 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.603394 19322 consensus_queue.cc:237] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.608790 18971 raft_consensus.cc:1275] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:16.615789 18231 raft_consensus.cc:2368] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:16.585529 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.618206 18972 raft_consensus.cc:3060] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.567761 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.619421 18276 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.580605 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.555500 19236 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.619949 19234 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:16.621515 19236 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.622120 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:16.622789 18383 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.582020 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:16.626333 19232 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.627602 19260 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:16.628232 19286 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.628119 19260 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.628512 19232 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.629833 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.630478 18385 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:16.631520 18378 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.552446 19153 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.580514 18976 raft_consensus.cc:2393] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.619592 18382 raft_consensus.cc:2393] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 3: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:16.582177 19326 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.626749 18308 raft_consensus.cc:3060] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.649293 19326 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.633810 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:16.651558 18970 raft_consensus.cc:2393] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.634007 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.652498 18305 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 4: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:16.636552 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.585662 18201 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.653060 18309 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
W20260709 12:18:16.653177 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 67583.4us
I20260709 12:18:16.585289 18973 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:16.648406 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.654412 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.660816 18237 raft_consensus.cc:3055] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:16.621449 19204 raft_consensus.cc:2804] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.661235 18237 raft_consensus.cc:740] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:16.661491 18232 raft_consensus.cc:1275] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:16.655115 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.656564 18276 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.658018 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.662755 18309 raft_consensus.cc:2368] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:16.663938 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.660184 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.665431 18306 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:16.662164 18385 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.667886 18378 raft_consensus.cc:1275] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:16.667012 18350 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.670554 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.672009 18237 consensus_queue.cc:260] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:16.652385 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:16.703547 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.703895 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.704483 18236 raft_consensus.cc:2393] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:16.667147 19328 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.671986 19148 raft_consensus.cc:2804] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.644447 19244 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:18:16.714439 18237 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.704922 18232 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:16.710403 18201 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.675802 19197 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.675686 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.644678 19286 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.701726 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:16.675890 19234 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:18:16.676270 19341 consensus_queue.cc:1048] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:18:16.709755 19328 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.718819 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.706627 18384 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.719384 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.721143 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:16.734822 18230 raft_consensus.cc:3060] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.738410 19198 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.739814 19262 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.740067 19328 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.765477 18237 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
W20260709 12:18:16.749291 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 120710us
W20260709 12:18:16.777199 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 110253us
I20260709 12:18:16.756421 19215 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.764853 18233 raft_consensus.cc:2368] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:16.764725 19198 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.760887 19204 raft_consensus.cc:697] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.778180 19262 raft_consensus.cc:697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.764410 18977 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.783720 19215 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.784145 19260 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:16.779121 19302 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:16.781108 19267 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.790488 19338 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:16.827280 19338 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.830726 19338 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.785929 19330 raft_consensus.cc:697] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.823647 19354 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.823014 19215 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.789930 19198 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.789431 19148 raft_consensus.cc:697] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:16.843808 19153 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.858877 18972 raft_consensus.cc:2468] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
W20260709 12:18:16.882733 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 172398us
I20260709 12:18:16.885246 18201 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.826603 19302 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:16.905817 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 241930us
I20260709 12:18:16.887084 19286 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:16.886335 18383 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:16.937143 18308 raft_consensus.cc:2468] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:16.937930 18380 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:16.938668 18923 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:16.901402 19262 consensus_queue.cc:237] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.883921 19204 consensus_queue.cc:237] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:16.870536 19354 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:16.944960 19354 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:16.897053 19329 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:16.945755 19329 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:16.946148 19329 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.929376 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.955107 18237 raft_consensus.cc:2393] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 2: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:16.931332 18236 raft_consensus.cc:1275] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:16.933007 19332 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:16.946210 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 330432us
I20260709 12:18:16.958982 18202 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:16.959838 18202 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:16.918906 19148 consensus_queue.cc:237] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:16.914785 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:16.952159 18924 leader_election.cc:400] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:16.964579 19334 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.974771 18924 leader_election.cc:403] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:16.983523 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 94789.4us
I20260709 12:18:16.980481 19188 raft_consensus.cc:2804] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.989749 18228 raft_consensus.cc:2393] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:16.968401 19185 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.981503 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:16.994370 18308 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:16.976253 18230 raft_consensus.cc:2468] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:16.899464 19330 consensus_queue.cc:237] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:17.000106 19302 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:17.005113 19344 log.cc:927] Time spent T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:18:16.980652 19321 consensus_queue.cc:1048] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:18:16.979449 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:17.006810 18972 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.995158 19185 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.010169 19185 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.011523 19332 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.012799 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.013674 18382 raft_consensus.cc:2393] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 3: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:16.964308 19328 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.011339 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.022506 19244 raft_consensus.cc:3060] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.024477 18379 raft_consensus.cc:3060] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:18:17.020130 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 66832.6us
I20260709 12:18:17.074873 18923 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.095554 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:17.102950 18228 raft_consensus.cc:2368] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
I20260709 12:18:17.087136 19348 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.103989 19348 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.105175 19328 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.105716 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.106316 18385 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.097016 18350 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.122071 18350 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.120180 18970 raft_consensus.cc:1275] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.129928 18276 leader_election.cc:400] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
I20260709 12:18:17.070264 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.130319 18276 leader_election.cc:403] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.095048 18924 leader_election.cc:400] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.070935 19188 raft_consensus.cc:697] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.089627 18976 raft_consensus.cc:1275] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.089375 18304 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.106287 19348 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:17.101068 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:17.097512 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.132445 18305 raft_consensus.cc:1275] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.093319 19346 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:17.124408 19270 raft_consensus.cc:2804] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:17.088780 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.086850 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.133153 19211 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:17.094930 19361 consensus_queue.cc:1048] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 12:18:17.143407 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.201395 18378 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.138028 18924 leader_election.cc:403] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.094611 19215 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.223429 19215 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.128949 19212 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:18:17.167141 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.199198 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.141963 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.093710 19329 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.127761 19199 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:17.142849 18972 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:17.232090 18385 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:17.140826 19332 consensus_queue.cc:1048] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:18:17.233943 18303 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.236033 18202 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:17.244650 19326 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:17.208770 19211 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.252514 18059 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50296 (request call id 72) took 1380 ms. Trace:
I20260709 12:18:17.219821 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.256071 19198 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:17.202385 19270 raft_consensus.cc:697] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:17.257066 19188 consensus_queue.cc:237] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.257900 18231 raft_consensus.cc:2368] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.209348 18308 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.267994 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:18:17.268082 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 86925.3us
W20260709 12:18:17.332877 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 96937.6us
I20260709 12:18:17.275102 19211 raft_consensus.cc:3060] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.277132 18384 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:17.248014 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
W20260709 12:18:17.282161 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 50764.1us
I20260709 12:18:17.227471 19199 raft_consensus.cc:493] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.247865 19185 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:17.328459 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 198738us
I20260709 12:18:17.233017 18382 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
W20260709 12:18:17.266664 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 171959us
I20260709 12:18:17.274555 19349 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.337256 18974 raft_consensus.cc:2368] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:17.273458 18059 rpcz_store.cc:276] 0709 12:18:15.872120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.873586 (+  1466us) service_pool.cc:224] Handling call
0709 12:18:17.252408 (+1378822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:16.167224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:16.186629 (+ 19405us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:16.186664 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:18:16.186680 (+    16us) tablet.cc:662] Decoding operations
0709 12:18:16.187060 (+   380us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:16.187121 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:16.187147 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:18:16.187447 (+   300us) tablet.cc:701] Row locks acquired
0709 12:18:16.187464 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:18:16.187612 (+   148us) write_op.cc:270] Start()
0709 12:18:16.187716 (+   104us) write_op.cc:276] Timestamp: P: 1783599496187570 usec, L: 0
0709 12:18:16.187735 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:16.188370 (+   635us) log.cc:844] Serialized 924 byte log entry
0709 12:18:16.490452 (+302082us) op_driver.cc:464] REPLICATION: finished
0709 12:18:16.578767 (+ 88315us) write_op.cc:301] APPLY: starting
0709 12:18:16.578833 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:16.578919 (+    86us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:16.579006 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:16.579287 (+   281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:16.579405 (+   118us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:18:16.579432 (+    27us) write_op.cc:312] APPLY: finished
0709 12:18:16.579567 (+   135us) log.cc:844] Serialized 28 byte log entry
0709 12:18:16.579700 (+   133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:16.579768 (+    68us) write_op.cc:454] Released schema lock
0709 12:18:16.579797 (+    29us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:16.580084 (+   287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:16.580117 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2843,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":88086,"apply.run_cpu_time_us":1295,"apply.run_wall_time_us":1299,"num_ops":2,"prepare.queue_time_us":165499,"prepare.run_cpu_time_us":7173,"prepare.run_wall_time_us":78894,"raft.queue_time_us":161164,"raft.run_cpu_time_us":19540,"raft.run_wall_time_us":82988,"replication_time_us":302508,"thread_start_us":382913,"threads_started":4,"wal-append.queue_time_us":85473}]]}
I20260709 12:18:17.351287 18311 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.361321 18379 raft_consensus.cc:2468] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:17.390061 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.365094 19198 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:17.366874 18303 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:17.203780 19346 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:17.337491 19334 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:18:17.369943 18977 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.372553 18376 raft_consensus.cc:2368] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
I20260709 12:18:17.376434 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.348026 19199 raft_consensus.cc:3060] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.344059 19215 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:17.399065 19325 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:17.371359 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.404130 18974 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:17.407608 18202 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:17.362003 18304 raft_consensus.cc:1275] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.399649 18969 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.421240 18350 leader_election.cc:400] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:17.423192 18350 leader_election.cc:403] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.426962 18234 raft_consensus.cc:1275] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.417546 18308 raft_consensus.cc:2468] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:17.431865 18202 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:17.432684 19228 raft_consensus.cc:2804] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:17.433262 19228 raft_consensus.cc:697] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.427796 19327 raft_consensus.cc:2804] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:17.434158 19327 raft_consensus.cc:697] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.435051 19327 consensus_queue.cc:237] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.412753 19341 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
I20260709 12:18:17.412055 18377 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:17.447402 18970 raft_consensus.cc:1275] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.430518 19185 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.431334 19215 raft_consensus.cc:697] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.433377 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.441452 19356 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:17.444931 19269 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.487366 18231 raft_consensus.cc:1275] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:17.490947 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:17.491815 18969 raft_consensus.cc:2393] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:17.492681 19376 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.407074 19270 consensus_queue.cc:237] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.496824 18311 raft_consensus.cc:2468] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:17.438092 19380 consensus_queue.cc:1048] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:18:17.498059 19215 consensus_queue.cc:237] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.500581 18924 leader_election.cc:400] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.501008 18924 leader_election.cc:403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.427994 19325 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:17.450865 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:17.505385 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 45171.7us
I20260709 12:18:17.507097 19325 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:17.508965 19346 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:17.504419 18202 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:17.434260 19228 consensus_queue.cc:237] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.456903 19148 consensus_queue.cc:1048] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:18:17.461680 19267 consensus_queue.cc:1048] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:18:17.457844 18923 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.519217 19325 raft_consensus.cc:2804] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:17.516592 19349 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.503079 19332 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:18:17.546495 18379 raft_consensus.cc:3060] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.529585 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.527861 19334 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:17.567641 18235 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:17.551416 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.537462 19204 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
W20260709 12:18:17.555243 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 102627us
I20260709 12:18:17.555876 19325 raft_consensus.cc:697] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.556445 18382 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:17.557410 19329 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:17.534898 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.558509 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:17.558908 19267 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.610862 18383 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:17.528173 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.510319 19269 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.529536 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.532374 19244 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.530272 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.569339 18304 raft_consensus.cc:3060] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.571432 19334 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.572556 18234 raft_consensus.cc:1275] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.569367 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:17.581557 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.583173 18231 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.583822 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.589550 18379 raft_consensus.cc:1275] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.623823 18302 raft_consensus.cc:2393] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:17.573975 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.567006 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.605273 19329 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.614389 18383 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.566874 19148 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:18:17.618882 18201 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.563439 19211 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.609941 19267 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.631960 18971 raft_consensus.cc:1275] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.590199 19382 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.596550 19204 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:17.624513 18384 raft_consensus.cc:2468] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:17.625371 19325 consensus_queue.cc:237] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:17.645692 19358 log.cc:927] Time spent T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.706s	user 0.000s	sys 0.006s
I20260709 12:18:17.655802 18974 raft_consensus.cc:2393] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 2: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:17.646703 19215 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:17.658083 19215 raft_consensus.cc:697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:17.659161 19215 consensus_queue.cc:237] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:17.648548 19376 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:18:17.662652 18350 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:17.664182 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:17.666785 19337 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.668509 19337 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.669181 19337 consensus_queue.cc:1048] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.670394 19337 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:17.672138 18350 leader_election.cc:400] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641) with higher term. Message: Invalid argument: T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:17.647446 19267 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.676385 18972 raft_consensus.cc:1275] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:17.654096 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:17.677923 19375 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:17.680227 18350 leader_election.cc:403] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.673676 18971 raft_consensus.cc:1275] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.676743 18978 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.621352 18923 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:17.686867 18275 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:17.652765 19385 log.cc:927] Time spent T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:18:17.652892 19211 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:17.685930 18376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33214 (request call id 309) took 1053 ms. Trace:
I20260709 12:18:17.699502 18275 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:17.699821 19287 raft_consensus.cc:2749] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.701267 19334 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:17.701857 19352 consensus_queue.cc:1048] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.701678 19267 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:17.644440 19329 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.736321 19329 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.738412 18234 raft_consensus.cc:1275] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.706825 18304 raft_consensus.cc:2468] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:17.711150 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:17.725571 18275 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:17.742058 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.743431 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.724156 19193 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:17.662921 18977 raft_consensus.cc:1275] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:17.729624 19322 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.686134 19338 raft_consensus.cc:2749] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641) with higher term. Message: Invalid argument: T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:17.733321 18350 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:17.746343 19244 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:17.727406 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 129159us
I20260709 12:18:17.754782 19322 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.780344 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:17.779918 19244 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.762902 19269 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:17.785048 19211 raft_consensus.cc:2749] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.746928 19193 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.752228 19199 raft_consensus.cc:515] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:17.764135 18302 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:17.819725 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:17.794258 19316 raft_consensus.cc:2749] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.824314 18309 raft_consensus.cc:2393] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:17.801993 19322 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.724624 18376 rpcz_store.cc:276] 0709 12:18:16.630393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.643178 (+ 12785us) service_pool.cc:224] Handling call
0709 12:18:17.097397 (+454219us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58000b5298. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66beee 000000000036eb39 00007fc1836df1e0 00007fc1837a80c4 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:18:17.683595 (+586198us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54007869d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:18:17.683733 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309886592}
I20260709 12:18:17.785611 19270 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:18:17.820932 18924 leader_election.cc:400] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061) with higher term. Message: Invalid argument: T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.835067 18924 leader_election.cc:400] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061) with higher term. Message: Invalid argument: T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4.
I20260709 12:18:17.794716 19287 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:18:17.822628 19244 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.836169 18385 raft_consensus.cc:2393] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 3: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:17.848359 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:17.849253 18378 raft_consensus.cc:2393] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 3: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:17.851325 19204 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:17.821816 19354 consensus_queue.cc:1048] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:18:17.893690 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 70463.7us
I20260709 12:18:17.904352 18350 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:17.905308 18275 leader_election.cc:400] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
I20260709 12:18:17.905714 18275 leader_election.cc:403] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.905583 18350 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:17.909777 19409 raft_consensus.cc:2804] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:17.919162 19409 raft_consensus.cc:697] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:17.920075 19409 consensus_queue.cc:237] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:17.914211 19209 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.937289 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:17.939628 19153 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3.
W20260709 12:18:17.942498 19391 log.cc:927] Time spent T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
W20260709 12:18:17.943790 19397 log.cc:927] Time spent T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:18:17.946012 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.949460 19193 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.952455 18379 raft_consensus.cc:1275] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:17.958010 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:17.956806 19199 leader_election.cc:290] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:17.958737 18385 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:17.958988 19267 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:17.974048 18276 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:17.975653 19153 consensus_queue.cc:1048] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:17.976570 19341 raft_consensus.cc:2749] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:17.980125 19316 consensus_queue.cc:1048] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.992211 18924 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:17.993927 19270 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.997066 18202 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:17.997942 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:17.999032 19188 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:17.999480 19188 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.999842 19188 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.014178 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:18.016566 18311 raft_consensus.cc:1275] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.017031 18302 raft_consensus.cc:1275] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.017710 19204 consensus_queue.cc:1048] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.021588 18306 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:17.985208 19322 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:17.441345  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.035447 18060 catalog_manager.cc:5697] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 2, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 2 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:18.040617 19244 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:18.054006 18308 raft_consensus.cc:1240] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:18.041687 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:18.063544 19409 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:18.065493 18306 raft_consensus.cc:1275] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.071517 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:18.040678 19232 consensus_queue.cc:1048] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:18:18.030889 19328 consensus_queue.cc:1048] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:18:18.092896 18385 raft_consensus.cc:3060] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.097102 18201 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:18.081562 19409 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:18.099841 19407 log.cc:927] Time spent T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:18:18.100926 19409 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:18.099025 19327 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:18.103351 18923 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:18.104272 19413 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:18.105194 19413 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.106406 19413 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.115236 18376 raft_consensus.cc:1275] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.093457 19375 consensus_queue.cc:1048] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.078965 18377 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.059777 19321 consensus_queue.cc:1048] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:18:18.127526 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:18.060323 19287 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:18:18.126554 19354 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.127041 19329 consensus_queue.cc:1048] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.149516 18381 raft_consensus.cc:1275] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:18.150854 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:18.222311 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 65675.6us
I20260709 12:18:18.347256 18385 raft_consensus.cc:1275] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:18:18.305217 19388 log.cc:927] Time spent T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:18:18.400223 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:18.150900 19354 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:18.400316 19368 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.347338 19202 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:18:18.393635 19332 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:18.303821 19384 consensus_queue.cc:1048] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:18:18.435782 18228 raft_consensus.cc:1275] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.456632 18976 raft_consensus.cc:1240] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:18.448731 18973 raft_consensus.cc:1240] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:18:18.431218 19368 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:18.435477 19332 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:18.449023 19244 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:18.622740 19421 log.cc:927] Time spent T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 12:18:18.625470 19430 log.cc:927] Time spent T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:18:18.675450 19417 log.cc:927] Time spent T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.543s	user 0.002s	sys 0.004s
I20260709 12:18:18.664709 18973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 411) took 1252 ms. Trace:
W20260709 12:18:18.719887 19427 log.cc:927] Time spent T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 12:18:18.725473 18377 consensus_meta.cc:287] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
I20260709 12:18:18.748173 19202 raft_consensus.cc:493] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:18.748878 19202 raft_consensus.cc:515] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:18.707109 18973 rpcz_store.cc:276] 0709 12:18:17.406835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.408385 (+  1550us) service_pool.cc:224] Handling call
0709 12:18:18.442989 (+1034604us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b580011fa98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:18.446009 (+  3020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.598653 (+152644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.659071 (+ 60418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31583488}
W20260709 12:18:18.733549 19413 consensus_meta.cc:287] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.004s
I20260709 12:18:18.729969 19354 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:18.729149 18377 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:18.779433 18306 raft_consensus.cc:1275] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.789382 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:18.803849 19202 leader_election.cc:290] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:18.811276 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 463283us
I20260709 12:18:18.765128 19413 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:18.818349 18385 raft_consensus.cc:1275] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:18.783160 19354 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:18:18.824331 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:18.825812 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:18.819258 18230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.008s	sys 0.016s
W20260709 12:18:18.827526 18230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.016s
I20260709 12:18:18.811612 19368 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:18:18.821089 18379 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.008s	sys 0.013s
I20260709 12:18:18.816684 19326 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:18.821997 19332 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:18.843458 18972 raft_consensus.cc:1275] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:18:18.816618 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 513077us
W20260709 12:18:18.862910 19188 consensus_meta.cc:287] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 12:18:18.863555 19188 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:18.865643 19413 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:18.837847 18379 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.013s
I20260709 12:18:18.838197 18380 raft_consensus.cc:1240] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:18:18.882045 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 57338.7us
I20260709 12:18:18.848325 19326 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:18.871531 19188 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:18.884254 19202 raft_consensus.cc:493] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:18.899022 19202 raft_consensus.cc:515] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:18.901602 19202 leader_election.cc:290] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:18.906214 19326 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:18.889941 19409 consensus_queue.cc:1048] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:18:18.924553 19448 consensus_queue.cc:1048] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:18.928207 18923 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:18.929152 19269 consensus_queue.cc:1048] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.929890 19443 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:18.930473 19443 raft_consensus.cc:697] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:18.931342 19443 consensus_queue.cc:237] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:18.938470 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:18.939142 18385 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.892630 19204 consensus_queue.cc:1059] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:18:18.941246 19341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.010s	sys 0.014s
W20260709 12:18:18.945546 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 55768.6us
W20260709 12:18:18.946065 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 52534.6us
I20260709 12:18:18.948225 18385 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
W20260709 12:18:18.946735 19341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.014s
I20260709 12:18:18.962512 19354 consensus_queue.cc:1059] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:18:18.981048 18276 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:18.982990 19450 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.983978 19326 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:18.984469 19326 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:18.996650 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 604162us
I20260709 12:18:19.005645 18385 raft_consensus.cc:1275] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:19.014498 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:19.004621 19426 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.004091 19364 consensus_queue.cc:1048] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:18:19.029352 19426 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.027841 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.024968 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:19.031596 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:19.006772 19328 consensus_queue.cc:1048] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:18:19.027024 19363 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.034183 19363 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.035535 19215 consensus_queue.cc:1048] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:19.036247 19363 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.027215 19334 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.026804 19226 raft_consensus.cc:493] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.016911 19368 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.032984 19332 raft_consensus.cc:493] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:19.037185 19334 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.049899 19332 raft_consensus.cc:515] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.052039 19334 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.047585 19226 raft_consensus.cc:515] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.054667 19226 leader_election.cc:290] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.055868 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.026530 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:19.060145 18382 raft_consensus.cc:1275] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:19.028542 18376 raft_consensus.cc:1275] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:18:19.064821 19416 log.cc:927] Time spent T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.932s	user 0.005s	sys 0.024s
W20260709 12:18:19.065133 19462 log.cc:927] Time spent T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:19.064553 18350 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.083477 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:19.020591 19326 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.100361 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41322 (request call id 92) took 1015 ms. Trace:
I20260709 12:18:19.100875 18378 rpcz_store.cc:276] 0709 12:18:18.085440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.085594 (+   154us) service_pool.cc:224] Handling call
0709 12:18:19.099722 (+1014128us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b58000b5298. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:19.099945 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.100110 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.100125 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.100157 (+    32us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:19.100173 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.100209 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.100311 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54755712}
I20260709 12:18:19.052389 19332 leader_election.cc:290] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.111418 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:19.093536 19337 raft_consensus.cc:2749] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:19.079537 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.084612 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33228 (request call id 540) took 1012 ms. Trace:
I20260709 12:18:19.119093 18232 raft_consensus.cc:1240] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:18:19.119406 19322 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.122756 19459 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.124419 18924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.057s	sys 0.096s
W20260709 12:18:19.156883 18924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.058s	sys 0.097s
W20260709 12:18:19.157368 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 1.12467e+06us
I20260709 12:18:19.125778 19426 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.079355 19368 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.117482 18201 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:19.149362 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.163555 18234 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:19.164611 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.164710 18276 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:19.108319 19364 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.112432 19376 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.166006 19364 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.166750 19376 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.169351 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.115175 19409 raft_consensus.cc:493] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.172359 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.168705 19364 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.205821 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:19.183564 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 66180.4us
I20260709 12:18:19.265851 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.268517 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:19.268739 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:19.182554 19322 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:19.276533 19455 consensus_queue.cc:1048] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:18:19.277024 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "388fffe591be477388e1e844d43d1cda"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:41324
I20260709 12:18:19.277709 18381 raft_consensus.cc:606] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.278079 18381 raft_consensus.cc:614] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:19.285938 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 56416.1us
I20260709 12:18:19.162624 19459 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.262946 19452 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.260722 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.143646 18384 rpcz_store.cc:276] 0709 12:18:18.072364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.073026 (+   662us) service_pool.cc:224] Handling call
0709 12:18:19.083258 (+1010232us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b58000b5298. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:18:19.084531 (+  1273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4875648}
I20260709 12:18:19.170056 19424 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:18:19.304363 19455 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.202279 19226 raft_consensus.cc:2749] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:19.274664 19267 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.285267 19322 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.266772 18923 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:18:19.322154 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 113416us
I20260709 12:18:19.306728 18978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53950 (request call id 306) took 1159 ms. Trace:
I20260709 12:18:19.183984 19409 raft_consensus.cc:515] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.326560 18924 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:19.330507 19262 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.331126 19262 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:19.332978 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 46381.3us
I20260709 12:18:19.310037 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:41324
I20260709 12:18:19.293278 19375 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:18:19.314900 19455 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.316821 19322 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.340592 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.350725 19478 consensus_queue.cc:1059] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:19.351174 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:19.350735 19474 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:19.318840 19244 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:18:19.351899 19474 raft_consensus.cc:697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:19.353137 19445 raft_consensus.cc:3055] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:19.352795 19474 consensus_queue.cc:237] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:19.353602 19463 log.cc:927] Time spent T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:18:19.355019 19466 log.cc:927] Time spent T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:18:19.355412 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.339289 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38380 (request call id 413) took 1169 ms. Trace:
I20260709 12:18:19.320379 19267 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.353467 19409 leader_election.cc:290] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.362315 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cbd36b69f445ad8ef1f859eb1ddb41" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.346280 19212 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.334123 19269 consensus_queue.cc:1059] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:18:19.349303 18381 raft_consensus.cc:606] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.384575 18376 raft_consensus.cc:1240] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.308753 19452 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.353515 19445 raft_consensus.cc:740] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
W20260709 12:18:19.386626 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 50911.9us
I20260709 12:18:19.358865 19413 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
W20260709 12:18:19.359491 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 129248us
I20260709 12:18:19.360553 19316 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:19.350039 19332 consensus_queue.cc:1048] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:18:19.400671 19467 consensus_queue.cc:1059] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:18:19.401675 19467 raft_consensus.cc:3055] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:19.402046 19467 raft_consensus.cc:740] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:19.402925 19467 consensus_queue.cc:260] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.403450 19452 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.406482 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.389130 18381 raft_consensus.cc:614] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:19.389567 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.410452 19350 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.411574 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfff73c71c1a49b3986f395d27a699a8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.326402 18978 rpcz_store.cc:276] 0709 12:18:18.145529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.149363 (+  3834us) service_pool.cc:224] Handling call
0709 12:18:18.149651 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.149856 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:18.397331 (+247475us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.134786 (+737455us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b180039a000. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc18456bab1 00007fc184578281 00007fc17b685e07 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a0455 00007fc17e788060 00007fc17e79a716 00007fc17e7ab287 00007fc17e7ab208
0709 12:18:19.260022 (+125236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.263828 (+  3806us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.271200 (+  7372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.276101 (+  4901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.305029 (+ 28928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244436,"prepare.queue_time_us":243607,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":52166,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":6776576,"thread_start_us":91712,"threads_started":1}
I20260709 12:18:19.392457 19368 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.411826 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.411880 18228 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:19.414873 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.393819 19212 raft_consensus.cc:3055] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:19.411770 19459 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:19.396413 19413 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.414834 19467 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.440897 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57252 (request call id 448) took 1288 ms. Trace:
I20260709 12:18:19.424074 19212 raft_consensus.cc:740] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:19.443284 18350 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:19.448836 18276 leader_election.cc:304] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:19.434592 19453 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.441360 18311 rpcz_store.cc:276] 0709 12:18:18.152291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.161049 (+  8758us) service_pool.cc:224] Handling call
0709 12:18:19.412556 (+1251507us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5800165698. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:19.412756 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.423153 (+ 10397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.426879 (+  3726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.431535 (+  4656us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.434566 (+  3031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.440712 (+  6146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.440839 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9155328}
I20260709 12:18:19.399624 19316 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.445156 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.447430 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:41324
W20260709 12:18:19.455730 18975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.321s	user 0.023s	sys 0.008s
I20260709 12:18:19.456864 19350 raft_consensus.cc:2749] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:19.558730 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 112741us
I20260709 12:18:19.438400 18923 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:19.552162 18975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.024s	sys 0.008s
I20260709 12:18:19.618533 19459 raft_consensus.cc:493] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.552063 18978 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:19.432252 19445 consensus_queue.cc:260] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.364842 18233 rpcz_store.cc:276] 0709 12:18:18.155323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.160814 (+  5491us) service_pool.cc:224] Handling call
0709 12:18:18.397427 (+236613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.169639 (+772212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.171488 (+  1849us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.279161 (+107673us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.301933 (+ 22772us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.301984 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.302064 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.314348 (+ 12284us) raft_consensus.cc:1685] finished
0709 12:18:19.314368 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.324918 (+ 10550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578661,"raft.queue_time_us":589147,"spinlock_wait_cycles":3076864,"thread_start_us":173033,"threads_started":2,"wal-append.queue_time_us":22722}
I20260709 12:18:19.616566 18381 raft_consensus.cc:606] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.499702 19453 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.648042 19409 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.651839 19212 consensus_queue.cc:260] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.662331 19368 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.645628 19459 raft_consensus.cc:515] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
W20260709 12:18:19.681000 19438 log.cc:927] Time spent T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:18:19.682467 19465 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.683173 19486 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:19.683493 19493 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.669487 19267 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.671751 19455 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:19.677426 19445 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.718184 19151 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.744652 19486 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.759002 19212 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.747818 19432 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.717790 19409 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.743172 19368 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.788714 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.773891 19492 raft_consensus.cc:493] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.774147 19332 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.774796 19267 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:19.763625 19413 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:19.756251 19493 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.781670 19486 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.796733 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:19.812780 18234 raft_consensus.cc:606] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:19.813136 18234 raft_consensus.cc:614] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:19.779157 19497 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.814728 18307 raft_consensus.cc:1275] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:19.805913 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
W20260709 12:18:19.794334 19489 log.cc:927] Time spent T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:18:19.808701 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.806461 18058 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34336 (request call id 153) took 3741 ms. Trace:
W20260709 12:18:19.803526 19480 log.cc:927] Time spent T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:18:19.818383 18058 rpcz_store.cc:276] 0709 12:18:16.052870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.053005 (+   135us) service_pool.cc:224] Handling call
0709 12:18:19.794272 (+3741267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92505,"reported_tablets":7}
I20260709 12:18:19.790215 19316 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.819222 18237 raft_consensus.cc:1240] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:18:19.822932 19494 log.cc:927] Time spent T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:18:19.824034 19502 raft_consensus.cc:493] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.824332 19496 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.824779 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.826243 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.826622 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
W20260709 12:18:19.827870 19490 log.cc:927] Time spent T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:18:19.806813 19325 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.828461 19325 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.781477 19151 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.827593 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.828703 18978 raft_consensus.cc:1275] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:19.755942 19465 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.811174 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.829648  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:19.795012 19469 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
W20260709 12:18:19.820557 19484 log.cc:927] Time spent T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:18:19.814843 19232 consensus_queue.cc:1059] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:18:19.820858 19452 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:19.820386 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.826622 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.866680 19459 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.867347 19459 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.867900 19459 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:19.868398 19465 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.870131 19493 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:19.824895 19496 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.870958 19453 leader_election.cc:290] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:19.851146 19328 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:19.872247 19328 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.872720 19496 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.875258 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:19.874598 19452 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.877868 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.806960 19332 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.879120 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.862605 19469 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.880254 19332 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.881091 19469 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:19.820127 19497 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:19.804983 19492 raft_consensus.cc:515] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.883482 19492 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.884183 19452 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:19.791993 19432 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:19.886924 18350 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.178.195:41061 timed out after 1.973s (SENT) [suppressed 21 similar messages]
W20260709 12:18:19.890751 18922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.893695 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94dc42a44c014b24a25ddcaad4075300" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:19.894109 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 88957.1us
I20260709 12:18:19.899379 18202 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:19.900182 19236 consensus_queue.cc:1048] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:19.901619 19236 raft_consensus.cc:2749] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:19.904902 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.907603 18202 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:19.909507 19188 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:19.911453 18202 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:19.913463 19188 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:19.915148 18202 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:19.916997 19215 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.919422 19215 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:19.971872 19215 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.974098 19215 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:19.918390 19491 log.cc:927] Time spent T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:18:19.924348 19376 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:19.927033 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:19.928997 19199 raft_consensus.cc:493] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.934958 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57266 (request call id 571) took 2097 ms. Trace:
I20260709 12:18:19.982735 18309 rpcz_store.cc:276] 0709 12:18:17.837276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.837896 (+   620us) service_pool.cc:224] Handling call
0709 12:18:17.992239 (+154343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.011897 (+ 19658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.011931 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.018742 (+  6811us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.050702 (+ 31960us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:18.050745 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.050821 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.625259 (+574438us) raft_consensus.cc:1685] finished
0709 12:18:18.625280 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.934602 (+1309322us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540020e250. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e78f8ad 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:18:19.934877 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19250,"raft.queue_time_us":19928,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":354152320,"thread_start_us":31597,"threads_started":1,"wal-append.queue_time_us":99129,"wal-append.run_cpu_time_us":2638,"wal-append.run_wall_time_us":1514729}
I20260709 12:18:19.984966 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.936513 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38380 (request call id 412) took 1782 ms. Trace:
I20260709 12:18:19.986290 18231 rpcz_store.cc:276] 0709 12:18:18.154268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.160755 (+  6487us) service_pool.cc:224] Handling call
0709 12:18:19.935458 (+1774703us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b58000d9898. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:19.935728 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.936087 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.936120 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.936172 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.936211 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.936291 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.936442 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11571584}
I20260709 12:18:19.940918 19356 raft_consensus.cc:3055] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:19.987944 19356 raft_consensus.cc:740] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:19.989112 19356 consensus_queue.cc:260] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.943060 19262 leader_election.cc:290] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:19.943635 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.992137 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.981824 19199 raft_consensus.cc:515] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:19.997176 19199 leader_election.cc:290] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:19.957336 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.998380 18972 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:19.999708 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.001008 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:19.962278 19316 raft_consensus.cc:493] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:20.002866 19316 raft_consensus.cc:515] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.004236 19376 raft_consensus.cc:493] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.004809 19376 raft_consensus.cc:515] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.005244 19316 leader_election.cc:290] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:19.964537 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.969045 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdcb3150843428e970fa883d21b1894" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.007310 18202 leader_election.cc:304] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.008549 19334 raft_consensus.cc:2749] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:20.012429 19376 leader_election.cc:290] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.016266 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.019994 19465 raft_consensus.cc:3055] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.020478 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.993495 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.022070 18202 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.020525 19465 raft_consensus.cc:740] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:20.023864 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5912d4ca89fd4924a83b748aeecca9f2" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.023581 19465 consensus_queue.cc:260] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:20.024912 19465 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.025231 19193 raft_consensus.cc:2749] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.026472 19193 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.026964 19193 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.035046 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.033371 19193 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:18:20.038084 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.038714 18975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53950 (request call id 303) took 1929 ms. Trace:
W20260709 12:18:20.052215 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 85832.2us
I20260709 12:18:20.063540 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.070106 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:19.891005 19322 consensus_meta.cc:287] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.005s
I20260709 12:18:20.081132 19368 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.081523 19459 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.081830 19151 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.059935 19363 raft_consensus.cc:493] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.082926 19363 raft_consensus.cc:515] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:19.856036 19502 raft_consensus.cc:515] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:20.092154 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.107924 19502 leader_election.cc:290] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:20.108547 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 678090us
I20260709 12:18:20.084167 19322 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.114080 19496 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.114549 19322 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:20.115635 18969 raft_consensus.cc:2410] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:20.116112 18970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53950 (request call id 309) took 1061 ms. Trace:
I20260709 12:18:20.116534 18970 rpcz_store.cc:276] 0709 12:18:19.054995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.062681 (+  7686us) service_pool.cc:224] Handling call
0709 12:18:19.495539 (+432858us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b580011fa98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:19.495737 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.684287 (+188550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.684324 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.716990 (+ 32666us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.850478 (+133488us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.850524 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.850591 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.115817 (+265226us) raft_consensus.cc:1685] finished
0709 12:18:20.115840 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.116048 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55603,"raft.queue_time_us":182816,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":4463,"spinlock_wait_cycles":25777536,"thread_start_us":261776,"threads_started":2,"wal-append.queue_time_us":134629}
I20260709 12:18:20.057507 18975 rpcz_store.cc:276] 0709 12:18:18.109768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.114788 (+  5020us) service_pool.cc:224] Handling call
0709 12:18:18.115155 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.115506 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.115537 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.134142 (+ 18605us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.440737 (+1306595us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17b6860ac 00007fc1844e09a9 00007fc17b6a269b 00007fc17b6a093f 00007fc17b6a2c02 00007fc17e32a20b
0709 12:18:19.647605 (+206868us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:19.651030 (+  3425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.661970 (+ 10940us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.917696 (+255726us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b5c9c85 00007fc17b5ca6a2 00007fc17e33c1db 00007fc17e337aaf 00007fc17e32b86e 00007fc17e32abb6 00007fc17e32a7d8 00007fc17e334221 00007fc17e3341d9 00007fc17e334169
0709 12:18:20.038459 (+120763us) raft_consensus.cc:1685] finished
0709 12:18:20.038483 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.038650 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2220,"raft.queue_time_us":295734,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":12505,"spinlock_wait_cycles":20425856,"thread_start_us":1506059,"threads_started":1,"wal-append.queue_time_us":1480755}
I20260709 12:18:20.119434 19328 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.121443 19432 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.100080 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.127398 19325 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.128448 19409 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.114640 19496 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.132730 19496 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.135336 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.134851 19486 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.116649 19497 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:20.137471 18310 raft_consensus.cc:2393] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 4: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:20.140725 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.141525 18306 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:20.143311 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.146538 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:20.149689 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:19.990267 19356 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.158736 19486 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.159020 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.072952 19321 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.159276 19363 leader_election.cc:290] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.165180 18306 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:18:20.172343 18306 pending_rounds.cc:85] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Aborting all ops after (but not including) 2
I20260709 12:18:20.175496 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.189543  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.190800  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.194703 18059 catalog_manager.cc:5697] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.172610 18306 pending_rounds.cc:107] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:20.202317 18306 raft_consensus.cc:2889] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.196539 18059 catalog_manager.cc:5697] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } }
I20260709 12:18:20.171798 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.225653 18311 raft_consensus.cc:1240] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:20.228202 18201 leader_election.cc:304] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.228394 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.235229 18924 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.185118 19321 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.236296 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:20.246474 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.255774 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.238832 19188 raft_consensus.cc:2749] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.259346 18202 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.261427 18973 raft_consensus.cc:1240] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:20.262583 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 375667us
I20260709 12:18:20.267899 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.248353 19269 raft_consensus.cc:2749] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.246179 19465 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.260370 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.285070 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.264988 19226 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.254148 19474 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:18:20.265033 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.301609 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.308918 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.311900 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.312480 18383 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:20.313393 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.313961 18383 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:20.289384 19226 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:20.286248 19465 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:20.331650 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 82821.6us
W20260709 12:18:20.307472 19467 consensus_meta.cc:287] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.000s
I20260709 12:18:20.295605 19509 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.304183 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.365409 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.330327 19226 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.367790 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.329924 19269 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.363610 19188 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.385205 19269 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.378014 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.381035 19508 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.367933 18923 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:20.364661 19509 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.425041 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.387233 19337 raft_consensus.cc:493] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.425678 19465 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.387652 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.425894 19321 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.429944 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.474560 19312 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:20.472970 18969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53950 (request call id 312) took 1417 ms. Trace:
I20260709 12:18:20.472256 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.468255 19509 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.496841 18383 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:18:20.499783 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.514537 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd81066a96b4346ab78ad395259fcc8" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.500324 19153 raft_consensus.cc:493] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.501106 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:20.629405 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.510336 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.497532 19508 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.627485 19153 raft_consensus.cc:515] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.654758 19424 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:20.654629 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 291671us
I20260709 12:18:20.655311 19424 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:20.503247 19337 raft_consensus.cc:515] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.655742 19424 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.513002 19312 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.658396 19269 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.508548 18969 rpcz_store.cc:276] 0709 12:18:19.055983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.063021 (+  7038us) service_pool.cc:224] Handling call
0709 12:18:19.926843 (+863822us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b580011fa98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc1837560a0 00007fc183755984 00007fc17ccd06d4 00007fc17ccd0662
0709 12:18:20.472708 (+545865us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540000aad4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e7942fa 00007fc183755b17 00007fc17ccd06d4 00007fc17ccd0662 00007fc17ccd0591 00007fc17ccd050c 00007fc17cccf7c2 00007fc17cacb48c 00007fc17caca8c6 00007fc17caca26f
0709 12:18:20.472878 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263469824}
I20260709 12:18:20.655649 18923 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:20.675896 18381 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
W20260709 12:18:20.722821 19530 log.cc:927] Time spent T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:18:20.723979 19531 log.cc:927] Time spent T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:20.724467 19188 raft_consensus.cc:2749] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.711292 19526 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:20.725492 19526 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.719141 19269 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:20.714318 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 58765.4us
W20260709 12:18:20.728387 19356 consensus_meta.cc:287] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 12:18:20.720844 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33228 (request call id 561) took 1355 ms. Trace:
I20260709 12:18:20.743778 19508 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.744879 19337 leader_election.cc:290] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.748092 19312 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.750057 19226 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.751382 18229 raft_consensus.cc:1240] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:20.752887 19226 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.753063 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.754489 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.755394 18302 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 5: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:20.756340 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.734607 19269 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.760942 19509 raft_consensus.cc:493] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.761103 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:20.763043 19509 raft_consensus.cc:515] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.759603 18923 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.762889 19269 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.761296 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aacfc26793e4bf28e5827e26159662b" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.766546 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ce96c35374410ba64078605ab401ef" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:20.768599 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:20.769516 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.769556 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.769248 18236 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
W20260709 12:18:20.770588 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.770376 18307 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:20.763952 19493 raft_consensus.cc:493] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.775811 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.775888 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.778409 19312 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:20.774170 19502 raft_consensus.cc:2749] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.770406 19226 raft_consensus.cc:493] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.778213 19478 raft_consensus.cc:493] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.784161 18378 raft_consensus.cc:1240] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:20.788801 18385 raft_consensus.cc:1240] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:20.787454 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.781585 19526 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.795279 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.795357 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:20.779243 19493 raft_consensus.cc:515] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.780884 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:20.802942 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:20.813218 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da0bd128e3a412fb2096d9bced6a731" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.783356 19312 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.787238 19478 raft_consensus.cc:515] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.789067 19226 raft_consensus.cc:515] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.823894 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.825593 18378 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 1.
I20260709 12:18:20.828282 19502 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:20.836762 19226 leader_election.cc:290] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.837531 18350 leader_election.cc:304] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.837908 19508 consensus_queue.cc:1048] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:20.839468 19153 leader_election.cc:290] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:20.840673 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305a8559734b417591ff6ac5f0609a2e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.842280 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.842412 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab54a9a3cb1444999d60e40d2852633" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.842938 18385 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:20.843909 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.848543 18350 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.854089 18350 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.846436 19325 raft_consensus.cc:493] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.847362 19509 leader_election.cc:290] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.850323 19199 raft_consensus.cc:2749] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:20.867332 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.868113 18385 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
W20260709 12:18:20.868703 19540 log.cc:927] Time spent T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:18:20.869066 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.873327 18973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53966 (request call id 432) took 1015 ms. Trace:
I20260709 12:18:20.873941 18973 rpcz_store.cc:276] 0709 12:18:19.857516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.881254 (+ 23738us) service_pool.cc:224] Handling call
0709 12:18:19.881542 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:20.267432 (+385890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.865574 (+598142us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54000069d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6f9571 00007fc17e790e01 00007fc17e78f83e 00007fc183754419 00007fc17cccbbd4 00007fc17cccbb62 00007fc17cccba91 00007fc17cccba0c 00007fc17cccacc2 00007fc17cacb48c 00007fc17caca8c6
0709 12:18:20.873249 (+  7675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836252416}
I20260709 12:18:20.875943 19493 leader_election.cc:290] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.741232 18380 rpcz_store.cc:276] 0709 12:18:19.360734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.361774 (+  1040us) service_pool.cc:224] Handling call
0709 12:18:19.903625 (+541851us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b58000b5298. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66be9c 00007fc17b66ba5b 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:19.903975 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.904201 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:20.353906 (+449705us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.625884 (+271978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.633850 (+  7966us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:20.703574 (+ 69724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.710632 (+  7058us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.716383 (+  5751us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":401350,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":767,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":118680,"spinlock_wait_cycles":47991296,"thread_start_us":571141,"threads_started":2,"wal-append.queue_time_us":306335}
I20260709 12:18:20.878713 19409 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.880286 19312 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.884455 18923 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.887008 19432 raft_consensus.cc:493] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.869189 19478 leader_election.cc:290] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.856578 19352 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.891494 19509 raft_consensus.cc:493] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.867734 19325 raft_consensus.cc:515] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.887691 19432 raft_consensus.cc:515] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:20.890728 19474 raft_consensus.cc:2749] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:20.907194 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 53184.8us
I20260709 12:18:20.913340 18350 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.889838 19424 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:20.886260 19269 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:20.898602 19509 raft_consensus.cc:515] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.918107 19352 raft_consensus.cc:2749] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.913393 19512 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.923352 18350 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:20.934180 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:20.932286 19352 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.936319 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:20.925683 19512 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:20.932318 19269 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.943095 19500 consensus_queue.cc:1059] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:20.942559 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:20.944278 19500 raft_consensus.cc:3055] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.944617 19500 raft_consensus.cc:740] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:20.944742 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
W20260709 12:18:20.937917 19542 log.cc:927] Time spent T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:18:20.940073 19199 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.937541 19547 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.937817 19352 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:20.958132 19500 consensus_queue.cc:260] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:20.959429 18202 leader_election.cc:304] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.959597 19500 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.960635 18202 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.961304 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.961953 19226 raft_consensus.cc:2749] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:20.962628 19226 raft_consensus.cc:2749] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.961655 19546 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:18:20.963524 19432 leader_election.cc:290] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:20.964430 19325 leader_election.cc:290] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:20.966065 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.967563 18202 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.968703 18202 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.969300 18975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53950 (request call id 324) took 1002 ms. Trace:
I20260709 12:18:20.970206 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.970564 19226 raft_consensus.cc:2749] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.962783 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e2d49deb2a6475590075e98db484a4a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.969842 19325 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.974403 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:20.950088 19199 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:20.950500 19547 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:20.985476 18202 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:20.985138 18275 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.952890 19352 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.963148 19424 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.005913 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:20.989533 19448 raft_consensus.cc:2749] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.008965 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.009102 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.009644 19512 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:20.987207 19269 raft_consensus.cc:493] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:20.991503 18275 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:21.011336 19269 raft_consensus.cc:515] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.012610 19262 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:21.013005 19262 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:21.013337 19262 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.987458 19199 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.022766 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.024068 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.024961 18229 raft_consensus.cc:2393] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
W20260709 12:18:21.025969 19549 log.cc:927] Time spent T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:18:21.025655 18059 catalog_manager.cc:5697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.989787 19547 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.028827 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.008737 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.015528 19509 leader_election.cc:290] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:21.036460 19551 log.cc:927] Time spent T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:18:21.038173 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.038321 18276 leader_election.cc:304] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.039090 18060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34342 (request call id 143) took 4535 ms. Trace:
W20260709 12:18:21.040038 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 48612.2us
I20260709 12:18:21.039938 18276 leader_election.cc:304] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:21.041231 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 55833.6us
I20260709 12:18:21.042788 18202 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.041821 18276 leader_election.cc:304] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.052089 19448 raft_consensus.cc:2749] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:20.990595 19548 log.cc:927] Time spent T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:18:21.055971 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b921fdab84e49f79157326d18a70aa7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.057554 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.059785 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.041314 18275 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
W20260709 12:18:21.017721 19516 log.cc:927] Time spent T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: Append to log took a long time: real 0.637s	user 0.004s	sys 0.000s
I20260709 12:18:21.068346 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.069096 18970 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:21.070312 18202 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:21.013383 19269 leader_election.cc:290] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.067541 18276 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:20.989327 19270 raft_consensus.cc:493] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:21.071255 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.062351 19448 raft_consensus.cc:2749] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.058478 19153 raft_consensus.cc:2749] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.065698 19497 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.970577 18975 rpcz_store.cc:276] 0709 12:18:19.966771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.120310 (+153539us) service_pool.cc:224] Handling call
0709 12:18:20.968566 (+848256us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b580011fa98. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17b52bdb1 00007fc17b66bb71 00007fc17b66ba22 00007fc1845848d9 00007fc1836deee0 00007fc1837a80ab 00007fc1837a8131 00007fc183769fc0 00007fc183754929 00007fc1837543d2 00007fc17cccbbd4
0709 12:18:20.968757 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:20.968957 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.968991 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.969037 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:20.969072 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.969130 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.969237 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57086208}
I20260709 12:18:21.065474 19337 raft_consensus.cc:493] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.070768 19453 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:21.040417 18060 rpcz_store.cc:276] 0709 12:18:16.486723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.490166 (+  3443us) service_pool.cc:224] Handling call
0709 12:18:16.623217 (+133051us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b54006482d4. stack: 00007fc17b671343 00007fc17b671240 00007fc17b0001d4 00007fc184d3e304 00007fc184d3e299 00007fc17e6fa090 00007fc17e798f3a 00007fc18454ee9c 00007fc18464d04e 00007fc182b0e2a4 00007fc182b0e232 00007fc182b0e161 00007fc182b0e0dc 00007fc182b0d392 00007fc17cacb48c 00007fc17caca8c6
0709 12:18:21.022267 (+4399050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:18.420732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:18.622912 (+202180us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:18.622952 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:18:18.622969 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:18.623374 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:18.623445 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:18.623477 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:18.623667 (+   190us) tablet.cc:701] Row locks acquired
0709 12:18:18.623686 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:18:18.623851 (+   165us) write_op.cc:270] Start()
0709 12:18:18.623973 (+   122us) write_op.cc:276] Timestamp: P: 1783599498623797 usec, L: 0
0709 12:18:18.623994 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:18.624726 (+   732us) log.cc:844] Serialized 540 byte log entry
0709 12:18:18.939241 (+314515us) op_driver.cc:464] REPLICATION: finished
0709 12:18:19.084415 (+145174us) write_op.cc:301] APPLY: starting
0709 12:18:19.084513 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:19.084646 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:19.114829 (+ 30183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:19.120063 (+  5234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:19.120236 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:19.120388 (+   152us) write_op.cc:312] APPLY: finished
0709 12:18:19.120627 (+   239us) log.cc:844] Serialized 22 byte log entry
0709 12:18:19.120833 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.120928 (+    95us) write_op.cc:454] Released schema lock
0709 12:18:19.120972 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:19.121358 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.121386 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1575732,"reported_tablets":10,"spinlock_wait_cycles":187532032,"child_traces":[["op",{"apply.queue_time_us":144921,"apply.run_cpu_time_us":2146,"apply.run_wall_time_us":36927,"num_ops":1,"prepare.queue_time_us":348433,"prepare.run_cpu_time_us":18207,"prepare.run_wall_time_us":422591,"raft.queue_time_us":87785,"raft.run_cpu_time_us":34429,"raft.run_wall_time_us":94604,"replication_time_us":315111,"thread_start_us":402632,"threads_started":4,"wal-append.queue_time_us":219990,"wal-append.run_cpu_time_us":10123,"wal-append.run_wall_time_us":1289084}]]}
I20260709 12:18:21.134878 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f1bbd2de5294bb49cdcd14a71bb0a0e" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.070875 19505 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.074095 19193 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:21.132511 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 60587.8us
I20260709 12:18:21.058347 19509 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.141892 19337 raft_consensus.cc:515] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.144698 19547 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.145467 19337 leader_election.cc:290] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.141853 18275 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:21.130740 19497 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:21.149199 19552 log.cc:927] Time spent T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:18:21.150545 19505 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.152951 19505 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.153023 19199 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.154021 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.084833 19270 raft_consensus.cc:515] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:21.158139 19352 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.161581 18383 raft_consensus.cc:1240] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.163357 19270 leader_election.cc:290] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:21.165122 19352 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:21.124868 19363 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.168372 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.169600 18969 raft_consensus.cc:1240] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.175702 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.177443 19352 raft_consensus.cc:993] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
W20260709 12:18:21.195937 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 128456us
I20260709 12:18:21.172190 19363 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
W20260709 12:18:21.184991 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.175382 19445 raft_consensus.cc:2804] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:21.142035 19448 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.139282 19453 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:21.201378 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecddc502cf58477d8c38c13f8d405f7f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.178457 19199 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.204524 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.198215 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.198722 19363 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.169828 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.167469 19497 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.212648 18276 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.194568 18971 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:21.212430 19453 raft_consensus.cc:3060] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:21.214694 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37db4f6fedfc49e4a401670153431564" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.215167 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.216387 19547 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.217515 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057782f021104153860c7f1a52634265" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.212116 19486 raft_consensus.cc:1081] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:21.220502 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.200839 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.198464 18234 raft_consensus.cc:1275] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.210649 19445 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.211122 18924 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.211318 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.221844 18350 leader_election.cc:304] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.214613 19501 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.222811 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.223754 18924 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.227463 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:21.196465 19316 raft_consensus.cc:493] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:21.229471 18924 leader_election.cc:304] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.229740 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.223062 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.228102 19426 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.230573 18276 leader_election.cc:304] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.226945 19486 raft_consensus.cc:2749] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:21.232607 19535 log.cc:927] Time spent T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
I20260709 12:18:21.233187 19547 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.233625 19547 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.233964 19547 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.231451 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.234961 19560 consensus_queue.cc:1059] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:21.224285 19445 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.234468 19262 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.235942 19560 raft_consensus.cc:3055] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.236409 19560 raft_consensus.cc:740] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:21.237246 19560 consensus_queue.cc:260] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.237954 19262 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.238418 19560 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.238844 19486 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.238507 19363 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:21.234872 18969 raft_consensus.cc:2393] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 4: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:21.240653 19316 raft_consensus.cc:515] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.242276 18969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53970
I20260709 12:18:21.242926 18969 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:21.243290 18969 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.246681 18350 leader_election.cc:304] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.248211 19511 raft_consensus.cc:2749] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.248911 19270 consensus_queue.cc:1059] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:21.232681 19321 raft_consensus.cc:2749] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.254519 18350 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.255035 19316 leader_election.cc:290] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.255677 18972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.255870 18350 leader_election.cc:304] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.257397 18973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.259151 19486 raft_consensus.cc:2749] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.259850 19486 raft_consensus.cc:2749] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.260952 18350 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.261690 19486 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:21.262166 19486 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:21.262569 19486 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:21.267124 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.258139 18973 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:21.259039 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.277997 18201 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.279752 18201 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.224576 19497 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.280831 18201 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.261718 18975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.287343 19509 raft_consensus.cc:2749] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.287786 18201 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.288584 19325 raft_consensus.cc:2749] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.282122 19188 raft_consensus.cc:2749] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.290580 19193 raft_consensus.cc:2749] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.291968 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012abbd307bb440c93b80adee8541719" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.292810 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37231cb8219f456f99b2043efccec059" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.296504 19363 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:21.301002 19445 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.304070 18376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.301559 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.314211 19212 raft_consensus.cc:2749] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:21.315333 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 86111.4us
I20260709 12:18:21.316684 18924 leader_election.cc:304] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.317937 19269 raft_consensus.cc:2749] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.320556 19547 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.322391 19426 raft_consensus.cc:3055] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.322922 19426 raft_consensus.cc:740] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.323711 19426 consensus_queue.cc:260] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:21.324954 19486 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.325587 19453 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.327574 18924 leader_election.cc:304] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.329071 18970 raft_consensus.cc:1240] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.326570 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.333000 19453 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.333528 19465 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.333657 19212 raft_consensus.cc:2749] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.335116 18924 leader_election.cc:304] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.336629 18201 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.341436 18924 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.277489 18350 leader_election.cc:304] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.282924 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.254855 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.342417 18201 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:21.349810 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 72369.4us
I20260709 12:18:21.351861 18235 raft_consensus.cc:1240] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.353535 18237 pending_rounds.cc:85] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Aborting all ops after (but not including) 1
I20260709 12:18:21.357729 18237 pending_rounds.cc:107] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:18:21.358037 18237 raft_consensus.cc:2889] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:21.358469 18350 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.359468 19505 raft_consensus.cc:2749] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.367487 18350 leader_election.cc:304] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.374795 18350 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.348398 19424 raft_consensus.cc:2749] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.355507 19509 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.387298 19509 raft_consensus.cc:493] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:21.387715 19509 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.388305 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5293f684a321421795eb6139805ef39f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.360671 19267 raft_consensus.cc:2749] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.378397 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.379076 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c282b6d8fe394885b2058ecbef26a541" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.380049 18308 raft_consensus.cc:1240] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:21.397945 18311 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 5.
I20260709 12:18:21.380255 18276 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.381084 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.376291 19352 raft_consensus.cc:2749] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.369639 19448 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:21.383252 18384 raft_consensus.cc:1240] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:21.376606 19270 consensus_queue.cc:1059] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:18:21.385578 19547 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.401798 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.376987 18383 raft_consensus.cc:1240] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.362964 19188 raft_consensus.cc:2749] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.361114 19511 raft_consensus.cc:2749] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.404114 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.366340 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.370744 18974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.355495 19244 consensus_queue.cc:1048] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:18:21.411912 18350 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.390551 19459 raft_consensus.cc:2749] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.379076 18381 raft_consensus.cc:1240] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.371263 19465 consensus_queue.cc:1059] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:18:21.407717 19453 raft_consensus.cc:2749] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.400915 19486 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.423867 18275 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.407932 19452 raft_consensus.cc:2749] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.427238 18970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.426662 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.429762 18275 leader_election.cc:304] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.412570 19503 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:21.437996 18923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.439071 18924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 67385.8us
I20260709 12:18:21.420804 19352 raft_consensus.cc:2749] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.441833 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95597fb4497541e298059186c9a44a77" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.442076 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.446724 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6de44e11a344e98fce7f3ac41604e9" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.421756 18969 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.449664 18971 raft_consensus.cc:1240] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Rejecting Update request from peer ef7fc80e188b4c458d42ec37740468df for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:21.450762 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.452037 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62389b333b65412ba48dd69a80e8be14" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.445972 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.453174 18311 raft_consensus.cc:2393] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:21.403138 19448 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.461035 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e33101322f4ceb8f0ba80bb561f699" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:21.460481 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 57060.7us
I20260709 12:18:21.438490 19560 raft_consensus.cc:2749] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.467561 18385 raft_consensus.cc:2468] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:21.437518 19503 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:21.476724 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.451166 19445 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.541816 18969 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.458595 19212 consensus_queue.cc:1059] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:18:21.448241 19559 consensus_queue.cc:1059] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:18:21.420495 19327 consensus_queue.cc:1059] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:18:21.450836 19337 raft_consensus.cc:493] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.463886 19465 consensus_queue.cc:1059] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:18:21.538834 19568 raft_consensus.cc:493] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef7fc80e188b4c458d42ec37740468df)
I20260709 12:18:21.446914 19151 raft_consensus.cc:2749] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.561962 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.540664 19503 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.454896 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.540066 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.545042 19325 raft_consensus.cc:493] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.548444 18309 raft_consensus.cc:1240] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:21.554664 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 111126us
I20260709 12:18:21.563174 18924 leader_election.cc:304] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.557216 19337 raft_consensus.cc:515] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.557286 19448 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.559404 19327 raft_consensus.cc:3055] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:21.561432 18302 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:21.570587 18924 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.577407 18202 leader_election.cc:304] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.579192 19325 raft_consensus.cc:515] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.562480 19560 raft_consensus.cc:3055] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.610752 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:21.612540 18235 raft_consensus.cc:2393] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 in current term 3: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:21.562877 19426 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.614630 18350 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.615593 18275 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:21.612013 18924 leader_election.cc:304] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.575313 19244 raft_consensus.cc:2749] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:21.621305 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 44018.7us
I20260709 12:18:21.619729 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.587903 19325 leader_election.cc:290] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.579001 19327 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:21.558890 19568 raft_consensus.cc:515] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.558890 19509 raft_consensus.cc:515] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.594901 19212 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:21.636480 19564 log.cc:927] Time spent T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:21.636597 19212 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.637100 19212 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.633908 18385 raft_consensus.cc:1240] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.619289 19459 raft_consensus.cc:2749] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.595187 19560 raft_consensus.cc:740] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:21.618479 19356 raft_consensus.cc:2749] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.618666 19151 raft_consensus.cc:2804] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:21.646631 19151 raft_consensus.cc:697] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:21.647547 19151 consensus_queue.cc:237] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.629809 19270 raft_consensus.cc:2749] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.630110 19546 raft_consensus.cc:3055] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.651927 19560 consensus_queue.cc:260] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.637471 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.653246 19560 raft_consensus.cc:3060] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.631706 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:21.655457 19327 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.635196 19325 raft_consensus.cc:2749] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.658150 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba7643c4e6d4a459dc5fe06baf0092d" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.645539 19337 leader_election.cc:290] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:21.651295 19546 raft_consensus.cc:740] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:21.660540 19546 consensus_queue.cc:260] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.661672 19546 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.664609 19509 leader_election.cc:290] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
W20260709 12:18:21.665488 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 89604.1us
I20260709 12:18:21.666303 18276 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.669521 18276 leader_election.cc:304] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.673820 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.618983 19497 consensus_queue.cc:1059] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:18:21.672036 19448 raft_consensus.cc:2749] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.671342 19453 raft_consensus.cc:2749] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:21.677873 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 194976us
I20260709 12:18:21.704224 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.709076 19568 leader_election.cc:290] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.714876 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.715718 18379 raft_consensus.cc:3055] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.716055 18379 raft_consensus.cc:740] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:21.716487 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.717274 19424 raft_consensus.cc:3055] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:21.717077 18379 consensus_queue.cc:260] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.713876 19503 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.719938 19503 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.717672 19424 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.718196 18379 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.736831 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25582256f10b4d31b2add593456d964e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:21.736861 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:41061, user_credentials={real_user=slave}} blocked reactor thread for 113373us
I20260709 12:18:21.741003 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.741853 18308 raft_consensus.cc:2393] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 5: Already voted for candidate c0771afef8984a5e9edd45be358960a2 in this term.
I20260709 12:18:21.739162 18202 leader_election.cc:304] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.749557 18350 leader_election.cc:304] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.750013 18202 leader_election.cc:304] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:21.757377 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.746235 19473 raft_consensus.cc:3055] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.749236 19327 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.750931 19467 raft_consensus.cc:2749] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.776456 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:21.776552 19486 raft_consensus.cc:2749] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.778082 19474 raft_consensus.cc:493] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:21.797253 19474 raft_consensus.cc:515] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:21.799643 19212 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.801936 19212 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:21.799674 19424 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.781227 19581 raft_consensus.cc:2749] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.803586 19424 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:21.785820 19473 raft_consensus.cc:740] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.806079 19473 consensus_queue.cc:260] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:21.807094 19473 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.816978 18306 raft_consensus.cc:1240] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:21.816895 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.817754 18308 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.820472 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d5fb2105e4453aa1d8b1b3758aade5" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.825518 18308 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:21.799780 19474 leader_election.cc:290] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:21.828125 18376 raft_consensus.cc:1240] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.830381 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.831403 18377 raft_consensus.cc:2410] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:18:21.832320 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.833156 18381 raft_consensus.cc:2393] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 in current term 4: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:21.834028 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.836508 18202 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.837129 19188 raft_consensus.cc:3055] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.837563 19188 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:21.838018 18202 leader_election.cc:304] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.838608 19546 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.839354 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.839499 19546 consensus_queue.cc:1059] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:21.841672 19327 raft_consensus.cc:2749] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.838353 19188 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.839957 18307 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:21.843945 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 48565.1us
I20260709 12:18:21.844133 18924 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.840538 19579 raft_consensus.cc:3055] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:21.853111 19579 raft_consensus.cc:740] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:21.847389 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a349f30cd4492389e44ee0d27ce020" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:21.858299 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de26469791e8437793e0833ab312e266" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:21.861749 19188 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.864650 18976 raft_consensus.cc:2368] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 5. Current term is 6.
I20260709 12:18:21.869233 18924 leader_election.cc:304] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.873489 19502 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:21.874682 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:21.875849 19579 consensus_queue.cc:260] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.877315 19579 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:21.878809 18379 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:21.875913 18381 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.882882 19465 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.896075 19267 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.896584 19465 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.898684 19465 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:21.896608 19267 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.901343 19267 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:21.883862 18350 leader_election.cc:400] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Vote denied by peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641) with higher term. Message: Invalid argument: T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 5. Current term is 6.
I20260709 12:18:21.889797 18924 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:21.903700 19473 raft_consensus.cc:2804] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:21.890187 19270 raft_consensus.cc:2749] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.892284 19502 raft_consensus.cc:697] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.884132 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.904176 19473 raft_consensus.cc:697] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.905228 18201 leader_election.cc:304] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.904965 19502 consensus_queue.cc:237] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.906183 18350 leader_election.cc:403] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:21.908193 18977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:21.909127 19574 raft_consensus.cc:2749] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.906670 19473 consensus_queue.cc:237] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:21.909423 18977 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:21.911417 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.912124 18202 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:21.914758 18377 raft_consensus.cc:1240] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.915174 19465 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.915712 19465 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.916109 19465 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.918537 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:21.924460 18381 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 6.
I20260709 12:18:21.925397 19478 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641) with higher term. Message: Invalid argument: T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 5. Current term is 6.
I20260709 12:18:21.928571 18233 raft_consensus.cc:1240] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.931864 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:21.929641 18923 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:21.941342 18307 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 6.
I20260709 12:18:21.921934 18305 raft_consensus.cc:2468] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:21.945188 18924 leader_election.cc:304] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:21.945948 18202 leader_election.cc:304] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.951664 19469 raft_consensus.cc:2804] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:21.947445 19270 raft_consensus.cc:2749] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.947986 19426 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.962874 18276 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:21.953022 19193 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:21.961074 19469 raft_consensus.cc:697] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:21.966535 19426 raft_consensus.cc:697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:21.967697 19501 raft_consensus.cc:2749] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:21.988955 19469 consensus_queue.cc:237] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:21.969311 19193 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.993666 19465 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:21.996038 18229 raft_consensus.cc:2393] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 4: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:21.998633 19478 raft_consensus.cc:493] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:21.999394 19478 raft_consensus.cc:515] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.001577 19478 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.002524 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:22.003463 18978 raft_consensus.cc:2393] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df in current term 3: Already voted for candidate 4758217c33d3483eac425c4d24d74bf5 in this term.
I20260709 12:18:21.999890 19465 leader_election.cc:290] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:22.007686 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:22.008607 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.009403 18229 raft_consensus.cc:2368] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 3. Current term is 4.
I20260709 12:18:22.009706 18978 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.013836 18350 leader_election.cc:400] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 3. Current term is 4.
I20260709 12:18:22.014272 18350 leader_election.cc:403] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.016770 18924 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5; no voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:22.018500 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f319baf6bd4d04bd7e15bd2123cbed" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:22.019227 18379 raft_consensus.cc:3060] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.022271 19426 consensus_queue.cc:237] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:22.032006 18059 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34320 (request call id 157) took 4601 ms. Trace:
I20260709 12:18:22.032284 18276 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:22.035590 19500 raft_consensus.cc:2749] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:22.036376 19193 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:22.038180 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:22.038607 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:22.040328 18229 raft_consensus.cc:1240] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Rejecting Update request from peer c0771afef8984a5e9edd45be358960a2 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:22.042477 18201 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:22.026008  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.032475 18059 rpcz_store.cc:276] 0709 12:18:17.433092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.434272 (+  1180us) service_pool.cc:224] Handling call
0709 12:18:22.031941 (+4597669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:21.293656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:21.294262 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:21.294295 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:18:21.294310 (+    15us) tablet.cc:662] Decoding operations
0709 12:18:21.294851 (+   541us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:21.294908 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:21.294933 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:21.295247 (+   314us) tablet.cc:701] Row locks acquired
0709 12:18:21.295264 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:18:21.295493 (+   229us) write_op.cc:270] Start()
0709 12:18:21.295603 (+   110us) write_op.cc:276] Timestamp: P: 1783599501295449 usec, L: 0
0709 12:18:21.295622 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:18:21.296296 (+   674us) log.cc:844] Serialized 1316 byte log entry
0709 12:18:21.799183 (+502887us) op_driver.cc:464] REPLICATION: finished
0709 12:18:21.982896 (+183713us) write_op.cc:301] APPLY: starting
0709 12:18:21.985392 (+  2496us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:21.994728 (+  9336us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:21.994853 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:21.995277 (+   424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:21.995450 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:18:21.995495 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:21.995695 (+   200us) log.cc:844] Serialized 34 byte log entry
0709 12:18:21.996522 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:21.996619 (+    97us) write_op.cc:454] Released schema lock
0709 12:18:21.996659 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:21.998033 (+  1374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:21.998136 (+   103us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2466044,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":174334,"apply.run_cpu_time_us":2237,"apply.run_wall_time_us":22643,"num_ops":3,"prepare.queue_time_us":264444,"prepare.run_cpu_time_us":37112,"prepare.run_wall_time_us":126356,"raft.queue_time_us":161359,"raft.run_cpu_time_us":43174,"raft.run_wall_time_us":162866,"replication_time_us":503383,"thread_start_us":597578,"threads_started":4,"wal-append.queue_time_us":174021}]]}
I20260709 12:18:22.048537 19193 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:22.077337 18978 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:22.078015 19474 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:22.079008 18202 leader_election.cc:304] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:22.080660 19193 raft_consensus.cc:2804] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:22.081164 19193 raft_consensus.cc:697] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:22.081960 19193 consensus_queue.cc:237] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.088851 19500 consensus_queue.cc:1059] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:22.090080 19262 raft_consensus.cc:3055] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:22.090575 19262 raft_consensus.cc:740] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:22.091373 19262 consensus_queue.cc:260] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.095816 19262 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.114612 18379 raft_consensus.cc:2468] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:22.116073 19478 raft_consensus.cc:2749] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 3. Current term is 4.
I20260709 12:18:22.083472 18060 catalog_manager.cc:5697] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } }
I20260709 12:18:22.126241 18060 catalog_manager.cc:5697] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } }
I20260709 12:18:22.128362 18060 catalog_manager.cc:5697] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } }
I20260709 12:18:22.137262 18060 catalog_manager.cc:5697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.139094 18060 catalog_manager.cc:5697] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } }
I20260709 12:18:22.141176 18060 catalog_manager.cc:5697] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } }
I20260709 12:18:22.142815 18060 catalog_manager.cc:5697] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.144434 18060 catalog_manager.cc:5697] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } }
I20260709 12:18:22.145851 18060 catalog_manager.cc:5697] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } }
I20260709 12:18:22.205091 18060 catalog_manager.cc:5697] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 3, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 3 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.203567 19500 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.208799 18060 catalog_manager.cc:5697] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.211936 18060 catalog_manager.cc:5697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } }
I20260709 12:18:22.216020 18060 catalog_manager.cc:5697] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } }
I20260709 12:18:22.219223 18060 catalog_manager.cc:5697] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 4 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.213816 19500 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:22.224424 18234 raft_consensus.cc:1275] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:22.228601 19500 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:22.229203 19500 consensus_queue.cc:1048] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.231130 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.234521 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:22.235049 18384 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:22.236117 18275 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:22.239840 19287 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:22.240188 19287 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.240481 19287 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.246471 19469 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.246357 19287 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:22.249982 19469 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.251259 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "388fffe591be477388e1e844d43d1cda"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:41324
I20260709 12:18:22.252200 18379 raft_consensus.cc:606] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:22.252554 18379 raft_consensus.cc:614] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.254194 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:22.255013 18976 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:22.256320 18202 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:22.257313 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:22.258702 19579 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.259707 19579 raft_consensus.cc:493] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.260120 19579 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.260530 19469 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:22.261775 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:22.262472 18308 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:22.265740 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd927b9f8b7a45cdb1851ae9060a9c69"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:22.266132 18379 raft_consensus.cc:1275] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:22.266472 18234 raft_consensus.cc:606] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:22.269205 18234 raft_consensus.cc:614] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.276891 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:22.277697 18379 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.269207 19287 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:22.281193 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:22.281960 18234 raft_consensus.cc:606] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:22.282297 18234 raft_consensus.cc:614] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.282481 19500 consensus_queue.cc:1048] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.283829  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:22.285693  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:22.286804  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.305104 18379 raft_consensus.cc:2468] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:22.307440 18275 leader_election.cc:304] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:22.308596 19500 raft_consensus.cc:2804] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:22.309106 19500 raft_consensus.cc:697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:22.309916 19500 consensus_queue.cc:237] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:22.321050 18058 catalog_manager.cc:5697] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } }
I20260709 12:18:22.328425 18058 catalog_manager.cc:5697] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.330097 18058 catalog_manager.cc:5697] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.335153 18058 catalog_manager.cc:5697] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.337338 18058 catalog_manager.cc:5697] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.339625 18058 catalog_manager.cc:5697] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 1 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.326561 19579 raft_consensus.cc:515] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.356521 18060 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50296 (request call id 73) took 1090 ms. Trace:
I20260709 12:18:22.356982 18060 rpcz_store.cc:276] 0709 12:18:21.266160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.267609 (+  1449us) service_pool.cc:224] Handling call
0709 12:18:22.356459 (+1088850us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:22.264537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:22.265097 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:22.265132 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:18:22.265149 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:22.266417 (+  1268us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:22.266519 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:22.266547 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:18:22.267605 (+  1058us) tablet.cc:701] Row locks acquired
0709 12:18:22.267622 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:18:22.267764 (+   142us) write_op.cc:270] Start()
0709 12:18:22.267901 (+   137us) write_op.cc:276] Timestamp: P: 1783599502267721 usec, L: 0
0709 12:18:22.267917 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:18:22.268558 (+   641us) log.cc:844] Serialized 5581 byte log entry
0709 12:18:22.281204 (+ 12646us) op_driver.cc:464] REPLICATION: finished
0709 12:18:22.281872 (+   668us) write_op.cc:301] APPLY: starting
0709 12:18:22.281971 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:22.282246 (+   275us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:22.282352 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:22.283668 (+  1316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:22.283914 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:18:22.283956 (+    42us) write_op.cc:312] APPLY: finished
0709 12:18:22.284265 (+   309us) log.cc:844] Serialized 100 byte log entry
0709 12:18:22.284428 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.284571 (+   143us) write_op.cc:454] Released schema lock
0709 12:18:22.284617 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:22.284939 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.284966 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1868,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":432,"apply.run_cpu_time_us":3042,"apply.run_wall_time_us":3042,"num_ops":14,"prepare.queue_time_us":17141,"prepare.run_cpu_time_us":4317,"prepare.run_wall_time_us":4317,"replication_time_us":13125,"thread_start_us":4357,"threads_started":1}]]}
I20260709 12:18:22.360862 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:22.361547 18978 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.367096 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385d18f3f52b4e1a9032cbef00cf99af" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:22.367826 18308 raft_consensus.cc:3060] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.367177 19579 leader_election.cc:290] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:22.378822 18308 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 5.
I20260709 12:18:22.379089 18978 raft_consensus.cc:2468] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 5.
I20260709 12:18:22.382578 18202 leader_election.cc:304] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:22.384514 19579 raft_consensus.cc:2804] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:22.385061 19579 raft_consensus.cc:697] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:22.385782 19579 consensus_queue.cc:237] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.395869 18059 catalog_manager.cc:5697] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.400058 18059 catalog_manager.cc:5697] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 4, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 4 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.421653 18384 raft_consensus.cc:1275] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.423476 18308 raft_consensus.cc:1275] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:22.423297 19473 consensus_queue.cc:1048] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.428082 19474 consensus_queue.cc:1048] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.444568 18060 catalog_manager.cc:5697] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 3 to 4, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 4 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.446722 18060 catalog_manager.cc:5697] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.448599 18060 catalog_manager.cc:5697] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } }
I20260709 12:18:22.475904 18060 catalog_manager.cc:5697] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.496332 18384 raft_consensus.cc:1275] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.500667 19579 consensus_queue.cc:1048] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.500552 19473 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.501801 19473 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.510702 18384 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.514287 18305 raft_consensus.cc:1275] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.516172 19426 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.523963 19579 raft_consensus.cc:493] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:22.536139 19579 raft_consensus.cc:515] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:22.548168 19579 leader_election.cc:290] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:22.555868 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:22.557009 19473 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:22.557941 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adc6e964f384c6fba8dd6b7f1d978c5" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:22.558996 18377 raft_consensus.cc:2368] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4.
I20260709 12:18:22.562353 18201 leader_election.cc:400] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4.
I20260709 12:18:22.562674 18201 leader_election.cc:403] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.563160 19579 raft_consensus.cc:3060] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.565359 18056 catalog_manager.cc:5697] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 3 to 5, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 5 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.567483 18384 raft_consensus.cc:1275] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.567227 18056 catalog_manager.cc:5697] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 3, leader changed from ef7fc80e188b4c458d42ec37740468df (127.8.178.196) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:22.568445 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.576416 19474 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.580464 18302 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:22.584087 19212 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.591675 18234 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:22.593878 18924 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:22.594883 19474 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.595285 19474 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.595592 19474 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.598649 19579 raft_consensus.cc:2749] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 3. Current term is 4.
I20260709 12:18:22.606050 18978 raft_consensus.cc:1275] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.607792 19193 consensus_queue.cc:1048] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:22.613394 18384 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:22.615188 19473 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:22.626524 18302 raft_consensus.cc:1275] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.629408 19465 consensus_queue.cc:1048] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.636693 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:22.686389 18379 raft_consensus.cc:1275] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.704216 19606 consensus_queue.cc:1048] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:22.717651 19605 log.cc:927] Time spent T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:18:22.713692 19474 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.725620 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:22.726382 18234 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.754838 18234 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 5.
I20260709 12:18:22.756243 18924 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:22.757128 19473 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:22.757886 19473 raft_consensus.cc:697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 5 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:22.758749 19473 consensus_queue.cc:237] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:22.781095 19603 log.cc:927] Time spent T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:18:22.799973 18384 raft_consensus.cc:1275] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.801368 19474 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:22.804178 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:22.804816 19287 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.818074 18060 catalog_manager.cc:5697] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.833386 19426 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:22.833956 19426 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.835623 18311 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:22.836056 19426 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.837352 19579 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.844607 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:22.845539 18381 raft_consensus.cc:2393] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 5: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:22.847715 19199 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.848207 19199 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.849869 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.850569 18234 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 5.
I20260709 12:18:22.852938 18058 catalog_manager.cc:5697] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:22.856730 18924 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:22.858791 19474 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.859200 19474 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:22.859539 19474 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.862895 19199 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.864295 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.865056 18233 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:22.866364 18229 raft_consensus.cc:1275] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.870765 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:22.876207 19337 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.876605 19337 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.876286 19473 raft_consensus.cc:493] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:22.876955 19337 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.876854 19500 consensus_queue.cc:1048] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:22.873993 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:22.877413 19473 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.879544 19473 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.880239 18978 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:22.882757 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:22.886770 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:22.887506 18229 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:22.892731 19337 raft_consensus.cc:515] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.894035 18379 raft_consensus.cc:2368] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 4. Current term is 5.
I20260709 12:18:22.895059 19474 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:22.896100 18923 leader_election.cc:400] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 4. Current term is 5.
I20260709 12:18:22.896489 18923 leader_election.cc:403] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:22.897190 19426 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.898486 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:22.899331 18381 raft_consensus.cc:2393] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 5: Already voted for candidate ef7fc80e188b4c458d42ec37740468df in this term.
I20260709 12:18:22.906198 19426 raft_consensus.cc:2749] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469) with higher term. Message: Invalid argument: T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 4. Current term is 5.
I20260709 12:18:22.909477 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:22.906935 19337 leader_election.cc:290] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.908118 19474 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:22.915457 18978 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:22.959372 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:22.963034 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739f249d075b46c393cd456fe4f93ea0" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:22.964076 18234 raft_consensus.cc:3060] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.972540 19287 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:22.974057 19287 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:22.990929 18350 leader_election.cc:304] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:23.009030 19337 raft_consensus.cc:2804] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:23.013093 19337 raft_consensus.cc:697] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:23.015110 19337 consensus_queue.cc:237] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.035181 19287 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:23.081254 18969 raft_consensus.cc:1275] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.114976 19616 consensus_queue.cc:1048] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:23.127938 19616 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.128607 19616 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.130574 19579 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.131511 19579 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:23.139678 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:23.135601 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:23.161409 18976 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:23.164788 18202 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:23.165822 19617 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:23.166266 19617 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.134373 19579 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:23.136148 19616 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:23.169924 19617 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.137668 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:23.181581 18377 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:23.186149 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:23.189149 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:23.202601 18311 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:23.199272 18237 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 5.
I20260709 12:18:23.204610 18234 raft_consensus.cc:2468] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:23.204919 18202 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:23.206017 19469 raft_consensus.cc:2804] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:23.206497 19469 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.206830 19469 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:23.208453 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:23.209478 18229 raft_consensus.cc:2368] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 4. Current term is 5.
I20260709 12:18:23.214564 19426 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.215365 19426 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:23.239583 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:23.240526 18311 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:23.242043 19426 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:23.243211 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:23.244993 18924 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:23.244163 18377 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 3.
I20260709 12:18:23.249527 19426 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:23.250101 19426 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.250532 19426 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.299561 18924 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:23.335379 19474 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:23.303130 18923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 49361.3us
I20260709 12:18:23.324102 18276 leader_election.cc:400] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 4. Current term is 5.
I20260709 12:18:23.331010 19337 raft_consensus.cc:493] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:23.349771 18276 leader_election.cc:403] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.350075 19337 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:23.350688 19501 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.354126 19337 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:23.323985 19617 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.355429  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.358348 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:23.359053 18377 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.364219 19501 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0771afef8984a5e9edd45be358960a2 for earlier term 4. Current term is 5.
I20260709 12:18:23.385041 18311 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:23.298768 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 131114us
I20260709 12:18:23.367254 18229 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.370313 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:23.387306 18978 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.370146 18377 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 5.
I20260709 12:18:23.393862 18201 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:23.395116 19616 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:23.395645 19616 raft_consensus.cc:697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:23.395790 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:23.396538 19616 consensus_queue.cc:237] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.400512 18978 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 5.
I20260709 12:18:23.374966 19469 raft_consensus.cc:515] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:23.400893 19617 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 5 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:23.401836 18229 raft_consensus.cc:2368] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:23.405689 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:23.406689 18311 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:23.405844 19469 leader_election.cc:290] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:23.411525 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:23.412372 18377 raft_consensus.cc:3060] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:23.412461 19212 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:23.417441 19212 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:23.428623 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2af9ea4e43c413080fda28b17c3869f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:23.429164 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 45118us
I20260709 12:18:23.448734 19474 raft_consensus.cc:697] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:23.450197 19474 consensus_queue.cc:237] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.462241 18311 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:23.467166 19426 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:23.469471 19426 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:23.471792 18350 leader_election.cc:400] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:23.472256 18350 leader_election.cc:403] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.472471 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:23.473167 18384 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.482013 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:23.482746 18308 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.485086 19424 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:23.485697 19424 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:23.488030 19424 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:23.494984 18308 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:23.497689 18924 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:23.499724 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:23.500571 18384 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 4.
I20260709 12:18:23.503664 19501 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.505200 18237 raft_consensus.cc:2393] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 in current term 5: Already voted for candidate 3d5db60b70564b85afdb88b4c7984ca5 in this term.
I20260709 12:18:23.504848 18202 leader_election.cc:304] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:23.508107 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:23.500320 19424 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:23.506199 19501 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:23.509136 19616 raft_consensus.cc:2804] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:23.513962 19501 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:23.514418 19616 raft_consensus.cc:697] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:23.514791 19424 raft_consensus.cc:697] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:23.515774 19424 consensus_queue.cc:237] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:23.516187 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:23.515777 19616 consensus_queue.cc:237] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:23.517079 18233 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 5.
I20260709 12:18:23.518661 18308 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 5.
I20260709 12:18:23.519586 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:23.523406 19501 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:23.523852 19501 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.507638 18377 raft_consensus.cc:2468] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:23.524201 19501 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.525230 19337 raft_consensus.cc:2749] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef7fc80e188b4c458d42ec37740468df for earlier term 2. Current term is 3.
I20260709 12:18:23.531039 18924 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:23.539947 19426 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:23.541528 19426 raft_consensus.cc:493] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c0771afef8984a5e9edd45be358960a2)
I20260709 12:18:23.541998 19426 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.552453 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:23.616019 19501 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:23.691279 18060 catalog_manager.cc:5697] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 3 to 5, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 5 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.691929 18057 catalog_manager.cc:5697] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 4 to 5, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 5 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.693513 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:23.695103 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:23.695773 18234 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.702365 18058 catalog_manager.cc:5697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.708333 19501 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:23.723842 18969 raft_consensus.cc:1275] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:23.743091 18234 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 6.
I20260709 12:18:23.782932 18229 raft_consensus.cc:1275] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:23.771968 19199 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:18:23.778650 18276 leader_election.cc:304] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:23.789564 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2670be13282d47d992a2899032fa7f00"
dest_uuid: "c0771afef8984a5e9edd45be358960a2"
mode: GRACEFUL
new_leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
 from {username='slave'} at 127.0.0.1:58832
I20260709 12:18:23.790351 18311 raft_consensus.cc:606] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Received request to transfer leadership to TS 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:23.792644 19426 raft_consensus.cc:515] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:23.793809 18971 raft_consensus.cc:2468] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 5.
I20260709 12:18:23.796684 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
mode: GRACEFUL
new_leader_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:18:23.797891 18234 raft_consensus.cc:606] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Received request to transfer leadership to TS ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:23.796695 19287 raft_consensus.cc:2804] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:23.798842 19287 raft_consensus.cc:697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 6 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:23.799795 19287 consensus_queue.cc:237] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:23.807168 18308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e56147159e647d280beddd4d51e778a"
dest_uuid: "c0771afef8984a5e9edd45be358960a2"
mode: GRACEFUL
new_leader_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:58832
I20260709 12:18:23.807608 19199 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.807889 18308 raft_consensus.cc:606] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Received request to transfer leadership to TS 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:23.808241 19199 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:23.811239 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5" is_pre_election: true
I20260709 12:18:23.818612 19199 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:23.831717 19426 leader_election.cc:290] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:23.848242 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:23.849001 18234 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:23.848232 18978 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:23.854993 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:23.861132 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:23.862144 18234 raft_consensus.cc:2368] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 5. Current term is 6.
I20260709 12:18:23.865005 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef6dbd8d5ca409da3ff154edacb0d96" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:23.866923 18924 leader_election.cc:400] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 5. Current term is 6.
I20260709 12:18:23.867347 18924 leader_election.cc:403] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.846781 19337 consensus_queue.cc:1048] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:18:23.881171 19478 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:23.881769 19478 raft_consensus.cc:493] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.882138 19478 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.884855 19632 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:23.893600 19473 raft_consensus.cc:3060] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.939775 19478 raft_consensus.cc:515] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:23.943420 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 62851.9us
I20260709 12:18:23.942586 18969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:23.958101 18308 raft_consensus.cc:1275] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:23.964187 18379 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:23.965346 19445 raft_consensus.cc:993] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: : Instructing follower 3d5db60b70564b85afdb88b4c7984ca5 to start an election
I20260709 12:18:23.965888 19445 raft_consensus.cc:1081] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Signalling peer 3d5db60b70564b85afdb88b4c7984ca5 to start an election
I20260709 12:18:23.966513 19474 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:23.976286 18978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "961c55a402cb45c38eeed153e21184da"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
mode: GRACEFUL
new_leader_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:18:23.976962 18978 raft_consensus.cc:606] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Received request to transfer leadership to TS ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:23.981834 18978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
mode: GRACEFUL
new_leader_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:18:23.983150 18978 raft_consensus.cc:606] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Received request to transfer leadership to TS ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:23.995512 18377 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:18:24.002566 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 51544.5us
I20260709 12:18:23.993309 19478 leader_election.cc:290] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:24.007190 19579 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:18:24.012813 18229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2670be13282d47d992a2899032fa7f00"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
 from {username='slave'} at 127.0.0.1:38380
I20260709 12:18:24.011271 19638 consensus_queue.cc:1048] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:18:24.009449  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:24.017257  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:24.013563 18229 raft_consensus.cc:493] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.018579 18229 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.018975 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedab17c8fe245b69ad728111f1caf37" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:24.019603 18237 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.021422  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:24.038694 19473 raft_consensus.cc:2749] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865) with higher term. Message: Invalid argument: T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4758217c33d3483eac425c4d24d74bf5 for earlier term 5. Current term is 6.
I20260709 12:18:24.054082 18379 raft_consensus.cc:1240] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:24.057556 18237 raft_consensus.cc:2468] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 6.
I20260709 12:18:24.068271 19426 consensus_queue.cc:1059] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:18:24.070835 19426 raft_consensus.cc:3055] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:24.071261 19426 raft_consensus.cc:740] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:24.072182 19426 consensus_queue.cc:260] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.073488 19426 raft_consensus.cc:3060] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.096194 18350 leader_election.cc:304] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:24.102928 18311 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:24.106403 19623 raft_consensus.cc:993] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5: : Instructing follower ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.107211 19624 raft_consensus.cc:1081] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Signalling peer ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.107935 18229 raft_consensus.cc:515] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:24.107084 19623 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:24.110020 19469 raft_consensus.cc:993] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: : Instructing follower ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.110684 19632 raft_consensus.cc:1081] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Signalling peer ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.114460 18385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:33228
I20260709 12:18:24.115234 18385 raft_consensus.cc:493] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.115592 18385 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.117727 19628 raft_consensus.cc:2804] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:24.118224 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:24.118480 19628 raft_consensus.cc:697] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:24.118871 18978 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.119541 19628 consensus_queue.cc:237] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.114414 18377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:41322
I20260709 12:18:24.123240 18377 raft_consensus.cc:493] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.123755 18377 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.128031 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2670be13282d47d992a2899032fa7f00" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:24.128744 18302 raft_consensus.cc:3055] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:24.129051 18302 raft_consensus.cc:740] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:24.130009 18302 consensus_queue.cc:260] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:24.131347 18302 raft_consensus.cc:3060] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:24.132637 19564 log.cc:927] Time spent T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:24.135953 18379 raft_consensus.cc:1275] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:24.136950 18229 leader_election.cc:290] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:24.137722 19638 consensus_queue.cc:1048] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:24.141314 18385 raft_consensus.cc:515] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.142839 19445 raft_consensus.cc:993] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: : Instructing follower 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:24.148164 18978 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:24.150230 18202 leader_election.cc:304] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:24.153944 18385 leader_election.cc:290] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:24.157428 18978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:24.157974 18978 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.151530 19501 raft_consensus.cc:1081] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Signalling peer 4758217c33d3483eac425c4d24d74bf5 to start an election
I20260709 12:18:24.160059 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b89f14ea9fa4acaa3818c68cc4a1d09" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:24.165540 18237 raft_consensus.cc:3055] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:24.165786 18978 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 6.
I20260709 12:18:24.165835 18969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e56147159e647d280beddd4d51e778a"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
 from {username='slave'} at 127.0.0.1:53950
I20260709 12:18:24.166774 18969 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.167157 18969 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.165970 18237 raft_consensus.cc:740] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:24.171525 18350 leader_election.cc:304] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:24.158926 19638 raft_consensus.cc:2804] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:24.161469 18382 raft_consensus.cc:1240] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Rejecting Update request from peer 3d5db60b70564b85afdb88b4c7984ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:24.171419 18237 consensus_queue.cc:260] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.172592 19638 raft_consensus.cc:697] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:24.173126 19337 raft_consensus.cc:2804] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:24.175323 18377 raft_consensus.cc:515] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.199873 19579 consensus_queue.cc:1059] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:24.199488 19638 consensus_queue.cc:237] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:24.201086 18377 leader_election.cc:290] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:24.199412 19424 raft_consensus.cc:993] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5: : Instructing follower ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.204947 19424 raft_consensus.cc:1081] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Signalling peer ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:24.206365 18976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:24.206990 18976 raft_consensus.cc:3055] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:24.207381 18976 raft_consensus.cc:740] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:24.207892 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbfc451de634f81ac9f6aaf022cf4d9" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:24.208539 18234 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.208127 18976 consensus_queue.cc:260] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.209595 18976 raft_consensus.cc:3060] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.206881 18377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "961c55a402cb45c38eeed153e21184da"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:41322
I20260709 12:18:24.210883 18377 raft_consensus.cc:493] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:24.211220 18377 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.214823 19337 raft_consensus.cc:697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:24.216041 19337 consensus_queue.cc:237] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.217384 18237 raft_consensus.cc:3060] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.231588 18377 raft_consensus.cc:515] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:24.236456 18302 raft_consensus.cc:2468] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:24.240708 18382 raft_consensus.cc:1240] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Rejecting Update request from peer 4758217c33d3483eac425c4d24d74bf5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:24.230079 18234 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:24.243158 18350 leader_election.cc:304] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:24.244638 19621 raft_consensus.cc:2804] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:24.236297 18978 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:24.262131 18976 raft_consensus.cc:2468] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:24.265861 18237 raft_consensus.cc:2468] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 6.
I20260709 12:18:24.275292 18377 leader_election.cc:290] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:24.275940 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:24.277305 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961c55a402cb45c38eeed153e21184da" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:24.278806 18971 raft_consensus.cc:3055] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:24.279170 18971 raft_consensus.cc:740] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:24.281431 18971 consensus_queue.cc:260] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:24.285370 18971 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.274701 18057 catalog_manager.cc:5697] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.255316 18969 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:24.295019 18969 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:18:24.286417 19424 consensus_queue.cc:1175] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c0771afef8984a5e9edd45be358960a2" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:18:24.309150 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:24.309883 18302 raft_consensus.cc:3055] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:24.310195 18302 raft_consensus.cc:740] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:24.311066 18302 consensus_queue.cc:260] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:24.312388 18302 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.310968 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "4758217c33d3483eac425c4d24d74bf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:24.318497 18234 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:24.332788 18234 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:24.337137 18971 raft_consensus.cc:2468] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:24.348929 18350 leader_election.cc:304] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df; no voters: c0771afef8984a5e9edd45be358960a2
I20260709 12:18:24.344672 18924 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5; no voters: 
I20260709 12:18:24.355351 19287 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.352876 19628 raft_consensus.cc:2804] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:24.365953 19628 raft_consensus.cc:697] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:24.367039 19628 consensus_queue.cc:237] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:24.391754 19424 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:24.395087 18060 catalog_manager.cc:5697] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.400243 19424 raft_consensus.cc:697] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Leader. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:24.401248 19424 consensus_queue.cc:237] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
W20260709 12:18:24.398819 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 47800.2us
I20260709 12:18:24.399161 18060 catalog_manager.cc:5697] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } }
I20260709 12:18:24.396152 19621 raft_consensus.cc:697] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:24.420096 19621 consensus_queue.cc:237] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:24.422537 18234 raft_consensus.cc:1275] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:24.415095 18302 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4758217c33d3483eac425c4d24d74bf5 in term 2.
I20260709 12:18:24.438160 19614 consensus_queue.cc:1048] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:24.438170 18058 catalog_manager.cc:5697] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 5 to 6, leader changed from 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 6 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.441620 18058 catalog_manager.cc:5697] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 5 to 6, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 6 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.484560 18056 catalog_manager.cc:5697] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 reported cstate change: term changed from 1 to 2, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "4758217c33d3483eac425c4d24d74bf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.486972 18057 catalog_manager.cc:5697] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 1 to 2, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.552215 18058 catalog_manager.cc:5697] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 4 to 5, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 5 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.554683 18058 catalog_manager.cc:5697] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 3 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.629115 18971 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:24.629524 18971 pending_rounds.cc:85] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Aborting all ops after (but not including) 3
I20260709 12:18:24.629746 18971 pending_rounds.cc:107] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:24.630016 18971 raft_consensus.cc:2889] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:24.631682 19337 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.649521 18234 raft_consensus.cc:1275] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:24.656067 19337 consensus_queue.cc:1048] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.725932 18302 raft_consensus.cc:1275] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:24.729034 19579 consensus_queue.cc:1048] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:24.749522 18971 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:24.754518 19337 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.781260 18969 raft_consensus.cc:1275] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:24.783154 19579 consensus_queue.cc:1048] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:24.814786 18233 raft_consensus.cc:1275] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:24.832865 18305 raft_consensus.cc:1275] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:24.835632 18234 raft_consensus.cc:1275] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Refusing update from remote peer 4758217c33d3483eac425c4d24d74bf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:24.837743 18234 raft_consensus.cc:1275] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:24.838914 19337 consensus_queue.cc:1048] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.844868 19212 consensus_queue.cc:1048] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:24.847321 19424 consensus_queue.cc:1048] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:24.884056 19337 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:24.886672 18971 raft_consensus.cc:1275] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:24.889380 18308 raft_consensus.cc:3060] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.907941 18308 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:24.921679 19621 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:24.923661 19621 consensus_queue.cc:1048] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:25.052737 18971 raft_consensus.cc:1275] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:25.067965 19628 consensus_queue.cc:1048] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:25.338373  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.418061 18971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe"
dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
mode: GRACEFUL
new_leader_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:18:25.418718 18971 raft_consensus.cc:606] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Received request to transfer leadership to TS ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:25.421693 18302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a"
dest_uuid: "c0771afef8984a5e9edd45be358960a2"
mode: GRACEFUL
new_leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
 from {username='slave'} at 127.0.0.1:58832
I20260709 12:18:25.422515 18302 raft_consensus.cc:606] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Received request to transfer leadership to TS 3d5db60b70564b85afdb88b4c7984ca5
I20260709 12:18:25.427016  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:25.430330  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:25.431248  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.494113 19623 raft_consensus.cc:993] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: : Instructing follower ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:25.494691 19623 raft_consensus.cc:1081] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Signalling peer ef7fc80e188b4c458d42ec37740468df to start an election
I20260709 12:18:25.507774 18377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe"
dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
 from {username='slave'} at 127.0.0.1:41322
I20260709 12:18:25.508415 18377 raft_consensus.cc:493] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.508742 18377 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.515604 18377 raft_consensus.cc:515] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:25.517621 18377 leader_election.cc:290] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:25.518985 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:25.519934 18971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c31e3a96fa847adb12c5d3632d3f3fe" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4758217c33d3483eac425c4d24d74bf5"
I20260709 12:18:25.529132 18302 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.529386 18971 raft_consensus.cc:3055] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:25.529788 18971 raft_consensus.cc:740] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4758217c33d3483eac425c4d24d74bf5, State: Running, Role: LEADER
I20260709 12:18:25.537529 18302 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:25.540722 18350 leader_election.cc:304] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:25.541653 19628 raft_consensus.cc:2804] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:25.542639 19628 raft_consensus.cc:697] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:25.544123 19628 consensus_queue.cc:237] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:25.537650 18971 consensus_queue.cc:260] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:25.562167 18971 raft_consensus.cc:3060] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.570508 18057 catalog_manager.cc:5697] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 3 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.571832 18971 raft_consensus.cc:2468] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:25.630173 19445 raft_consensus.cc:993] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: : Instructing follower 3d5db60b70564b85afdb88b4c7984ca5 to start an election
I20260709 12:18:25.630808 19670 raft_consensus.cc:1081] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Signalling peer 3d5db60b70564b85afdb88b4c7984ca5 to start an election
I20260709 12:18:25.645599 18234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a"
dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
 from {username='slave'} at 127.0.0.1:38380
I20260709 12:18:25.646226 18234 raft_consensus.cc:493] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.646632 18234 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.654784 18234 raft_consensus.cc:515] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:25.664172 18234 leader_election.cc:290] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469)
I20260709 12:18:25.664062 18302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:25.665755 18302 raft_consensus.cc:3055] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:25.666138 18302 raft_consensus.cc:740] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:25.666965 18302 consensus_queue.cc:260] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:25.672848 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c6dbbbb353448c88878a019afcd95a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:25.673511 18377 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.681430 18302 raft_consensus.cc:3060] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:25.689055 18377 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:25.690583 18201 leader_election.cc:304] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:25.692104 19639 raft_consensus.cc:2804] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:25.692580 19639 raft_consensus.cc:697] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:25.693571 18302 raft_consensus.cc:2468] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:25.693481 19639 consensus_queue.cc:237] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } }
I20260709 12:18:25.776837 18057 catalog_manager.cc:5697] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 3, leader changed from c0771afef8984a5e9edd45be358960a2 (127.8.178.195) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:25.779008 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.196:33469, user_credentials={real_user=slave}} blocked reactor thread for 82957.1us
I20260709 12:18:26.056984 18969 raft_consensus.cc:1275] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.058967 19337 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.127249 18311 raft_consensus.cc:1275] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.134757 19628 consensus_queue.cc:1048] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.204139 18302 raft_consensus.cc:1275] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.206830 19469 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:26.269377 19678 log.cc:927] Time spent T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:26.305441 18377 raft_consensus.cc:1275] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:26.307596 19469 consensus_queue.cc:1048] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:26.505723  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.581204  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:26.583401  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:26.584141  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.627174  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.686964  8907 tablet_server.cc:179] TabletServer@127.8.178.193:38641 shutting down...
W20260709 12:18:26.694577 18350 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:26.707682 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.713338 18350 consensus_peers.cc:597] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.713995 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.750162 18276 consensus_peers.cc:597] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.751006 18276 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.770895  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:26.774232  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.775491  8907 raft_consensus.cc:2243] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.776547  8907 raft_consensus.cc:2272] T 4e56147159e647d280beddd4d51e778a P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:26.776865 18350 consensus_peers.cc:597] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.778707 18276 consensus_peers.cc:597] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.781688  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.783439  8907 raft_consensus.cc:2243] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.784070  8907 raft_consensus.cc:2272] T 0ba7643c4e6d4a459dc5fe06baf0092d P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.787303  8907 tablet_replica.cc:333] stopping tablet replica
W20260709 12:18:26.787305 18276 consensus_peers.cc:597] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.788306  8907 raft_consensus.cc:2243] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.788882  8907 raft_consensus.cc:2272] T abdcb3150843428e970fa883d21b1894 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.791739  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.792560  8907 raft_consensus.cc:2243] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.793159  8907 raft_consensus.cc:2272] T 37db4f6fedfc49e4a401670153431564 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.796684  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.797591  8907 raft_consensus.cc:2243] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.798151  8907 raft_consensus.cc:2272] T 2670be13282d47d992a2899032fa7f00 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:26.816828 18350 consensus_peers.cc:597] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.817476 18350 consensus_peers.cc:597] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.820401 18276 consensus_peers.cc:597] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.823690 18202 consensus_peers.cc:597] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.825045 18350 consensus_peers.cc:597] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.826275  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.827692  8907 raft_consensus.cc:2243] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.828130  8907 raft_consensus.cc:2272] T 94dc42a44c014b24a25ddcaad4075300 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.830776  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.831504  8907 raft_consensus.cc:2243] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.832345  8907 raft_consensus.cc:2272] T 3231bb7672254b5c82246040d42fdae4 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.861176  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.862105  8907 raft_consensus.cc:2243] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.868685  8907 raft_consensus.cc:2272] T dd927b9f8b7a45cdb1851ae9060a9c69 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.875242  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.876188  8907 raft_consensus.cc:2243] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.877295  8907 raft_consensus.cc:2272] T 3a12161578fc412fa63fc5ab2b1f73fc P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.882207  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.883154  8907 raft_consensus.cc:2243] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.884255  8907 raft_consensus.cc:2272] T f7ae7664b5ab484caea3e423a1e9289f P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.887727  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.888571  8907 raft_consensus.cc:2243] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.890084  8907 raft_consensus.cc:2272] T 217d661eba0249388484125571f7c38e P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.895812  8907 tablet_replica.cc:333] stopping tablet replica
W20260709 12:18:26.896426 18350 consensus_peers.cc:597] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.896718  8907 raft_consensus.cc:2243] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:26.897449 18350 consensus_peers.cc:597] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.898149 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.897498  8907 raft_consensus.cc:2272] T dfff73c71c1a49b3986f395d27a699a8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.901616  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.902719  8907 raft_consensus.cc:2243] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.903597  8907 raft_consensus.cc:2272] T 9f0b214e224f41628a28b5c153d8a384 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.905925  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.906931  8907 raft_consensus.cc:2243] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.907560  8907 raft_consensus.cc:2272] T d1d5fb2105e4453aa1d8b1b3758aade5 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.910538  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.911312  8907 raft_consensus.cc:2243] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.911752  8907 raft_consensus.cc:2272] T c282b6d8fe394885b2058ecbef26a541 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.915493  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.916357  8907 raft_consensus.cc:2243] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.916862  8907 raft_consensus.cc:2272] T ffbfc451de634f81ac9f6aaf022cf4d9 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.919795  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.920550  8907 raft_consensus.cc:2243] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.921121  8907 raft_consensus.cc:2272] T 385d18f3f52b4e1a9032cbef00cf99af P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.924311  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.925289  8907 raft_consensus.cc:2243] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.925843  8907 raft_consensus.cc:2272] T bedab17c8fe245b69ad728111f1caf37 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:26.926409 18276 consensus_peers.cc:597] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:26.927393 18202 consensus_peers.cc:597] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.929217  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.930223  8907 raft_consensus.cc:2243] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.930840  8907 raft_consensus.cc:2272] T 5293f684a321421795eb6139805ef39f P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.939102  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.940017  8907 raft_consensus.cc:2243] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.940605  8907 raft_consensus.cc:2272] T fe6de44e11a344e98fce7f3ac41604e9 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.943750  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.944607  8907 raft_consensus.cc:2243] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.945183  8907 raft_consensus.cc:2272] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.948940  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.949736  8907 raft_consensus.cc:2243] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.951501  8907 raft_consensus.cc:2272] T 5e1e241eba1b4006923e669f4a48efec P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.953874  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.954706  8907 raft_consensus.cc:2243] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.955994  8907 raft_consensus.cc:2272] T ade29f5a49df44369d1a6e667d19c105 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.960774  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.961999  8907 raft_consensus.cc:2243] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:18:26.962401 18276 consensus_peers.cc:597] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.963165  8907 raft_consensus.cc:2272] T f47eddc3680748a6af9175de327137b8 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.966776  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.967598  8907 raft_consensus.cc:2243] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.968181  8907 raft_consensus.cc:2272] T 9b921fdab84e49f79157326d18a70aa7 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.971354  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.972002  8907 raft_consensus.cc:2243] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.972429  8907 raft_consensus.cc:2272] T 7e2d49deb2a6475590075e98db484a4a P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.975270  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.976253  8907 raft_consensus.cc:2243] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:26.977345  8907 raft_consensus.cc:2272] T afcea13cb6af475ea953aefa36c4cce7 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.980381  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.981146  8907 raft_consensus.cc:2243] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.981701  8907 raft_consensus.cc:2272] T d4cbd36b69f445ad8ef1f859eb1ddb41 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.984583  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.985491  8907 raft_consensus.cc:2243] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.986032  8907 raft_consensus.cc:2272] T 4ab54a9a3cb1444999d60e40d2852633 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.989410  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.990267  8907 raft_consensus.cc:2243] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.990823  8907 raft_consensus.cc:2272] T ecddc502cf58477d8c38c13f8d405f7f P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:26.993937  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.994729  8907 raft_consensus.cc:2243] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.995306  8907 raft_consensus.cc:2272] T 961c55a402cb45c38eeed153e21184da P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:26.997464 18202 consensus_peers.cc:597] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:26.998301  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:26.999250  8907 raft_consensus.cc:2243] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:26.999931  8907 raft_consensus.cc:2272] T b1f319baf6bd4d04bd7e15bd2123cbed P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.003628  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.004398  8907 raft_consensus.cc:2243] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:27.005436  8907 raft_consensus.cc:2272] T 051db7f6af1d40de85352437916770f1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:26.999372 18202 consensus_peers.cc:597] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:27.008458  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.009591  8907 raft_consensus.cc:2243] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.010097  8907 raft_consensus.cc:2272] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.013015  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.013782  8907 raft_consensus.cc:2243] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:27.013968 18276 consensus_peers.cc:597] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:27.014308  8907 raft_consensus.cc:2272] T 057782f021104153860c7f1a52634265 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:27.016070 18350 consensus_peers.cc:597] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:27.018054  8907 tablet_replica.cc:333] stopping tablet replica
W20260709 12:18:27.018863 18350 consensus_peers.cc:597] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:27.019044  8907 raft_consensus.cc:2243] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.019642  8907 raft_consensus.cc:2272] T 5912d4ca89fd4924a83b748aeecca9f2 P 4758217c33d3483eac425c4d24d74bf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.022063  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.022678  8907 raft_consensus.cc:2243] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.023169  8907 raft_consensus.cc:2272] T efd81066a96b4346ab78ad395259fcc8 P 4758217c33d3483eac425c4d24d74bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.026690  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.027714  8907 raft_consensus.cc:2243] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:27.028796  8907 raft_consensus.cc:2272] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.031855  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.032599  8907 raft_consensus.cc:2243] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.033187  8907 raft_consensus.cc:2272] T 95597fb4497541e298059186c9a44a77 P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.035723  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.036412  8907 raft_consensus.cc:2243] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:27.037418  8907 raft_consensus.cc:2272] T 388fffe591be477388e1e844d43d1cda P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.040406  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.041075  8907 raft_consensus.cc:2243] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:27.042237  8907 raft_consensus.cc:2272] T c4e099ccbe3143b0b277c1a9cd4df141 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.045689  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.046475  8907 raft_consensus.cc:2243] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:27.047956  8907 raft_consensus.cc:2272] T f73019155e63498984aba01ac4d3df0f P 4758217c33d3483eac425c4d24d74bf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.051381  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.052048  8907 raft_consensus.cc:2243] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.052567  8907 raft_consensus.cc:2272] T 1c31e3a96fa847adb12c5d3632d3f3fe P 4758217c33d3483eac425c4d24d74bf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.057893  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.058961  8907 raft_consensus.cc:2243] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.059569  8907 raft_consensus.cc:2272] T 739f249d075b46c393cd456fe4f93ea0 P 4758217c33d3483eac425c4d24d74bf5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.062785  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:27.063571  8907 raft_consensus.cc:2243] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.064181  8907 raft_consensus.cc:2272] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 4758217c33d3483eac425c4d24d74bf5 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:27.078004 18276 consensus_peers.cc:597] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.061908 18350 consensus_peers.cc:597] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.079177 18350 consensus_peers.cc:597] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.124581 18202 consensus_peers.cc:597] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.164888 18202 consensus_peers.cc:597] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.497874 18202 connection.cc:769] client connection to 127.8.178.193:38641 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:18:27.539528 18276 consensus_peers.cc:597] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:27.892282 18350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:38641, user_credentials={real_user=slave}} blocked reactor thread for 44135.3us
I20260709 12:18:27.907944 19677 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:27.908685 19677 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:27.911427 19677 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:27.914131 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:27.917322 18276 leader_election.cc:336] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:27.918241 18276 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:27.919613 19677 raft_consensus.cc:2749] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:27.929549 19699 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:27.930199 19699 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:27.932390 19699 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:27.939414 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:27.957403 18202 leader_election.cc:336] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:27.958009 18202 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:27.958812 19699 raft_consensus.cc:2749] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:27.983278 19677 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:27.983960 19677 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:27.986403 19677 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:27.993638 18276 leader_election.cc:336] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:27.993911 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:27.995761 18275 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:27.999652 19677 raft_consensus.cc:2749] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:28.019827 19705 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.020474 19705 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.023849 19705 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:28.026324 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:28.028646 18202 leader_election.cc:336] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.029552 18202 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:28.030285 19705 raft_consensus.cc:2749] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:28.070452 19700 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.071143 19700 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.075311 19700 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.076447 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.077509 19337 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.078056 19337 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.080097 19337 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.081231 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.088639 19337 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.089308 19337 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:28.091944 18350 leader_election.cc:336] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.092458 18350 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:28.092864 19337 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.093151 19696 raft_consensus.cc:2749] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:28.095016 18276 leader_election.cc:336] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.095585 18276 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:28.096318 19700 raft_consensus.cc:2749] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:28.099582 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.100432 18305 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:28.102566 18350 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.103319 19696 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.103698 19696 raft_consensus.cc:493] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.104038 19696 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:28.105167 18350 leader_election.cc:336] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.111079 19705 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.111791 19705 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.114367 19696 raft_consensus.cc:515] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.114997 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.116402 19699 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.116984 19699 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.119154 19699 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:28.121518 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "051db7f6af1d40de85352437916770f1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.122116 18305 raft_consensus.cc:3060] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:28.122444 18350 leader_election.cc:336] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.123157 19696 leader_election.cc:290] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.124238 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.124864 18311 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:28.127223 18202 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.129534 19698 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:28.129902 19698 raft_consensus.cc:493] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.130405 19698 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:28.136602 18202 leader_election.cc:336] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.137123 18305 raft_consensus.cc:2468] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:28.138935 19696 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.141788 18350 leader_election.cc:304] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.142946 19337 raft_consensus.cc:2804] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.142185 19705 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.144493 19337 raft_consensus.cc:697] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.139547 19696 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.145385 19337 consensus_queue.cc:237] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.151763 19696 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.156044 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
W20260709 12:18:28.158623 18350 leader_election.cc:336] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.159744 18350 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:28.160956 18202 leader_election.cc:336] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.161433 19705 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.161755 19693 raft_consensus.cc:2749] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:28.153280 19700 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.161991 19696 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.162788 19700 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.162686 19705 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.163084 19696 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.165047 19698 raft_consensus.cc:515] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.167514 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.168292 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.161477 18202 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:28.168875 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.169556 19699 raft_consensus.cc:2749] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:28.165556 19696 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.171062 19705 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:28.175539 18276 leader_election.cc:336] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.190516 18276 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
W20260709 12:18:28.191040 18202 leader_election.cc:336] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.176836 18350 leader_election.cc:336] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.191608 18350 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5, c0771afef8984a5e9edd45be358960a2
I20260709 12:18:28.178406 19699 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.192540 19699 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.194324 19693 raft_consensus.cc:2749] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:28.194754 19699 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.191839 19702 raft_consensus.cc:2749] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.195433 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.197471 19702 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.198083 19702 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.200201 19702 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.201221 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e56147159e647d280beddd4d51e778a" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.201854 18305 raft_consensus.cc:3060] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.204051 18057 catalog_manager.cc:5697] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 4 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.178884 19698 leader_election.cc:290] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:28.165122 19700 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.207962 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
W20260709 12:18:28.214886 18276 leader_election.cc:336] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.223302 18305 raft_consensus.cc:2468] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:28.224766 18202 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:28.225127 18275 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:28.225746 19705 raft_consensus.cc:2749] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:28.226274 19702 raft_consensus.cc:2749] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:28.227836 19702 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.228341 19702 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.233584 19700 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.234124 19700 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.236629 19700 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:28.238755 18276 leader_election.cc:336] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.242895 19702 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.228550 18202 leader_election.cc:304] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
W20260709 12:18:28.243353 18276 leader_election.cc:336] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.243889 19705 raft_consensus.cc:2804] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.244433 19705 raft_consensus.cc:697] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:28.244892 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.245644 18384 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 2.
I20260709 12:18:28.245287 19705 consensus_queue.cc:237] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.247156 18275 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.248737 19700 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:28.249173 19700 raft_consensus.cc:493] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.249666 19700 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.249070 19337 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.258888 19337 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:28.261795 18202 leader_election.cc:336] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.263397 19337 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
W20260709 12:18:28.267597 18202 leader_election.cc:336] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.268152 18202 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
I20260709 12:18:28.269954 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.270895 19700 raft_consensus.cc:515] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.273932 19628 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.274621 19711 raft_consensus.cc:2749] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:28.274580 19628 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.276743 19628 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.279711 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3231bb7672254b5c82246040d42fdae4" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:28.280355 18382 raft_consensus.cc:3060] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:28.292709 18350 leader_election.cc:336] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.293298 18350 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.294922 18382 raft_consensus.cc:2468] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:28.295902 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.302021 18229 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:28.297151 19628 raft_consensus.cc:2749] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:28.303926 18350 leader_election.cc:336] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.304198 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.304857 18275 leader_election.cc:304] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.305056 18229 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:28.305759 19677 raft_consensus.cc:2804] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.306260 19677 raft_consensus.cc:697] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:28.307152 19677 consensus_queue.cc:237] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.314848 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.316398 19702 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.316815 19702 raft_consensus.cc:493] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.318002 19702 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.321978 18350 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.326011 19337 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.326516 19337 raft_consensus.cc:493] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.326890 19337 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.334319 19700 leader_election.cc:290] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.335776 19337 raft_consensus.cc:515] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.341274 19628 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.342024 19628 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.344283 19628 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.346041 19700 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.347355 19337 leader_election.cc:290] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.346454 19718 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.347980 19718 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.349603 19711 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.350345 19711 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.351284 19700 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.352727 19711 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
I20260709 12:18:28.356195 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
W20260709 12:18:28.356403 18276 leader_election.cc:336] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.356972 18305 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 5.
I20260709 12:18:28.353281 19718 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.358268 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.361579 18311 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:28.359525 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.363600 19718 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.364162 19718 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.360512 19700 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.330137 19702 raft_consensus.cc:515] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.366291 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.367156 19711 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:28.364936 18202 leader_election.cc:336] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.367655 18229 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 3.
I20260709 12:18:28.367136 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0b214e224f41628a28b5c153d8a384" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:28.369081 18233 raft_consensus.cc:3060] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.370720 19702 leader_election.cc:290] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.367640 19711 raft_consensus.cc:493] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.372594 19705 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.373237 19705 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.375283 19718 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.375447 19705 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:28.366492 18276 leader_election.cc:336] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.372704 19711 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.378965 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.379774 18382 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 2.
I20260709 12:18:28.380362 18056 catalog_manager.cc:5697] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.381423 18201 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.385362 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ae7664b5ab484caea3e423a1e9289f" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:28.386153 18229 raft_consensus.cc:3060] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.386157 19705 raft_consensus.cc:2804] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:28.388453 19705 raft_consensus.cc:493] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.393839 19705 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.394739 19699 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.395432 19699 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.393705 18229 raft_consensus.cc:2468] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:28.398641 19699 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.400324 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.401181 18382 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:28.402762 18201 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.392572 19711 raft_consensus.cc:515] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.408268 19711 leader_election.cc:290] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061)
W20260709 12:18:28.403297 18202 leader_election.cc:336] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.409047 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.404810 19628 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.409754 18384 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:28.410153 19628 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.411223 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df" is_pre_election: true
I20260709 12:18:28.412746 19628 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.413172 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e099ccbe3143b0b277c1a9cd4df141" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.413807 18311 raft_consensus.cc:3060] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.415143 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.415910 18350 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.416714 19337 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:28.417055 19337 raft_consensus.cc:493] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.417390 19337 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.409585 18057 catalog_manager.cc:5697] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.421787 19718 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:28.422406 19718 raft_consensus.cc:493] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.422857 19718 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.422827 19711 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.430177 19711 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.430648 19711 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.434964 19628 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.435274 19693 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.435599 19628 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.435899 19693 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.437784 19628 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.438088 19693 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.439152 19711 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.440946 18311 raft_consensus.cc:2468] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 6.
W20260709 12:18:28.452327  8907 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19004)
I20260709 12:18:28.389173 18276 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.457273 18233 raft_consensus.cc:2468] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:28.458122 19677 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.459477 19677 raft_consensus.cc:493] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.459981 19677 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.461155 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.461876 18229 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:28.463518 19718 raft_consensus.cc:515] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
W20260709 12:18:28.466135 18350 leader_election.cc:336] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.467034 18350 leader_election.cc:336] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.477728 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e39a3f16bd4d5cbe1eba372cb7e3e1" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:28.478461 18384 raft_consensus.cc:3060] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.481778 19718 leader_election.cc:290] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.484908 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.485725 18305 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 2.
I20260709 12:18:28.458170 19337 raft_consensus.cc:515] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.488297 18384 raft_consensus.cc:2468] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 4.
I20260709 12:18:28.490336 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2" is_pre_election: true
I20260709 12:18:28.490622 18201 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.491009 18305 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 6.
I20260709 12:18:28.491550 19698 raft_consensus.cc:2804] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.476977 19711 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.492133 19698 raft_consensus.cc:697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:28.493243 19698 consensus_queue.cc:237] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:28.458570 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.194:45865, user_credentials={real_user=slave}} blocked reactor thread for 69487.4us
I20260709 12:18:28.497416 19696 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.499289 18202 leader_election.cc:304] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.499126 19696 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:28.500844 18202 leader_election.cc:336] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.506050 18202 leader_election.cc:336] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.501528 19711 raft_consensus.cc:2804] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:28.507757 19711 raft_consensus.cc:697] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:28.508715 19711 consensus_queue.cc:237] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.501425 19696 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.488929 19337 leader_election.cc:290] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.502751 19677 raft_consensus.cc:515] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.512540 19677 leader_election.cc:290] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.498445 18350 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.513695 18350 leader_election.cc:304] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.514492 19696 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.514889 19696 raft_consensus.cc:493] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.515267 19696 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.523365 19628 raft_consensus.cc:2804] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:28.532979 18276 leader_election.cc:336] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.534976 18350 leader_election.cc:336] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.535154 18057 catalog_manager.cc:5697] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 4 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.537192 19705 raft_consensus.cc:515] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.548303 19628 raft_consensus.cc:697] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.549777 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217d661eba0249388484125571f7c38e" candidate_uuid: "3d5db60b70564b85afdb88b4c7984ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:28.550649 18384 raft_consensus.cc:3060] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.549638 19628 consensus_queue.cc:237] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.556386 19705 leader_election.cc:290] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Requested vote from peers ef7fc80e188b4c458d42ec37740468df (127.8.178.196:33469), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.557915 19696 raft_consensus.cc:515] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.560163 19696 leader_election.cc:290] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.563282 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73019155e63498984aba01ac4d3df0f" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.564035 18311 raft_consensus.cc:3060] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.571244 18276 leader_election.cc:304] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.572700 18057 catalog_manager.cc:5697] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 4 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:28.574924 18202 leader_election.cc:336] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.578652 19702 raft_consensus.cc:2804] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.579370 19702 raft_consensus.cc:697] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:28.580178 19702 consensus_queue.cc:237] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.583650 18311 raft_consensus.cc:2468] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 5.
I20260709 12:18:28.593115 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a12161578fc412fa63fc5ab2b1f73fc" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:28.593786 18233 raft_consensus.cc:3060] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.596321 18350 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.597265 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.598089 19628 raft_consensus.cc:2804] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:28.598505 19628 raft_consensus.cc:493] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.598886 19628 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.599418 19337 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:28.599815 19337 raft_consensus.cc:493] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.599906 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5" is_pre_election: true
I20260709 12:18:28.600188 19337 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:28.601024 18234 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:28.603276 18057 catalog_manager.cc:5697] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 5 to 6, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 6 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.605276 18233 raft_consensus.cc:2468] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 4.
I20260709 12:18:28.614907 18350 leader_election.cc:304] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.608400 19337 raft_consensus.cc:515] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.616415 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "388fffe591be477388e1e844d43d1cda" candidate_uuid: "c0771afef8984a5e9edd45be358960a2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef7fc80e188b4c458d42ec37740468df"
I20260709 12:18:28.620092 18382 raft_consensus.cc:3060] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:28.620797 18350 leader_election.cc:336] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.621556 18350 leader_election.cc:336] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.619104 19696 raft_consensus.cc:2804] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:28.624678 19696 raft_consensus.cc:697] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.625094 18056 catalog_manager.cc:5697] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.627580 19696 consensus_queue.cc:237] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.610536 19628 raft_consensus.cc:515] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.631642 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f47eddc3680748a6af9175de327137b8" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:28.632544 18233 raft_consensus.cc:3060] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.641222 18350 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.642208 19724 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.642632 19724 raft_consensus.cc:493] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4758217c33d3483eac425c4d24d74bf5)
I20260709 12:18:28.643006 19724 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:28.643532 18382 raft_consensus.cc:2468] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0771afef8984a5e9edd45be358960a2 in term 5.
I20260709 12:18:28.646059 19337 leader_election.cc:290] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
W20260709 12:18:28.619135 18276 leader_election.cc:336] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.651001 19724 raft_consensus.cc:515] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
W20260709 12:18:28.651513 18276 leader_election.cc:336] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.652099 18276 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0771afef8984a5e9edd45be358960a2; no voters: 4758217c33d3483eac425c4d24d74bf5, ef7fc80e188b4c458d42ec37740468df
W20260709 12:18:28.647871 18350 leader_election.cc:336] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.656840 18350 leader_election.cc:336] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.657531 18350 leader_election.cc:336] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.653131 19724 leader_election.cc:290] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Requested vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:28.632424 19628 leader_election.cc:290] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Requested vote from peers c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061), 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641)
I20260709 12:18:28.661761 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcea13cb6af475ea953aefa36c4cce7" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.662351 18311 raft_consensus.cc:3060] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:28.663388 18056 catalog_manager.cc:5697] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 4 to 5, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 5 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.669286 18311 raft_consensus.cc:2468] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 3.
I20260709 12:18:28.670817 19702 raft_consensus.cc:2749] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.655234 18233 raft_consensus.cc:2468] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:28.649204 18384 raft_consensus.cc:2468] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d5db60b70564b85afdb88b4c7984ca5 in term 3.
I20260709 12:18:28.677104 18275 leader_election.cc:304] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.677950 19702 raft_consensus.cc:2804] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:28.678418 19702 raft_consensus.cc:697] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 5 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:28.678717 18201 leader_election.cc:304] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.679306 19702 consensus_queue.cc:237] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.680987 19711 raft_consensus.cc:2804] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.681798 19711 raft_consensus.cc:697] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Becoming Leader. State: Replica: 3d5db60b70564b85afdb88b4c7984ca5, State: Running, Role: LEADER
I20260709 12:18:28.682732 19711 consensus_queue.cc:237] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.687489 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1e241eba1b4006923e669f4a48efec" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c0771afef8984a5e9edd45be358960a2"
I20260709 12:18:28.688181 18311 raft_consensus.cc:3060] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:28.691431 18202 leader_election.cc:336] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.695026 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade29f5a49df44369d1a6e667d19c105" candidate_uuid: "ef7fc80e188b4c458d42ec37740468df" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3d5db60b70564b85afdb88b4c7984ca5"
I20260709 12:18:28.695593 18234 raft_consensus.cc:3060] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:28.699036 18350 consensus_peers.cc:597] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:28.701373 18350 leader_election.cc:304] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.702226 19724 raft_consensus.cc:2804] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:28.708825 18234 raft_consensus.cc:2468] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 4.
I20260709 12:18:28.722702 19724 raft_consensus.cc:697] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.723798 19724 consensus_queue.cc:237] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.726204 18350 leader_election.cc:304] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.727069 19628 raft_consensus.cc:2804] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.727679 19628 raft_consensus.cc:697] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.728490 18276 leader_election.cc:304] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, c0771afef8984a5e9edd45be358960a2; no voters: 
I20260709 12:18:28.728413 19628 consensus_queue.cc:237] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.729095 18056 catalog_manager.cc:5697] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 4 to 5, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 5 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.730731 19677 raft_consensus.cc:2804] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.731393 19677 raft_consensus.cc:697] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Becoming Leader. State: Replica: c0771afef8984a5e9edd45be358960a2, State: Running, Role: LEADER
I20260709 12:18:28.732420 19677 consensus_queue.cc:237] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } }
I20260709 12:18:28.739811 18057 catalog_manager.cc:5697] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "3d5db60b70564b85afdb88b4c7984ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.739986 18350 leader_election.cc:304] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d5db60b70564b85afdb88b4c7984ca5, ef7fc80e188b4c458d42ec37740468df; no voters: 
I20260709 12:18:28.743451 19337 raft_consensus.cc:2804] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:28.744073 19337 raft_consensus.cc:697] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.745065 19337 consensus_queue.cc:237] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:28.743708 18311 raft_consensus.cc:2468] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc80e188b4c458d42ec37740468df in term 7.
W20260709 12:18:28.760484 18276 leader_election.cc:336] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.761245 18276 leader_election.cc:336] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.768551 18350 leader_election.cc:336] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.773607 18350 leader_election.cc:336] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:28.774207 18350 leader_election.cc:336] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
I20260709 12:18:28.777542 18311 raft_consensus.cc:1275] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:28.779400 18350 leader_election.cc:304] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0771afef8984a5e9edd45be358960a2, ef7fc80e188b4c458d42ec37740468df; no voters: 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:28.780089 19337 raft_consensus.cc:2804] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:28.780689 19337 raft_consensus.cc:697] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 7 LEADER]: Becoming Leader. State: Replica: ef7fc80e188b4c458d42ec37740468df, State: Running, Role: LEADER
I20260709 12:18:28.782723 19693 consensus_queue.cc:1048] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:28.791517 19337 consensus_queue.cc:237] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } }
I20260709 12:18:28.793458 18058 catalog_manager.cc:5697] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 2 to 3, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 3 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.814361 18384 raft_consensus.cc:1275] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.816330 19719 consensus_queue.cc:1048] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:18:28.870270 18202 consensus_peers.cc:597] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:28.876917 18311 raft_consensus.cc:1275] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:28.877452 18057 catalog_manager.cc:5697] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to c0771afef8984a5e9edd45be358960a2 (127.8.178.195). New cstate: current_term: 4 leader_uuid: "c0771afef8984a5e9edd45be358960a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:28.878159 18058 catalog_manager.cc:5697] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 4 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.880226 18058 catalog_manager.cc:5697] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 6 to 7, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 7 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.881677 19699 consensus_queue.cc:1048] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:28.881347 18058 catalog_manager.cc:5697] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df reported cstate change: term changed from 3 to 4, leader changed from 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193) to ef7fc80e188b4c458d42ec37740468df (127.8.178.196). New cstate: current_term: 4 leader_uuid: "ef7fc80e188b4c458d42ec37740468df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:28.914515 18379 raft_consensus.cc:1275] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:28.926045 19711 consensus_queue.cc:1048] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:18:28.928315 18276 consensus_peers.cc:597] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.007908 18350 consensus_peers.cc:597] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.016296 18276 consensus_peers.cc:597] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.047616 18350 consensus_peers.cc:597] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.057940 18305 raft_consensus.cc:1275] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:29.059326 18202 consensus_peers.cc:597] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.060693 19699 consensus_queue.cc:1048] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:29.066895 18276 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.088083 18202 consensus_peers.cc:597] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.098344 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:29.103922 18305 raft_consensus.cc:1275] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:29.107534 18202 consensus_peers.cc:597] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.111675 19628 consensus_queue.cc:1048] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:29.121572 18311 raft_consensus.cc:1275] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:29.124318 18233 raft_consensus.cc:1275] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:29.125834 19628 consensus_queue.cc:1048] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:29.134814 19628 consensus_queue.cc:1048] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:29.136350 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:29.140738 18229 raft_consensus.cc:1275] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:29.147455 19719 consensus_queue.cc:1048] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:29.185276 18233 raft_consensus.cc:1275] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:29.189211 19337 consensus_queue.cc:1048] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:29.195056 18350 consensus_peers.cc:597] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.212477 18350 consensus_peers.cc:597] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.217581 18350 consensus_peers.cc:597] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.218744 18384 raft_consensus.cc:1275] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Refusing update from remote peer 3d5db60b70564b85afdb88b4c7984ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:29.224154 19722 consensus_queue.cc:1048] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:29.242553 18350 consensus_peers.cc:597] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.250788 18276 consensus_peers.cc:597] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.253592 18276 consensus_peers.cc:597] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.265339 18350 consensus_peers.cc:597] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:29.265941 18350 consensus_peers.cc:597] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:29.295298 18384 raft_consensus.cc:1275] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:29.297111 19702 consensus_queue.cc:1048] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:29.308521 18233 raft_consensus.cc:1275] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer c0771afef8984a5e9edd45be358960a2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:29.311116 19677 consensus_queue.cc:1048] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:29.314714 18276 consensus_peers.cc:597] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.343091 18202 consensus_peers.cc:597] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.353062 18350 consensus_peers.cc:597] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.353149 18276 consensus_peers.cc:597] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.353639 18276 consensus_peers.cc:597] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:29.357353 18229 raft_consensus.cc:1275] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:29.372186 19628 consensus_queue.cc:1048] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:29.378511 18311 raft_consensus.cc:1275] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 7 FOLLOWER]: Refusing update from remote peer ef7fc80e188b4c458d42ec37740468df: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:29.390005 19628 consensus_queue.cc:1048] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0771afef8984a5e9edd45be358960a2" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 41061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:18:29.417126 18350 consensus_peers.cc:597] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.451107 18350 consensus_peers.cc:597] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.452908  8907 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19004)
W20260709 12:18:29.467777 18350 consensus_peers.cc:597] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.500022 18276 consensus_peers.cc:597] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.500532 18276 consensus_peers.cc:597] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.513553 18202 consensus_peers.cc:597] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.537312 18350 consensus_peers.cc:597] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.538362 18202 consensus_peers.cc:597] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.593366 18350 consensus_peers.cc:597] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.619716 18202 consensus_peers.cc:597] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.646373 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.699059 18350 consensus_peers.cc:597] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.705926 18276 consensus_peers.cc:597] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.746982 18350 consensus_peers.cc:597] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.752363 18350 consensus_peers.cc:597] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.753090 18276 consensus_peers.cc:597] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.766749 18276 consensus_peers.cc:597] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.859712 18276 consensus_peers.cc:597] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.865005 18202 consensus_peers.cc:597] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:29.955120 18202 consensus_peers.cc:597] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:30.453394  8907 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19004)
W20260709 12:18:31.236433 18350 consensus_peers.cc:597] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.283437 18276 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.328630 18350 consensus_peers.cc:597] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.357618 18202 consensus_peers.cc:597] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.381035 18276 consensus_peers.cc:597] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.392976 18202 consensus_peers.cc:597] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.453274 18276 consensus_peers.cc:597] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.453864  8907 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19004)
W20260709 12:18:31.505754 18350 consensus_peers.cc:597] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.533656 18276 consensus_peers.cc:597] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.567063 18202 consensus_peers.cc:597] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.575838 18202 consensus_peers.cc:597] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.589957 18350 consensus_peers.cc:597] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.592626 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.622812 18350 consensus_peers.cc:597] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.683832 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.699783 18350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111) [suppressed 426 similar messages]
W20260709 12:18:31.702016 18350 consensus_peers.cc:597] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.711185 18202 consensus_peers.cc:597] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.742901 18276 consensus_peers.cc:597] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.755146 18350 consensus_peers.cc:597] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.802811 18350 consensus_peers.cc:597] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.816097 18276 consensus_peers.cc:597] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.834761 18276 consensus_peers.cc:597] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.841272 18350 consensus_peers.cc:597] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:31.911985 18202 consensus_peers.cc:597] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.919986 18276 consensus_peers.cc:597] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.947446 18202 consensus_peers.cc:597] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.966089 18350 consensus_peers.cc:597] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:31.971923 18276 consensus_peers.cc:597] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.006964 18350 consensus_peers.cc:597] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.027011 18276 consensus_peers.cc:597] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.036033 18350 consensus_peers.cc:597] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.038820 18350 consensus_peers.cc:597] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.064381 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.076713 18276 consensus_peers.cc:597] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.122833 18350 consensus_peers.cc:597] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.136144 18202 consensus_peers.cc:597] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.184772 18350 consensus_peers.cc:597] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.194134 18350 consensus_peers.cc:597] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.270298 18276 consensus_peers.cc:597] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.297204 18350 consensus_peers.cc:597] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:32.304544  8907 tablet_server.cc:196] TabletServer@127.8.178.193:38641 shutdown complete.
W20260709 12:18:32.313987 18202 consensus_peers.cc:597] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.327256 18350 consensus_peers.cc:597] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.342854 18276 consensus_peers.cc:597] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:32.383576 18276 consensus_peers.cc:597] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:32.389838  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
W20260709 12:18:32.406605 18276 consensus_peers.cc:597] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.419566 18276 consensus_peers.cc:597] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.425809 18276 consensus_peers.cc:597] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.433736 18350 consensus_peers.cc:597] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.455017  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:32.456014  8907 tablet_replica.cc:333] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.456827  8907 raft_consensus.cc:2243] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.457782  8907 raft_consensus.cc:2272] T a6c6dbbbb353448c88878a019afcd95a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.460079  8907 tablet_replica.cc:333] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.460659  8907 raft_consensus.cc:2243] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.461431  8907 raft_consensus.cc:2272] T efd81066a96b4346ab78ad395259fcc8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.463446  8907 tablet_replica.cc:333] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.464262  8907 raft_consensus.cc:2243] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.465145  8907 raft_consensus.cc:2272] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.467367  8907 tablet_replica.cc:333] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.467967  8907 raft_consensus.cc:2243] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.468408  8907 raft_consensus.cc:2272] T 62389b333b65412ba48dd69a80e8be14 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.470647  8907 tablet_replica.cc:333] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.471386  8907 raft_consensus.cc:2243] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.472360  8907 raft_consensus.cc:2272] T c4e099ccbe3143b0b277c1a9cd4df141 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.475378  8907 tablet_replica.cc:333] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.476313  8907 raft_consensus.cc:2243] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.476902  8907 raft_consensus.cc:2272] T 0ba7643c4e6d4a459dc5fe06baf0092d P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.477542 18350 consensus_peers.cc:597] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.479414  8907 tablet_replica.cc:333] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.480103  8907 raft_consensus.cc:2243] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.480541  8907 raft_consensus.cc:2272] T ecddc502cf58477d8c38c13f8d405f7f P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.482555  8907 tablet_replica.cc:333] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.483121  8907 raft_consensus.cc:2243] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.483556  8907 raft_consensus.cc:2272] T 7e2d49deb2a6475590075e98db484a4a P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.485615  8907 tablet_replica.cc:333] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.486178  8907 raft_consensus.cc:2243] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.486652  8907 raft_consensus.cc:2272] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.488535  8907 tablet_replica.cc:333] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.489089  8907 raft_consensus.cc:2243] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.490017  8907 raft_consensus.cc:2272] T 305a8559734b417591ff6ac5f0609a2e P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.492331  8907 tablet_replica.cc:333] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.493211  8907 raft_consensus.cc:2243] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.494278  8907 raft_consensus.cc:2272] T 4e56147159e647d280beddd4d51e778a P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.497107  8907 tablet_replica.cc:333] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.497723  8907 raft_consensus.cc:2243] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.498208  8907 raft_consensus.cc:2272] T 9f0b214e224f41628a28b5c153d8a384 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.500680  8907 tablet_replica.cc:333] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.501533  8907 raft_consensus.cc:2243] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.502115  8907 raft_consensus.cc:2272] T 7adc6e964f384c6fba8dd6b7f1d978c5 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.504685  8907 tablet_replica.cc:333] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.505246  8907 raft_consensus.cc:2243] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:18:32.505631 18276 consensus_peers.cc:597] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.506049  8907 raft_consensus.cc:2272] T 25582256f10b4d31b2add593456d964e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.506373 18276 consensus_peers.cc:597] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.509160  8907 tablet_replica.cc:333] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.510128  8907 raft_consensus.cc:2243] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.510756  8907 raft_consensus.cc:2272] T d1a349f30cd4492389e44ee0d27ce020 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.514261  8907 tablet_replica.cc:333] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.515268  8907 raft_consensus.cc:2243] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.515805  8907 raft_consensus.cc:2272] T 7ef6dbd8d5ca409da3ff154edacb0d96 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.516870 18350 consensus_peers.cc:597] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.518517  8907 tablet_replica.cc:333] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.519445  8907 raft_consensus.cc:2243] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.520015  8907 raft_consensus.cc:2272] T f47eddc3680748a6af9175de327137b8 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.520862 18202 consensus_peers.cc:597] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 -> Peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Couldn't send request to peer 4758217c33d3483eac425c4d24d74bf5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:32.522748  8907 tablet_replica.cc:333] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.523656  8907 raft_consensus.cc:2243] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.524184  8907 raft_consensus.cc:2272] T ade29f5a49df44369d1a6e667d19c105 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.527101  8907 tablet_replica.cc:333] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.527976  8907 raft_consensus.cc:2243] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.528651  8907 raft_consensus.cc:2272] T fe6de44e11a344e98fce7f3ac41604e9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.531797  8907 tablet_replica.cc:333] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.532552  8907 raft_consensus.cc:2243] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.533470  8907 raft_consensus.cc:2272] T 385d18f3f52b4e1a9032cbef00cf99af P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.536597  8907 tablet_replica.cc:333] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.537494  8907 raft_consensus.cc:2243] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.538096  8907 raft_consensus.cc:2272] T c282b6d8fe394885b2058ecbef26a541 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.541167  8907 tablet_replica.cc:333] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
W20260709 12:18:32.541663 18276 consensus_peers.cc:597] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.542039  8907 raft_consensus.cc:2243] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.542783  8907 raft_consensus.cc:2272] T ffbfc451de634f81ac9f6aaf022cf4d9 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.546629  8907 tablet_replica.cc:333] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.547465  8907 raft_consensus.cc:2243] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.548121  8907 raft_consensus.cc:2272] T a7e33101322f4ceb8f0ba80bb561f699 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.551187  8907 tablet_replica.cc:333] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.551885  8907 raft_consensus.cc:2243] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.552886  8907 raft_consensus.cc:2272] T 2670be13282d47d992a2899032fa7f00 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.555759  8907 tablet_replica.cc:333] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.556556  8907 raft_consensus.cc:2243] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.557664  8907 raft_consensus.cc:2272] T b1f319baf6bd4d04bd7e15bd2123cbed P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.559996 18276 consensus_peers.cc:597] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.560616  8907 tablet_replica.cc:333] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.561269  8907 raft_consensus.cc:2243] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.562023  8907 raft_consensus.cc:2272] T 2aacfc26793e4bf28e5827e26159662b P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.564047  8907 tablet_replica.cc:333] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.564662  8907 raft_consensus.cc:2243] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.565188  8907 raft_consensus.cc:2272] T bedab17c8fe245b69ad728111f1caf37 P 3d5db60b70564b85afdb88b4c7984ca5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.567256  8907 tablet_replica.cc:333] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.568053  8907 raft_consensus.cc:2243] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.568624  8907 raft_consensus.cc:2272] T 012abbd307bb440c93b80adee8541719 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.570799  8907 tablet_replica.cc:333] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.571334  8907 raft_consensus.cc:2243] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.572173  8907 raft_consensus.cc:2272] T 4ab54a9a3cb1444999d60e40d2852633 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.575058  8907 tablet_replica.cc:333] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.575712  8907 raft_consensus.cc:2243] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.576303  8907 raft_consensus.cc:2272] T abdcb3150843428e970fa883d21b1894 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.578738  8907 tablet_replica.cc:333] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
W20260709 12:18:32.578873 18276 consensus_peers.cc:597] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.579476  8907 raft_consensus.cc:2243] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.579921  8907 raft_consensus.cc:2272] T dd927b9f8b7a45cdb1851ae9060a9c69 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.581959  8907 tablet_replica.cc:333] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.582545  8907 raft_consensus.cc:2243] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.582990  8907 raft_consensus.cc:2272] T 3a12161578fc412fa63fc5ab2b1f73fc P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.585016  8907 tablet_replica.cc:333] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.585557  8907 raft_consensus.cc:2243] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.586352  8907 raft_consensus.cc:2272] T 217d661eba0249388484125571f7c38e P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.589038  8907 tablet_replica.cc:333] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.589905  8907 raft_consensus.cc:2243] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.591051  8907 raft_consensus.cc:2272] T 2da0bd128e3a412fb2096d9bced6a731 P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.591826 18350 consensus_peers.cc:597] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.593951  8907 tablet_replica.cc:333] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.594753  8907 raft_consensus.cc:2243] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.595295  8907 raft_consensus.cc:2272] T f7ae7664b5ab484caea3e423a1e9289f P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.597420  8907 tablet_replica.cc:333] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.597949  8907 raft_consensus.cc:2243] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.598877  8907 raft_consensus.cc:2272] T c4ce96c35374410ba64078605ab401ef P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.601110  8907 tablet_replica.cc:333] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.601620  8907 raft_consensus.cc:2243] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.602386  8907 raft_consensus.cc:2272] T a2af9ea4e43c413080fda28b17c3869f P 3d5db60b70564b85afdb88b4c7984ca5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.604812  8907 tablet_replica.cc:333] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.605619  8907 raft_consensus.cc:2243] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.606204  8907 raft_consensus.cc:2272] T 37db4f6fedfc49e4a401670153431564 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.608503  8907 tablet_replica.cc:333] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.609134  8907 raft_consensus.cc:2243] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.609787  8907 raft_consensus.cc:2272] T 739f249d075b46c393cd456fe4f93ea0 P 3d5db60b70564b85afdb88b4c7984ca5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.611948  8907 tablet_replica.cc:333] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.612489  8907 raft_consensus.cc:2243] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.612932  8907 raft_consensus.cc:2272] T 94dc42a44c014b24a25ddcaad4075300 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.615044  8907 tablet_replica.cc:333] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.615754  8907 raft_consensus.cc:2243] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.616559  8907 raft_consensus.cc:2272] T de26469791e8437793e0833ab312e266 P 3d5db60b70564b85afdb88b4c7984ca5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.618597  8907 tablet_replica.cc:333] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.619240  8907 raft_consensus.cc:2243] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.620322  8907 raft_consensus.cc:2272] T 37231cb8219f456f99b2043efccec059 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.622888  8907 tablet_replica.cc:333] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
W20260709 12:18:32.622987 18276 consensus_peers.cc:597] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.623417  8907 raft_consensus.cc:2243] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.624327  8907 raft_consensus.cc:2272] T 057782f021104153860c7f1a52634265 P 3d5db60b70564b85afdb88b4c7984ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.627023  8907 tablet_replica.cc:333] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5: stopping tablet replica
I20260709 12:18:32.627637  8907 raft_consensus.cc:2243] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.628146  8907 raft_consensus.cc:2272] T 5912d4ca89fd4924a83b748aeecca9f2 P 3d5db60b70564b85afdb88b4c7984ca5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.653257 18350 consensus_peers.cc:597] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.656330 18276 consensus_peers.cc:597] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.663026 18276 consensus_peers.cc:597] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.676257 18350 consensus_peers.cc:597] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.695837 18350 consensus_peers.cc:597] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.704347 18350 consensus_peers.cc:597] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.706535 18276 consensus_peers.cc:597] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.706840 18350 consensus_peers.cc:597] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.712193  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
W20260709 12:18:32.747696 18350 consensus_peers.cc:597] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.795063  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
W20260709 12:18:32.836120 18276 consensus_peers.cc:597] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:32.839892 18350 consensus_peers.cc:597] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.841135  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:32.841993  8907 tablet_replica.cc:333] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.842813  8907 raft_consensus.cc:2243] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.843868  8907 raft_consensus.cc:2272] T 388fffe591be477388e1e844d43d1cda P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.846518  8907 tablet_replica.cc:333] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.847132  8907 raft_consensus.cc:2243] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.847637  8907 raft_consensus.cc:2272] T c4e099ccbe3143b0b277c1a9cd4df141 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.849359 18276 consensus_peers.cc:597] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 -> Peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Couldn't send request to peer 3d5db60b70564b85afdb88b4c7984ca5. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.850198  8907 tablet_replica.cc:333] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.850871  8907 raft_consensus.cc:2243] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.851258  8907 raft_consensus.cc:2272] T efd81066a96b4346ab78ad395259fcc8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.853050  8907 tablet_replica.cc:333] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.853569  8907 raft_consensus.cc:2243] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.853917  8907 raft_consensus.cc:2272] T a6c6dbbbb353448c88878a019afcd95a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.855763  8907 tablet_replica.cc:333] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.856314  8907 raft_consensus.cc:2243] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.856678  8907 raft_consensus.cc:2272] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.858642  8907 tablet_replica.cc:333] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.859107  8907 raft_consensus.cc:2243] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.859820  8907 raft_consensus.cc:2272] T 7e2d49deb2a6475590075e98db484a4a P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.861677  8907 tablet_replica.cc:333] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.862147  8907 raft_consensus.cc:2243] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.862907  8907 raft_consensus.cc:2272] T 0ba7643c4e6d4a459dc5fe06baf0092d P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.864697  8907 tablet_replica.cc:333] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.865199  8907 raft_consensus.cc:2243] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.865950  8907 raft_consensus.cc:2272] T c282b6d8fe394885b2058ecbef26a541 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.867880  8907 tablet_replica.cc:333] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.868384  8907 raft_consensus.cc:2243] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.868785  8907 raft_consensus.cc:2272] T dfff73c71c1a49b3986f395d27a699a8 P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.870617  8907 tablet_replica.cc:333] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.871109  8907 raft_consensus.cc:2243] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.871482  8907 raft_consensus.cc:2272] T 37231cb8219f456f99b2043efccec059 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.873270  8907 tablet_replica.cc:333] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.873766  8907 raft_consensus.cc:2243] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.874212  8907 raft_consensus.cc:2272] T 961c55a402cb45c38eeed153e21184da P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.875932  8907 tablet_replica.cc:333] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.876451  8907 raft_consensus.cc:2243] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.876856  8907 raft_consensus.cc:2272] T 305a8559734b417591ff6ac5f0609a2e P c0771afef8984a5e9edd45be358960a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.878669  8907 tablet_replica.cc:333] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.879179  8907 raft_consensus.cc:2243] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.879577  8907 raft_consensus.cc:2272] T 4e56147159e647d280beddd4d51e778a P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.881371  8907 tablet_replica.cc:333] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.881920  8907 raft_consensus.cc:2243] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.882838  8907 raft_consensus.cc:2272] T d1a349f30cd4492389e44ee0d27ce020 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.885197  8907 tablet_replica.cc:333] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.885938  8907 raft_consensus.cc:2243] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.886758  8907 raft_consensus.cc:2272] T 7ef6dbd8d5ca409da3ff154edacb0d96 P c0771afef8984a5e9edd45be358960a2 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.888664  8907 tablet_replica.cc:333] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.889219  8907 raft_consensus.cc:2243] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.889962  8907 raft_consensus.cc:2272] T d4cbd36b69f445ad8ef1f859eb1ddb41 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.891819  8907 tablet_replica.cc:333] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.892351  8907 raft_consensus.cc:2243] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.892765  8907 raft_consensus.cc:2272] T afcea13cb6af475ea953aefa36c4cce7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.894810  8907 tablet_replica.cc:333] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.895341  8907 raft_consensus.cc:2243] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.896117  8907 raft_consensus.cc:2272] T fe6de44e11a344e98fce7f3ac41604e9 P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.898206  8907 tablet_replica.cc:333] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.898855  8907 raft_consensus.cc:2243] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.899356  8907 raft_consensus.cc:2272] T 2da0bd128e3a412fb2096d9bced6a731 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.901793  8907 tablet_replica.cc:333] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.902570  8907 raft_consensus.cc:2243] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.903563  8907 raft_consensus.cc:2272] T f7ae7664b5ab484caea3e423a1e9289f P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.905639  8907 tablet_replica.cc:333] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.906211  8907 raft_consensus.cc:2243] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.907042  8907 raft_consensus.cc:2272] T a7e33101322f4ceb8f0ba80bb561f699 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.909236  8907 tablet_replica.cc:333] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.909942  8907 raft_consensus.cc:2243] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.910416  8907 raft_consensus.cc:2272] T 2670be13282d47d992a2899032fa7f00 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.913463  8907 tablet_replica.cc:333] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.914106  8907 raft_consensus.cc:2243] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.914644  8907 raft_consensus.cc:2272] T 25582256f10b4d31b2add593456d964e P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.916674  8907 tablet_replica.cc:333] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.917191  8907 raft_consensus.cc:2243] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.917665  8907 raft_consensus.cc:2272] T 5e1e241eba1b4006923e669f4a48efec P c0771afef8984a5e9edd45be358960a2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.920097  8907 tablet_replica.cc:333] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.920852  8907 raft_consensus.cc:2243] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.921911  8907 raft_consensus.cc:2272] T 9b921fdab84e49f79157326d18a70aa7 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.924672  8907 tablet_replica.cc:333] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.925490  8907 raft_consensus.cc:2243] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.926558  8907 raft_consensus.cc:2272] T 5912d4ca89fd4924a83b748aeecca9f2 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.928224 18350 consensus_peers.cc:597] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.929196  8907 tablet_replica.cc:333] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.930083  8907 raft_consensus.cc:2243] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.931074  8907 raft_consensus.cc:2272] T abdcb3150843428e970fa883d21b1894 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.933409  8907 tablet_replica.cc:333] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.934392  8907 raft_consensus.cc:2243] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.935235  8907 raft_consensus.cc:2272] T dd927b9f8b7a45cdb1851ae9060a9c69 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.937188  8907 tablet_replica.cc:333] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.937726  8907 raft_consensus.cc:2243] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.938632  8907 raft_consensus.cc:2272] T 3a12161578fc412fa63fc5ab2b1f73fc P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.941398  8907 tablet_replica.cc:333] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.942052  8907 raft_consensus.cc:2243] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.943006  8907 raft_consensus.cc:2272] T 62389b333b65412ba48dd69a80e8be14 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:32.943524 18350 consensus_peers.cc:597] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:32.945417  8907 tablet_replica.cc:333] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.946022  8907 raft_consensus.cc:2243] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.946522  8907 raft_consensus.cc:2272] T 95597fb4497541e298059186c9a44a77 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.948701  8907 tablet_replica.cc:333] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.949375  8907 raft_consensus.cc:2243] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.949855  8907 raft_consensus.cc:2272] T 051db7f6af1d40de85352437916770f1 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.952275  8907 tablet_replica.cc:333] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.953042  8907 raft_consensus.cc:2243] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.953682  8907 raft_consensus.cc:2272] T 2aacfc26793e4bf28e5827e26159662b P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.956404  8907 tablet_replica.cc:333] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.957163  8907 raft_consensus.cc:2243] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.957698  8907 raft_consensus.cc:2272] T 5293f684a321421795eb6139805ef39f P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.961315  8907 tablet_replica.cc:333] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.962128  8907 raft_consensus.cc:2243] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.963199  8907 raft_consensus.cc:2272] T 012abbd307bb440c93b80adee8541719 P c0771afef8984a5e9edd45be358960a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.967064  8907 tablet_replica.cc:333] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.967896  8907 raft_consensus.cc:2243] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.968497  8907 raft_consensus.cc:2272] T d1d5fb2105e4453aa1d8b1b3758aade5 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.972195  8907 tablet_replica.cc:333] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.972924  8907 raft_consensus.cc:2243] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.973718  8907 raft_consensus.cc:2272] T 7adc6e964f384c6fba8dd6b7f1d978c5 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.976145  8907 tablet_replica.cc:333] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.976714  8907 raft_consensus.cc:2243] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.977149  8907 raft_consensus.cc:2272] T de26469791e8437793e0833ab312e266 P c0771afef8984a5e9edd45be358960a2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.979621  8907 tablet_replica.cc:333] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.980396  8907 raft_consensus.cc:2243] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:32.981299  8907 raft_consensus.cc:2272] T 3231bb7672254b5c82246040d42fdae4 P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.984058  8907 tablet_replica.cc:333] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.984762  8907 raft_consensus.cc:2243] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.985430  8907 raft_consensus.cc:2272] T 385d18f3f52b4e1a9032cbef00cf99af P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.987962  8907 tablet_replica.cc:333] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.988502  8907 raft_consensus.cc:2243] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.988971  8907 raft_consensus.cc:2272] T c4ce96c35374410ba64078605ab401ef P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:32.991333  8907 tablet_replica.cc:333] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:32.991961  8907 raft_consensus.cc:2243] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:32.992453  8907 raft_consensus.cc:2272] T a2af9ea4e43c413080fda28b17c3869f P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.023276  8907 tablet_replica.cc:333] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:33.024936  8907 raft_consensus.cc:2243] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.026595  8907 raft_consensus.cc:2272] T f73019155e63498984aba01ac4d3df0f P c0771afef8984a5e9edd45be358960a2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.033535  8907 tablet_replica.cc:333] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2: stopping tablet replica
I20260709 12:18:33.034251  8907 raft_consensus.cc:2243] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.035200  8907 raft_consensus.cc:2272] T 1c31e3a96fa847adb12c5d3632d3f3fe P c0771afef8984a5e9edd45be358960a2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:33.041410 18350 consensus_peers.cc:597] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:33.044010 18350 consensus_peers.cc:597] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:33.045274 18350 consensus_peers.cc:597] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:33.098694 18350 consensus_peers.cc:597] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:33.146211 18350 consensus_peers.cc:597] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:33.192938  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
W20260709 12:18:33.206308 18350 consensus_peers.cc:597] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:41061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:33.265774 18350 consensus_peers.cc:597] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:41061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:33.316320  8907 tablet_server.cc:179] TabletServer@127.8.178.196:0 shutting down...
I20260709 12:18:33.357613  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:33.358408  8907 tablet_replica.cc:333] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.359413  8907 raft_consensus.cc:2243] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.360056  8907 raft_consensus.cc:2272] T 388fffe591be477388e1e844d43d1cda P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.362444  8907 tablet_replica.cc:333] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.363220  8907 raft_consensus.cc:2243] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.363905  8907 raft_consensus.cc:2272] T a6c6dbbbb353448c88878a019afcd95a P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.366927  8907 tablet_replica.cc:333] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
W20260709 12:18:33.367152 18350 consensus_peers.cc:597] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df -> Peer c0771afef8984a5e9edd45be358960a2 (127.8.178.195:41061): Couldn't send request to peer c0771afef8984a5e9edd45be358960a2. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.195:41061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:33.367892  8907 raft_consensus.cc:2243] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.368847  8907 raft_consensus.cc:2272] T ecddc502cf58477d8c38c13f8d405f7f P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.371160  8907 tablet_replica.cc:333] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.371807  8907 raft_consensus.cc:2243] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.372303  8907 raft_consensus.cc:2272] T 217d661eba0249388484125571f7c38e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.374711  8907 tablet_replica.cc:333] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.375595  8907 raft_consensus.cc:2243] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.376235  8907 raft_consensus.cc:2272] T 2da0bd128e3a412fb2096d9bced6a731 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.379060  8907 tablet_replica.cc:333] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.379662  8907 raft_consensus.cc:2243] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.380602  8907 raft_consensus.cc:2272] T 2f1bbd2de5294bb49cdcd14a71bb0a0e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.382998  8907 tablet_replica.cc:333] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.383592  8907 raft_consensus.cc:2243] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.384775  8907 raft_consensus.cc:2272] T 4b89f14ea9fa4acaa3818c68cc4a1d09 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.388033  8907 tablet_replica.cc:333] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.388702  8907 raft_consensus.cc:2243] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.389243  8907 raft_consensus.cc:2272] T a7e33101322f4ceb8f0ba80bb561f699 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.391855  8907 tablet_replica.cc:333] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.392714  8907 raft_consensus.cc:2243] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.393803  8907 raft_consensus.cc:2272] T dfff73c71c1a49b3986f395d27a699a8 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.396737  8907 tablet_replica.cc:333] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.397347  8907 raft_consensus.cc:2243] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.398341  8907 raft_consensus.cc:2272] T 961c55a402cb45c38eeed153e21184da P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.400732  8907 tablet_replica.cc:333] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.401352  8907 raft_consensus.cc:2243] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.401886  8907 raft_consensus.cc:2272] T 37231cb8219f456f99b2043efccec059 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.404347  8907 tablet_replica.cc:333] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.404927  8907 raft_consensus.cc:2243] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.405396  8907 raft_consensus.cc:2272] T 057782f021104153860c7f1a52634265 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.407698  8907 tablet_replica.cc:333] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.408245  8907 raft_consensus.cc:2243] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.408689  8907 raft_consensus.cc:2272] T d4cbd36b69f445ad8ef1f859eb1ddb41 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.410665  8907 tablet_replica.cc:333] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.411204  8907 raft_consensus.cc:2243] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.411643  8907 raft_consensus.cc:2272] T 4ab54a9a3cb1444999d60e40d2852633 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.413772  8907 tablet_replica.cc:333] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.414309  8907 raft_consensus.cc:2243] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.415371  8907 raft_consensus.cc:2272] T afcea13cb6af475ea953aefa36c4cce7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.417438  8907 tablet_replica.cc:333] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.417961  8907 raft_consensus.cc:2243] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.418838  8907 raft_consensus.cc:2272] T f47eddc3680748a6af9175de327137b8 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.420768  8907 tablet_replica.cc:333] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.421288  8907 raft_consensus.cc:2243] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.422219  8907 raft_consensus.cc:2272] T 5e1e241eba1b4006923e669f4a48efec P ef7fc80e188b4c458d42ec37740468df [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.424201  8907 tablet_replica.cc:333] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.424698  8907 raft_consensus.cc:2243] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.425150  8907 raft_consensus.cc:2272] T 9b921fdab84e49f79157326d18a70aa7 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.427191  8907 tablet_replica.cc:333] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.427714  8907 raft_consensus.cc:2243] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.428640  8907 raft_consensus.cc:2272] T ade29f5a49df44369d1a6e667d19c105 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.430419  8907 tablet_replica.cc:333] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.430940  8907 raft_consensus.cc:2243] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.431730  8907 raft_consensus.cc:2272] T 5293f684a321421795eb6139805ef39f P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.433710  8907 tablet_replica.cc:333] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.434217  8907 raft_consensus.cc:2243] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.434697  8907 raft_consensus.cc:2272] T 012abbd307bb440c93b80adee8541719 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.436682  8907 tablet_replica.cc:333] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.437189  8907 raft_consensus.cc:2243] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.437934  8907 raft_consensus.cc:2272] T bedab17c8fe245b69ad728111f1caf37 P ef7fc80e188b4c458d42ec37740468df [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.439841  8907 tablet_replica.cc:333] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.440321  8907 raft_consensus.cc:2243] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.441089  8907 raft_consensus.cc:2272] T d1d5fb2105e4453aa1d8b1b3758aade5 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.443011  8907 tablet_replica.cc:333] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.443532  8907 raft_consensus.cc:2243] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.443991  8907 raft_consensus.cc:2272] T 7adc6e964f384c6fba8dd6b7f1d978c5 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.445884  8907 tablet_replica.cc:333] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.446350  8907 raft_consensus.cc:2243] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.447199  8907 raft_consensus.cc:2272] T 9f0b214e224f41628a28b5c153d8a384 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.449209  8907 tablet_replica.cc:333] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.449703  8907 raft_consensus.cc:2243] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.450115  8907 raft_consensus.cc:2272] T 25582256f10b4d31b2add593456d964e P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.452014  8907 tablet_replica.cc:333] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.452172 19770 raft_consensus.cc:493] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3d5db60b70564b85afdb88b4c7984ca5)
I20260709 12:18:33.452852  8907 raft_consensus.cc:2243] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.452833 19770 raft_consensus.cc:515] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc80e188b4c458d42ec37740468df" member_type: VOTER last_known_addr { host: "127.8.178.196" port: 33469 } } peers { permanent_uuid: "4758217c33d3483eac425c4d24d74bf5" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38641 } } peers { permanent_uuid: "3d5db60b70564b85afdb88b4c7984ca5" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 45865 } }
I20260709 12:18:33.454245  8907 raft_consensus.cc:2272] T 94dc42a44c014b24a25ddcaad4075300 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.455741 19770 leader_election.cc:290] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641), 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865)
I20260709 12:18:33.457638  8907 tablet_replica.cc:333] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.458398  8907 raft_consensus.cc:2243] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.459228  8907 raft_consensus.cc:2272] T 3231bb7672254b5c82246040d42fdae4 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:33.459309 18350 leader_election.cc:336] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4758217c33d3483eac425c4d24d74bf5 (127.8.178.193:38641): Network error: Client connection negotiation failed: client connection to 127.8.178.193:38641: connect: Connection refused (error 111)
W20260709 12:18:33.460081 18350 leader_election.cc:336] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3d5db60b70564b85afdb88b4c7984ca5 (127.8.178.194:45865): Network error: Client connection negotiation failed: client connection to 127.8.178.194:45865: connect: Connection refused (error 111)
I20260709 12:18:33.460398 18350 leader_election.cc:304] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7fc80e188b4c458d42ec37740468df; no voters: 3d5db60b70564b85afdb88b4c7984ca5, 4758217c33d3483eac425c4d24d74bf5
I20260709 12:18:33.460987 19770 raft_consensus.cc:2749] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.461994  8907 tablet_replica.cc:333] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.462646  8907 raft_consensus.cc:2243] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.463112  8907 raft_consensus.cc:2272] T de26469791e8437793e0833ab312e266 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.465164  8907 tablet_replica.cc:333] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.465636  8907 raft_consensus.cc:2243] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.466523  8907 raft_consensus.cc:2272] T f73019155e63498984aba01ac4d3df0f P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.468504  8907 tablet_replica.cc:333] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.468982  8907 raft_consensus.cc:2243] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.469796  8907 raft_consensus.cc:2272] T 1c31e3a96fa847adb12c5d3632d3f3fe P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.471954  8907 tablet_replica.cc:333] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.472496  8907 raft_consensus.cc:2243] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.473296  8907 raft_consensus.cc:2272] T 739f249d075b46c393cd456fe4f93ea0 P ef7fc80e188b4c458d42ec37740468df [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.475315  8907 tablet_replica.cc:333] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.475797  8907 raft_consensus.cc:2243] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.476202  8907 raft_consensus.cc:2272] T c4ce96c35374410ba64078605ab401ef P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.478147  8907 tablet_replica.cc:333] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.478657  8907 raft_consensus.cc:2243] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.479115  8907 raft_consensus.cc:2272] T a2af9ea4e43c413080fda28b17c3869f P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.481093  8907 tablet_replica.cc:333] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.481575  8907 raft_consensus.cc:2243] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.482410  8907 raft_consensus.cc:2272] T 37db4f6fedfc49e4a401670153431564 P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.484694  8907 tablet_replica.cc:333] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.485154  8907 raft_consensus.cc:2243] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.486114  8907 raft_consensus.cc:2272] T 051db7f6af1d40de85352437916770f1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.488078  8907 tablet_replica.cc:333] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.488556  8907 raft_consensus.cc:2243] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.488984  8907 raft_consensus.cc:2272] T b1f319baf6bd4d04bd7e15bd2123cbed P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.491170  8907 tablet_replica.cc:333] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.491657  8907 raft_consensus.cc:2243] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.492117  8907 raft_consensus.cc:2272] T 2aacfc26793e4bf28e5827e26159662b P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.494180  8907 tablet_replica.cc:333] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.494685  8907 raft_consensus.cc:2243] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.495146  8907 raft_consensus.cc:2272] T 62e39a3f16bd4d5cbe1eba372cb7e3e1 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.497153  8907 tablet_replica.cc:333] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.497666  8907 raft_consensus.cc:2243] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.498122  8907 raft_consensus.cc:2272] T 62389b333b65412ba48dd69a80e8be14 P ef7fc80e188b4c458d42ec37740468df [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.500113  8907 tablet_replica.cc:333] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.500633  8907 raft_consensus.cc:2243] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.501510  8907 raft_consensus.cc:2272] T 95597fb4497541e298059186c9a44a77 P ef7fc80e188b4c458d42ec37740468df [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.503553  8907 tablet_replica.cc:333] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.504029  8907 raft_consensus.cc:2243] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.504463  8907 raft_consensus.cc:2272] T 305a8559734b417591ff6ac5f0609a2e P ef7fc80e188b4c458d42ec37740468df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.506325  8907 tablet_replica.cc:333] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.506834  8907 raft_consensus.cc:2243] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:33.507314  8907 raft_consensus.cc:2272] T d1a349f30cd4492389e44ee0d27ce020 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.509271  8907 tablet_replica.cc:333] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df: stopping tablet replica
I20260709 12:18:33.509734  8907 raft_consensus.cc:2243] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.510576  8907 raft_consensus.cc:2272] T ffbfc451de634f81ac9f6aaf022cf4d9 P ef7fc80e188b4c458d42ec37740468df [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.605815  8907 tablet_server.cc:196] TabletServer@127.8.178.196:0 shutdown complete.
I20260709 12:18:33.674382  8907 master.cc:562] Master@127.8.178.254:34201 shutting down...
I20260709 12:18:33.703539  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:33.704177  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:33.704504  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P ad2bca390f7040c2b77960e7cf1e4c5c: stopping tablet replica
I20260709 12:18:33.726617  8907 master.cc:584] Master@127.8.178.254:34201 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (44908 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:18:33.814229  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:38953
I20260709 12:18:33.815375  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:33.820997 19771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:33.821043 19772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:33.822116 19774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:33.824010  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:33.825212  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:33.825402  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:33.825560  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599513825543 us; error 0 us; skew 500 ppm
I20260709 12:18:33.826068  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:33.828390  8907 webserver.cc:533] Webserver started at http://127.8.178.254:40877/ using document root <none> and password file <none>
I20260709 12:18:33.828861  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:33.829037  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:33.829284  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:33.830551  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "077bc1454ac543538cad3f06ee4df4e4"
format_stamp: "Formatted at 2026-07-09 12:18:33 on dist-test-slave-jlx4"
I20260709 12:18:33.834973  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:18:33.838347 19779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:33.839138  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:18:33.839419  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "077bc1454ac543538cad3f06ee4df4e4"
format_stamp: "Formatted at 2026-07-09 12:18:33 on dist-test-slave-jlx4"
I20260709 12:18:33.839694  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:33.867749  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:33.868952  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:33.905653  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:38953
I20260709 12:18:33.905761 19830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:38953 every 8 connection(s)
I20260709 12:18:33.909492 19831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:33.920187 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4: Bootstrap starting.
I20260709 12:18:33.924883 19831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:33.928966 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4: No bootstrap required, opened a new log
I20260709 12:18:33.931193 19831 raft_consensus.cc:359] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER }
I20260709 12:18:33.931604 19831 raft_consensus.cc:385] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:33.931800 19831 raft_consensus.cc:740] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 077bc1454ac543538cad3f06ee4df4e4, State: Initialized, Role: FOLLOWER
I20260709 12:18:33.932497 19831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER }
I20260709 12:18:33.932925 19831 raft_consensus.cc:399] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:33.933113 19831 raft_consensus.cc:493] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:33.933314 19831 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:33.937954 19831 raft_consensus.cc:515] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER }
I20260709 12:18:33.938472 19831 leader_election.cc:304] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 077bc1454ac543538cad3f06ee4df4e4; no voters: 
I20260709 12:18:33.939563 19831 leader_election.cc:290] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:33.939886 19834 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:33.941488 19834 raft_consensus.cc:697] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 1 LEADER]: Becoming Leader. State: Replica: 077bc1454ac543538cad3f06ee4df4e4, State: Running, Role: LEADER
I20260709 12:18:33.942202 19834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER }
I20260709 12:18:33.942374 19831 sys_catalog.cc:565] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:33.948238 19835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "077bc1454ac543538cad3f06ee4df4e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER } }
I20260709 12:18:33.948861 19835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:33.949388 19836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 077bc1454ac543538cad3f06ee4df4e4. Latest consensus state: current_term: 1 leader_uuid: "077bc1454ac543538cad3f06ee4df4e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "077bc1454ac543538cad3f06ee4df4e4" member_type: VOTER } }
I20260709 12:18:33.950029 19836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:33.951007 19842 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:33.958113 19842 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:33.959148  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:33.966961 19842 catalog_manager.cc:1383] Generated new cluster ID: 0dbf79c0b8394982a729d044ecf9dce3
I20260709 12:18:33.967214 19842 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:33.995455 19842 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:33.996740 19842 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:34.010663 19842 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4: Generated new TSK 0
I20260709 12:18:34.011235 19842 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:34.026320  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:34.032405 19852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:34.033401 19853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:34.037607  8907 server_base.cc:1061] running on GCE node
W20260709 12:18:34.037760 19855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:34.042872  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:34.043110  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:34.043282  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599514043260 us; error 0 us; skew 500 ppm
I20260709 12:18:34.043850  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:34.046227  8907 webserver.cc:533] Webserver started at http://127.8.178.193:39981/ using document root <none> and password file <none>
I20260709 12:18:34.046753  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:34.046931  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:34.047197  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:34.048360  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "6b4f74e723b34d8fa90b9383c67810ca"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.053010  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:34.056521 19860 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.057272  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:34.057564  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "6b4f74e723b34d8fa90b9383c67810ca"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.057842  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:34.082219  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:34.083714  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:34.085271  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:34.087666  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:34.087873  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.088135  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:34.088311  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.126868  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:39275
I20260709 12:18:34.126967 19922 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:39275 every 8 connection(s)
I20260709 12:18:34.132270  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:34.139683 19927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:34.141635 19928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:34.148300 19930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:34.148423  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:34.148329 19923 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38953
I20260709 12:18:34.149232 19923 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:34.150158 19923 heartbeater.cc:507] Master 127.8.178.254:38953 requested a full tablet report, sending...
I20260709 12:18:34.150522  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:34.150853  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:34.151067  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599514151044 us; error 0 us; skew 500 ppm
I20260709 12:18:34.151716  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:34.152585 19796 ts_manager.cc:194] Registered new tserver with Master: 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275)
I20260709 12:18:34.154603  8907 webserver.cc:533] Webserver started at http://127.8.178.194:36053/ using document root <none> and password file <none>
I20260709 12:18:34.155296  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:34.155200 19796 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51390
I20260709 12:18:34.155711  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:34.156090  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:34.157612  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "bb6dcb9197154d10a289a0c4990e9467"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.162261  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:34.167016 19935 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.167807  8907 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:18:34.168115  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "bb6dcb9197154d10a289a0c4990e9467"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.168397  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:34.182328  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:34.183651  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:34.185114  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:34.187403  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:34.187623  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.187858  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:34.188022  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.226373  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:41305
I20260709 12:18:34.226508 19997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:41305 every 8 connection(s)
I20260709 12:18:34.231016  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:34.237939 20001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:34.239753 20002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:34.241400 20004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:34.241989  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:34.242851  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:34.243091  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:34.243160 19998 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38953
I20260709 12:18:34.243294  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599514243275 us; error 0 us; skew 500 ppm
I20260709 12:18:34.243633 19998 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:34.244053  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:34.244354 19998 heartbeater.cc:507] Master 127.8.178.254:38953 requested a full tablet report, sending...
I20260709 12:18:34.246402 19796 ts_manager.cc:194] Registered new tserver with Master: bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:34.246590  8907 webserver.cc:533] Webserver started at http://127.8.178.195:42535/ using document root <none> and password file <none>
I20260709 12:18:34.247162  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:34.247347  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:34.247592  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:34.247798 19796 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51400
I20260709 12:18:34.248783  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.253234  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:34.256711 20009 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.257453  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:18:34.257767  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:34.258062  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:34.267704  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:34.268893  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:34.270416  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:34.272671  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:34.272879  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.273105  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:34.273254  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:34.312008  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:42935
I20260709 12:18:34.312131 20071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:42935 every 8 connection(s)
I20260709 12:18:34.332124 20072 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38953
I20260709 12:18:34.332582 20072 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:34.333287 20072 heartbeater.cc:507] Master 127.8.178.254:38953 requested a full tablet report, sending...
I20260709 12:18:34.335232 19796 ts_manager.cc:194] Registered new tserver with Master: f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.335811  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019440075s
I20260709 12:18:34.336584 19796 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51410
I20260709 12:18:34.361747 19796 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51414:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:34.364503 19796 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:34.441572 19888 tablet_service.cc:1511] Processing CreateTablet for tablet 82e493523f344116afe08795a21c6768 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:34.443107 19888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e493523f344116afe08795a21c6768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.443349 19959 tablet_service.cc:1511] Processing CreateTablet for tablet e0528ac0021d4edf9e5cc754f843334b (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:34.444211 19963 tablet_service.cc:1511] Processing CreateTablet for tablet 82e493523f344116afe08795a21c6768 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:34.444936 19959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0528ac0021d4edf9e5cc754f843334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.445585 19963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e493523f344116afe08795a21c6768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.444716 19958 tablet_service.cc:1511] Processing CreateTablet for tablet efc7b232866c437bbb7d2610b52138d0 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:34.447572 19887 tablet_service.cc:1511] Processing CreateTablet for tablet 10d0b21066174288990933ad1409e96e (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:34.448906 19887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d0b21066174288990933ad1409e96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.455063 19962 tablet_service.cc:1511] Processing CreateTablet for tablet 10d0b21066174288990933ad1409e96e (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:34.455399 19960 tablet_service.cc:1511] Processing CreateTablet for tablet 2773f6718e984e7c895b988b8c007e78 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:34.456936 19886 tablet_service.cc:1511] Processing CreateTablet for tablet abcd0ec65d5a418897d5a59951991218 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:34.458408 19886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd0ec65d5a418897d5a59951991218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.460222 19882 tablet_service.cc:1511] Processing CreateTablet for tablet f32bb100689f44ff96d0c3631465fa29 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:34.461589 19882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bb100689f44ff96d0c3631465fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.457396 19883 tablet_service.cc:1511] Processing CreateTablet for tablet efc7b232866c437bbb7d2610b52138d0 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:34.462632 19883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc7b232866c437bbb7d2610b52138d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.463440 19881 tablet_service.cc:1511] Processing CreateTablet for tablet 136e15ed8590492b993dd306e4992cf8 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:34.465479 19880 tablet_service.cc:1511] Processing CreateTablet for tablet c3c48d12724542d6850c6a2ea7c579b2 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:34.465680 19957 tablet_service.cc:1511] Processing CreateTablet for tablet f32bb100689f44ff96d0c3631465fa29 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:34.467649 19956 tablet_service.cc:1511] Processing CreateTablet for tablet 136e15ed8590492b993dd306e4992cf8 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:34.469563 19955 tablet_service.cc:1511] Processing CreateTablet for tablet c3c48d12724542d6850c6a2ea7c579b2 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:34.470136 19879 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdc77036e1648d2a74b61e7c73a0662 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:34.471592 19961 tablet_service.cc:1511] Processing CreateTablet for tablet abcd0ec65d5a418897d5a59951991218 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:34.472596 19885 tablet_service.cc:1511] Processing CreateTablet for tablet 2773f6718e984e7c895b988b8c007e78 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:34.473047 19958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc7b232866c437bbb7d2610b52138d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.472810 19954 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdc77036e1648d2a74b61e7c73a0662 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:34.474236 19884 tablet_service.cc:1511] Processing CreateTablet for tablet e0528ac0021d4edf9e5cc754f843334b (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:34.474793 19881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136e15ed8590492b993dd306e4992cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.483004 19879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdc77036e1648d2a74b61e7c73a0662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.484143 19885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773f6718e984e7c895b988b8c007e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.486671 19880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c48d12724542d6850c6a2ea7c579b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.490096 19884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0528ac0021d4edf9e5cc754f843334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.496498 19962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d0b21066174288990933ad1409e96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.497418 19957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bb100689f44ff96d0c3631465fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.500975 20037 tablet_service.cc:1511] Processing CreateTablet for tablet 82e493523f344116afe08795a21c6768 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:34.502492 20037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e493523f344116afe08795a21c6768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.503625 20033 tablet_service.cc:1511] Processing CreateTablet for tablet e0528ac0021d4edf9e5cc754f843334b (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:34.504941 20033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0528ac0021d4edf9e5cc754f843334b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.505223 20036 tablet_service.cc:1511] Processing CreateTablet for tablet 10d0b21066174288990933ad1409e96e (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:34.506536 20036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d0b21066174288990933ad1409e96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.507560 20032 tablet_service.cc:1511] Processing CreateTablet for tablet efc7b232866c437bbb7d2610b52138d0 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:34.508898 20032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc7b232866c437bbb7d2610b52138d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.511580 20031 tablet_service.cc:1511] Processing CreateTablet for tablet f32bb100689f44ff96d0c3631465fa29 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:34.512913 20031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bb100689f44ff96d0c3631465fa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.508903 19956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136e15ed8590492b993dd306e4992cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.515676 20030 tablet_service.cc:1511] Processing CreateTablet for tablet 136e15ed8590492b993dd306e4992cf8 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:34.517051 20030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136e15ed8590492b993dd306e4992cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.519888 19955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c48d12724542d6850c6a2ea7c579b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.519574 20028 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdc77036e1648d2a74b61e7c73a0662 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:34.520884 20028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdc77036e1648d2a74b61e7c73a0662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.501075 20035 tablet_service.cc:1511] Processing CreateTablet for tablet abcd0ec65d5a418897d5a59951991218 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:34.522760 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd0ec65d5a418897d5a59951991218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.526749 19954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdc77036e1648d2a74b61e7c73a0662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.519577 20029 tablet_service.cc:1511] Processing CreateTablet for tablet c3c48d12724542d6850c6a2ea7c579b2 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:34.527024 20035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd0ec65d5a418897d5a59951991218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.527729 20029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c48d12724542d6850c6a2ea7c579b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.530102 20034 tablet_service.cc:1511] Processing CreateTablet for tablet 2773f6718e984e7c895b988b8c007e78 (DEFAULT_TABLE table=test-workload [id=a71ba3f8080948e0859ea96f1a280c89]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:34.531471 20034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773f6718e984e7c895b988b8c007e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.534754 19960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2773f6718e984e7c895b988b8c007e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.584748 20086 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.608501 20087 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.659577 20088 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:34.675593 20086 tablet_bootstrap.cc:654] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.676375 20088 tablet_bootstrap.cc:654] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.681339 20086 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:34.681836 20086 ts_tablet_manager.cc:1403] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.005s
I20260709 12:18:34.683362 20087 tablet_bootstrap.cc:654] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.687893 20086 raft_consensus.cc:359] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.688784 20086 raft_consensus.cc:385] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.689097 20086 raft_consensus.cc:740] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.689877 20086 consensus_queue.cc:260] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.692611 19923 heartbeater.cc:499] Master 127.8.178.254:38953 was elected leader, sending a full tablet report...
I20260709 12:18:34.693650 20086 ts_tablet_manager.cc:1434] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:18:34.693754 20088 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:34.694564 20088 ts_tablet_manager.cc:1403] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.010s
I20260709 12:18:34.694821 20086 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.697623 20087 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:34.697324 20088 raft_consensus.cc:359] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.698212 20087 ts_tablet_manager.cc:1403] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.006s
I20260709 12:18:34.698212 20088 raft_consensus.cc:385] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.698865 20088 raft_consensus.cc:740] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.699834 20088 consensus_queue.cc:260] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.700872 20086 tablet_bootstrap.cc:654] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.701467 20087 raft_consensus.cc:359] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.702309 20087 raft_consensus.cc:385] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.702677 20087 raft_consensus.cc:740] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.703637 20087 consensus_queue.cc:260] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.709589 20088 ts_tablet_manager.cc:1434] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:18:34.710686 20072 heartbeater.cc:499] Master 127.8.178.254:38953 was elected leader, sending a full tablet report...
I20260709 12:18:34.713030 19998 heartbeater.cc:499] Master 127.8.178.254:38953 was elected leader, sending a full tablet report...
I20260709 12:18:34.717610 20087 ts_tablet_manager.cc:1434] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:18:34.718910 20087 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.720875 20088 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:34.725744 20087 tablet_bootstrap.cc:654] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.729676 20088 tablet_bootstrap.cc:654] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:34.730397 19999 tablet.cc:2406] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:34.733369 20086 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:34.737954 20086 ts_tablet_manager.cc:1403] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.012s
I20260709 12:18:34.739801 20087 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:34.740494 20087 ts_tablet_manager.cc:1403] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.012s
I20260709 12:18:34.741473 20086 raft_consensus.cc:359] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.743098 20086 raft_consensus.cc:385] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.743484 20086 raft_consensus.cc:740] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.743940 20087 raft_consensus.cc:359] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.744853 20087 raft_consensus.cc:385] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.744516 20086 consensus_queue.cc:260] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.745214 20087 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.746167 20087 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.747014 20086 ts_tablet_manager.cc:1434] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:18:34.748246 20086 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.748556 20087 ts_tablet_manager.cc:1434] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:34.749648 20087 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.753762 20092 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.754329 20092 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.758919 20092 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.760053 20087 tablet_bootstrap.cc:654] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.761740 20088 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:34.762409 20088 ts_tablet_manager.cc:1403] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.011s
I20260709 12:18:34.765942 20088 raft_consensus.cc:359] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.766535 20088 raft_consensus.cc:385] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.766827 20088 raft_consensus.cc:740] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.768321 20086 tablet_bootstrap.cc:654] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.768990 20087 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:34.769601 20087 ts_tablet_manager.cc:1403] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 12:18:34.769995 20088 consensus_queue.cc:260] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.772693 20088 ts_tablet_manager.cc:1434] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:34.777912 20088 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:34.775331 20087 raft_consensus.cc:359] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.776502 20093 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.780622 20093 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.788033 20088 tablet_bootstrap.cc:654] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.788316 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
W20260709 12:18:34.790577 19862 leader_election.cc:343] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.798506 20093 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:34.800460 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
W20260709 12:18:34.802227 20012 leader_election.cc:343] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.802764 20087 raft_consensus.cc:385] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.803117 20087 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.803964 20087 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.804890 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:34.805634 20047 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 0.
I20260709 12:18:34.805847 20086 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:34.806270 20087 ts_tablet_manager.cc:1434] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.003s
I20260709 12:18:34.806404 20086 ts_tablet_manager.cc:1403] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.017s
I20260709 12:18:34.808827 20088 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:34.809629 20088 ts_tablet_manager.cc:1403] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 12:18:34.809571 20086 raft_consensus.cc:359] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.810549 20086 raft_consensus.cc:385] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.810856 20086 raft_consensus.cc:740] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.811602 20086 consensus_queue.cc:260] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.813417 20087 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.813187 20088 raft_consensus.cc:359] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.814123 20088 raft_consensus.cc:385] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.814457 20088 raft_consensus.cc:740] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.815251 20088 consensus_queue.cc:260] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.817428 20088 ts_tablet_manager.cc:1434] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:34.818467 20088 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:34.813787 20086 ts_tablet_manager.cc:1434] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:34.824877 20087 tablet_bootstrap.cc:654] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.825179 20086 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.813410 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:34.827652 19973 raft_consensus.cc:2468] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 0.
I20260709 12:18:34.828939 20011 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:34.830297 20093 raft_consensus.cc:2804] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.830729 20093 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.831058 20093 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.831652 19862 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:34.832310 20088 tablet_bootstrap.cc:654] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.832526 20092 raft_consensus.cc:2804] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.832937 20092 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.833272 20092 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.831552 20086 tablet_bootstrap.cc:654] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.839421 20093 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.841089 20086 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:34.840768 20092 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.841734 20086 ts_tablet_manager.cc:1403] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.005s
I20260709 12:18:34.842480 20087 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:34.843098 20087 ts_tablet_manager.cc:1403] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.004s
I20260709 12:18:34.844347 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:34.844873 20086 raft_consensus.cc:359] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.845621 20086 raft_consensus.cc:385] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.845901 20086 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
W20260709 12:18:34.846089 19862 leader_election.cc:343] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.846597 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:34.846803 20086 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
W20260709 12:18:34.848227 20012 leader_election.cc:343] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.848579 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:34.849270 20047 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.850728 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:34.851445 19973 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:34.858592 20092 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Requested vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.859752 20093 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:34.860836 20047 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 1.
I20260709 12:18:34.863111 20087 raft_consensus.cc:359] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.868291 20087 raft_consensus.cc:385] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.868660 20087 raft_consensus.cc:740] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.868829 19862 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:34.864837 19973 raft_consensus.cc:2468] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:34.869622 20092 raft_consensus.cc:2804] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.869530 20087 consensus_queue.cc:260] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.872862 20088 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:34.873009 20087 ts_tablet_manager.cc:1434] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:18:34.873471 20088 ts_tablet_manager.cc:1403] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.014s
I20260709 12:18:34.871423 20092 raft_consensus.cc:697] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Becoming Leader. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Running, Role: LEADER
I20260709 12:18:34.874037 20087 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.874380 20092 consensus_queue.cc:237] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.876456 20088 raft_consensus.cc:359] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.877256 20088 raft_consensus.cc:385] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.877543 20088 raft_consensus.cc:740] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.867142 20086 ts_tablet_manager.cc:1434] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 12:18:34.870771 20011 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:34.878298 20088 consensus_queue.cc:260] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.878981 20093 raft_consensus.cc:2804] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:34.879410 20086 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.889478 20087 tablet_bootstrap.cc:654] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.892716 20093 raft_consensus.cc:697] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:34.893730 20086 tablet_bootstrap.cc:654] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.893963 20093 consensus_queue.cc:237] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.900314 20087 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:34.900962 20087 ts_tablet_manager.cc:1403] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 12:18:34.902878 20086 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:34.903549 20086 ts_tablet_manager.cc:1403] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:18:34.908069 20086 raft_consensus.cc:359] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.909135 20086 raft_consensus.cc:385] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.909507 20086 raft_consensus.cc:740] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.910876 20087 raft_consensus.cc:359] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.912529 20087 raft_consensus.cc:385] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:34.912865 20087 raft_consensus.cc:740] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:34.912969 19794 catalog_manager.cc:5697] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 1 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:34.913930 20087 consensus_queue.cc:260] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.910485 20086 consensus_queue.cc:260] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.912686 19796 catalog_manager.cc:5697] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193). New cstate: current_term: 1 leader_uuid: "6b4f74e723b34d8fa90b9383c67810ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:34.919867 20087 ts_tablet_manager.cc:1434] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:18:34.921818 20086 ts_tablet_manager.cc:1434] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:18:34.922832 20086 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:34.923313 20088 ts_tablet_manager.cc:1434] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.049s	user 0.020s	sys 0.015s
I20260709 12:18:34.924593 20088 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:34.927795 20086 tablet_bootstrap.cc:654] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.930107 20095 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.930691 20095 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.931092 20087 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:34.939440 20087 tablet_bootstrap.cc:654] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:34.943745 20095 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.943665 20088 tablet_bootstrap.cc:654] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:34.954447 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:34.954629 20092 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.955554 20092 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.958074 20092 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.960330 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
W20260709 12:18:34.962811 19862 leader_election.cc:343] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.970041 20092 raft_consensus.cc:493] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.970709 20092 raft_consensus.cc:515] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:34.972924 20092 leader_election.cc:290] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.974702 20095 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.974963 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:34.975292 20095 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
W20260709 12:18:34.976913 19862 leader_election.cc:343] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.977463 20095 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:34.981681 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:34.982543 19973 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 0.
I20260709 12:18:34.986481 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:34.987996 19862 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:34.988937 20092 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:34.989321 20092 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.989674 20092 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:34.989444 19862 leader_election.cc:343] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:34.990466 19862 leader_election.cc:304] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:34.991477 20107 raft_consensus.cc:2749] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:34.997220 20092 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.000002 20088 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.000560 20088 ts_tablet_manager.cc:1403] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.015s
I20260709 12:18:35.004601 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:35.005218 19973 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.009418 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.009919 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
W20260709 12:18:35.011327 19937 leader_election.cc:343] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:35.012104 19937 leader_election.cc:343] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.013648 19973 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 1.
I20260709 12:18:35.014037 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.014820 19862 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:35.015801 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.017042 20107 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.020596 20086 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:35.021246 20086 ts_tablet_manager.cc:1403] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.099s	user 0.055s	sys 0.039s
W20260709 12:18:35.021528 19862 leader_election.cc:343] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.021742 20107 raft_consensus.cc:697] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Becoming Leader. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Running, Role: LEADER
I20260709 12:18:35.022714 20107 consensus_queue.cc:237] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.023917 20088 raft_consensus.cc:359] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.020524 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.024399 20086 raft_consensus.cc:359] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.024708 20088 raft_consensus.cc:385] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.027513 20088 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.014859 19897 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.028658 19938 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.015861 20092 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Requested vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.029860 20086 raft_consensus.cc:385] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.030241 20086 raft_consensus.cc:740] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.030484 20095 raft_consensus.cc:2749] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:35.030004 19938 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.031080 20086 consensus_queue.cc:260] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.032070 20095 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.032429 20095 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.032760 20095 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.032554 20088 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.033428 20086 ts_tablet_manager.cc:1434] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:18:35.034502 20086 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:35.037524 19796 catalog_manager.cc:5697] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193). New cstate: current_term: 1 leader_uuid: "6b4f74e723b34d8fa90b9383c67810ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.041251 20086 tablet_bootstrap.cc:654] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.042884 20088 ts_tablet_manager.cc:1434] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.005s
I20260709 12:18:35.043275 20087 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:35.043947 20087 ts_tablet_manager.cc:1403] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.113s	user 0.030s	sys 0.031s
I20260709 12:18:35.047281 20088 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:35.041244 20095 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.049491 20095 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.050746 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.050354 20087 raft_consensus.cc:359] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.051514 20087 raft_consensus.cc:385] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.051908 20087 raft_consensus.cc:740] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.052712 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.053377 19897 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.053036 20087 consensus_queue.cc:260] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
W20260709 12:18:35.058753 19937 leader_election.cc:343] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.061347 20087 ts_tablet_manager.cc:1434] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:18:35.062330 19897 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.062875 20087 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:35.063632 19938 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.064854 20095 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.066732 20109 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.067512 20086 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:35.067328 20109 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.068068 20086 ts_tablet_manager.cc:1403] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.016s
I20260709 12:18:35.071333 20086 raft_consensus.cc:359] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.072062 20086 raft_consensus.cc:385] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.072345 20086 raft_consensus.cc:740] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.073035 20086 consensus_queue.cc:260] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.074530 20095 raft_consensus.cc:697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:35.075489 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.076539 20086 ts_tablet_manager.cc:1434] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:35.077149 20088 tablet_bootstrap.cc:654] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.077697 20086 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:35.075489 20095 consensus_queue.cc:237] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
W20260709 12:18:35.078529 20011 leader_election.cc:343] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.073280 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
W20260709 12:18:35.080260 20012 leader_election.cc:343] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.080724 20012 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:35.081568 20093 raft_consensus.cc:2749] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:35.084493 20086 tablet_bootstrap.cc:654] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.085383 20087 tablet_bootstrap.cc:654] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.087891 20109 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.090675 20088 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.091408 20088 ts_tablet_manager.cc:1403] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.011s
I20260709 12:18:35.094609 20088 raft_consensus.cc:359] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.095336 20088 raft_consensus.cc:385] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.095650 20088 raft_consensus.cc:740] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.096518 20092 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.096369 20088 consensus_queue.cc:260] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.097114 20092 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.099256 20092 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.099644 20086 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:35.100335 20086 ts_tablet_manager.cc:1403] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:18:35.101037 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.101089 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.102979 19973 raft_consensus.cc:2393] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b4f74e723b34d8fa90b9383c67810ca in current term 1: Already voted for candidate f1f2e9dce3fd4c3d810956924bf9082b in this term.
I20260709 12:18:35.103876 20086 raft_consensus.cc:359] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.104709 20086 raft_consensus.cc:385] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.105051 20086 raft_consensus.cc:740] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.104825 19862 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.106508 20088 ts_tablet_manager.cc:1434] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:18:35.105966 20086 consensus_queue.cc:260] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.108850 20086 ts_tablet_manager.cc:1434] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:35.110028 20086 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:35.107074 20092 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.115686 20088 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:35.116155 20086 tablet_bootstrap.cc:654] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.122682 20088 tablet_bootstrap.cc:654] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.129472 20086 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:35.131240 20086 ts_tablet_manager.cc:1403] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:18:35.124715 19796 catalog_manager.cc:5697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.134186 20088 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.135073 20088 ts_tablet_manager.cc:1403] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:18:35.138006 20088 raft_consensus.cc:359] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.138738 20088 raft_consensus.cc:385] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.138936 20087 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:35.134181 20086 raft_consensus.cc:359] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.139580 20087 ts_tablet_manager.cc:1403] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.020s
I20260709 12:18:35.139856 20086 raft_consensus.cc:385] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.140149 20086 raft_consensus.cc:740] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.140791 20086 consensus_queue.cc:260] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.142758 20086 ts_tablet_manager.cc:1434] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:18:35.142608 20087 raft_consensus.cc:359] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.143404 20087 raft_consensus.cc:385] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.143714 20087 raft_consensus.cc:740] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.130057 20092 raft_consensus.cc:2749] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:35.143810 20086 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:35.139027 20088 raft_consensus.cc:740] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.145309 20088 consensus_queue.cc:260] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.147583 20088 ts_tablet_manager.cc:1434] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:18:35.148607 20088 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:35.150580 20086 tablet_bootstrap.cc:654] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.144495 20087 consensus_queue.cc:260] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.153916 20087 ts_tablet_manager.cc:1434] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:18:35.155094 20087 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:35.155112 20088 tablet_bootstrap.cc:654] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.150771 20095 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.157596 20095 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.160727 20095 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.162003 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.162571 20087 tablet_bootstrap.cc:654] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:35.163305 19937 leader_election.cc:343] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.164341 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.165024 19898 raft_consensus.cc:2468] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.166740 19938 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.167984 20095 raft_consensus.cc:2804] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.168340 20095 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.168653 20095 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.181452 20086 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: No bootstrap required, opened a new log
I20260709 12:18:35.181107 20095 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.182124 20086 ts_tablet_manager.cc:1403] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.011s
I20260709 12:18:35.183421 20095 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.181496 20087 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:35.184226 20087 ts_tablet_manager.cc:1403] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 12:18:35.184355 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.184988 19898 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.184844 20086 raft_consensus.cc:359] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.185546 20086 raft_consensus.cc:385] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.185809 20086 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.186172 20087 raft_consensus.cc:359] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.186484 20086 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.186853 20087 raft_consensus.cc:385] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.186839 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.192114 20088 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.188606 20086 ts_tablet_manager.cc:1434] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:35.193938 20087 raft_consensus.cc:740] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.194960 20088 ts_tablet_manager.cc:1403] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.019s
I20260709 12:18:35.195104 20109 raft_consensus.cc:493] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.188617 19937 leader_election.cc:343] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:35.195384 20087 consensus_queue.cc:260] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.195652 20109 raft_consensus.cc:515] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.198153 20087 ts_tablet_manager.cc:1434] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:18:35.199057 20087 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:35.199978 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.200667 19897 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 0.
I20260709 12:18:35.200986 20088 raft_consensus.cc:359] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.201714 20088 raft_consensus.cc:385] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.201901 20095 raft_consensus.cc:493] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.202746 20109 leader_election.cc:290] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.202564 20095 raft_consensus.cc:515] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.194264 19898 raft_consensus.cc:2468] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.204448 19938 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:35.204851 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.204468 20012 leader_election.cc:304] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.205612 19973 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 0.
I20260709 12:18:35.205870 20109 raft_consensus.cc:2804] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.206091 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.201979 20088 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.207736 20109 raft_consensus.cc:493] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.206919 20046 raft_consensus.cc:2468] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.208276 20109 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.207175 20125 raft_consensus.cc:2804] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.208885 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.210778 19898 raft_consensus.cc:2468] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.211916 19938 leader_election.cc:304] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:35.204695 20087 tablet_bootstrap.cc:654] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.208930 20095 leader_election.cc:290] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.217010 20095 raft_consensus.cc:2804] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.218165 20095 raft_consensus.cc:493] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.219059 20095 raft_consensus.cc:3060] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.220054 20109 raft_consensus.cc:515] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.222942 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.223222 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:35.223482 20125 raft_consensus.cc:697] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:35.223869 19973 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.224306 20087 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:35.224967 20087 ts_tablet_manager.cc:1403] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 12:18:35.225363 19898 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.226336 20095 raft_consensus.cc:515] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.224388 20125 consensus_queue.cc:237] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.229192 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.229772 19897 raft_consensus.cc:3060] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.230549 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.231170 20046 raft_consensus.cc:3060] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.230861 20087 raft_consensus.cc:359] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.231947 20087 raft_consensus.cc:385] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.232283 20087 raft_consensus.cc:740] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.207753 20088 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.233081 20087 consensus_queue.cc:260] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.234104 20088 ts_tablet_manager.cc:1434] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
I20260709 12:18:35.235528 20087 ts_tablet_manager.cc:1434] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:35.237128 20088 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:35.232424 19898 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:35.237272 20087 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: Bootstrap starting.
I20260709 12:18:35.239414 20012 leader_election.cc:304] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.240309 20093 raft_consensus.cc:2804] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.240983 20093 raft_consensus.cc:697] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:35.241832 20093 consensus_queue.cc:237] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.243640 20095 leader_election.cc:290] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.244019 19973 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:35.240289 20046 raft_consensus.cc:2468] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.245592 19897 raft_consensus.cc:2468] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.246977 19937 leader_election.cc:304] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.245850 20109 leader_election.cc:290] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.248395 20095 raft_consensus.cc:2804] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.249105 20095 raft_consensus.cc:697] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:35.249997 20095 consensus_queue.cc:237] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.254171 20087 tablet_bootstrap.cc:654] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.254716 19794 catalog_manager.cc:5697] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.258133 20088 tablet_bootstrap.cc:654] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.259660 20087 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: No bootstrap required, opened a new log
I20260709 12:18:35.260365 20087 ts_tablet_manager.cc:1403] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 12:18:35.266831 19796 catalog_manager.cc:5697] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 1 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.267472 20087 raft_consensus.cc:359] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.268265 20087 raft_consensus.cc:385] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.268551 20087 raft_consensus.cc:740] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.269234 20087 consensus_queue.cc:260] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.271543 20087 ts_tablet_manager.cc:1434] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.005s
I20260709 12:18:35.279608 20088 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.280134 20088 ts_tablet_manager.cc:1403] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.015s
I20260709 12:18:35.282882 20088 raft_consensus.cc:359] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.282487 19796 catalog_manager.cc:5697] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.283573 20088 raft_consensus.cc:385] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.283862 20088 raft_consensus.cc:740] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.284566 20088 consensus_queue.cc:260] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.286478 20088 ts_tablet_manager.cc:1434] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:18:35.287616 20088 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: Bootstrap starting.
I20260709 12:18:35.292676 20088 tablet_bootstrap.cc:654] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:35.298527 20088 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: No bootstrap required, opened a new log
I20260709 12:18:35.299026 20088 ts_tablet_manager.cc:1403] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:18:35.301262 20088 raft_consensus.cc:359] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.301751 20088 raft_consensus.cc:385] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:35.301923 20088 raft_consensus.cc:740] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Initialized, Role: FOLLOWER
I20260709 12:18:35.302546 20095 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.302407 20088 consensus_queue.cc:260] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.303066 20095 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.304566 20088 ts_tablet_manager.cc:1434] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:18:35.305261 20095 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.306068 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.306181 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.306854 19898 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.306905 20046 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 0.
I20260709 12:18:35.308120 19937 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.308717 20095 raft_consensus.cc:2804] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.309052 20095 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.309301 20095 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.314985 19973 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.315348 20095 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.317333 20095 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.318010 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.318363 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.318727 19898 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.318969 20046 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.323491 20092 consensus_queue.cc:1048] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.324735 20107 consensus_queue.cc:1048] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.327373 19898 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.329246 20046 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:35.330346 19937 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.331205 20095 raft_consensus.cc:2804] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.331681 20095 raft_consensus.cc:697] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:35.332490 20095 consensus_queue.cc:237] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.351385 19796 catalog_manager.cc:5697] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.455559 20093 consensus_queue.cc:1048] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.460492 20092 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.461650 20047 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.464474 20046 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.468528 20109 consensus_queue.cc:1048] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.473886 20107 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.487901 20095 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.513218 20125 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.522967 20107 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.523407 20107 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.525202 20107 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.526183 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:35.526149 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.526978 20046 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 0.
I20260709 12:18:35.527087 19973 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 0.
I20260709 12:18:35.527961 19862 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.528605 20107 raft_consensus.cc:2804] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.528964 20107 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.529316 20107 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.534611 20107 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.536180 20107 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Requested vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:35.536932 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:35.537168 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:35.537472 19973 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.537740 20046 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.542807 19973 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 1.
I20260709 12:18:35.542807 20046 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 1.
I20260709 12:18:35.544014 19862 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:35.544661 20107 raft_consensus.cc:2804] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.545024 20107 raft_consensus.cc:697] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Becoming Leader. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Running, Role: LEADER
I20260709 12:18:35.545763 20107 consensus_queue.cc:237] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.552166 19796 catalog_manager.cc:5697] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193). New cstate: current_term: 1 leader_uuid: "6b4f74e723b34d8fa90b9383c67810ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.593004 20110 raft_consensus.cc:493] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.593550 20110 raft_consensus.cc:515] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.595233 20110 leader_election.cc:290] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.596172 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.596241 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.596854 19898 raft_consensus.cc:2468] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 0.
I20260709 12:18:35.596952 19973 raft_consensus.cc:2468] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 0.
I20260709 12:18:35.597847 20012 leader_election.cc:304] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.598625 20110 raft_consensus.cc:2804] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:35.598901 20110 raft_consensus.cc:493] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.599162 20110 raft_consensus.cc:3060] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.604292 20110 raft_consensus.cc:515] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.605906 20110 leader_election.cc:290] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.606848 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:35.606806 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:35.607620 19973 raft_consensus.cc:3060] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.607649 19898 raft_consensus.cc:3060] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.615082 19898 raft_consensus.cc:2468] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:35.615083 19973 raft_consensus.cc:2468] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:35.616341 20011 leader_election.cc:304] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:35.617031 20110 raft_consensus.cc:2804] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:35.617483 20110 raft_consensus.cc:697] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:35.618218 20110 consensus_queue.cc:237] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.625118 19796 catalog_manager.cc:5697] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 0 to 1, leader changed from <none> to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 1 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.666879 20110 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.667503 20110 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:35.669221 20110 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:35.670121 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:35.670362 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:35.671041 19898 raft_consensus.cc:2393] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1f2e9dce3fd4c3d810956924bf9082b in current term 1: Already voted for candidate bb6dcb9197154d10a289a0c4990e9467 in this term.
I20260709 12:18:35.671986 20012 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:35.672605 20110 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:35.677441 20110 raft_consensus.cc:2749] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:35.682004 20110 consensus_queue.cc:1048] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.693712 20125 consensus_queue.cc:1048] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.696673 20109 consensus_queue.cc:1048] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.703368 20136 consensus_queue.cc:1048] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.713833 20125 consensus_queue.cc:1048] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.722451 20125 consensus_queue.cc:1048] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.748746 20125 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:35.759878 20162 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:35.840619  8907 ts_manager.cc:295] Set tserver state for 6b4f74e723b34d8fa90b9383c67810ca to MAINTENANCE_MODE
I20260709 12:18:35.841485  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
I20260709 12:18:35.864581  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:35.865247  8907 tablet_replica.cc:333] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.865816  8907 raft_consensus.cc:2243] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.866271  8907 raft_consensus.cc:2272] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.868652  8907 tablet_replica.cc:333] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.869240  8907 raft_consensus.cc:2243] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:35.869855  8907 pending_rounds.cc:70] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Trying to abort 1 pending ops.
I20260709 12:18:35.870093  8907 pending_rounds.cc:77] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623615682068480 op_type: NO_OP noop_request { }
I20260709 12:18:35.870612  8907 raft_consensus.cc:2889] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:35.870898  8907 raft_consensus.cc:2272] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.873180  8907 tablet_replica.cc:333] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.873741  8907 raft_consensus.cc:2243] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.874167  8907 raft_consensus.cc:2272] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.876463  8907 tablet_replica.cc:333] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.877015  8907 raft_consensus.cc:2243] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.877377  8907 raft_consensus.cc:2272] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.879228  8907 tablet_replica.cc:333] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.879726  8907 raft_consensus.cc:2243] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.880122  8907 raft_consensus.cc:2272] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.882277  8907 tablet_replica.cc:333] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.882838  8907 raft_consensus.cc:2243] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.883244  8907 raft_consensus.cc:2272] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.885452  8907 tablet_replica.cc:333] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.885975  8907 raft_consensus.cc:2243] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.886368  8907 raft_consensus.cc:2272] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.888796  8907 tablet_replica.cc:333] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.889446  8907 raft_consensus.cc:2243] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:35.890198  8907 raft_consensus.cc:2272] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.892769  8907 tablet_replica.cc:333] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.893229  8907 raft_consensus.cc:2243] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:35.893575  8907 raft_consensus.cc:2272] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.895715  8907 tablet_replica.cc:333] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: stopping tablet replica
I20260709 12:18:35.896183  8907 raft_consensus.cc:2243] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:35.896885  8907 raft_consensus.cc:2272] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:35.924618  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
W20260709 12:18:35.955801 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:36.012326 20012 consensus_peers.cc:597] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.068228 20012 consensus_peers.cc:597] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.082938 19938 consensus_peers.cc:597] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:36.121234 20093 consensus_queue.cc:1048] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:36.238830 19938 consensus_peers.cc:597] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.277117 19938 consensus_peers.cc:597] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.291123 19938 consensus_peers.cc:597] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.310552 20012 consensus_peers.cc:597] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:36.700754 19938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111) [suppressed 185 similar messages]
W20260709 12:18:36.956832 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:37.002543 20093 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.003155 20093 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.005088 20093 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:37.006145 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
W20260709 12:18:37.008477 20012 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.008837 20012 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:37.009428 20093 raft_consensus.cc:2749] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:37.293000 20162 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.293556 20162 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.295107 20162 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:37.296164 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
W20260709 12:18:37.298295 19938 leader_election.cc:336] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.298709 19938 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:37.299341 20162 raft_consensus.cc:2749] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:37.322096 20093 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.322656 20093 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.324445 20093 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:37.325536 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:37.326212 19973 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 1.
I20260709 12:18:37.327158 20011 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:37.327768 20093 raft_consensus.cc:2804] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:37.327812 20012 leader_election.cc:336] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.328083 20093 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.328397 20093 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.333196 20093 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.334888 20093 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:37.335908 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:37.336552 19973 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:37.338104 20012 leader_election.cc:336] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.342029 19973 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:37.343047 20011 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:37.343923 20093 raft_consensus.cc:2804] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:37.344314 20093 raft_consensus.cc:697] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:37.344907 20093 consensus_queue.cc:237] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.352082 19795 catalog_manager.cc:5697] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 1 to 2, leader changed from 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 2 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:37.392153 20162 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.392714 20162 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.394335 20162 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:37.395428 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:37.396129 20046 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:37.397028 19937 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:37.397686 20162 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:37.397763 19938 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.398020 20162 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:37.398340 20162 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.403295 20162 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.404771 20162 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:37.405786 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:37.406387 20046 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:37.408262 19938 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.411846 20046 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:37.412878 19937 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:37.413544 20162 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:37.414350 20162 raft_consensus.cc:697] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:37.415071 20162 consensus_queue.cc:237] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.421713 19795 catalog_manager.cc:5697] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 1 to 2, leader changed from 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.617857 20162 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.618315 20162 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.619911 20162 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:37.621100 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:37.621771 20046 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 1.
I20260709 12:18:37.622713 19937 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
W20260709 12:18:37.623157 19938 leader_election.cc:336] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.623363 20162 raft_consensus.cc:2804] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:37.623771 20162 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.624024 20162 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:37.629473 20162 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.631254 20162 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:37.632213 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:37.632743 20046 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:37.634670 19938 leader_election.cc:336] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:37.638023 20046 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:37.639006 19937 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:37.639678 20162 raft_consensus.cc:2804] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:37.640115 20162 raft_consensus.cc:697] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:37.640925 20162 consensus_queue.cc:237] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:37.647707 19795 catalog_manager.cc:5697] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 1 to 2, leader changed from 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:37.833946 19973 raft_consensus.cc:1275] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:37.835189 20093 consensus_queue.cc:1048] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:37.843972 19938 consensus_peers.cc:597] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:37.850698 20012 consensus_peers.cc:597] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:37.866472 20046 raft_consensus.cc:1275] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:37.867802 20162 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:37.957674 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:38.029898 20045 raft_consensus.cc:1275] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:38.031159 20162 consensus_queue.cc:1048] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:38.042994 19938 consensus_peers.cc:597] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:38.307513 20012 consensus_peers.cc:597] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.461520 20012 consensus_peers.cc:597] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.594348 19938 consensus_peers.cc:597] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.659284 19938 consensus_peers.cc:597] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.780824 19938 consensus_peers.cc:597] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.830509 19938 consensus_peers.cc:597] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.953393 20012 consensus_peers.cc:597] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:38.958633 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:39.959667 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:40.271226 19938 consensus_peers.cc:597] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:40.412798 19938 consensus_peers.cc:597] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:40.448141 20012 consensus_peers.cc:597] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:40.876221 19938 consensus_peers.cc:597] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:40.943774  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:40.951416 20191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:40.951930 20192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:40.952057 20194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:40.953697  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:40.956805  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:40.957026  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:40.957211  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599520957192 us; error 0 us; skew 500 ppm
I20260709 12:18:40.957732  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:40.960158  8907 webserver.cc:533] Webserver started at http://127.8.178.193:39981/ using document root <none> and password file <none>
W20260709 12:18:40.960562 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:40.960611  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:40.961032  8907 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:18:40.964490  8907 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:18:40.967955 20199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:40.968755  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:40.969015  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "6b4f74e723b34d8fa90b9383c67810ca"
format_stamp: "Formatted at 2026-07-09 12:18:34 on dist-test-slave-jlx4"
I20260709 12:18:40.969259  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:40.978756  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:40.980060  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:40.981506  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:18:40.983274 19938 consensus_peers.cc:597] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:40.985357 20206 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:18:41.005885 20012 consensus_peers.cc:597] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:41.037205  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:18:41.037667  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:18:41.037992  8907 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:18:41.042760 20206 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.053601 20206 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.054275 20206 tablet_bootstrap.cc:492] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.054838 20206 ts_tablet_manager.cc:1403] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 12:18:41.056901 20206 raft_consensus.cc:359] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.057425 20206 raft_consensus.cc:740] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.058036 20206 consensus_queue.cc:260] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.060608 20206 ts_tablet_manager.cc:1434] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:18:41.061502 20206 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.076036 20206 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.076771 20206 tablet_bootstrap.cc:492] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.077337 20206 ts_tablet_manager.cc:1403] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 12:18:41.078830  8907 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:18:41.079138  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.038s	sys 0.003s
I20260709 12:18:41.079411 20206 raft_consensus.cc:359] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.079993 20206 raft_consensus.cc:740] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.080828 20206 consensus_queue.cc:260] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.082799 20206 ts_tablet_manager.cc:1434] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:18:41.083482 20206 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.095948 20206 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.096693 20206 tablet_bootstrap.cc:492] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.097420 20206 ts_tablet_manager.cc:1403] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:18:41.099710 20206 raft_consensus.cc:359] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.100250 20206 raft_consensus.cc:740] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.100907 20206 consensus_queue.cc:260] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.102698 20206 ts_tablet_manager.cc:1434] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:41.103340 20206 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.113178 20206 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.113835 20206 tablet_bootstrap.cc:492] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.114329 20206 ts_tablet_manager.cc:1403] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:18:41.116546 20206 raft_consensus.cc:359] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.117203 20206 raft_consensus.cc:740] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.117949 20206 consensus_queue.cc:260] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.120111 20206 ts_tablet_manager.cc:1434] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:41.120739 20206 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
W20260709 12:18:41.123765 20012 consensus_peers.cc:597] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:41.131353 20206 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.132052 20206 tablet_bootstrap.cc:492] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.132530 20206 ts_tablet_manager.cc:1403] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:18:41.134486 20206 raft_consensus.cc:359] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.134968 20206 raft_consensus.cc:740] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.135538 20206 consensus_queue.cc:260] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.136914 20206 ts_tablet_manager.cc:1434] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:18:41.136991  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:39275
I20260709 12:18:41.137552 20206 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.137070 20268 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:39275 every 8 connection(s)
I20260709 12:18:41.141881  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.156638 20206 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.157956 20206 tablet_bootstrap.cc:492] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.158802 20206 ts_tablet_manager.cc:1403] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 12:18:41.162088 20206 raft_consensus.cc:359] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.162896 20206 raft_consensus.cc:740] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.163757 20206 consensus_queue.cc:260] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.165450 20206 ts_tablet_manager.cc:1434] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:18:41.166313 20206 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.168599 20269 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38953
I20260709 12:18:41.169003 20269 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:41.169739 20269 heartbeater.cc:507] Master 127.8.178.254:38953 requested a full tablet report, sending...
I20260709 12:18:41.173270 20046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:41.174036 20046 raft_consensus.cc:606] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:41.176545 19794 ts_manager.cc:194] Re-registered known tserver with Master: 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275)
I20260709 12:18:41.178495 20206 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:18:41.179610 20206 tablet_bootstrap.cc:492] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.180282 20206 ts_tablet_manager.cc:1403] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:18:41.182687 20206 raft_consensus.cc:359] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.183550 20206 raft_consensus.cc:740] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.184144 20206 consensus_queue.cc:260] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.185882 20206 ts_tablet_manager.cc:1434] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:18:41.186322 19794 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59206
I20260709 12:18:41.186738 20206 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.191886 20269 heartbeater.cc:499] Master 127.8.178.254:38953 was elected leader, sending a full tablet report...
I20260709 12:18:41.193281 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:41.193933 19973 raft_consensus.cc:606] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:41.199791 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:41.200553 19973 raft_consensus.cc:606] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:41.202351  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:41.202977  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:41.203755  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.206135 20206 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.207139 20206 tablet_bootstrap.cc:492] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.207866 20206 ts_tablet_manager.cc:1403] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 12:18:41.210361 20206 raft_consensus.cc:359] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.211117 20206 raft_consensus.cc:740] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.211834 20241 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.211932 20206 consensus_queue.cc:260] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.214195 20206 ts_tablet_manager.cc:1434] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:41.215029 20206 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.229943 20206 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.230237 20190 raft_consensus.cc:993] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:41.230834 20189 raft_consensus.cc:1081] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:41.230957 20206 tablet_bootstrap.cc:492] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.232206 20206 ts_tablet_manager.cc:1403] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:18:41.232708 20046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:41.233377 20046 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.233738 20046 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.234535 20206 raft_consensus.cc:359] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.235240 20206 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.236033 20206 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.238054 20206 ts_tablet_manager.cc:1434] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:41.238901 20206 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap starting.
I20260709 12:18:41.241209 20046 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.243463 20046 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:41.246080 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:41.246691 19973 raft_consensus.cc:3055] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.247000 19973 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:41.247781 19973 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.249030 19973 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.256006 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
W20260709 12:18:41.257266 20012 leader_election.cc:343] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:41.258983 19973 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:41.260097 20011 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:41.260735 20109 raft_consensus.cc:2804] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:41.261027 20206 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:41.261736 20206 tablet_bootstrap.cc:492] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Bootstrap complete.
I20260709 12:18:41.261938 20109 raft_consensus.cc:697] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:41.262247 20206 ts_tablet_manager.cc:1403] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 12:18:41.262851 20109 consensus_queue.cc:237] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.264273 20206 raft_consensus.cc:359] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.264767 20206 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:41.265291 20206 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.267124 20206 ts_tablet_manager.cc:1434] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:41.270170 19794 catalog_manager.cc:5697] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 1 to 2, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 2 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.353804 20241 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.358631 20241 pending_rounds.cc:85] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Aborting all ops after (but not including) 0
I20260709 12:18:41.358831 20241 pending_rounds.cc:107] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:18:41.359131 20241 raft_consensus.cc:2889] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.372267 20284 raft_consensus.cc:993] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:41.372704 20284 raft_consensus.cc:1081] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:41.374047 19973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:41.374547 19973 raft_consensus.cc:493] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.374831 19973 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.379287 19973 raft_consensus.cc:515] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.380815 19973 leader_election.cc:290] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:41.381924 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:41.382242 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:41.382660 20046 raft_consensus.cc:3055] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.382884 20241 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.383108 20046 raft_consensus.cc:740] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:41.384020 20046 consensus_queue.cc:260] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.385270 20046 raft_consensus.cc:3060] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.389779 20241 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:41.390911 19938 leader_election.cc:304] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:41.391531 20189 raft_consensus.cc:2804] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:41.391660 20046 raft_consensus.cc:2468] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:41.392031 20189 raft_consensus.cc:697] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:41.392838 20189 consensus_queue.cc:237] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.399626 19795 catalog_manager.cc:5697] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 1 to 2, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.496639 20241 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.594976 20190 raft_consensus.cc:993] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:41.595443 20189 raft_consensus.cc:1081] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:41.596837 20046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:41.597318 20046 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:41.597734 20046 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.603322 20046 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.604763 20046 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:41.605607 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:41.605839 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:41.606276 20241 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.606364 19973 raft_consensus.cc:3055] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:41.606794 19973 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:41.607520 19973 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.608702 19973 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.613376 20241 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:41.614715 20012 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:41.615303 19973 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:41.615532 20284 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:41.616060 20284 raft_consensus.cc:697] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:41.616777 20284 consensus_queue.cc:237] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:41.623745 19795 catalog_manager.cc:5697] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 1 to 2, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 2 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.809643 20241 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:41.814790 20241 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.816088 20284 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:41.818261 20046 raft_consensus.cc:1275] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.819828 20295 consensus_queue.cc:1048] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:41.832901 19973 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.834556 20298 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:41.841198 20241 raft_consensus.cc:1275] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:41.843212 20189 consensus_queue.cc:1048] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:41.961581 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:42.051858 20241 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.053040 20298 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:42.062259 19973 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.063670 20109 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:42.213699  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.220638 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:42.221112 19973 raft_consensus.cc:606] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:42.223248 20046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e493523f344116afe08795a21c6768"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:42.223675 20046 raft_consensus.cc:606] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:42.225692 20046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:42.226059 20046 raft_consensus.cc:606] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:42.226995  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:42.227447  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:42.227972  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.365175 20298 raft_consensus.cc:993] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:42.365682 20109 raft_consensus.cc:1081] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:42.367208 19973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:42.367745 19973 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.368088 19973 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.373114 19973 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.374462 19973 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:42.375286 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:42.375515 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:42.375970 20241 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.376008 20046 raft_consensus.cc:3055] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.376444 20046 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:42.377193 20046 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.378356 20046 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.383490 20241 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:42.384860 19938 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:42.385087 20046 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:42.385682 20189 raft_consensus.cc:2804] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.387058 20189 raft_consensus.cc:697] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:42.387717 20189 consensus_queue.cc:237] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.391031 20298 raft_consensus.cc:993] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:42.391461 20109 raft_consensus.cc:1081] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:42.393098 19973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82e493523f344116afe08795a21c6768"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:42.393623 19973 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.393965 19973 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.394404 19796 catalog_manager.cc:5697] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 2 to 3, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.399780 19973 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.401959 19973 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:42.402786 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:42.403590 20243 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.403674 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:42.404598 20045 raft_consensus.cc:3055] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:42.404819 20045 raft_consensus.cc:740] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:42.405471 20045 consensus_queue.cc:260] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.406306 20045 raft_consensus.cc:3060] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:42.411552 20243 raft_consensus.cc:2468] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:42.412873 19938 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:42.413097 20045 raft_consensus.cc:2468] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 2.
I20260709 12:18:42.413640 20306 raft_consensus.cc:2804] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:42.414047 20306 raft_consensus.cc:697] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:42.414861 20306 consensus_queue.cc:237] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.422272 19796 catalog_manager.cc:5697] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 1 to 2, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.564015 20189 raft_consensus.cc:993] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:42.564464 20306 raft_consensus.cc:1081] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:42.565938 20045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:42.566413 20045 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.566751 20045 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.571853 20045 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.573460 20045 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:42.574235 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:42.574548 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:42.574892 20243 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.575083 19973 raft_consensus.cc:3055] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.575387 19973 raft_consensus.cc:740] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:42.575994 19973 consensus_queue.cc:260] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.576872 19973 raft_consensus.cc:3060] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.580053 20243 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 3.
I20260709 12:18:42.581233 20012 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:42.581914 20109 raft_consensus.cc:2804] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.582077 19973 raft_consensus.cc:2468] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 3.
I20260709 12:18:42.582319 20109 raft_consensus.cc:697] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:42.583658 20109 consensus_queue.cc:237] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:42.590487 19796 catalog_manager.cc:5697] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 2 to 3, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 3 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.893194 20045 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.894340 20189 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.904386 20243 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.906679 20306 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.941367 20243 raft_consensus.cc:1275] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.942610 20306 consensus_queue.cc:1048] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:42.952564 20045 raft_consensus.cc:1275] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:42.953958 20189 consensus_queue.cc:1048] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:42.962385 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:43.110491 20243 raft_consensus.cc:1275] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:43.112142 20298 consensus_queue.cc:1048] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:43.127060 19973 raft_consensus.cc:1275] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:43.129345 20324 consensus_queue.cc:1048] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:43.234402  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.243571 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:43.244252 19973 raft_consensus.cc:606] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:43.246734 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:43.247171 19973 raft_consensus.cc:606] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:43.249603 20045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:43.250084 20045 raft_consensus.cc:606] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:43.251335  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:43.251822  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.252540  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.371399 20295 raft_consensus.cc:993] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:43.371876 20189 raft_consensus.cc:1081] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:43.373373 20045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:43.373881 20045 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:43.374169 20045 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.382247 20045 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.384121 20045 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:43.385259 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:43.385337 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:43.386143 20243 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.386174 19973 raft_consensus.cc:3055] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:43.386775 19973 raft_consensus.cc:740] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:43.387763 19973 consensus_queue.cc:260] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.388810 19973 raft_consensus.cc:3060] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:43.393095 20243 raft_consensus.cc:2468] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:43.394583 20012 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:43.395457 20324 raft_consensus.cc:2804] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:43.395478 19973 raft_consensus.cc:2468] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 2.
I20260709 12:18:43.395892 20324 raft_consensus.cc:697] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:43.397035 20324 consensus_queue.cc:237] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.403827 19794 catalog_manager.cc:5697] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 1 to 2, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 2 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.460354 20314 raft_consensus.cc:993] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:43.460767 20189 raft_consensus.cc:1081] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:43.462198 20045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:43.462713 20045 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:43.462975 20045 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.468343 20045 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.470068 20045 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:43.470954 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:43.471117 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:43.471688 20243 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.471731 19973 raft_consensus.cc:3055] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:43.472116 19973 raft_consensus.cc:740] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:43.472818 19973 consensus_queue.cc:260] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.473801 19973 raft_consensus.cc:3060] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.477576 20243 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 4.
I20260709 12:18:43.478735 20012 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:43.479410 20324 raft_consensus.cc:2804] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:43.479789 20324 raft_consensus.cc:697] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:43.479863 19973 raft_consensus.cc:2468] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 4.
I20260709 12:18:43.480971 20324 consensus_queue.cc:237] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.487433 19794 catalog_manager.cc:5697] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 3 to 4, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 4 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.673806 20324 raft_consensus.cc:993] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:43.674283 20298 raft_consensus.cc:1081] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:43.675871 19973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:43.676306 19973 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:43.676529 19973 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.682570 19973 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.684470 19973 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:43.685164 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:43.685827 20243 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.687986 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:43.688541 20045 raft_consensus.cc:3055] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:43.688782 20045 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:43.689769 20045 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.690912 20045 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:43.692392 20243 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:43.693501 19938 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:43.694221 20189 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:43.694725 20189 raft_consensus.cc:697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:43.695688 20189 consensus_queue.cc:237] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:43.696995 20045 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:43.702996 19794 catalog_manager.cc:5697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 2 to 3, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.832758 20243 raft_consensus.cc:1275] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:43.834134 20324 consensus_queue.cc:1048] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:43.845477 19973 raft_consensus.cc:1275] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:43.847466 20298 consensus_queue.cc:1048] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:43.933410 19973 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:43.934608 20324 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:43.945521 20243 raft_consensus.cc:1275] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:43.948782 20324 consensus_queue.cc:1048] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:43.963507 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:44.160647 20243 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:44.161919 20189 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:44.172240 20045 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:44.173995 20342 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:44.258780  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:44.266848 20045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d0b21066174288990933ad1409e96e"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:44.267405 20045 raft_consensus.cc:606] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:44.269961 19973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
mode: GRACEFUL
new_leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:49946
I20260709 12:18:44.270475 19973 raft_consensus.cc:606] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Received request to transfer leadership to TS f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:44.272912 20045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:44.273435 20045 raft_consensus.cc:606] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:44.274610  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:44.275080  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:44.275692  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:44.964849 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:45.482458 20347 raft_consensus.cc:493] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.483247 20347 raft_consensus.cc:515] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.488937 20347 leader_election.cc:290] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:45.535816 20348 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.536583 20348 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.586330 20348 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:45.590925 20347 raft_consensus.cc:493] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.591711 20347 raft_consensus.cc:515] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.594081 20347 leader_election.cc:290] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:45.651165 20355 raft_consensus.cc:493] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.651965 20356 raft_consensus.cc:493] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.652038 20355 raft_consensus.cc:515] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.652889 20356 raft_consensus.cc:515] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.655756 20356 leader_election.cc:290] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.655879 20355 leader_election.cc:290] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.656351 20356 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.656919 20356 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.659926 20355 raft_consensus.cc:493] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.660570 20355 raft_consensus.cc:515] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.662859 20355 leader_election.cc:290] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.663395 20355 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.663822 20355 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.665292 20355 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.667965 20356 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.671087 20356 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.671711 20356 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.686136 20356 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.691636 20356 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.691828 20355 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.692313 20356 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.692499 20355 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.694747 20355 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.695293 20356 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.710880 20351 raft_consensus.cc:493] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.711606 20352 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.711517 20351 raft_consensus.cc:515] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.712222 20352 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.714445 20352 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.716462 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.724087 20043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.725203 20044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.725662 20041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.726147 20047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.726336 20041 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 2.
I20260709 12:18:45.727226 20040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.727829 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.731009 20201 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:45.731876 20355 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.726596 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.732493 20355 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.734850 20355 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.735828 20236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.735059 20356 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:45.737366 20356 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader bb6dcb9197154d10a289a0c4990e9467)
I20260709 12:18:45.737735 20356 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.736887 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.740676 20361 raft_consensus.cc:493] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.741801 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.743058 20351 leader_election.cc:290] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.748920 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.751215 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.751977 20356 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.752965 20243 raft_consensus.cc:1240] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Rejecting Update request from peer bb6dcb9197154d10a289a0c4990e9467 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:45.753944 20353 raft_consensus.cc:993] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: : Instructing follower f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:45.754479 20353 raft_consensus.cc:1081] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Signalling peer f1f2e9dce3fd4c3d810956924bf9082b to start an election
I20260709 12:18:45.743261 20361 raft_consensus.cc:515] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.755059 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:45.755672 20046 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.744100 19938 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.744546 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.756177 20042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
 from {username='slave'} at 127.0.0.1:46982
I20260709 12:18:45.757429 20042 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.745111 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.759840 20354 raft_consensus.cc:493] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.760460 20354 raft_consensus.cc:515] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.761358 20352 raft_consensus.cc:493] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1f2e9dce3fd4c3d810956924bf9082b)
I20260709 12:18:45.761950 20352 raft_consensus.cc:515] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.757826 20042 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.765359 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.757820 20238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.770049 20352 leader_election.cc:290] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.770560 20352 raft_consensus.cc:2749] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.772935 20361 leader_election.cc:290] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.774026 20046 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 3.
I20260709 12:18:45.775564 20201 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:45.775660 20046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.776391 20355 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:45.776538 20354 leader_election.cc:290] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.776938 20355 raft_consensus.cc:697] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 LEADER]: Becoming Leader. State: Replica: 6b4f74e723b34d8fa90b9383c67810ca, State: Running, Role: LEADER
I20260709 12:18:45.777931 20355 consensus_queue.cc:237] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.779450 20045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
I20260709 12:18:45.753911 20356 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 election: Requested vote from peers bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.780956 20040 raft_consensus.cc:1240] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Rejecting Update request from peer bb6dcb9197154d10a289a0c4990e9467 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:45.781680 20042 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.787148 19938 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.785934 20353 consensus_queue.cc:1059] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:45.790153 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:45.790673 20241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.790855 20237 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.791604 20239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.792959 20243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca" is_pre_election: true
I20260709 12:18:45.795392 19794 catalog_manager.cc:5697] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca reported cstate change: term changed from 2 to 3, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193). New cstate: current_term: 3 leader_uuid: "6b4f74e723b34d8fa90b9383c67810ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.797272 20353 raft_consensus.cc:2749] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:45.797907 20363 raft_consensus.cc:3055] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:45.798370 20363 raft_consensus.cc:740] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:45.799259 20042 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:45.799443 20363 consensus_queue.cc:260] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.801713 19973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.802471 20237 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 4.
I20260709 12:18:45.803331 19969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd0ec65d5a418897d5a59951991218" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.803851 20012 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
I20260709 12:18:45.804028 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.804781 20348 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:45.805063 20363 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.805270 20348 raft_consensus.cc:697] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:45.806123 20348 consensus_queue.cc:237] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.806941 19938 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.807699 19970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:45.808336 19970 raft_consensus.cc:3055] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:45.808368 20011 leader_election.cc:304] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:45.808763 19970 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:45.809592 19970 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.811033 19970 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:45.809954 20011 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:45.811358 20353 raft_consensus.cc:2749] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.809659 20350 raft_consensus.cc:2749] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.811852 20347 raft_consensus.cc:2749] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.812831 19938 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.813515 20347 raft_consensus.cc:993] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:45.813942 20011 leader_election.cc:304] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:45.816464 20349 raft_consensus.cc:1081] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:45.818722 20353 raft_consensus.cc:2749] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:45.824676 20347 raft_consensus.cc:2749] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.819224 19938 leader_election.cc:304] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.826651 19973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10d0b21066174288990933ad1409e96e"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:45.826942 20353 raft_consensus.cc:2749] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.827291 19973 raft_consensus.cc:493] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.822419 19970 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 4.
I20260709 12:18:45.827754 19973 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.828363 19796 catalog_manager.cc:5697] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 3 to 4, leader changed from bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 4 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.834961 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c48d12724542d6850c6a2ea7c579b2" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.836545 19972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdc77036e1648d2a74b61e7c73a0662" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.836735 19967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.837684 19967 raft_consensus.cc:2393] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b4f74e723b34d8fa90b9383c67810ca in current term 4: Already voted for candidate f1f2e9dce3fd4c3d810956924bf9082b in this term.
I20260709 12:18:45.837596 19968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0528ac0021d4edf9e5cc754f843334b" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.838685 19971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "136e15ed8590492b993dd306e4992cf8" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.838110 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.839771 19965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.839952 19966 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 3.
I20260709 12:18:45.836997 19969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bb100689f44ff96d0c3631465fa29" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.841192 19973 raft_consensus.cc:515] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.842139 19970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e493523f344116afe08795a21c6768" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:45.842556 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "6b4f74e723b34d8fa90b9383c67810ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:45.842173 20201 leader_election.cc:304] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.844437 20355 raft_consensus.cc:2749] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.845168 19973 leader_election.cc:290] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:45.844555 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:45.846019 20237 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.846921 20201 leader_election.cc:304] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.846025 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d0b21066174288990933ad1409e96e" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:45.848070 20201 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.848809 20356 raft_consensus.cc:2749] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:45.849246 20201 leader_election.cc:304] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.849531 20356 raft_consensus.cc:2749] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:45.850144 20356 raft_consensus.cc:2749] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:45.850508 20201 leader_election.cc:304] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.847903 20042 raft_consensus.cc:3055] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:45.851375 20357 raft_consensus.cc:2749] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.851694 20201 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.851634 20042 raft_consensus.cc:740] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:45.852969 19966 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b4f74e723b34d8fa90b9383c67810ca in term 3.
I20260709 12:18:45.853717 20201 leader_election.cc:304] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.853053 20042 consensus_queue.cc:260] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.854912 20355 raft_consensus.cc:2749] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:45.855404 20042 raft_consensus.cc:3060] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:45.855547 20201 leader_election.cc:304] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca; no voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:45.856381 20355 raft_consensus.cc:2749] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.858081 20237 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:45.858660 20357 raft_consensus.cc:2749] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.859344 19938 leader_election.cc:304] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:45.860177 20363 raft_consensus.cc:2804] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:45.860616 20363 raft_consensus.cc:697] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:45.861455 20363 consensus_queue.cc:237] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:45.862497 20042 raft_consensus.cc:2468] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 3.
I20260709 12:18:45.869055 19796 catalog_manager.cc:5697] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 2 to 3, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:45.966007 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:46.256982 20042 raft_consensus.cc:1275] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:46.258502 20363 consensus_queue.cc:1048] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:46.268110 20237 raft_consensus.cc:1275] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:46.270447 20364 consensus_queue.cc:1048] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:46.273650 20237 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:46.275413 20349 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:46.287216 19966 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:46.288969 20348 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:46.298012 19966 raft_consensus.cc:1275] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Refusing update from remote peer 6b4f74e723b34d8fa90b9383c67810ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:46.299782 20357 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:46.304505 20042 raft_consensus.cc:1275] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Refusing update from remote peer 6b4f74e723b34d8fa90b9383c67810ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:46.306005 20357 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:46.694197  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:46.701831 20042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
mode: GRACEFUL
new_leader_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:60146
I20260709 12:18:46.702371 20042 raft_consensus.cc:606] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Received request to transfer leadership to TS bb6dcb9197154d10a289a0c4990e9467
I20260709 12:18:46.703636  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:46.704209  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:46.704905  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:46.723057 20265 debug-util.cc:398] Leaking SignalData structure 0x7b080011c500 after lost signal to thread 8910
W20260709 12:18:46.724073 20265 debug-util.cc:398] Leaking SignalData structure 0x7b0800268680 after lost signal to thread 19830
W20260709 12:18:46.726574 20265 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3bc0 after lost signal to thread 20268
I20260709 12:18:46.840612 20382 raft_consensus.cc:993] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: : Instructing follower bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:46.841264 20382 raft_consensus.cc:1081] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Signalling peer bb6dcb9197154d10a289a0c4990e9467 to start an election
I20260709 12:18:46.843091 19966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0"
dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
 from {username='slave'} at 127.0.0.1:41640
I20260709 12:18:46.843679 19966 raft_consensus.cc:493] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:46.844023 19966 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.850519 19966 raft_consensus.cc:515] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:46.853267 20237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6b4f74e723b34d8fa90b9383c67810ca"
I20260709 12:18:46.853873 20237 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.855443 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc7b232866c437bbb7d2610b52138d0" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b"
I20260709 12:18:46.856083 20042 raft_consensus.cc:3055] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:46.853837 19966 leader_election.cc:290] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 5 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:46.856415 20042 raft_consensus.cc:740] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:46.857239 20042 consensus_queue.cc:260] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:46.858372 20042 raft_consensus.cc:3060] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.862138 20237 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 5.
I20260709 12:18:46.863574 19938 leader_election.cc:304] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4f74e723b34d8fa90b9383c67810ca, bb6dcb9197154d10a289a0c4990e9467; no voters: 
I20260709 12:18:46.864009 20042 raft_consensus.cc:2468] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6dcb9197154d10a289a0c4990e9467 in term 5.
I20260709 12:18:46.864382 20364 raft_consensus.cc:2804] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:46.864912 20364 raft_consensus.cc:697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 5 LEADER]: Becoming Leader. State: Replica: bb6dcb9197154d10a289a0c4990e9467, State: Running, Role: LEADER
I20260709 12:18:46.865700 20364 consensus_queue.cc:237] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:46.871901 19795 catalog_manager.cc:5697] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 reported cstate change: term changed from 4 to 5, leader changed from f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195) to bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194). New cstate: current_term: 5 leader_uuid: "bb6dcb9197154d10a289a0c4990e9467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:46.967163 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:47.409721 20237 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 5 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:47.411134 20353 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:47.425263 20042 raft_consensus.cc:1275] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 5 FOLLOWER]: Refusing update from remote peer bb6dcb9197154d10a289a0c4990e9467: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:47.427260 20353 consensus_queue.cc:1048] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:47.714031  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:556: Failure
Expected: (consensus::RaftPeerPB::LEADER) != (replica.role()), actual: 1 vs 1
I20260709 12:18:47.750784  8907 tablet_server.cc:179] TabletServer@127.8.178.193:39275 shutting down...
I20260709 12:18:47.781430  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:47.782531  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.783717  8907 raft_consensus.cc:2243] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.784381  8907 raft_consensus.cc:2272] T e0528ac0021d4edf9e5cc754f843334b P 6b4f74e723b34d8fa90b9383c67810ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.788060  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.788848  8907 raft_consensus.cc:2243] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.789438  8907 raft_consensus.cc:2272] T efc7b232866c437bbb7d2610b52138d0 P 6b4f74e723b34d8fa90b9383c67810ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.793226  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.794169  8907 raft_consensus.cc:2243] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.794798  8907 raft_consensus.cc:2272] T 6fdc77036e1648d2a74b61e7c73a0662 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.797964  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.798676  8907 raft_consensus.cc:2243] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.799278  8907 raft_consensus.cc:2272] T abcd0ec65d5a418897d5a59951991218 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.802476  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.803359  8907 raft_consensus.cc:2243] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.803898  8907 raft_consensus.cc:2272] T c3c48d12724542d6850c6a2ea7c579b2 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.807192  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.807993  8907 raft_consensus.cc:2243] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.808483  8907 raft_consensus.cc:2272] T 10d0b21066174288990933ad1409e96e P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.811512  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.812199  8907 raft_consensus.cc:2243] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:47.813189  8907 raft_consensus.cc:2272] T 2773f6718e984e7c895b988b8c007e78 P 6b4f74e723b34d8fa90b9383c67810ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.816308  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.817000  8907 raft_consensus.cc:2243] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.817611  8907 raft_consensus.cc:2272] T 136e15ed8590492b993dd306e4992cf8 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:47.820406 20012 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
I20260709 12:18:47.820983  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.821872  8907 raft_consensus.cc:2243] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.822644  8907 raft_consensus.cc:2272] T 82e493523f344116afe08795a21c6768 P 6b4f74e723b34d8fa90b9383c67810ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:47.823274 20012 consensus_peers.cc:597] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:47.825898  8907 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:47.826726  8907 raft_consensus.cc:2243] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.827241  8907 raft_consensus.cc:2272] T f32bb100689f44ff96d0c3631465fa29 P 6b4f74e723b34d8fa90b9383c67810ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:47.846225 19938 consensus_peers.cc:597] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.873788 20012 consensus_peers.cc:597] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.891212 20012 consensus_peers.cc:597] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.968250 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:48.035820 19938 consensus_peers.cc:597] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:48.089188 19938 consensus_peers.cc:597] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:48.154899 20012 consensus_peers.cc:597] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:48.160357 19938 consensus_peers.cc:597] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:48.265314 19938 consensus_peers.cc:597] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:48.751966 20399 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:48.752611 20399 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:48.755018 20399 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195:42935)
I20260709 12:18:48.756191 20042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "bb6dcb9197154d10a289a0c4990e9467" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" is_pre_election: true
W20260709 12:18:48.759019 19938 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:48.759375 19938 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467; no voters: 6b4f74e723b34d8fa90b9383c67810ca, f1f2e9dce3fd4c3d810956924bf9082b
I20260709 12:18:48.759965 20399 raft_consensus.cc:2749] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:48.867504  8907 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 20265)
I20260709 12:18:48.894359 20403 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:48.894950 20403 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:48.896730 20403 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:48.898406 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467" is_pre_election: true
I20260709 12:18:48.899158 19966 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 3.
I20260709 12:18:48.900620 20011 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 
W20260709 12:18:48.901170 20012 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:48.901463 20403 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:48.901906 20403 raft_consensus.cc:493] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b4f74e723b34d8fa90b9383c67810ca)
I20260709 12:18:48.902297 20403 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.908821 20403 raft_consensus.cc:515] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:48.910440 20403 leader_election.cc:290] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Requested vote from peers 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275), bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305)
I20260709 12:18:48.911643 19966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2773f6718e984e7c895b988b8c007e78" candidate_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bb6dcb9197154d10a289a0c4990e9467"
I20260709 12:18:48.912307 19966 raft_consensus.cc:3060] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:48.914119 20012 leader_election.cc:336] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111)
I20260709 12:18:48.917989 19966 raft_consensus.cc:2468] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f2e9dce3fd4c3d810956924bf9082b in term 4.
I20260709 12:18:48.919128 20011 leader_election.cc:304] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb6dcb9197154d10a289a0c4990e9467, f1f2e9dce3fd4c3d810956924bf9082b; no voters: 6b4f74e723b34d8fa90b9383c67810ca
I20260709 12:18:48.919845 20403 raft_consensus.cc:2804] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:48.920293 20403 raft_consensus.cc:697] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Becoming Leader. State: Replica: f1f2e9dce3fd4c3d810956924bf9082b, State: Running, Role: LEADER
I20260709 12:18:48.921144 20403 consensus_queue.cc:237] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } }
I20260709 12:18:48.929070 19794 catalog_manager.cc:5697] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b reported cstate change: term changed from 3 to 4, leader changed from 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193) to f1f2e9dce3fd4c3d810956924bf9082b (127.8.178.195). New cstate: current_term: 4 leader_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b4f74e723b34d8fa90b9383c67810ca" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1f2e9dce3fd4c3d810956924bf9082b" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 42935 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:48.969452 19844 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:49.306066 20012 consensus_peers.cc:597] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer 6b4f74e723b34d8fa90b9383c67810ca (127.8.178.193:39275): Couldn't send request to peer 6b4f74e723b34d8fa90b9383c67810ca. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:39275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.403452 19966 raft_consensus.cc:1275] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Refusing update from remote peer f1f2e9dce3fd4c3d810956924bf9082b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:49.404680 20403 consensus_queue.cc:1048] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6dcb9197154d10a289a0c4990e9467" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:49.665700  8907 tablet_server.cc:196] TabletServer@127.8.178.193:39275 shutdown complete.
I20260709 12:18:49.695139  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:18:49.722146  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:49.722869  8907 tablet_replica.cc:333] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.723567  8907 raft_consensus.cc:2243] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.724385  8907 raft_consensus.cc:2272] T 10d0b21066174288990933ad1409e96e P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.726552  8907 tablet_replica.cc:333] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.727142  8907 raft_consensus.cc:2243] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.727579  8907 raft_consensus.cc:2272] T f32bb100689f44ff96d0c3631465fa29 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.729837  8907 tablet_replica.cc:333] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.730412  8907 raft_consensus.cc:2243] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.730923  8907 raft_consensus.cc:2272] T 6fdc77036e1648d2a74b61e7c73a0662 P bb6dcb9197154d10a289a0c4990e9467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.733210  8907 tablet_replica.cc:333] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.733744  8907 raft_consensus.cc:2243] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.734611  8907 raft_consensus.cc:2272] T abcd0ec65d5a418897d5a59951991218 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.736792  8907 tablet_replica.cc:333] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.737313  8907 raft_consensus.cc:2243] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.738142  8907 raft_consensus.cc:2272] T c3c48d12724542d6850c6a2ea7c579b2 P bb6dcb9197154d10a289a0c4990e9467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.740475  8907 tablet_replica.cc:333] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.741020  8907 raft_consensus.cc:2243] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.741439  8907 raft_consensus.cc:2272] T 2773f6718e984e7c895b988b8c007e78 P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.744069  8907 tablet_replica.cc:333] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.744722  8907 raft_consensus.cc:2243] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.745178  8907 raft_consensus.cc:2272] T 136e15ed8590492b993dd306e4992cf8 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.747408  8907 tablet_replica.cc:333] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.747921  8907 raft_consensus.cc:2243] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.748716  8907 raft_consensus.cc:2272] T 82e493523f344116afe08795a21c6768 P bb6dcb9197154d10a289a0c4990e9467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.750857  8907 tablet_replica.cc:333] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.751340  8907 raft_consensus.cc:2243] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.752090  8907 raft_consensus.cc:2272] T efc7b232866c437bbb7d2610b52138d0 P bb6dcb9197154d10a289a0c4990e9467 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.754382  8907 tablet_replica.cc:333] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467: stopping tablet replica
I20260709 12:18:49.754946  8907 raft_consensus.cc:2243] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.755395  8907 raft_consensus.cc:2272] T e0528ac0021d4edf9e5cc754f843334b P bb6dcb9197154d10a289a0c4990e9467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.788082  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
I20260709 12:18:49.814699  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
W20260709 12:18:49.832541 20011 consensus_peers.cc:597] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b -> Peer bb6dcb9197154d10a289a0c4990e9467 (127.8.178.194:41305): Couldn't send request to peer bb6dcb9197154d10a289a0c4990e9467. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:41305: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:49.843199  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:49.844003  8907 tablet_replica.cc:333] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.844726  8907 raft_consensus.cc:2243] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.845645  8907 raft_consensus.cc:2272] T 2773f6718e984e7c895b988b8c007e78 P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.848533  8907 tablet_replica.cc:333] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.849141  8907 raft_consensus.cc:2243] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.849933  8907 raft_consensus.cc:2272] T 136e15ed8590492b993dd306e4992cf8 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.852015  8907 tablet_replica.cc:333] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.852649  8907 raft_consensus.cc:2243] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.853083  8907 raft_consensus.cc:2272] T efc7b232866c437bbb7d2610b52138d0 P f1f2e9dce3fd4c3d810956924bf9082b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.855226  8907 tablet_replica.cc:333] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.855723  8907 raft_consensus.cc:2243] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.856515  8907 raft_consensus.cc:2272] T f32bb100689f44ff96d0c3631465fa29 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.858566  8907 tablet_replica.cc:333] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.859076  8907 raft_consensus.cc:2243] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.859493  8907 raft_consensus.cc:2272] T c3c48d12724542d6850c6a2ea7c579b2 P f1f2e9dce3fd4c3d810956924bf9082b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.861505  8907 tablet_replica.cc:333] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.862022  8907 raft_consensus.cc:2243] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.862484  8907 raft_consensus.cc:2272] T abcd0ec65d5a418897d5a59951991218 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.864486  8907 tablet_replica.cc:333] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.864974  8907 raft_consensus.cc:2243] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.865726  8907 raft_consensus.cc:2272] T e0528ac0021d4edf9e5cc754f843334b P f1f2e9dce3fd4c3d810956924bf9082b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.867873  8907 tablet_replica.cc:333] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.868363  8907 raft_consensus.cc:2243] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.869186  8907 raft_consensus.cc:2272] T 6fdc77036e1648d2a74b61e7c73a0662 P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.871672  8907 tablet_replica.cc:333] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.872164  8907 raft_consensus.cc:2243] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.872545  8907 raft_consensus.cc:2272] T 10d0b21066174288990933ad1409e96e P f1f2e9dce3fd4c3d810956924bf9082b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.874644  8907 tablet_replica.cc:333] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b: stopping tablet replica
I20260709 12:18:49.875082  8907 raft_consensus.cc:2243] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:49.875519  8907 raft_consensus.cc:2272] T 82e493523f344116afe08795a21c6768 P f1f2e9dce3fd4c3d810956924bf9082b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.897320  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:18:49.921871  8907 master.cc:562] Master@127.8.178.254:38953 shutting down...
I20260709 12:18:49.942411  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:49.943019  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:49.943372  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P 077bc1454ac543538cad3f06ee4df4e4: stopping tablet replica
I20260709 12:18:49.964514  8907 master.cc:584] Master@127.8.178.254:38953 shutdown complete.
I20260709 12:18:49.993990  8907 test_util.cc:182] -----------------------------------------------
I20260709 12:18:49.994215  8907 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599162605813-8907-0
[  FAILED  ] LeaderRebalancerTest.TestMaintenanceMode (16183 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:18:49.997398  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:38471
I20260709 12:18:49.998585  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.004222 20413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.004460 20415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.004901 20412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.005999  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:50.007179  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.007361  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.007483  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599530007467 us; error 0 us; skew 500 ppm
I20260709 12:18:50.007956  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.010293  8907 webserver.cc:533] Webserver started at http://127.8.178.254:33467/ using document root <none> and password file <none>
I20260709 12:18:50.010838  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.010998  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.011212  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.012338  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "d78062cf570f4746b7cf25836fefcd6f"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.017027  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:50.020601 20420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.021334  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:50.021621  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "d78062cf570f4746b7cf25836fefcd6f"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.021912  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.036548  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.037695  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.076254  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:38471
I20260709 12:18:50.076371 20471 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:38471 every 8 connection(s)
I20260709 12:18:50.080255 20472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.091907 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f: Bootstrap starting.
I20260709 12:18:50.096832 20472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.101177 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f: No bootstrap required, opened a new log
I20260709 12:18:50.103428 20472 raft_consensus.cc:359] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER }
I20260709 12:18:50.103854 20472 raft_consensus.cc:385] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.104033 20472 raft_consensus.cc:740] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d78062cf570f4746b7cf25836fefcd6f, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.104604 20472 consensus_queue.cc:260] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER }
I20260709 12:18:50.105068 20472 raft_consensus.cc:399] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:50.105257 20472 raft_consensus.cc:493] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:50.105464 20472 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.110345 20472 raft_consensus.cc:515] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER }
I20260709 12:18:50.110910 20472 leader_election.cc:304] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d78062cf570f4746b7cf25836fefcd6f; no voters: 
I20260709 12:18:50.111984 20472 leader_election.cc:290] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:50.112329 20475 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.113735 20475 raft_consensus.cc:697] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 1 LEADER]: Becoming Leader. State: Replica: d78062cf570f4746b7cf25836fefcd6f, State: Running, Role: LEADER
I20260709 12:18:50.114574 20475 consensus_queue.cc:237] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER }
I20260709 12:18:50.114934 20472 sys_catalog.cc:565] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:50.118954 20476 sys_catalog.cc:455] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d78062cf570f4746b7cf25836fefcd6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER } }
I20260709 12:18:50.119145 20477 sys_catalog.cc:455] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d78062cf570f4746b7cf25836fefcd6f. Latest consensus state: current_term: 1 leader_uuid: "d78062cf570f4746b7cf25836fefcd6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78062cf570f4746b7cf25836fefcd6f" member_type: VOTER } }
I20260709 12:18:50.119648 20476 sys_catalog.cc:458] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:50.119817 20477 sys_catalog.cc:458] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:50.122176 20482 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:50.129876 20482 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:50.130949  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:50.138942 20482 catalog_manager.cc:1383] Generated new cluster ID: bedc8b68bbaa46d29db5d5a1aeecbf20
I20260709 12:18:50.139262 20482 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:50.154994 20482 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:50.156437 20482 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:50.175282 20482 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f: Generated new TSK 0
I20260709 12:18:50.176038 20482 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:50.198208  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.204375 20493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.205170 20494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.207047  8907 server_base.cc:1061] running on GCE node
W20260709 12:18:50.207557 20496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.208488  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.208683  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.208851  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599530208824 us; error 0 us; skew 500 ppm
I20260709 12:18:50.209350  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.211688  8907 webserver.cc:533] Webserver started at http://127.8.178.193:36825/ using document root <none> and password file <none>
I20260709 12:18:50.212147  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.212327  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.212568  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.213636  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "7615c6cdaf314e328eaede3af3434e9d"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.218257  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:18:50.222323 20501 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.223158  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:50.223444  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "7615c6cdaf314e328eaede3af3434e9d"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.223759  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.235873  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.237109  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.238610  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.240970  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.241163  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.241412  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.241576  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.281872  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:36721
I20260709 12:18:50.281982 20563 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:36721 every 8 connection(s)
I20260709 12:18:50.287024  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.294590 20568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.296823 20569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.298525  8907 server_base.cc:1061] running on GCE node
W20260709 12:18:50.299734 20571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.300835 20564 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38471
I20260709 12:18:50.301429 20564 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.302171 20564 heartbeater.cc:507] Master 127.8.178.254:38471 requested a full tablet report, sending...
I20260709 12:18:50.300869  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:50.302587  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.302778  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599530302759 us; error 0 us; skew 500 ppm
I20260709 12:18:50.303879  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.304520 20437 ts_manager.cc:194] Registered new tserver with Master: 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721)
I20260709 12:18:50.306806  8907 webserver.cc:533] Webserver started at http://127.8.178.194:37925/ using document root <none> and password file <none>
I20260709 12:18:50.307163 20437 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38058
I20260709 12:18:50.307509  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.307842  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.308153  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.309489  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.314280  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 12:18:50.319380 20576 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.320436  8907 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:18:50.320824  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.321197  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.341255  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.342492  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.343932  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.346391  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.346684  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:18:50.346948  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.347087  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.385375  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:39721
I20260709 12:18:50.385491 20638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:39721 every 8 connection(s)
I20260709 12:18:50.390105  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:50.396981 20642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.397861 20643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:50.399947 20645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:50.400624  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:50.401487 20639 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38471
I20260709 12:18:50.401722  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:50.401979 20639 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:50.402027  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:50.402354  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599530402333 us; error 0 us; skew 500 ppm
I20260709 12:18:50.402982 20639 heartbeater.cc:507] Master 127.8.178.254:38471 requested a full tablet report, sending...
I20260709 12:18:50.403188  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:50.405273 20437 ts_manager.cc:194] Registered new tserver with Master: ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
I20260709 12:18:50.405975  8907 webserver.cc:533] Webserver started at http://127.8.178.195:34281/ using document root <none> and password file <none>
I20260709 12:18:50.406561  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:50.406737  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:50.406807 20437 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38074
I20260709 12:18:50.406980  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:50.408387  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "193c473952864ddf880b87e8e9d56475"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.412879  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:50.416115 20650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.416923  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:50.417217  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "193c473952864ddf880b87e8e9d56475"
format_stamp: "Formatted at 2026-07-09 12:18:50 on dist-test-slave-jlx4"
I20260709 12:18:50.417490  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:50.435029  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:50.436249  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:50.437690  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:50.440045  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:50.440251  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.440482  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:50.440634  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:50.479910  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:34957
I20260709 12:18:50.480015 20712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:34957 every 8 connection(s)
I20260709 12:18:50.493670 20713 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38471
I20260709 12:18:50.494120 20713 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:50.494938 20713 heartbeater.cc:507] Master 127.8.178.254:38471 requested a full tablet report, sending...
I20260709 12:18:50.496827 20437 ts_manager.cc:194] Registered new tserver with Master: 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:50.497908  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014597176s
I20260709 12:18:50.498204 20437 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38082
I20260709 12:18:50.523061 20437 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38096:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:50.525369 20437 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:50.575870 20604 tablet_service.cc:1511] Processing CreateTablet for tablet 111671a4d497445eb5146452bc126cc4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:50.577342 20604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111671a4d497445eb5146452bc126cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.577342 20603 tablet_service.cc:1511] Processing CreateTablet for tablet e7e57763c3994963bef5bca9d3e1fb94 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:50.579106 20603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e57763c3994963bef5bca9d3e1fb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.579348 20529 tablet_service.cc:1511] Processing CreateTablet for tablet 111671a4d497445eb5146452bc126cc4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:50.580157 20528 tablet_service.cc:1511] Processing CreateTablet for tablet e7e57763c3994963bef5bca9d3e1fb94 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:50.580727 20529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111671a4d497445eb5146452bc126cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.581481 20528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e57763c3994963bef5bca9d3e1fb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.597725 20678 tablet_service.cc:1511] Processing CreateTablet for tablet 111671a4d497445eb5146452bc126cc4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:50.599277 20678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111671a4d497445eb5146452bc126cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.601155 20677 tablet_service.cc:1511] Processing CreateTablet for tablet e7e57763c3994963bef5bca9d3e1fb94 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e79c5ad28f744e5a9f42d01b8dc5f49]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:50.602571 20677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e57763c3994963bef5bca9d3e1fb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:50.599169 20728 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: Bootstrap starting.
I20260709 12:18:50.613749 20729 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: Bootstrap starting.
I20260709 12:18:50.616191 20728 tablet_bootstrap.cc:654] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.619145 20730 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: Bootstrap starting.
I20260709 12:18:50.625592 20729 tablet_bootstrap.cc:654] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.625694 20728 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: No bootstrap required, opened a new log
I20260709 12:18:50.626349 20728 ts_tablet_manager.cc:1403] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 12:18:50.626755 20730 tablet_bootstrap.cc:654] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.628739 20728 raft_consensus.cc:359] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.629431 20728 raft_consensus.cc:385] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.629729 20728 raft_consensus.cc:740] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.630623 20728 consensus_queue.cc:260] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.632376 20729 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: No bootstrap required, opened a new log
I20260709 12:18:50.632638 20730 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: No bootstrap required, opened a new log
I20260709 12:18:50.632941 20729 ts_tablet_manager.cc:1403] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:18:50.633086 20730 ts_tablet_manager.cc:1403] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 12:18:50.635892 20729 raft_consensus.cc:359] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.636121 20730 raft_consensus.cc:359] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.636638 20729 raft_consensus.cc:385] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.636848 20730 raft_consensus.cc:385] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.636976 20729 raft_consensus.cc:740] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.637238 20730 raft_consensus.cc:740] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.637715 20639 heartbeater.cc:499] Master 127.8.178.254:38471 was elected leader, sending a full tablet report...
I20260709 12:18:50.638023 20728 ts_tablet_manager.cc:1434] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 12:18:50.638088 20730 consensus_queue.cc:260] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.639070 20728 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: Bootstrap starting.
I20260709 12:18:50.641006 20729 consensus_queue.cc:260] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.646255 20728 tablet_bootstrap.cc:654] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.651209 20713 heartbeater.cc:499] Master 127.8.178.254:38471 was elected leader, sending a full tablet report...
I20260709 12:18:50.652228 20728 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: No bootstrap required, opened a new log
I20260709 12:18:50.653264 20728 ts_tablet_manager.cc:1403] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 12:18:50.652354 20730 ts_tablet_manager.cc:1434] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 12:18:50.654693 20729 ts_tablet_manager.cc:1434] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.009s
I20260709 12:18:50.655007 20564 heartbeater.cc:499] Master 127.8.178.254:38471 was elected leader, sending a full tablet report...
I20260709 12:18:50.655465 20730 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: Bootstrap starting.
I20260709 12:18:50.655819 20729 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: Bootstrap starting.
I20260709 12:18:50.658998 20728 raft_consensus.cc:359] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.659861 20728 raft_consensus.cc:385] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.660210 20728 raft_consensus.cc:740] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.661218 20728 consensus_queue.cc:260] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.663228 20729 tablet_bootstrap.cc:654] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.663900 20728 ts_tablet_manager.cc:1434] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:50.665023 20730 tablet_bootstrap.cc:654] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:50.671815 20730 tablet_bootstrap.cc:492] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: No bootstrap required, opened a new log
I20260709 12:18:50.672284 20730 ts_tablet_manager.cc:1403] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 12:18:50.674855 20730 raft_consensus.cc:359] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.675444 20730 raft_consensus.cc:385] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.675668 20730 raft_consensus.cc:740] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.676282 20730 consensus_queue.cc:260] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.677533 20734 raft_consensus.cc:493] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.678174 20730 ts_tablet_manager.cc:1434] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:50.678103 20734 raft_consensus.cc:515] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.680755 20734 leader_election.cc:290] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:50.694217 20729 tablet_bootstrap.cc:492] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: No bootstrap required, opened a new log
I20260709 12:18:50.694110 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d" is_pre_election: true
I20260709 12:18:50.694902 20729 ts_tablet_manager.cc:1403] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.010s
I20260709 12:18:50.694970 20539 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 0.
I20260709 12:18:50.696612 20580 leader_election.cc:304] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7615c6cdaf314e328eaede3af3434e9d, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:50.697546 20734 raft_consensus.cc:2804] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.697918 20734 raft_consensus.cc:493] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.698247 20734 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.698750 20729 raft_consensus.cc:359] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.699373 20729 raft_consensus.cc:385] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:50.699607 20729 raft_consensus.cc:740] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Initialized, Role: FOLLOWER
I20260709 12:18:50.699525 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "193c473952864ddf880b87e8e9d56475" is_pre_election: true
I20260709 12:18:50.700459 20688 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 0.
I20260709 12:18:50.700534 20729 consensus_queue.cc:260] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.702802 20729 ts_tablet_manager.cc:1434] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:50.705133 20734 raft_consensus.cc:515] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.706918 20734 leader_election.cc:290] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 1 election: Requested vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:50.707950 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "193c473952864ddf880b87e8e9d56475"
I20260709 12:18:50.707860 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:50.708745 20539 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.708695 20688 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.716667 20539 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 1.
I20260709 12:18:50.717360 20688 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 1.
I20260709 12:18:50.717998 20580 leader_election.cc:304] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7615c6cdaf314e328eaede3af3434e9d, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:50.718890 20734 raft_consensus.cc:2804] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.720028 20734 raft_consensus.cc:697] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Running, Role: LEADER
I20260709 12:18:50.720690 20734 consensus_queue.cc:237] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.728253 20436 catalog_manager.cc:5697] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.951345 20735 raft_consensus.cc:493] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.951879 20735 raft_consensus.cc:515] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.953946 20735 leader_election.cc:290] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721), 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721)
I20260709 12:18:50.962460 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" is_pre_election: true
I20260709 12:18:50.963312 20614 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 0.
I20260709 12:18:50.964046 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d" is_pre_election: true
I20260709 12:18:50.964612 20652 leader_election.cc:304] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:50.964747 20539 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 0.
I20260709 12:18:50.965524 20735 raft_consensus.cc:2804] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:50.965828 20735 raft_consensus.cc:493] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.966089 20735 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.971622 20735 raft_consensus.cc:515] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.973207 20735 leader_election.cc:290] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721), 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721)
I20260709 12:18:50.974138 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:50.974062 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:50.974761 20539 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.974836 20614 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:50.981998 20539 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:50.981998 20614 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:50.983359 20652 leader_election.cc:304] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:50.984084 20735 raft_consensus.cc:2804] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:50.984917 20735 raft_consensus.cc:697] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Leader. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:50.985705 20735 consensus_queue.cc:237] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:50.994288 20436 catalog_manager.cc:5697] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 reported cstate change: term changed from 0 to 1, leader changed from <none> to 193c473952864ddf880b87e8e9d56475 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "193c473952864ddf880b87e8e9d56475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.025858 20436 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38112:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:51.027834 20436 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:51.050841 20528 tablet_service.cc:1511] Processing CreateTablet for tablet bac17dc750354513b7501bb1c5bbb662 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:51.052173 20528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac17dc750354513b7501bb1c5bbb662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.052150 20604 tablet_service.cc:1511] Processing CreateTablet for tablet bac17dc750354513b7501bb1c5bbb662 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:51.053445 20604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac17dc750354513b7501bb1c5bbb662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.053378 20677 tablet_service.cc:1511] Processing CreateTablet for tablet bac17dc750354513b7501bb1c5bbb662 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:51.054752 20677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac17dc750354513b7501bb1c5bbb662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.055266 20529 tablet_service.cc:1511] Processing CreateTablet for tablet 736cd8c6228440ffa3233a6f33bc06c0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:51.056430 20529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cd8c6228440ffa3233a6f33bc06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.058913 20678 tablet_service.cc:1511] Processing CreateTablet for tablet 736cd8c6228440ffa3233a6f33bc06c0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:51.059468 20603 tablet_service.cc:1511] Processing CreateTablet for tablet 736cd8c6228440ffa3233a6f33bc06c0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=1f849515a76c45d5a1a11bd7c7686cca]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:51.060174 20678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cd8c6228440ffa3233a6f33bc06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.060683 20603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cd8c6228440ffa3233a6f33bc06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.072340 20730 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: Bootstrap starting.
I20260709 12:18:51.076727 20728 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Bootstrap starting.
I20260709 12:18:51.078976 20730 tablet_bootstrap.cc:654] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.083071 20728 tablet_bootstrap.cc:654] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.091316 20729 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: Bootstrap starting.
I20260709 12:18:51.092538 20730 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: No bootstrap required, opened a new log
I20260709 12:18:51.093103 20730 ts_tablet_manager.cc:1403] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 12:18:51.095947 20728 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: No bootstrap required, opened a new log
I20260709 12:18:51.096561 20728 ts_tablet_manager.cc:1403] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:18:51.096719 20729 tablet_bootstrap.cc:654] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.096975 20730 raft_consensus.cc:359] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.099519 20730 raft_consensus.cc:385] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.099812 20730 raft_consensus.cc:740] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.100008 20728 raft_consensus.cc:359] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.100456 20730 consensus_queue.cc:260] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.100843 20728 raft_consensus.cc:385] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.101195 20728 raft_consensus.cc:740] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.102053 20728 consensus_queue.cc:260] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.102524 20730 ts_tablet_manager.cc:1434] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:18:51.104461 20728 ts_tablet_manager.cc:1434] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:18:51.105509 20728 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: Bootstrap starting.
I20260709 12:18:51.108798 20730 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: Bootstrap starting.
I20260709 12:18:51.114218 20729 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: No bootstrap required, opened a new log
I20260709 12:18:51.114959 20729 ts_tablet_manager.cc:1403] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 12:18:51.116374 20728 tablet_bootstrap.cc:654] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.118558 20729 raft_consensus.cc:359] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.119416 20729 raft_consensus.cc:385] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.119721 20729 raft_consensus.cc:740] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.120875 20729 consensus_queue.cc:260] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.121457 20730 tablet_bootstrap.cc:654] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.122447 20735 raft_consensus.cc:493] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.122978 20735 raft_consensus.cc:515] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.125077 20735 leader_election.cc:290] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
W20260709 12:18:51.126017 20485 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:51.126348 20729 ts_tablet_manager.cc:1434] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:18:51.128507 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" is_pre_election: true
I20260709 12:18:51.128990 20729 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: Bootstrap starting.
I20260709 12:18:51.129796 20730 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: No bootstrap required, opened a new log
W20260709 12:18:51.130079 20652 leader_election.cc:343] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:51.130339 20730 ts_tablet_manager.cc:1403] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:18:51.127710 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d" is_pre_election: true
I20260709 12:18:51.131711 20539 raft_consensus.cc:2468] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 0.
I20260709 12:18:51.133005 20654 leader_election.cc:304] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, 7615c6cdaf314e328eaede3af3434e9d; no voters: ea4dca17862d46b18d48a3c90e7a8c70
I20260709 12:18:51.133422 20730 raft_consensus.cc:359] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.134191 20730 raft_consensus.cc:385] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.134261 20735 raft_consensus.cc:2804] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.134665 20730 raft_consensus.cc:740] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.134934 20735 raft_consensus.cc:493] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.135342 20735 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.135736 20730 consensus_queue.cc:260] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.136278 20729 tablet_bootstrap.cc:654] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.137935 20730 ts_tablet_manager.cc:1434] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:51.122418 20728 tablet_bootstrap.cc:492] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: No bootstrap required, opened a new log
I20260709 12:18:51.143993 20728 ts_tablet_manager.cc:1403] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 12:18:51.143628 20735 raft_consensus.cc:515] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.147275 20728 raft_consensus.cc:359] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.148087 20728 raft_consensus.cc:385] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.148486 20728 raft_consensus.cc:740] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.149252 20728 consensus_queue.cc:260] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.149760 20734 consensus_queue.cc:1048] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.157099 20728 ts_tablet_manager.cc:1434] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:51.158615 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:51.158887 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.159464 20539 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.159566 20614 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.170872 20729 tablet_bootstrap.cc:492] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: No bootstrap required, opened a new log
I20260709 12:18:51.171574 20729 ts_tablet_manager.cc:1403] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.018s
I20260709 12:18:51.174458 20744 raft_consensus.cc:493] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.174768 20729 raft_consensus.cc:359] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.175716 20729 raft_consensus.cc:385] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.175755 20744 raft_consensus.cc:515] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.176142 20729 raft_consensus.cc:740] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.160667 20735 leader_election.cc:290] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Requested vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
I20260709 12:18:51.176479 20614 raft_consensus.cc:2468] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:51.177249 20729 consensus_queue.cc:260] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.177949 20652 leader_election.cc:304] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:51.178124 20744 leader_election.cc:290] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
I20260709 12:18:51.179400 20538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d" is_pre_election: true
I20260709 12:18:51.180087 20538 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 0.
I20260709 12:18:51.180344 20744 raft_consensus.cc:2804] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.180051 20729 ts_tablet_manager.cc:1434] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:18:51.180896 20744 raft_consensus.cc:697] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Leader. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.181384 20654 leader_election.cc:304] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, 7615c6cdaf314e328eaede3af3434e9d; no voters: 
I20260709 12:18:51.182358 20735 raft_consensus.cc:2804] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:51.182914 20735 raft_consensus.cc:493] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.182026 20744 consensus_queue.cc:237] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.183332 20735 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.184876 20539 raft_consensus.cc:2468] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:51.186367 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" is_pre_election: true
I20260709 12:18:51.187229 20614 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 0.
I20260709 12:18:51.193603 20437 catalog_manager.cc:5697] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 reported cstate change: term changed from 0 to 1, leader changed from <none> to 193c473952864ddf880b87e8e9d56475 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "193c473952864ddf880b87e8e9d56475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.197505 20735 raft_consensus.cc:515] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.201263 20538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:51.201942 20538 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.203280 20741 consensus_queue.cc:1048] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.210618 20538 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:51.211239 20735 leader_election.cc:290] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Requested vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
I20260709 12:18:51.212132 20654 leader_election.cc:304] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, 7615c6cdaf314e328eaede3af3434e9d; no voters: 
I20260709 12:18:51.213191 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.213867 20614 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.214460 20735 raft_consensus.cc:2804] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.215096 20735 raft_consensus.cc:697] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Leader. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.215894 20735 consensus_queue.cc:237] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.221153 20614 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 1.
I20260709 12:18:51.227089 20437 catalog_manager.cc:5697] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 reported cstate change: term changed from 0 to 1, leader changed from <none> to 193c473952864ddf880b87e8e9d56475 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "193c473952864ddf880b87e8e9d56475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.264730 20688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "111671a4d497445eb5146452bc126cc4"
dest_uuid: "193c473952864ddf880b87e8e9d56475"
mode: GRACEFUL
new_leader_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:33158
I20260709 12:18:51.265278 20688 raft_consensus.cc:606] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Received request to transfer leadership to TS 7615c6cdaf314e328eaede3af3434e9d
I20260709 12:18:51.277222 20614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94"
dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
mode: GRACEFUL
new_leader_uuid: "193c473952864ddf880b87e8e9d56475"
 from {username='slave'} at 127.0.0.1:45676
I20260709 12:18:51.277753 20614 raft_consensus.cc:606] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 LEADER]: Received request to transfer leadership to TS 193c473952864ddf880b87e8e9d56475
I20260709 12:18:51.283279 20688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662"
dest_uuid: "193c473952864ddf880b87e8e9d56475"
mode: GRACEFUL
new_leader_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:33158
I20260709 12:18:51.283797 20688 raft_consensus.cc:606] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Received request to transfer leadership to TS 7615c6cdaf314e328eaede3af3434e9d
I20260709 12:18:51.288610 20688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0"
dest_uuid: "193c473952864ddf880b87e8e9d56475"
mode: GRACEFUL
new_leader_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:33158
I20260709 12:18:51.289104 20688 raft_consensus.cc:606] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Received request to transfer leadership to TS 7615c6cdaf314e328eaede3af3434e9d
I20260709 12:18:51.386704 20735 consensus_queue.cc:1048] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.399739 20768 consensus_queue.cc:1048] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:51.409672 20735 raft_consensus.cc:993] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: : Instructing follower 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.410128 20735 raft_consensus.cc:1081] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Signalling peer 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.411799 20539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "111671a4d497445eb5146452bc126cc4"
dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:37592
I20260709 12:18:51.412400 20539 raft_consensus.cc:493] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.412801 20539 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.418090 20539 raft_consensus.cc:515] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.421217 20539 leader_election.cc:290] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Requested vote from peers ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:51.431970 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.432641 20614 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.432945 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111671a4d497445eb5146452bc126cc4" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "193c473952864ddf880b87e8e9d56475"
I20260709 12:18:51.433598 20688 raft_consensus.cc:3055] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.433938 20688 raft_consensus.cc:740] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.434777 20688 consensus_queue.cc:260] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.436105 20688 raft_consensus.cc:3060] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.440622 20614 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.441974 20503 leader_election.cc:304] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7615c6cdaf314e328eaede3af3434e9d, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:51.443002 20736 raft_consensus.cc:2804] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.443634 20688 raft_consensus.cc:2468] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.445660 20736 raft_consensus.cc:697] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Becoming Leader. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Running, Role: LEADER
I20260709 12:18:51.446506 20736 consensus_queue.cc:237] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.452946 20436 catalog_manager.cc:5697] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d reported cstate change: term changed from 1 to 2, leader changed from 193c473952864ddf880b87e8e9d56475 (127.8.178.195) to 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193). New cstate: current_term: 2 leader_uuid: "7615c6cdaf314e328eaede3af3434e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.577363 20734 raft_consensus.cc:993] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: : Instructing follower 193c473952864ddf880b87e8e9d56475 to start an election
I20260709 12:18:51.577790 20761 raft_consensus.cc:1081] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 LEADER]: Signalling peer 193c473952864ddf880b87e8e9d56475 to start an election
I20260709 12:18:51.579268 20688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94"
dest_uuid: "193c473952864ddf880b87e8e9d56475"
 from {username='slave'} at 127.0.0.1:33152
I20260709 12:18:51.579867 20688 raft_consensus.cc:493] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.580145 20688 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.585142 20688 raft_consensus.cc:515] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.586855 20688 leader_election.cc:290] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 2 election: Requested vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721)
I20260709 12:18:51.587967 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:51.588508 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e57763c3994963bef5bca9d3e1fb94" candidate_uuid: "193c473952864ddf880b87e8e9d56475" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.588573 20539 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.589076 20614 raft_consensus.cc:3055] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.589440 20614 raft_consensus.cc:740] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Running, Role: LEADER
I20260709 12:18:51.590090 20614 consensus_queue.cc:260] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.591099 20614 raft_consensus.cc:3060] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.594363 20539 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 2.
I20260709 12:18:51.595616 20654 leader_election.cc:304] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, 7615c6cdaf314e328eaede3af3434e9d; no voters: 
I20260709 12:18:51.596134 20614 raft_consensus.cc:2468] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 193c473952864ddf880b87e8e9d56475 in term 2.
I20260709 12:18:51.596259 20735 raft_consensus.cc:2804] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.596776 20735 raft_consensus.cc:697] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 2 LEADER]: Becoming Leader. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.597489 20735 consensus_queue.cc:237] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.602986 20735 consensus_queue.cc:1048] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.603439 20436 catalog_manager.cc:5697] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 reported cstate change: term changed from 1 to 2, leader changed from ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194) to 193c473952864ddf880b87e8e9d56475 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "193c473952864ddf880b87e8e9d56475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.615234 20768 consensus_queue.cc:1048] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.623001 20744 raft_consensus.cc:993] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: : Instructing follower 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.623435 20768 raft_consensus.cc:1081] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Signalling peer 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.624929 20539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0"
dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:37592
I20260709 12:18:51.625514 20539 raft_consensus.cc:493] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.625883 20539 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.630981 20539 raft_consensus.cc:515] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.632550 20539 leader_election.cc:290] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Requested vote from peers ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:51.633585 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.633674 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "193c473952864ddf880b87e8e9d56475"
I20260709 12:18:51.634343 20614 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.634480 20688 raft_consensus.cc:3055] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.634928 20688 raft_consensus.cc:740] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.635761 20688 consensus_queue.cc:260] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.637094 20688 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.640427 20614 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.641533 20503 leader_election.cc:304] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7615c6cdaf314e328eaede3af3434e9d, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:51.642212 20736 raft_consensus.cc:2804] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.642624 20736 raft_consensus.cc:697] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Becoming Leader. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Running, Role: LEADER
I20260709 12:18:51.642932 20688 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.643368 20736 consensus_queue.cc:237] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.649778 20437 catalog_manager.cc:5697] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d reported cstate change: term changed from 1 to 2, leader changed from 193c473952864ddf880b87e8e9d56475 (127.8.178.195) to 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193). New cstate: current_term: 2 leader_uuid: "7615c6cdaf314e328eaede3af3434e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.679034 20768 consensus_queue.cc:1048] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.684835 20744 raft_consensus.cc:993] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: : Instructing follower 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.685338 20735 raft_consensus.cc:1081] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Signalling peer 7615c6cdaf314e328eaede3af3434e9d to start an election
I20260709 12:18:51.687036 20538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662"
dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
 from {username='slave'} at 127.0.0.1:37592
I20260709 12:18:51.687585 20538 raft_consensus.cc:493] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.687924 20538 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.689801 20768 consensus_queue.cc:1048] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.694519 20538 raft_consensus.cc:515] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.696089 20539 raft_consensus.cc:1240] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Rejecting Update request from peer 193c473952864ddf880b87e8e9d56475 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:51.697638 20538 leader_election.cc:290] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Requested vote from peers ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:51.698292 20614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
I20260709 12:18:51.698292 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac17dc750354513b7501bb1c5bbb662" candidate_uuid: "7615c6cdaf314e328eaede3af3434e9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "193c473952864ddf880b87e8e9d56475"
I20260709 12:18:51.699235 20614 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.699599 20688 raft_consensus.cc:3055] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:51.699981 20688 raft_consensus.cc:740] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 193c473952864ddf880b87e8e9d56475, State: Running, Role: LEADER
I20260709 12:18:51.700829 20688 consensus_queue.cc:260] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.701614 20768 consensus_queue.cc:1059] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:51.703034 20688 raft_consensus.cc:3060] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:51.706877 20614 raft_consensus.cc:2468] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.708436 20503 leader_election.cc:304] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7615c6cdaf314e328eaede3af3434e9d, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:51.709404 20736 raft_consensus.cc:2804] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:51.709741 20688 raft_consensus.cc:2468] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7615c6cdaf314e328eaede3af3434e9d in term 2.
I20260709 12:18:51.709829 20736 raft_consensus.cc:697] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Becoming Leader. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Running, Role: LEADER
I20260709 12:18:51.711282 20736 consensus_queue.cc:237] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:51.717186 20437 catalog_manager.cc:5697] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d reported cstate change: term changed from 1 to 2, leader changed from 193c473952864ddf880b87e8e9d56475 (127.8.178.195) to 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193). New cstate: current_term: 2 leader_uuid: "7615c6cdaf314e328eaede3af3434e9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.737599  8907 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:18:51.739260  8907 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:18:51.739660  8907 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:18:51.751502 20539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0"
dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
mode: GRACEFUL
new_leader_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
 from {username='slave'} at 127.0.0.1:37602
I20260709 12:18:51.752079 20539 raft_consensus.cc:606] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Received request to transfer leadership to TS ea4dca17862d46b18d48a3c90e7a8c70
I20260709 12:18:51.753240  8907 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:18:51.962313 20688 raft_consensus.cc:1275] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.963550 20736 consensus_queue.cc:1048] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:51.971189 20614 raft_consensus.cc:1275] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:51.973291 20772 consensus_queue.cc:1048] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.090845 20539 raft_consensus.cc:1275] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Refusing update from remote peer 193c473952864ddf880b87e8e9d56475: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.092135 20735 consensus_queue.cc:1048] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.101343 20614 raft_consensus.cc:1275] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Refusing update from remote peer 193c473952864ddf880b87e8e9d56475: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.102671 20744 consensus_queue.cc:1048] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.110749 20688 raft_consensus.cc:1275] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.112115 20772 consensus_queue.cc:1048] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.121749 20614 raft_consensus.cc:1275] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.123736 20736 consensus_queue.cc:1048] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.129312 20772 raft_consensus.cc:993] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: : Instructing follower ea4dca17862d46b18d48a3c90e7a8c70 to start an election
I20260709 12:18:52.129845 20772 raft_consensus.cc:1081] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Signalling peer ea4dca17862d46b18d48a3c90e7a8c70 to start an election
I20260709 12:18:52.131484 20614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0"
dest_uuid: "ea4dca17862d46b18d48a3c90e7a8c70"
 from {username='slave'} at 127.0.0.1:45690
I20260709 12:18:52.131996 20614 raft_consensus.cc:493] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.132306 20614 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.135365 20613 raft_consensus.cc:1275] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.136909 20772 consensus_queue.cc:1048] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.139621 20614 raft_consensus.cc:515] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:52.142656 20614 leader_election.cc:290] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 3 election: Requested vote from peers 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721), 193c473952864ddf880b87e8e9d56475 (127.8.178.195:34957)
I20260709 12:18:52.143420 20688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "193c473952864ddf880b87e8e9d56475"
I20260709 12:18:52.144125 20688 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.146916 20687 raft_consensus.cc:1275] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Refusing update from remote peer 7615c6cdaf314e328eaede3af3434e9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:52.148717 20736 consensus_queue.cc:1048] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:52.151636 20688 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 3.
I20260709 12:18:52.142683 20539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cd8c6228440ffa3233a6f33bc06c0" candidate_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7615c6cdaf314e328eaede3af3434e9d"
I20260709 12:18:52.152837 20539 raft_consensus.cc:3055] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:52.153148 20539 raft_consensus.cc:740] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7615c6cdaf314e328eaede3af3434e9d, State: Running, Role: LEADER
I20260709 12:18:52.153967 20539 consensus_queue.cc:260] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:52.155398 20539 raft_consensus.cc:3060] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:52.157963 20580 leader_election.cc:304] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 193c473952864ddf880b87e8e9d56475, ea4dca17862d46b18d48a3c90e7a8c70; no voters: 
I20260709 12:18:52.158665 20761 raft_consensus.cc:2804] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:52.164393 20761 raft_consensus.cc:697] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 LEADER]: Becoming Leader. State: Replica: ea4dca17862d46b18d48a3c90e7a8c70, State: Running, Role: LEADER
I20260709 12:18:52.165457 20761 consensus_queue.cc:237] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } }
I20260709 12:18:52.169955 20539 raft_consensus.cc:2468] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dca17862d46b18d48a3c90e7a8c70 in term 3.
I20260709 12:18:52.172938 20436 catalog_manager.cc:5697] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 reported cstate change: term changed from 2 to 3, leader changed from 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193) to ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194). New cstate: current_term: 3 leader_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7615c6cdaf314e328eaede3af3434e9d" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 36721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dca17862d46b18d48a3c90e7a8c70" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "193c473952864ddf880b87e8e9d56475" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 34957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.368412  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
I20260709 12:18:52.385452  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:52.386076  8907 tablet_replica.cc:333] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d: stopping tablet replica
I20260709 12:18:52.386678  8907 raft_consensus.cc:2243] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.387151  8907 raft_consensus.cc:2272] T 736cd8c6228440ffa3233a6f33bc06c0 P 7615c6cdaf314e328eaede3af3434e9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.389426  8907 tablet_replica.cc:333] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d: stopping tablet replica
I20260709 12:18:52.389969  8907 raft_consensus.cc:2243] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:52.390889  8907 raft_consensus.cc:2272] T bac17dc750354513b7501bb1c5bbb662 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.393335  8907 tablet_replica.cc:333] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d: stopping tablet replica
I20260709 12:18:52.393851  8907 raft_consensus.cc:2243] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:52.394721  8907 raft_consensus.cc:2272] T 111671a4d497445eb5146452bc126cc4 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.397090  8907 tablet_replica.cc:333] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d: stopping tablet replica
I20260709 12:18:52.397570  8907 raft_consensus.cc:2243] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.397976  8907 raft_consensus.cc:2272] T e7e57763c3994963bef5bca9d3e1fb94 P 7615c6cdaf314e328eaede3af3434e9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.410868  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
I20260709 12:18:52.423278  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:18:52.440745  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:52.441378  8907 tablet_replica.cc:333] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70: stopping tablet replica
I20260709 12:18:52.441941  8907 raft_consensus.cc:2243] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.442461  8907 raft_consensus.cc:2272] T bac17dc750354513b7501bb1c5bbb662 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.444917  8907 tablet_replica.cc:333] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: stopping tablet replica
I20260709 12:18:52.445575  8907 raft_consensus.cc:2243] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:52.446252  8907 pending_rounds.cc:70] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Trying to abort 1 pending ops.
I20260709 12:18:52.446507  8907 pending_rounds.cc:77] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305623683759771648 op_type: NO_OP noop_request { }
I20260709 12:18:52.446813  8907 raft_consensus.cc:2889] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:52.447081  8907 raft_consensus.cc:2272] T 736cd8c6228440ffa3233a6f33bc06c0 P ea4dca17862d46b18d48a3c90e7a8c70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.449352  8907 tablet_replica.cc:333] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70: stopping tablet replica
I20260709 12:18:52.449893  8907 raft_consensus.cc:2243] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.450328  8907 raft_consensus.cc:2272] T e7e57763c3994963bef5bca9d3e1fb94 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.452533  8907 tablet_replica.cc:333] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70: stopping tablet replica
I20260709 12:18:52.453030  8907 raft_consensus.cc:2243] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.453446  8907 raft_consensus.cc:2272] T 111671a4d497445eb5146452bc126cc4 P ea4dca17862d46b18d48a3c90e7a8c70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.476521  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
I20260709 12:18:52.489246  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
I20260709 12:18:52.515298  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:52.516355  8907 tablet_replica.cc:333] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475: stopping tablet replica
W20260709 12:18:52.516703 20652 consensus_peers.cc:597] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 -> Peer ea4dca17862d46b18d48a3c90e7a8c70 (127.8.178.194:39721): Couldn't send request to peer ea4dca17862d46b18d48a3c90e7a8c70. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:39721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:52.516958 20654 consensus_peers.cc:597] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 -> Peer 7615c6cdaf314e328eaede3af3434e9d (127.8.178.193:36721): Couldn't send request to peer 7615c6cdaf314e328eaede3af3434e9d. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:36721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:52.517117  8907 raft_consensus.cc:2243] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.517738  8907 raft_consensus.cc:2272] T 736cd8c6228440ffa3233a6f33bc06c0 P 193c473952864ddf880b87e8e9d56475 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.520005  8907 tablet_replica.cc:333] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475: stopping tablet replica
I20260709 12:18:52.520684  8907 raft_consensus.cc:2243] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.521179  8907 raft_consensus.cc:2272] T bac17dc750354513b7501bb1c5bbb662 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.523840  8907 tablet_replica.cc:333] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475: stopping tablet replica
I20260709 12:18:52.524401  8907 raft_consensus.cc:2243] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:52.525231  8907 raft_consensus.cc:2272] T e7e57763c3994963bef5bca9d3e1fb94 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.527647  8907 tablet_replica.cc:333] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475: stopping tablet replica
I20260709 12:18:52.528117  8907 raft_consensus.cc:2243] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.528540  8907 raft_consensus.cc:2272] T 111671a4d497445eb5146452bc126cc4 P 193c473952864ddf880b87e8e9d56475 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.551851  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:18:52.564780  8907 master.cc:562] Master@127.8.178.254:38471 shutting down...
I20260709 12:18:52.580114  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:52.580688  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.581043  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P d78062cf570f4746b7cf25836fefcd6f: stopping tablet replica
I20260709 12:18:52.591714  8907 master.cc:584] Master@127.8.178.254:38471 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2623 ms)
[----------] 6 tests from LeaderRebalancerTest (369852 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:18:52.621215  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:38643
I20260709 12:18:52.622453  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:52.627401 20785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:52.627524 20786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:52.630214 20788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:52.630471  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:52.631361  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:52.631691  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:52.631836  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599532631820 us; error 0 us; skew 500 ppm
I20260709 12:18:52.632483  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:52.635068  8907 webserver.cc:533] Webserver started at http://127.8.178.254:44931/ using document root <none> and password file <none>
I20260709 12:18:52.635576  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:52.635748  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:52.635996  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:52.637075  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "77d35b0e4365486eb156ce26b2e211c6"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.642136  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:18:52.645619 20793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.646484  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:52.646770  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "77d35b0e4365486eb156ce26b2e211c6"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.647058  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:52.664311  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:52.665323  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:52.700870  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:38643
I20260709 12:18:52.700991 20844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:38643 every 8 connection(s)
I20260709 12:18:52.705050 20845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.717300 20845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: Bootstrap starting.
I20260709 12:18:52.721871 20845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.726049 20845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: No bootstrap required, opened a new log
I20260709 12:18:52.728375 20845 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER }
I20260709 12:18:52.728770 20845 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.729010 20845 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d35b0e4365486eb156ce26b2e211c6, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.729590 20845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER }
I20260709 12:18:52.730057 20845 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:52.730257 20845 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:52.730538 20845 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.735476 20845 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER }
I20260709 12:18:52.736045 20845 leader_election.cc:304] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77d35b0e4365486eb156ce26b2e211c6; no voters: 
I20260709 12:18:52.737131 20845 leader_election.cc:290] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:52.737470 20848 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.738859 20848 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 1 LEADER]: Becoming Leader. State: Replica: 77d35b0e4365486eb156ce26b2e211c6, State: Running, Role: LEADER
I20260709 12:18:52.739564 20848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER }
I20260709 12:18:52.739975 20845 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:52.742303 20849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77d35b0e4365486eb156ce26b2e211c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER } }
I20260709 12:18:52.743095 20849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:52.742354 20850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77d35b0e4365486eb156ce26b2e211c6. Latest consensus state: current_term: 1 leader_uuid: "77d35b0e4365486eb156ce26b2e211c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d35b0e4365486eb156ce26b2e211c6" member_type: VOTER } }
I20260709 12:18:52.743578 20850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:52.745931 20854 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:52.752745 20854 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:52.753932  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:52.760901 20854 catalog_manager.cc:1383] Generated new cluster ID: ae9f5fcf844349868bc9841ef1c1d1c5
I20260709 12:18:52.761201 20854 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:52.788873 20854 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:52.790158 20854 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:52.809068 20854 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: Generated new TSK 0
I20260709 12:18:52.809796 20854 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:52.820319  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:52.826205 20866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:52.827823 20867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:52.828806 20869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:52.828850  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:52.829932  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:52.830123  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:52.830271  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599532830253 us; error 0 us; skew 500 ppm
I20260709 12:18:52.830794  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:52.832947  8907 webserver.cc:533] Webserver started at http://127.8.178.193:37749/ using document root <none> and password file <none>
I20260709 12:18:52.833400  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:52.833567  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:52.833817  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:52.834921  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "d8fa47222ab94faea1241a2034c3e7af"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.839329  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:18:52.842702 20874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.843423  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:18:52.843688  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "d8fa47222ab94faea1241a2034c3e7af"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.843976  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:52.877532  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:52.878707  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:52.880120  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:52.882450  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:52.882647  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.882891  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:52.883100  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.921401  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:41035
I20260709 12:18:52.921509 20936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:41035 every 8 connection(s)
I20260709 12:18:52.926455  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:52.933684 20941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:52.934571 20942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:52.936935  8907 server_base.cc:1061] running on GCE node
W20260709 12:18:52.936964 20944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:52.938716  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:52.938992  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:52.939217  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599532939197 us; error 0 us; skew 500 ppm
I20260709 12:18:52.939927  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:52.941937 20937 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38643
I20260709 12:18:52.942279 20937 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:52.942714  8907 webserver.cc:533] Webserver started at http://127.8.178.194:33881/ using document root <none> and password file <none>
I20260709 12:18:52.943055 20937 heartbeater.cc:507] Master 127.8.178.254:38643 requested a full tablet report, sending...
I20260709 12:18:52.943225  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:52.943461  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:52.943660  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:52.945087 20810 ts_manager.cc:194] Registered new tserver with Master: d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035)
I20260709 12:18:52.946537  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.947016 20810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46756
I20260709 12:18:52.951082  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:18:52.954514 20949 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.955258  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:18:52.955552  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
format_stamp: "Formatted at 2026-07-09 12:18:52 on dist-test-slave-jlx4"
I20260709 12:18:52.955832  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:52.971801  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:52.972913  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:52.974305  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:52.976536  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:52.976735  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:52.976958  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:52.977106  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:53.013540  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:41215
I20260709 12:18:53.013644 21011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:41215 every 8 connection(s)
I20260709 12:18:53.018142  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:53.024894 21015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:53.026652 21016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:53.028702 21018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:53.029515 21012 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38643
I20260709 12:18:53.029626  8907 server_base.cc:1061] running on GCE node
I20260709 12:18:53.029968 21012 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:53.030652  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:53.030920  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:53.030792 21012 heartbeater.cc:507] Master 127.8.178.254:38643 requested a full tablet report, sending...
I20260709 12:18:53.031198  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599533031179 us; error 0 us; skew 500 ppm
I20260709 12:18:53.031839  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:53.033248 20810 ts_manager.cc:194] Registered new tserver with Master: f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.034574  8907 webserver.cc:533] Webserver started at http://127.8.178.195:38905/ using document root <none> and password file <none>
I20260709 12:18:53.035251  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:53.035193 20810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46766
I20260709 12:18:53.035734  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:53.036090  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:53.037305  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "bc52017e4298417cbac6d1f33ff45def"
format_stamp: "Formatted at 2026-07-09 12:18:53 on dist-test-slave-jlx4"
I20260709 12:18:53.041868  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:18:53.045213 21023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:53.046028  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:53.046327  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "bc52017e4298417cbac6d1f33ff45def"
format_stamp: "Formatted at 2026-07-09 12:18:53 on dist-test-slave-jlx4"
I20260709 12:18:53.046639  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:53.077932  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:53.079053  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:53.080413  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:53.082682  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:53.082967  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:53.083251  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:53.083449  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:53.156270  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:36281
I20260709 12:18:53.156428 21086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:36281 every 8 connection(s)
I20260709 12:18:53.174149 21087 heartbeater.cc:344] Connected to a master server at 127.8.178.254:38643
I20260709 12:18:53.174574 21087 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:53.175618 21087 heartbeater.cc:507] Master 127.8.178.254:38643 requested a full tablet report, sending...
I20260709 12:18:53.177935 20810 ts_manager.cc:194] Registered new tserver with Master: bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:53.178406  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017585605s
I20260709 12:18:53.180495 20810 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46770
I20260709 12:18:53.206923 20810 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46776:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:53.209853 20810 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:53.294255 21052 tablet_service.cc:1511] Processing CreateTablet for tablet 421e52116ce6412fa1e5c84bf5a14209 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:53.296537 21052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e52116ce6412fa1e5c84bf5a14209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.300334 21050 tablet_service.cc:1511] Processing CreateTablet for tablet 95a4e4f8e5b848e88ebfb909cb429b7a (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:53.301903 21050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a4e4f8e5b848e88ebfb909cb429b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.304296 21049 tablet_service.cc:1511] Processing CreateTablet for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:53.305920 21049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.294363 21051 tablet_service.cc:1511] Processing CreateTablet for tablet a0f075ff99b34bd4bcefbec68c736f96 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:53.306639 20977 tablet_service.cc:1511] Processing CreateTablet for tablet 421e52116ce6412fa1e5c84bf5a14209 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:53.308281 20977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e52116ce6412fa1e5c84bf5a14209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.309787 21048 tablet_service.cc:1511] Processing CreateTablet for tablet 945e7aee947b4000b3adb3a542e97481 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:53.311702 20976 tablet_service.cc:1511] Processing CreateTablet for tablet a0f075ff99b34bd4bcefbec68c736f96 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:53.307207 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f075ff99b34bd4bcefbec68c736f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.313202 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f075ff99b34bd4bcefbec68c736f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.314822 20975 tablet_service.cc:1511] Processing CreateTablet for tablet 95a4e4f8e5b848e88ebfb909cb429b7a (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:53.316299 20975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a4e4f8e5b848e88ebfb909cb429b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.318341 21047 tablet_service.cc:1511] Processing CreateTablet for tablet 9358ee83f89640d5bdf3a594b9e5cb57 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:53.312846 20974 tablet_service.cc:1511] Processing CreateTablet for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:53.320010 21047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9358ee83f89640d5bdf3a594b9e5cb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.324405 21046 tablet_service.cc:1511] Processing CreateTablet for tablet e3be1e129ca7450b865739ce755c8b05 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:53.326030 21046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3be1e129ca7450b865739ce755c8b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.328558 21045 tablet_service.cc:1511] Processing CreateTablet for tablet b92fe9272504412e8cb26f3d6b87d96f (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:53.330168 21045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fe9272504412e8cb26f3d6b87d96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.334189 21044 tablet_service.cc:1511] Processing CreateTablet for tablet 3d425f635b4f4ca08a7e064630f35748 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:53.337548 20973 tablet_service.cc:1511] Processing CreateTablet for tablet 945e7aee947b4000b3adb3a542e97481 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:53.339401 21048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e7aee947b4000b3adb3a542e97481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.340173 21044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d425f635b4f4ca08a7e064630f35748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.340368 20972 tablet_service.cc:1511] Processing CreateTablet for tablet 9358ee83f89640d5bdf3a594b9e5cb57 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:53.341828 20972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9358ee83f89640d5bdf3a594b9e5cb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.343765 20971 tablet_service.cc:1511] Processing CreateTablet for tablet e3be1e129ca7450b865739ce755c8b05 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:53.345263 20971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3be1e129ca7450b865739ce755c8b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.347702 20970 tablet_service.cc:1511] Processing CreateTablet for tablet b92fe9272504412e8cb26f3d6b87d96f (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:53.349185 20970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fe9272504412e8cb26f3d6b87d96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.351701 20969 tablet_service.cc:1511] Processing CreateTablet for tablet 3d425f635b4f4ca08a7e064630f35748 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:53.353148 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d425f635b4f4ca08a7e064630f35748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.356511 20974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.358417 20973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e7aee947b4000b3adb3a542e97481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.407802 20902 tablet_service.cc:1511] Processing CreateTablet for tablet 421e52116ce6412fa1e5c84bf5a14209 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:53.409571 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e52116ce6412fa1e5c84bf5a14209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.409945 20897 tablet_service.cc:1511] Processing CreateTablet for tablet 9358ee83f89640d5bdf3a594b9e5cb57 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:53.411667 20897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9358ee83f89640d5bdf3a594b9e5cb57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.412890 20900 tablet_service.cc:1511] Processing CreateTablet for tablet 95a4e4f8e5b848e88ebfb909cb429b7a (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:53.415730 20899 tablet_service.cc:1511] Processing CreateTablet for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:53.417187 20895 tablet_service.cc:1511] Processing CreateTablet for tablet b92fe9272504412e8cb26f3d6b87d96f (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:53.418292 20898 tablet_service.cc:1511] Processing CreateTablet for tablet 945e7aee947b4000b3adb3a542e97481 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:53.414335 20900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a4e4f8e5b848e88ebfb909cb429b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.419798 20894 tablet_service.cc:1511] Processing CreateTablet for tablet 3d425f635b4f4ca08a7e064630f35748 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:53.411660 20901 tablet_service.cc:1511] Processing CreateTablet for tablet a0f075ff99b34bd4bcefbec68c736f96 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:53.415829 20896 tablet_service.cc:1511] Processing CreateTablet for tablet e3be1e129ca7450b865739ce755c8b05 (DEFAULT_TABLE table=test-workload [id=b78883c429db4040acd6de9fbd69ae22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:53.424520 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d425f635b4f4ca08a7e064630f35748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.426782 20899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c0be00a95a4b55a3cb57ee1cdadb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.428769 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f075ff99b34bd4bcefbec68c736f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.430683 20896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3be1e129ca7450b865739ce755c8b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.433174 20895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92fe9272504412e8cb26f3d6b87d96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.433854 20898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945e7aee947b4000b3adb3a542e97481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:53.477794 21103 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.485122 21103 tablet_bootstrap.cc:654] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.512583 21104 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.523126 21104 tablet_bootstrap.cc:654] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.527707 21102 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.538012 21103 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.538691 21103 ts_tablet_manager.cc:1403] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 12:18:53.541038 21102 tablet_bootstrap.cc:654] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.542689 21103 raft_consensus.cc:359] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.543853 21103 raft_consensus.cc:385] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.544214 21103 raft_consensus.cc:740] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.545746 21104 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:53.545346 21103 consensus_queue.cc:260] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.546280 21104 ts_tablet_manager.cc:1403] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.011s
I20260709 12:18:53.547330 21102 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.547917 21102 ts_tablet_manager.cc:1403] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:18:53.548004 21012 heartbeater.cc:499] Master 127.8.178.254:38643 was elected leader, sending a full tablet report...
I20260709 12:18:53.548380 21103 ts_tablet_manager.cc:1434] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:53.549646 21103 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.549808 21104 raft_consensus.cc:359] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.550591 21104 raft_consensus.cc:385] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.550856 21104 raft_consensus.cc:740] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.551710 21104 consensus_queue.cc:260] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.551723 21102 raft_consensus.cc:359] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.552664 21102 raft_consensus.cc:385] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.552950 21102 raft_consensus.cc:740] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.553840 21102 consensus_queue.cc:260] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.556742 21103 tablet_bootstrap.cc:654] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.562649 21087 heartbeater.cc:499] Master 127.8.178.254:38643 was elected leader, sending a full tablet report...
I20260709 12:18:53.563841 21102 ts_tablet_manager.cc:1434] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 12:18:53.565189 21102 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.572729 21102 tablet_bootstrap.cc:654] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.576658 20937 heartbeater.cc:499] Master 127.8.178.254:38643 was elected leader, sending a full tablet report...
I20260709 12:18:53.578050 21103 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.578737 21103 ts_tablet_manager.cc:1403] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:18:53.582077 21103 raft_consensus.cc:359] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.583086 21103 raft_consensus.cc:385] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.583525 21103 raft_consensus.cc:740] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.584445 21103 consensus_queue.cc:260] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.585906 21102 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.586532 21102 ts_tablet_manager.cc:1403] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:18:53.586812 21104 ts_tablet_manager.cc:1434] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.005s
I20260709 12:18:53.587528 21103 ts_tablet_manager.cc:1434] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:53.587984 21104 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.588654 21103 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.589695 21102 raft_consensus.cc:359] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.590530 21102 raft_consensus.cc:385] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.590816 21102 raft_consensus.cc:740] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.591850 21102 consensus_queue.cc:260] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.594395 21102 ts_tablet_manager.cc:1434] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:53.595468 21102 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.595867 21104 tablet_bootstrap.cc:654] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.596119 21103 tablet_bootstrap.cc:654] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.603024 21102 tablet_bootstrap.cc:654] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.609573 21103 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.610244 21103 ts_tablet_manager.cc:1403] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 12:18:53.613574 21102 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.613541 21103 raft_consensus.cc:359] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.614326 21102 ts_tablet_manager.cc:1403] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:18:53.614374 21103 raft_consensus.cc:385] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.614854 21103 raft_consensus.cc:740] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.615826 21103 consensus_queue.cc:260] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.617754 21102 raft_consensus.cc:359] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.618604 21102 raft_consensus.cc:385] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.618886 21102 raft_consensus.cc:740] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.619971 21102 consensus_queue.cc:260] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.620828 21103 ts_tablet_manager.cc:1434] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:53.621948 21103 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.625135 21102 ts_tablet_manager.cc:1434] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:53.626403 21102 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.628957 21103 tablet_bootstrap.cc:654] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.633445 21102 tablet_bootstrap.cc:654] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.644268 21103 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.645033 21103 ts_tablet_manager.cc:1403] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:18:53.646998 21110 raft_consensus.cc:493] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.647684 21110 raft_consensus.cc:515] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.648922 21103 raft_consensus.cc:359] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.650118 21103 raft_consensus.cc:385] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.650532 21103 raft_consensus.cc:740] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.651508 21103 consensus_queue.cc:260] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.653604 21104 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:53.653973 21103 ts_tablet_manager.cc:1434] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:53.654202 21104 ts_tablet_manager.cc:1403] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.066s	user 0.033s	sys 0.021s
I20260709 12:18:53.655288 21103 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.657418 21104 raft_consensus.cc:359] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.658175 21104 raft_consensus.cc:385] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.658502 21104 raft_consensus.cc:740] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.659265 21104 consensus_queue.cc:260] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.663232 21110 leader_election.cc:290] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035)
I20260709 12:18:53.663830 21103 tablet_bootstrap.cc:654] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.667409 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:53.668342 20987 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:53.670030 21026 leader_election.cc:304] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:53.671087 21110 raft_consensus.cc:2804] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.671470 21110 raft_consensus.cc:493] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.671801 21110 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.673241 21104 ts_tablet_manager.cc:1434] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:18:53.674407 21104 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.676607 21103 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.677116 21103 ts_tablet_manager.cc:1403] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 12:18:53.679736 21103 raft_consensus.cc:359] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.680521 21103 raft_consensus.cc:385] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.680800 21103 raft_consensus.cc:740] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.680874 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:53.681620 21103 consensus_queue.cc:260] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.682478 21104 tablet_bootstrap.cc:654] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:53.682901 21024 leader_election.cc:343] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.684064 21103 ts_tablet_manager.cc:1434] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:53.684945 21103 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.689402 21102 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.690025 21102 ts_tablet_manager.cc:1403] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.008s
I20260709 12:18:53.691479 21103 tablet_bootstrap.cc:654] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.693213 21102 raft_consensus.cc:359] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.693990 21102 raft_consensus.cc:385] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.694284 21102 raft_consensus.cc:740] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.695125 21110 raft_consensus.cc:515] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.695264 21102 consensus_queue.cc:260] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.698302 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:53.699079 20987 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.707476 21110 leader_election.cc:290] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035)
I20260709 12:18:53.709038 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:53.709249 20987 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:53.710660 21026 leader_election.cc:304] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
W20260709 12:18:53.711449 21024 leader_election.cc:343] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.711577 21102 ts_tablet_manager.cc:1434] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.009s
I20260709 12:18:53.706859 21123 raft_consensus.cc:493] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.712908 21110 raft_consensus.cc:2804] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.714035 21110 raft_consensus.cc:697] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:53.713852 21123 raft_consensus.cc:515] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.715255 21110 consensus_queue.cc:237] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:53.716652 21123 leader_election.cc:290] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.716917 21103 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.718290 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:53.721118 21103 ts_tablet_manager.cc:1403] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.005s
I20260709 12:18:53.719556 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
W20260709 12:18:53.721691 21024 leader_election.cc:343] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.721994 20987 raft_consensus.cc:2468] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:53.719986 21102 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.723395 21026 leader_election.cc:304] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:53.724597 21123 raft_consensus.cc:2804] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.724975 21123 raft_consensus.cc:493] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.724843 21103 raft_consensus.cc:359] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.725447 21123 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.725570 21103 raft_consensus.cc:385] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.725996 21103 raft_consensus.cc:740] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.719432 21104 tablet_bootstrap.cc:492] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:53.726872 21104 ts_tablet_manager.cc:1403] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.006s
I20260709 12:18:53.726867 21103 consensus_queue.cc:260] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.732513 21122 raft_consensus.cc:493] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.733166 21122 raft_consensus.cc:515] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.741283 21103 ts_tablet_manager.cc:1434] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:18:53.742144 21122 leader_election.cc:290] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.742339 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:53.742552 21103 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.743211 21104 raft_consensus.cc:359] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.744048 21104 raft_consensus.cc:385] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.744385 21104 raft_consensus.cc:740] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.744855 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:53.754051 21103 tablet_bootstrap.cc:654] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.754251 20987 raft_consensus.cc:2468] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
W20260709 12:18:53.749735 20858 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:53.745326 21104 consensus_queue.cc:260] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.753165 21102 tablet_bootstrap.cc:654] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:53.744547 21024 leader_election.cc:343] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.763134 21104 ts_tablet_manager.cc:1434] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.007s
I20260709 12:18:53.764736 21026 leader_election.cc:304] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:53.766064 21110 raft_consensus.cc:2804] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.766471 21110 raft_consensus.cc:493] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.766796 20810 catalog_manager.cc:5697] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.768219 21103 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.768808 21103 ts_tablet_manager.cc:1403] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.000s
I20260709 12:18:53.772071 21103 raft_consensus.cc:359] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.773000 21103 raft_consensus.cc:385] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.773356 21103 raft_consensus.cc:740] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.778671 21123 raft_consensus.cc:515] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.780794 21104 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.781826 21123 leader_election.cc:290] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.782289 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:53.774236 21103 consensus_queue.cc:260] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.782809 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:53.766824 21110 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.783444 20987 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.783391 21109 raft_consensus.cc:493] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.785169 21109 raft_consensus.cc:515] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.782981 20912 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.787523 21103 ts_tablet_manager.cc:1434] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:18:53.788795 21103 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:53.796011 21103 tablet_bootstrap.cc:654] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.796845 21104 tablet_bootstrap.cc:654] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.799584 21110 raft_consensus.cc:515] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.800539 21109 leader_election.cc:290] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:53.819041 20987 raft_consensus.cc:2468] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:53.821498 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:53.824141 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:53.841529 20986 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.824700 21110 leader_election.cc:290] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.825235 20912 raft_consensus.cc:2468] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
W20260709 12:18:53.847405 21024 leader_election.cc:343] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.848209 21024 leader_election.cc:304] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:53.851382 21102 tablet_bootstrap.cc:492] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.851987 21110 raft_consensus.cc:2804] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.852138 21102 ts_tablet_manager.cc:1403] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.132s	user 0.040s	sys 0.056s
I20260709 12:18:53.852746 21110 raft_consensus.cc:697] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:53.855592 21110 consensus_queue.cc:237] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.856021 21102 raft_consensus.cc:359] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.854542 20986 raft_consensus.cc:2468] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:53.857856 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:53.858397 21026 leader_election.cc:304] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:53.856917 21102 raft_consensus.cc:385] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.859619 21102 raft_consensus.cc:740] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.859670 21123 raft_consensus.cc:2804] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.860711 21102 consensus_queue.cc:260] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.861510 21123 raft_consensus.cc:697] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:53.862473 21123 consensus_queue.cc:237] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:53.869377 20878 leader_election.cc:343] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.870373 21103 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.871048 21103 ts_tablet_manager.cc:1403] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.051s
I20260709 12:18:53.872193 21104 tablet_bootstrap.cc:492] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:53.872826 21104 ts_tablet_manager.cc:1403] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.004s
I20260709 12:18:53.873766 21122 raft_consensus.cc:493] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.874150 21103 raft_consensus.cc:359] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.875167 21103 raft_consensus.cc:385] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.875473 21103 raft_consensus.cc:740] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.874351 21122 raft_consensus.cc:515] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.878640 21102 ts_tablet_manager.cc:1434] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.008s
I20260709 12:18:53.878468 21103 consensus_queue.cc:260] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.879793 21102 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.880252 21122 leader_election.cc:290] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.882233 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:53.884011 20987 raft_consensus.cc:2468] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:53.885555 21026 leader_election.cc:304] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:53.886885 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:53.888262 21103 ts_tablet_manager.cc:1434] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 12:18:53.888546 21024 leader_election.cc:343] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.889895 21122 raft_consensus.cc:2804] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:53.890405 21122 raft_consensus.cc:493] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.890858 21122 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.887378 21102 tablet_bootstrap.cc:654] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.895952 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:53.897148 21103 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
W20260709 12:18:53.897670 20877 leader_election.cc:343] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.898190 20877 leader_election.cc:304] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:53.899425 21109 raft_consensus.cc:2749] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:53.906371 21103 tablet_bootstrap.cc:654] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.906773 21104 raft_consensus.cc:359] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.908301 21104 raft_consensus.cc:385] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.911748 21122 raft_consensus.cc:515] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.909045 21104 raft_consensus.cc:740] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.915670 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:53.916007 21104 consensus_queue.cc:260] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:53.917510 21024 leader_election.cc:343] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:53.919039 20810 catalog_manager.cc:5697] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.920814 21102 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:53.921397 21102 ts_tablet_manager.cc:1403] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.002s
I20260709 12:18:53.921162 20810 catalog_manager.cc:5697] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.919021 21104 ts_tablet_manager.cc:1434] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.003s
I20260709 12:18:53.923944 21104 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.924666 21102 raft_consensus.cc:359] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.925459 21102 raft_consensus.cc:385] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.925747 21102 raft_consensus.cc:740] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.926612 21108 raft_consensus.cc:493] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.926937 21122 leader_election.cc:290] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:53.928738 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:53.930888 20987 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.930744 21102 consensus_queue.cc:260] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.931393 21103 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:53.931938 21103 ts_tablet_manager.cc:1403] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.016s
I20260709 12:18:53.933439 21102 ts_tablet_manager.cc:1434] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:18:53.934563 21102 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:53.927230 21108 raft_consensus.cc:515] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.934906 21103 raft_consensus.cc:359] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.935590 21103 raft_consensus.cc:385] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.935875 21103 raft_consensus.cc:740] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.936694 21103 consensus_queue.cc:260] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.942260 21102 tablet_bootstrap.cc:654] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.942915 21108 leader_election.cc:290] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:53.957191 21104 tablet_bootstrap.cc:654] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:53.970327 21104 tablet_bootstrap.cc:492] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:53.971007 21104 ts_tablet_manager.cc:1403] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.003s
I20260709 12:18:53.973536 20987 raft_consensus.cc:2468] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:53.974646 21104 raft_consensus.cc:359] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.976940 21104 raft_consensus.cc:385] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:53.977418 21104 raft_consensus.cc:740] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:53.978564 21104 consensus_queue.cc:260] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.979032 21026 leader_election.cc:304] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:53.980122 21122 raft_consensus.cc:2804] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:53.980599 21122 raft_consensus.cc:697] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:53.981427 21122 consensus_queue.cc:237] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.988772 21104 ts_tablet_manager.cc:1434] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:18:53.992856 21109 raft_consensus.cc:493] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.993664 21109 raft_consensus.cc:515] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:53.996125 21109 leader_election.cc:290] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:53.998709 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:53.993253 21104 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:53.999485 21062 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 0.
I20260709 12:18:54.000905 20878 leader_election.cc:304] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.001488 21108 raft_consensus.cc:493] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.001890 21109 raft_consensus.cc:2804] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.002381 21109 raft_consensus.cc:493] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.002821 21109 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:53.997908 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.002032 21108 raft_consensus.cc:515] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.006767 20987 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 0.
I20260709 12:18:54.007381 20810 catalog_manager.cc:5697] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.009346 21108 leader_election.cc:290] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.014616 21109 raft_consensus.cc:515] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.017563 21104 tablet_bootstrap.cc:654] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.019467 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.020188 20987 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.020351 21108 raft_consensus.cc:493] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.020893 21108 raft_consensus.cc:515] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.016623 21146 raft_consensus.cc:493] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.023098 21108 leader_election.cc:290] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.023208 21146 raft_consensus.cc:515] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.025735 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.026919 21062 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.035023 21062 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:54.036432 20878 leader_election.cc:304] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.037631 21061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:54.039268 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:54.041944 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:54.042657 21060 raft_consensus.cc:2468] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
W20260709 12:18:54.044314 20953 leader_election.cc:343] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:54.045140 20953 leader_election.cc:343] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.026273 21109 leader_election.cc:290] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.046017 20953 leader_election.cc:304] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.046833 21108 raft_consensus.cc:2804] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.047261 21108 raft_consensus.cc:493] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.047571 21108 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.051003 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.051898 20986 raft_consensus.cc:2393] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8fa47222ab94faea1241a2034c3e7af in current term 1: Already voted for candidate bc52017e4298417cbac6d1f33ff45def in this term.
I20260709 12:18:54.046725 21109 raft_consensus.cc:2804] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.054339 21109 raft_consensus.cc:697] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:54.059557 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:54.060043 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
W20260709 12:18:54.061525 20950 leader_election.cc:343] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.062636 20950 leader_election.cc:304] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7db1e9b4dfe4abaafa0e140bafbc556; no voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.062251 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:54.064738 21140 raft_consensus.cc:2749] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:54.064904 20950 leader_election.cc:343] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.065416 20950 leader_election.cc:304] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7db1e9b4dfe4abaafa0e140bafbc556; no voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.063928 21108 raft_consensus.cc:515] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:54.066555 20950 leader_election.cc:343] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.063467 21103 ts_tablet_manager.cc:1434] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.131s	user 0.027s	sys 0.053s
I20260709 12:18:54.067828 21102 tablet_bootstrap.cc:492] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:54.068567 21102 ts_tablet_manager.cc:1403] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.071s
I20260709 12:18:54.069382 21146 leader_election.cc:290] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.070518 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.072521 21102 raft_consensus.cc:359] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:54.073854 20950 leader_election.cc:343] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:54.074345 21140 raft_consensus.cc:2749] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.078953 21102 raft_consensus.cc:385] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.079396 21102 raft_consensus.cc:740] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.075832 21108 leader_election.cc:290] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.079613 20987 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:54.076565 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.077589 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:54.068666 21109 consensus_queue.cc:237] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.080704 21102 consensus_queue.cc:260] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.081348 21104 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:54.082695 20878 leader_election.cc:304] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.084889 21104 ts_tablet_manager.cc:1403] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.029s
I20260709 12:18:54.085944 21148 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.080754 21062 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.091318 21102 ts_tablet_manager.cc:1434] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:18:54.092765 21102 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:54.096362 21062 raft_consensus.cc:2468] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:54.098058 20953 leader_election.cc:304] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.089735 21104 raft_consensus.cc:359] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.099545 21104 raft_consensus.cc:385] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.099745 21108 raft_consensus.cc:2804] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.100486 21108 raft_consensus.cc:697] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:54.101390 21108 consensus_queue.cc:237] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.104962 21148 raft_consensus.cc:2749] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.099846 21104 raft_consensus.cc:740] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.106419 21104 consensus_queue.cc:260] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.108799 21104 ts_tablet_manager.cc:1434] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:18:54.107300 21102 tablet_bootstrap.cc:654] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.109138 20810 catalog_manager.cc:5697] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 1 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.110132 21104 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:54.117545 21104 tablet_bootstrap.cc:654] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.120683 21102 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:54.124599 21102 ts_tablet_manager.cc:1403] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.000s
I20260709 12:18:54.127362 21102 raft_consensus.cc:359] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.128042 21102 raft_consensus.cc:385] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.128309 21102 raft_consensus.cc:740] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.129207 21102 consensus_queue.cc:260] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.135833 21102 ts_tablet_manager.cc:1434] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:18:54.136840 21102 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:54.139528 20809 catalog_manager.cc:5697] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.142846 21102 tablet_bootstrap.cc:654] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:54.150352 21024 consensus_peers.cc:597] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.152736 21104 tablet_bootstrap.cc:492] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:54.153457 21104 ts_tablet_manager.cc:1403] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.017s
I20260709 12:18:54.156620 21104 raft_consensus.cc:359] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.157450 21104 raft_consensus.cc:385] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.157792 21104 raft_consensus.cc:740] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.158603 21104 consensus_queue.cc:260] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.160913 21104 ts_tablet_manager.cc:1434] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:18:54.162009 21104 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:54.164105 21102 tablet_bootstrap.cc:492] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:54.164665 21102 ts_tablet_manager.cc:1403] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 12:18:54.168994 21104 tablet_bootstrap.cc:654] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.169306 21102 raft_consensus.cc:359] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.170089 21102 raft_consensus.cc:385] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.170354 21102 raft_consensus.cc:740] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.171221 21102 consensus_queue.cc:260] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.175357 21102 ts_tablet_manager.cc:1434] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:18:54.184785 21104 tablet_bootstrap.cc:492] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:54.185307 21104 ts_tablet_manager.cc:1403] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 12:18:54.187579 21104 raft_consensus.cc:359] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.188215 21104 raft_consensus.cc:385] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.188472 21104 raft_consensus.cc:740] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.189043 21104 consensus_queue.cc:260] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.190641 21104 ts_tablet_manager.cc:1434] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:18:54.191449 21104 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:54.195720 21104 tablet_bootstrap.cc:654] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:54.199291 21122 raft_consensus.cc:493] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.199862 21122 raft_consensus.cc:515] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.202092 21122 leader_election.cc:290] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.203938 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:54.204805 20911 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.205542 21104 tablet_bootstrap.cc:492] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:54.204782 21122 consensus_queue.cc:1048] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.206099 21104 ts_tablet_manager.cc:1403] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:18:54.206566 21024 leader_election.cc:304] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.207477 21110 raft_consensus.cc:2804] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.207859 21110 raft_consensus.cc:493] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.208168 21110 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.208995 21104 raft_consensus.cc:359] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.209721 21104 raft_consensus.cc:385] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:54.209988 21104 raft_consensus.cc:740] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:54.204420 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.210822 21104 consensus_queue.cc:260] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.211275 20987 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.210731 21123 raft_consensus.cc:493] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.213587 21123 raft_consensus.cc:515] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.215914 21123 leader_election.cc:290] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.218859 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:54.219621 20911 raft_consensus.cc:2468] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.220422 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.220906 21024 leader_election.cc:304] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.221230 20987 raft_consensus.cc:2468] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.221879 21123 raft_consensus.cc:2804] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.222263 21123 raft_consensus.cc:493] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.222616 21123 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.228523 21110 raft_consensus.cc:515] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.231365 21110 leader_election.cc:290] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.213161 21104 ts_tablet_manager.cc:1434] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:54.236335 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.236987 20987 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.230070 21123 raft_consensus.cc:515] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.242475 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.243187 20911 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.244444 21123 leader_election.cc:290] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.244685 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.245365 20912 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.248088 20987 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.249552 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.250198 20987 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.252717 21026 leader_election.cc:304] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.253997 21110 raft_consensus.cc:2804] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.254503 21110 raft_consensus.cc:697] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.255335 21110 consensus_queue.cc:237] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.258270 20987 raft_consensus.cc:2468] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.259337 20912 raft_consensus.cc:2468] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.260851 21024 leader_election.cc:304] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.261768 21122 raft_consensus.cc:2804] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.262228 21122 raft_consensus.cc:697] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.263069 21122 consensus_queue.cc:237] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.264526 20911 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.290747 20810 catalog_manager.cc:5697] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.293509 20911 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.303093 21135 consensus_queue.cc:1048] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.305935 20810 catalog_manager.cc:5697] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.326743 21162 consensus_queue.cc:1048] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.358923 21135 consensus_queue.cc:1048] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.365178 21135 raft_consensus.cc:493] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.365769 21135 raft_consensus.cc:515] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.369398 21135 leader_election.cc:290] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.370878 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:54.371601 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.372395 20987 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.377869 21135 consensus_queue.cc:1048] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.378377 21026 leader_election.cc:304] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.379447 21135 raft_consensus.cc:2804] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:54.379827 21135 raft_consensus.cc:493] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.380169 21135 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.381059 20912 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:54.386714 21135 raft_consensus.cc:515] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.389786 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.390401 20912 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.390965 21135 leader_election.cc:290] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:54.391587 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.392318 20986 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.399618 20912 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.400892 21024 leader_election.cc:304] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:54.401902 21135 raft_consensus.cc:2804] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:54.402388 21135 raft_consensus.cc:697] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.403252 20986 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:54.403205 21135 consensus_queue.cc:237] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.411805 20809 catalog_manager.cc:5697] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.476701 21135 consensus_queue.cc:1048] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.481604 21109 consensus_queue.cc:1048] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.488225 21122 consensus_queue.cc:1048] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.501965 21109 consensus_queue.cc:1048] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.518996 20912 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.525188 21108 consensus_queue.cc:1048] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.537321 21173 consensus_queue.cc:1048] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.583339 21109 raft_consensus.cc:493] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.583864 21109 raft_consensus.cc:515] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.585618 21109 leader_election.cc:290] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.586364 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:54.586654 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:54.587858 20878 leader_election.cc:304] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.588559 21109 raft_consensus.cc:2749] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:54.656837 21135 consensus_queue.cc:1048] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.668036 21123 consensus_queue.cc:1048] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.688405 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.689194 21062 raft_consensus.cc:606] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.694819 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.695350 21062 raft_consensus.cc:606] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.700333 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.700842 21062 raft_consensus.cc:606] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.704571 20912 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:54.706205 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.706835 21062 raft_consensus.cc:606] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.711913 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.712469 21062 raft_consensus.cc:606] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.715833 21162 raft_consensus.cc:993] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.716308 21123 raft_consensus.cc:1081] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.717732 20912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39146
I20260709 12:18:54.717998 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.718269 20912 raft_consensus.cc:493] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.718708 21062 raft_consensus.cc:606] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.718742 20912 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.726272 20912 raft_consensus.cc:515] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.728859 20912 leader_election.cc:290] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.729642 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.730526 20986 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.729635 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.734624 21062 raft_consensus.cc:3055] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.734997 21062 raft_consensus.cc:740] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.735975 20912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:39162
I20260709 12:18:54.735857 21062 consensus_queue.cc:260] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.736588 20912 raft_consensus.cc:606] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.737258 21062 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.739643 20986 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.740897 20877 leader_election.cc:304] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.741739 21109 raft_consensus.cc:2804] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.742149 21109 raft_consensus.cc:697] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:54.742466 21060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:54.743108 21060 raft_consensus.cc:606] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:54.743027 21109 consensus_queue.cc:237] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:18:54.744880 21062 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.750620 20809 catalog_manager.cc:5697] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.759205 20986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:18:54.759932 20986 raft_consensus.cc:606] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:18:54.777367 21162 raft_consensus.cc:993] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.777805 21123 raft_consensus.cc:1081] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.779248 20912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39146
I20260709 12:18:54.779745 20912 raft_consensus.cc:493] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.780041 20912 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.786626 20912 raft_consensus.cc:515] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.788424 20912 leader_election.cc:290] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.789242 20986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.789412 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a4e4f8e5b848e88ebfb909cb429b7a" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.789880 20986 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.789958 21062 raft_consensus.cc:3055] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.790326 21062 raft_consensus.cc:740] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.791081 21062 consensus_queue.cc:260] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.792047 21062 raft_consensus.cc:3060] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.795334 20986 raft_consensus.cc:2468] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.796607 20877 leader_election.cc:304] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.797216 21062 raft_consensus.cc:2468] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.797454 21109 raft_consensus.cc:2804] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.798051 21109 raft_consensus.cc:697] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:54.798830 21109 consensus_queue.cc:237] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.804893 20809 catalog_manager.cc:5697] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.822952 21123 consensus_queue.cc:1048] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.830178 21162 raft_consensus.cc:993] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.830704 21162 raft_consensus.cc:1081] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.833927 20987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:18:54.834551 20987 raft_consensus.cc:493] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.834976 20987 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.838927 21123 consensus_queue.cc:1048] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.840292 21162 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:54.844494 20987 raft_consensus.cc:515] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.848362 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.848883 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9358ee83f89640d5bdf3a594b9e5cb57" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.849782 21062 raft_consensus.cc:3055] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.850160 21062 raft_consensus.cc:740] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.851300 21062 consensus_queue.cc:260] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.852342 21062 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.859119 21123 raft_consensus.cc:993] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.859710 21123 raft_consensus.cc:1081] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.861940 20985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:18:54.863140 20985 raft_consensus.cc:493] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.863588 20985 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.868149 20987 leader_election.cc:290] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.869740 21162 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:54.873289 20985 raft_consensus.cc:515] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.874945 21062 raft_consensus.cc:2468] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:54.876319 20953 leader_election.cc:304] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.876611 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.878011 21173 raft_consensus.cc:2804] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.878542 21173 raft_consensus.cc:697] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:54.879380 21173 consensus_queue.cc:237] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.880901 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.881517 21062 raft_consensus.cc:3055] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.881781 21062 raft_consensus.cc:740] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.882582 21062 consensus_queue.cc:260] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.883653 20985 leader_election.cc:290] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.883836 21062 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.889735 21109 raft_consensus.cc:993] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.890254 21148 raft_consensus.cc:1081] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:54.890089 20809 catalog_manager.cc:5697] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.891985 21062 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:54.892549 20985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60018
I20260709 12:18:54.893179 20953 leader_election.cc:304] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:54.893560 20985 raft_consensus.cc:493] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.893962 20985 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.894088 21173 raft_consensus.cc:2804] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.894984 21173 raft_consensus.cc:697] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:54.895892 21173 consensus_queue.cc:237] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.902053 20985 raft_consensus.cc:515] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.904376 20985 leader_election.cc:290] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.904655 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:54.904999 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3be1e129ca7450b865739ce755c8b05" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.905458 20911 raft_consensus.cc:3055] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.905658 21062 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.905897 20911 raft_consensus.cc:740] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:54.905874 20809 catalog_manager.cc:5697] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.907091 20911 consensus_queue.cc:260] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.908598 20911 raft_consensus.cc:3060] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.912326 21062 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:54.914003 20953 leader_election.cc:304] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.915045 21173 raft_consensus.cc:2804] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.915542 21173 raft_consensus.cc:697] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:54.915611 21123 raft_consensus.cc:993] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.916173 21123 raft_consensus.cc:1081] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:54.916792 20911 raft_consensus.cc:2468] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:54.916407 21173 consensus_queue.cc:237] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.918123 20912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39146
I20260709 12:18:54.918769 20912 raft_consensus.cc:493] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.919129 20912 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.924290 20809 catalog_manager.cc:5697] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from d8fa47222ab94faea1241a2034c3e7af (127.8.178.193) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.924721 20912 raft_consensus.cc:515] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.926766 20912 leader_election.cc:290] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:54.927485 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:54.927843 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f075ff99b34bd4bcefbec68c736f96" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:54.928191 20985 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.928476 21062 raft_consensus.cc:3055] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:54.928800 21062 raft_consensus.cc:740] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:54.929518 21062 consensus_queue.cc:260] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.930888 21062 raft_consensus.cc:3060] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:54.935053 20985 raft_consensus.cc:2468] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.936189 20877 leader_election.cc:304] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:54.937009 21148 raft_consensus.cc:2804] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:54.937402 21148 raft_consensus.cc:697] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:54.937896 21062 raft_consensus.cc:2468] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:54.938135 21148 consensus_queue.cc:237] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:54.945732 20809 catalog_manager.cc:5697] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.072139 21123 raft_consensus.cc:993] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:55.072579 21162 raft_consensus.cc:1081] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:55.074074 20912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39146
I20260709 12:18:55.074605 20912 raft_consensus.cc:493] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.074967 20912 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.080406 20912 raft_consensus.cc:515] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.082345 20912 leader_election.cc:290] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:55.083384 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:55.083380 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c0be00a95a4b55a3cb57ee1cdadb0c" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:55.084143 21062 raft_consensus.cc:3055] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:55.084406 20985 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.084547 21062 raft_consensus.cc:740] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:55.085433 21062 consensus_queue.cc:260] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.086397 21062 raft_consensus.cc:3060] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.090129 20985 raft_consensus.cc:2468] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:55.091305 20877 leader_election.cc:304] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:55.091823 21062 raft_consensus.cc:2468] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:55.091998 21148 raft_consensus.cc:2804] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:55.092546 21148 raft_consensus.cc:697] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:55.093348 21148 consensus_queue.cc:237] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.099093 20809 catalog_manager.cc:5697] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.107044 21140 raft_consensus.cc:993] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:18:55.107626 21186 raft_consensus.cc:1081] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:18:55.109071 21062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41338
I20260709 12:18:55.109582 21062 raft_consensus.cc:493] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.109911 21062 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.115006 21062 raft_consensus.cc:515] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.116732 21062 leader_election.cc:290] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:55.117646 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:55.118359 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d425f635b4f4ca08a7e064630f35748" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:55.118417 20912 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.119108 20985 raft_consensus.cc:3055] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:55.119426 20985 raft_consensus.cc:740] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:55.120041 20985 consensus_queue.cc:260] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.120842 20985 raft_consensus.cc:3060] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.124853 20912 raft_consensus.cc:2468] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 2.
I20260709 12:18:55.125636 20911 raft_consensus.cc:1240] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Rejecting Update request from peer f7db1e9b4dfe4abaafa0e140bafbc556 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:55.126281 21024 leader_election.cc:304] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:55.126595 20985 raft_consensus.cc:2468] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 2.
I20260709 12:18:55.127213 21162 raft_consensus.cc:2804] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:55.127693 21162 raft_consensus.cc:697] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 2 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:55.128484 21162 consensus_queue.cc:237] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.135128 20808 catalog_manager.cc:5697] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 1 to 2, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 2 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.199597 20985 raft_consensus.cc:1275] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.200763 21148 consensus_queue.cc:1048] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.203413 20987 raft_consensus.cc:1275] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.204957 21109 consensus_queue.cc:1048] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.209632 21062 raft_consensus.cc:1275] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.212245 21187 consensus_queue.cc:1048] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.217163 21060 raft_consensus.cc:1275] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.218721 21146 consensus_queue.cc:1048] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.226265 21122 raft_consensus.cc:993] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:55.226748 21162 raft_consensus.cc:1081] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:55.228332 20985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:18:55.228855 20985 raft_consensus.cc:493] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.229154 20985 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.234862 20985 raft_consensus.cc:515] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.237048 20985 leader_election.cc:290] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:55.238294 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:55.238641 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92fe9272504412e8cb26f3d6b87d96f" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:55.238941 20911 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.239279 21062 raft_consensus.cc:3055] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:55.239562 21062 raft_consensus.cc:740] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:55.240234 21062 consensus_queue.cc:260] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.241171 21062 raft_consensus.cc:3060] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.244398 20911 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:55.245497 20950 leader_election.cc:304] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:55.246224 21186 raft_consensus.cc:2804] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:55.246747 21186 raft_consensus.cc:697] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:55.247144 21062 raft_consensus.cc:2468] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:55.247568 21186 consensus_queue.cc:237] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:55.254611 20808 catalog_manager.cc:5697] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.332271 20985 raft_consensus.cc:1275] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.333477 21146 consensus_queue.cc:1048] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.341069 21062 raft_consensus.cc:1275] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.343338 21146 consensus_queue.cc:1048] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.349066 20911 raft_consensus.cc:1275] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.350461 21186 consensus_queue.cc:1048] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.360153 21062 raft_consensus.cc:1275] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.361657 21173 consensus_queue.cc:1048] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.429457 20911 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.434849 20911 raft_consensus.cc:1275] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.436149 21173 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.443532 21062 raft_consensus.cc:1275] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.445852 21140 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.457423 20911 raft_consensus.cc:3060] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:55.460865 21062 raft_consensus.cc:1275] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.462201 21140 consensus_queue.cc:1048] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.464956 20911 raft_consensus.cc:1275] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.466408 21140 consensus_queue.cc:1048] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.573940 21062 raft_consensus.cc:1275] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.575227 21146 consensus_queue.cc:1048] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.583688 20985 raft_consensus.cc:1275] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.585620 21187 consensus_queue.cc:1048] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.630230 20911 raft_consensus.cc:1275] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.631559 21162 consensus_queue.cc:1048] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.640221 20985 raft_consensus.cc:1275] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.641644 21122 consensus_queue.cc:1048] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.690044 21062 raft_consensus.cc:1275] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.691273 21140 consensus_queue.cc:1048] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:55.700196 20911 raft_consensus.cc:1275] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:55.704440 21173 consensus_queue.cc:1048] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:57.829890 20810 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42306:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:57.832072 20810 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:57.883700 20902 tablet_service.cc:1511] Processing CreateTablet for tablet 80b9380511ec48b38bacedb1d48f2a67 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:57.884690 20970 tablet_service.cc:1511] Processing CreateTablet for tablet 80b9380511ec48b38bacedb1d48f2a67 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:57.885088 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b9380511ec48b38bacedb1d48f2a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.885999 20970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b9380511ec48b38bacedb1d48f2a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.885852 21048 tablet_service.cc:1511] Processing CreateTablet for tablet 80b9380511ec48b38bacedb1d48f2a67 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:57.887264 21048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b9380511ec48b38bacedb1d48f2a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.890166 20894 tablet_service.cc:1511] Processing CreateTablet for tablet a9685da56a3d45938fc81587d035167e (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:57.891561 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9685da56a3d45938fc81587d035167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.891170 20972 tablet_service.cc:1511] Processing CreateTablet for tablet a9685da56a3d45938fc81587d035167e (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:57.895071 20972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9685da56a3d45938fc81587d035167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.895910 21047 tablet_service.cc:1511] Processing CreateTablet for tablet a9685da56a3d45938fc81587d035167e (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:57.897269 21047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9685da56a3d45938fc81587d035167e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.897082 20897 tablet_service.cc:1511] Processing CreateTablet for tablet d0853d9b602946428be0b54d8db3fba5 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:57.898121 20969 tablet_service.cc:1511] Processing CreateTablet for tablet d0853d9b602946428be0b54d8db3fba5 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:57.898371 20897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0853d9b602946428be0b54d8db3fba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.899430 20969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0853d9b602946428be0b54d8db3fba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.903904 20898 tablet_service.cc:1511] Processing CreateTablet for tablet dd86a68c0bdd4232bf8fa4b61c20a869 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:57.904256 21045 tablet_service.cc:1511] Processing CreateTablet for tablet d0853d9b602946428be0b54d8db3fba5 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:57.905296 20898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd86a68c0bdd4232bf8fa4b61c20a869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.905582 21045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0853d9b602946428be0b54d8db3fba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.907127 21044 tablet_service.cc:1511] Processing CreateTablet for tablet dd86a68c0bdd4232bf8fa4b61c20a869 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:57.907876 20977 tablet_service.cc:1511] Processing CreateTablet for tablet dd86a68c0bdd4232bf8fa4b61c20a869 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:57.908457 21044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd86a68c0bdd4232bf8fa4b61c20a869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.909147 20977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd86a68c0bdd4232bf8fa4b61c20a869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.912289 20974 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86138da8b040c5aa6085094c26e9c1 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:57.913609 20974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86138da8b040c5aa6085094c26e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.915139 20900 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7e43f6ff54d9fb212745f8165acbd (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:57.915412 20899 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86138da8b040c5aa6085094c26e9c1 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:57.916214 21046 tablet_service.cc:1511] Processing CreateTablet for tablet 9c86138da8b040c5aa6085094c26e9c1 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:57.917469 21046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86138da8b040c5aa6085094c26e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.917685 20971 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7e43f6ff54d9fb212745f8165acbd (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:57.918957 20971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7e43f6ff54d9fb212745f8165acbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.923383 21050 tablet_service.cc:1511] Processing CreateTablet for tablet 88297a618b894e28866f169c89413c33 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:57.925415 21050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88297a618b894e28866f169c89413c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.925103 20895 tablet_service.cc:1511] Processing CreateTablet for tablet 18be5f23c22e4079b3e2e4058b1f6841 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:57.927891 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 88297a618b894e28866f169c89413c33 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:57.929243 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88297a618b894e28866f169c89413c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.929797 21052 tablet_service.cc:1511] Processing CreateTablet for tablet 18be5f23c22e4079b3e2e4058b1f6841 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:57.931133 21052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be5f23c22e4079b3e2e4058b1f6841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.931427 20973 tablet_service.cc:1511] Processing CreateTablet for tablet 18be5f23c22e4079b3e2e4058b1f6841 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:57.923970 20901 tablet_service.cc:1511] Processing CreateTablet for tablet 88297a618b894e28866f169c89413c33 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:57.932708 20973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be5f23c22e4079b3e2e4058b1f6841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.933148 20975 tablet_service.cc:1511] Processing CreateTablet for tablet 4a321279a53849279fab7ee3a0d68049 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:57.936220 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88297a618b894e28866f169c89413c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.939497 21049 tablet_service.cc:1511] Processing CreateTablet for tablet 4a321279a53849279fab7ee3a0d68049 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:57.940856 21049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a321279a53849279fab7ee3a0d68049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.944984 20895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18be5f23c22e4079b3e2e4058b1f6841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.945765 20899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c86138da8b040c5aa6085094c26e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.946374 20900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7e43f6ff54d9fb212745f8165acbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.922367 21051 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7e43f6ff54d9fb212745f8165acbd (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:57.947517 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7e43f6ff54d9fb212745f8165acbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.934335 20975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a321279a53849279fab7ee3a0d68049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.950841 20896 tablet_service.cc:1511] Processing CreateTablet for tablet 4a321279a53849279fab7ee3a0d68049 (DEFAULT_TABLE table=soft_deleted_table [id=65995fda6e114c809da092d667321ddf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:57.952203 20896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a321279a53849279fab7ee3a0d68049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:57.971648 21207 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:57.988628 21207 tablet_bootstrap.cc:654] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.102890 21210 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.112659 21207 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.113366 21207 ts_tablet_manager.cc:1403] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.010s
I20260709 12:18:58.118541 21208 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.122393 21210 tablet_bootstrap.cc:654] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.117609 21207 raft_consensus.cc:359] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.130223 21207 raft_consensus.cc:385] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.130669 21207 raft_consensus.cc:740] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.131619 21207 consensus_queue.cc:260] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.136184 21207 ts_tablet_manager.cc:1434] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 12:18:58.136394 21208 tablet_bootstrap.cc:654] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.137377 21207 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.146798 21207 tablet_bootstrap.cc:654] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.151315 21208 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.151774 21208 ts_tablet_manager.cc:1403] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.008s
I20260709 12:18:58.152930 21207 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.153589 21207 ts_tablet_manager.cc:1403] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 12:18:58.153512 21210 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.154351 21210 ts_tablet_manager.cc:1403] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.009s
I20260709 12:18:58.154227 21208 raft_consensus.cc:359] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.155107 21208 raft_consensus.cc:385] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.155519 21208 raft_consensus.cc:740] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.156275 21208 consensus_queue.cc:260] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.157321 21207 raft_consensus.cc:359] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.157490 21210 raft_consensus.cc:359] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.158304 21207 raft_consensus.cc:385] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.158376 21210 raft_consensus.cc:385] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.158679 21207 raft_consensus.cc:740] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.158790 21210 raft_consensus.cc:740] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.159577 21208 ts_tablet_manager.cc:1434] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:58.159541 21207 consensus_queue.cc:260] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.159766 21210 consensus_queue.cc:260] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.160876 21208 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.168376 21210 ts_tablet_manager.cc:1434] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:18:58.169759 21210 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.174016 21207 ts_tablet_manager.cc:1434] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.008s
I20260709 12:18:58.175253 21208 tablet_bootstrap.cc:654] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.175206 21207 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.184598 21207 tablet_bootstrap.cc:654] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.195044 21210 tablet_bootstrap.cc:654] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.198665 21208 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.199290 21208 ts_tablet_manager.cc:1403] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:18:58.200592 21207 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.201254 21207 ts_tablet_manager.cc:1403] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:18:58.202715 21208 raft_consensus.cc:359] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.203624 21208 raft_consensus.cc:385] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.204043 21208 raft_consensus.cc:740] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.204389 21207 raft_consensus.cc:359] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.205155 21187 raft_consensus.cc:493] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.205300 21207 raft_consensus.cc:385] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.204963 21208 consensus_queue.cc:260] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.205729 21207 raft_consensus.cc:740] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.205785 21187 raft_consensus.cc:515] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.206609 21207 consensus_queue.cc:260] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.209167 21207 ts_tablet_manager.cc:1434] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:58.208925 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.209728 20985 raft_consensus.cc:2468] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 0.
I20260709 12:18:58.209836 21208 ts_tablet_manager.cc:1434] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:18:58.211071 21208 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.211117 20877 leader_election.cc:304] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.214284 21207 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.219754 21208 tablet_bootstrap.cc:654] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.222862 21187 leader_election.cc:290] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.224416 21210 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.225047 21210 ts_tablet_manager.cc:1403] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.017s
I20260709 12:18:58.228396 21210 raft_consensus.cc:359] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.229072 21207 tablet_bootstrap.cc:654] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.229193 21210 raft_consensus.cc:385] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.230692 21210 raft_consensus.cc:740] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.231482 21210 consensus_queue.cc:260] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.233791 21210 ts_tablet_manager.cc:1434] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:18:58.234920 21210 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.239269 21218 raft_consensus.cc:2804] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.239768 21218 raft_consensus.cc:493] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.240094 21218 raft_consensus.cc:3060] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.240180 21208 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.240767 21208 ts_tablet_manager.cc:1403] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:18:58.244251 21208 raft_consensus.cc:359] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.245163 21208 raft_consensus.cc:385] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.245481 21208 raft_consensus.cc:740] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.246330 21208 consensus_queue.cc:260] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.248678 21208 ts_tablet_manager.cc:1434] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:18:58.249406 21210 tablet_bootstrap.cc:654] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.249821 21208 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
W20260709 12:18:58.250622 20878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:36281, user_credentials={real_user=slave}} blocked reactor thread for 46110.6us
I20260709 12:18:58.252411 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.255704 21218 raft_consensus.cc:515] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.256570 21208 tablet_bootstrap.cc:654] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.258821 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:58.259389 21218 leader_election.cc:290] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.259519 20985 raft_consensus.cc:3060] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.262138 21207 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.262715 21207 ts_tablet_manager.cc:1403] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.002s
I20260709 12:18:58.264319 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.265982 21207 raft_consensus.cc:359] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.266762 21207 raft_consensus.cc:385] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.267052 21207 raft_consensus.cc:740] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.267779 21207 consensus_queue.cc:260] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.270233 21207 ts_tablet_manager.cc:1434] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:58.271423 21207 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.271528 20985 raft_consensus.cc:2468] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:58.273451 20877 leader_election.cc:304] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.274339 21218 raft_consensus.cc:2804] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.274888 21218 raft_consensus.cc:697] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
W20260709 12:18:58.275465 20878 leader_election.cc:343] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.276567 21218 consensus_queue.cc:237] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:58.277261 20878 leader_election.cc:343] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.279066 21207 tablet_bootstrap.cc:654] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.284020 21208 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.285065 21208 ts_tablet_manager.cc:1403] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 12:18:58.286624 21217 raft_consensus.cc:493] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.287213 21217 raft_consensus.cc:515] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.288295 21210 tablet_bootstrap.cc:492] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.288915 21210 ts_tablet_manager.cc:1403] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.017s
I20260709 12:18:58.293045 21196 raft_consensus.cc:493] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.290553 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.295199 21196 raft_consensus.cc:515] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:58.296795 20877 leader_election.cc:343] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.288709 21208 raft_consensus.cc:359] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.298112 21208 raft_consensus.cc:385] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.298085 21210 raft_consensus.cc:359] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.298898 21208 raft_consensus.cc:740] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.299152 21210 raft_consensus.cc:385] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.299541 21210 raft_consensus.cc:740] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.298293 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.300170 21208 consensus_queue.cc:260] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:58.301405 21024 leader_election.cc:343] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.290946 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.303601 21208 ts_tablet_manager.cc:1434] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:18:58.304973 21208 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.300302 21210 consensus_queue.cc:260] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.307987 21210 ts_tablet_manager.cc:1434] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:18:58.309325 21210 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
W20260709 12:18:58.311542 20878 leader_election.cc:343] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.312067 20878 leader_election.cc:304] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.317188 21210 tablet_bootstrap.cc:654] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.317513 21208 tablet_bootstrap.cc:654] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.318074 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
W20260709 12:18:58.319847 21026 leader_election.cc:343] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.320359 21026 leader_election.cc:304] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def; no voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.321180 21196 leader_election.cc:290] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.321764 21196 raft_consensus.cc:2749] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.289604 21217 leader_election.cc:290] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.323068 21218 raft_consensus.cc:2749] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.323437 21196 raft_consensus.cc:493] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.323985 21196 raft_consensus.cc:515] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.324831 21207 tablet_bootstrap.cc:492] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.326103 21207 ts_tablet_manager.cc:1403] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.020s
I20260709 12:18:58.326347 20809 catalog_manager.cc:5697] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 1 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.327409 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
W20260709 12:18:58.328967 21026 leader_election.cc:343] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.329614 21196 leader_election.cc:290] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.329471 21207 raft_consensus.cc:359] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.330260 21207 raft_consensus.cc:385] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.330564 21207 raft_consensus.cc:740] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.331228 21207 consensus_queue.cc:260] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.333257 21207 ts_tablet_manager.cc:1434] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:58.334597 21207 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.338682 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
W20260709 12:18:58.340313 21024 leader_election.cc:343] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.340862 21210 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.340782 21024 leader_election.cc:304] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def; no voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.341105 21207 tablet_bootstrap.cc:654] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.341427 21210 ts_tablet_manager.cc:1403] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:18:58.342020 21196 raft_consensus.cc:2749] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.344810 21210 raft_consensus.cc:359] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.345724 21210 raft_consensus.cc:385] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.346072 21210 raft_consensus.cc:740] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.346887 21210 consensus_queue.cc:260] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.350291 21210 ts_tablet_manager.cc:1434] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:58.350805 21208 tablet_bootstrap.cc:492] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.351675 21208 ts_tablet_manager.cc:1403] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:18:58.352002 21210 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.354935 21208 raft_consensus.cc:359] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.355661 21208 raft_consensus.cc:385] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.355990 21208 raft_consensus.cc:740] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.356679 21208 consensus_queue.cc:260] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.357292 21207 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.358382 21207 ts_tablet_manager.cc:1403] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:18:58.358949 21210 tablet_bootstrap.cc:654] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.359091 21208 ts_tablet_manager.cc:1434] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:58.361840 21207 raft_consensus.cc:359] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.362521 21208 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.362917 21207 raft_consensus.cc:385] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.363332 21207 raft_consensus.cc:740] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.364383 21207 consensus_queue.cc:260] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.371124 21207 ts_tablet_manager.cc:1434] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:18:58.371958 21208 tablet_bootstrap.cc:654] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.372813 21207 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.377866 21210 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.378515 21210 ts_tablet_manager.cc:1403] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.014s
I20260709 12:18:58.380280 21207 tablet_bootstrap.cc:654] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.381579 21210 raft_consensus.cc:359] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.382349 21210 raft_consensus.cc:385] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.382663 21210 raft_consensus.cc:740] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.383380 21210 consensus_queue.cc:260] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.385777 21210 ts_tablet_manager.cc:1434] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:58.386879 21210 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.389026 21208 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.388974 21218 raft_consensus.cc:493] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.389714 21208 ts_tablet_manager.cc:1403] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.011s
I20260709 12:18:58.389628 21218 raft_consensus.cc:515] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.391013 21173 raft_consensus.cc:493] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.391526 21173 raft_consensus.cc:515] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.392261 21218 leader_election.cc:290] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.393528 21173 leader_election.cc:290] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.393318 21208 raft_consensus.cc:359] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.393838 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.394079 21208 raft_consensus.cc:385] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.394397 21208 raft_consensus.cc:740] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
W20260709 12:18:58.395358 20877 leader_election.cc:343] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.395169 21208 consensus_queue.cc:260] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.395609 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.396303 21207 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.396883 21207 ts_tablet_manager.cc:1403] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.010s
I20260709 12:18:58.397984 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.398654 20911 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.400349 21207 raft_consensus.cc:359] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.401163 21207 raft_consensus.cc:385] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.401454 21207 raft_consensus.cc:740] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.396764 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.403033 21060 raft_consensus.cc:2468] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 0.
I20260709 12:18:58.393567 21210 tablet_bootstrap.cc:654] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.396245 21062 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.404589 20878 leader_election.cc:304] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.406059 21218 raft_consensus.cc:2804] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.406474 21218 raft_consensus.cc:493] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.406800 21218 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.401432 20950 leader_election.cc:304] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.414688 21218 raft_consensus.cc:515] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.415653 21173 raft_consensus.cc:2804] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.416154 21173 raft_consensus.cc:493] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.416482 21173 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.417824 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:58.418771 21210 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.419312 21210 ts_tablet_manager.cc:1403] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.010s
W20260709 12:18:58.419453 20877 leader_election.cc:343] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.402443 21207 consensus_queue.cc:260] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.422197 21207 ts_tablet_manager.cc:1434] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:18:58.422564 21210 raft_consensus.cc:359] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.423172 21218 leader_election.cc:290] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.423346 21210 raft_consensus.cc:385] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.423688 21210 raft_consensus.cc:740] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.424546 21207 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.424403 21210 consensus_queue.cc:260] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.427831 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.428829 21060 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.432247 21207 tablet_bootstrap.cc:654] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.432288 21210 ts_tablet_manager.cc:1434] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:18:58.433919 21210 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.438172 21060 raft_consensus.cc:2468] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:58.440626 20878 leader_election.cc:304] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.441134 21210 tablet_bootstrap.cc:654] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.446616 21208 ts_tablet_manager.cc:1434] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.023s
I20260709 12:18:58.448539 21208 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.444502 21173 raft_consensus.cc:515] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.450392 21173 leader_election.cc:290] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.452527 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.454747 21060 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.454917 21208 tablet_bootstrap.cc:654] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.441746 21218 raft_consensus.cc:2804] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.456342 21218 raft_consensus.cc:697] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:58.456650 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.457340 20911 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.457178 21218 consensus_queue.cc:237] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.459056 21232 raft_consensus.cc:493] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.459604 21232 raft_consensus.cc:515] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.461910 21232 leader_election.cc:290] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.462137 21207 tablet_bootstrap.cc:492] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.462769 21207 ts_tablet_manager.cc:1403] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.011s
I20260709 12:18:58.463335 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.464808 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.465540 21062 raft_consensus.cc:2468] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.467526 20953 leader_election.cc:304] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.468446 21232 raft_consensus.cc:2804] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.468807 21232 raft_consensus.cc:493] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.469216 21232 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:58.469540 20950 leader_election.cc:343] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.473166 21060 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.465969 21207 raft_consensus.cc:359] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.474388 21207 raft_consensus.cc:385] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.474725 21207 raft_consensus.cc:740] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.475382 21207 consensus_queue.cc:260] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.477443 21207 ts_tablet_manager.cc:1434] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:18:58.478626 21207 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: Bootstrap starting.
I20260709 12:18:58.482515 21208 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.483119 21208 ts_tablet_manager.cc:1403] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.010s
I20260709 12:18:58.485903 21210 tablet_bootstrap.cc:492] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.486259 21208 raft_consensus.cc:359] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.487114 21210 ts_tablet_manager.cc:1403] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.011s
I20260709 12:18:58.487140 21208 raft_consensus.cc:385] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.487624 21208 raft_consensus.cc:740] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.488384 21208 consensus_queue.cc:260] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.477062 21232 raft_consensus.cc:515] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.490360 21210 raft_consensus.cc:359] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.490697 21208 ts_tablet_manager.cc:1434] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:58.494912 21210 raft_consensus.cc:385] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.495395 21232 leader_election.cc:290] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.495982 21208 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
I20260709 12:18:58.496380 21207 tablet_bootstrap.cc:654] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.497953 21210 raft_consensus.cc:740] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.498713 21218 raft_consensus.cc:493] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.499217 21218 raft_consensus.cc:515] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.495419 20953 leader_election.cc:304] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.501391 21232 raft_consensus.cc:2804] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.501878 21232 raft_consensus.cc:697] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:58.502453 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.502720 21232 consensus_queue.cc:237] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.503170 20985 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 0.
I20260709 12:18:58.504640 20877 leader_election.cc:304] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.493644 21196 raft_consensus.cc:493] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.505471 21217 raft_consensus.cc:2804] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.505867 21217 raft_consensus.cc:493] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.502662 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.506413 21217 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.506572 21062 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.508283 21208 tablet_bootstrap.cc:654] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.510915 20912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.519963 21207 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: No bootstrap required, opened a new log
I20260709 12:18:58.519781 21217 raft_consensus.cc:515] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.520661 21207 ts_tablet_manager.cc:1403] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.007s
I20260709 12:18:58.505841 21196 raft_consensus.cc:515] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.523089 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:58.523758 20987 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.524391 21196 leader_election.cc:290] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.524606 21207 raft_consensus.cc:359] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.525393 21207 raft_consensus.cc:385] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.525661 21207 raft_consensus.cc:740] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.525611 20809 catalog_manager.cc:5697] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.526603 21207 consensus_queue.cc:260] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.527316 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.528218 21207 ts_tablet_manager.cc:1434] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 12:18:58.533667 21024 leader_election.cc:343] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.535341 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.533005 21208 tablet_bootstrap.cc:492] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.542248 20985 raft_consensus.cc:2468] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:58.542390 21208 ts_tablet_manager.cc:1403] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.002s
I20260709 12:18:58.532968 20987 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:58.544123 20877 leader_election.cc:304] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.544960 21187 raft_consensus.cc:2804] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.545281 21217 leader_election.cc:290] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.548209 20911 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.549837 21062 raft_consensus.cc:2468] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.549911 21218 leader_election.cc:290] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.551731 21026 leader_election.cc:304] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:58.552351 20953 leader_election.cc:304] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.552697 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.553325 21232 raft_consensus.cc:2804] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.547848 20807 catalog_manager.cc:5697] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 1 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.528177 21226 raft_consensus.cc:493] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.554637 21226 raft_consensus.cc:515] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.554994 21208 raft_consensus.cc:359] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.555975 21208 raft_consensus.cc:385] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.556257 21208 raft_consensus.cc:740] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.551707 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.536586 21210 consensus_queue.cc:260] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.554087 21232 raft_consensus.cc:697] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:58.560705 21232 consensus_queue.cc:237] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.556849 21226 leader_election.cc:290] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.562258 21226 raft_consensus.cc:2804] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.562855 21226 raft_consensus.cc:493] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.563935 21226 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.540050 21196 raft_consensus.cc:493] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.565351 20912 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.569746 21060 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.570588 21173 raft_consensus.cc:493] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.570847 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.571188 21173 raft_consensus.cc:515] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.573611 21226 raft_consensus.cc:515] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.565521 21196 raft_consensus.cc:515] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.574292 20912 raft_consensus.cc:2468] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.576363 20911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.577478 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.578275 21173 leader_election.cc:290] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.576427 21196 leader_election.cc:290] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.579248 21061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.579751 21210 ts_tablet_manager.cc:1434] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.004s
I20260709 12:18:58.579892 21061 raft_consensus.cc:2468] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.580267 21060 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 1.
I20260709 12:18:58.580837 21210 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.574822 20807 catalog_manager.cc:5697] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.581979 20953 leader_election.cc:304] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.582347 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.556981 21208 consensus_queue.cc:260] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.585093 21232 raft_consensus.cc:2804] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.585557 21232 raft_consensus.cc:493] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.585925 21232 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.589345 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.590250 20987 raft_consensus.cc:2393] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc52017e4298417cbac6d1f33ff45def in current term 1: Already voted for candidate d8fa47222ab94faea1241a2034c3e7af in this term.
W20260709 12:18:58.584337 20950 leader_election.cc:343] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:58.591975 21024 leader_election.cc:343] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.592288 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd86a68c0bdd4232bf8fa4b61c20a869" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.593143 20987 raft_consensus.cc:2393] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc52017e4298417cbac6d1f33ff45def in current term 1: Already voted for candidate d8fa47222ab94faea1241a2034c3e7af in this term.
I20260709 12:18:58.593385 21226 leader_election.cc:290] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.594473 21026 leader_election.cc:304] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def; no voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.594682 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:58.595357 20985 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.595826 21226 raft_consensus.cc:3060] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.596671 21187 raft_consensus.cc:697] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
W20260709 12:18:58.597880 20933 debug-util.cc:398] Leaking SignalData structure 0x7b0800045380 after lost signal to thread 8910
I20260709 12:18:58.597609 21187 consensus_queue.cc:237] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
W20260709 12:18:58.600462 20933 debug-util.cc:398] Leaking SignalData structure 0x7b08001952a0 after lost signal to thread 20936
I20260709 12:18:58.595898 21208 ts_tablet_manager.cc:1434] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.002s
W20260709 12:18:58.601812 20933 debug-util.cc:398] Leaking SignalData structure 0x7b080003be60 after lost signal to thread 21011
I20260709 12:18:58.602286 21208 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: Bootstrap starting.
W20260709 12:18:58.603652 20933 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7320 after lost signal to thread 21086
I20260709 12:18:58.604290 21226 raft_consensus.cc:2749] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.609720 21210 tablet_bootstrap.cc:654] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.593752 21232 raft_consensus.cc:515] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.612049 20985 raft_consensus.cc:2468] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:58.613917 21208 tablet_bootstrap.cc:654] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.613492 21026 leader_election.cc:304] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:58.616564 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.616983 21226 raft_consensus.cc:2804] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.613528 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.617611 21226 raft_consensus.cc:697] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
W20260709 12:18:58.618924 20950 leader_election.cc:343] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:58.617224 21060 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.626078 21024 leader_election.cc:304] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def; no voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.615353 21232 leader_election.cc:290] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.618585 21226 consensus_queue.cc:237] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.627653 21242 raft_consensus.cc:2749] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.627696 21060 raft_consensus.cc:2468] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.629186 20953 leader_election.cc:304] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:58.630686 21232 raft_consensus.cc:2804] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.630028 20807 catalog_manager.cc:5697] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 1 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.632452 21232 raft_consensus.cc:697] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:58.632712 21208 tablet_bootstrap.cc:492] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: No bootstrap required, opened a new log
I20260709 12:18:58.633265 21208 ts_tablet_manager.cc:1403] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:18:58.633545 21232 consensus_queue.cc:237] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.636184 21208 raft_consensus.cc:359] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.636945 21208 raft_consensus.cc:385] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.637228 21208 raft_consensus.cc:740] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.641027 21210 tablet_bootstrap.cc:492] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.637934 21208 consensus_queue.cc:260] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.641680 21210 ts_tablet_manager.cc:1403] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.009s
I20260709 12:18:58.643357 21208 ts_tablet_manager.cc:1434] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:58.645167 21210 raft_consensus.cc:359] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.648972 21210 raft_consensus.cc:385] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.649263 21210 raft_consensus.cc:740] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.651778 21210 consensus_queue.cc:260] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.653828 21210 ts_tablet_manager.cc:1434] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 12:18:58.654937 21210 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: Bootstrap starting.
I20260709 12:18:58.660933 21210 tablet_bootstrap.cc:654] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:58.658950 20809 catalog_manager.cc:5697] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.674233 20807 catalog_manager.cc:5697] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.680305 21210 tablet_bootstrap.cc:492] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: No bootstrap required, opened a new log
I20260709 12:18:58.680928 21210 ts_tablet_manager.cc:1403] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:18:58.683636 21210 raft_consensus.cc:359] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.684356 21210 raft_consensus.cc:385] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:58.684617 21210 raft_consensus.cc:740] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Initialized, Role: FOLLOWER
I20260709 12:18:58.685273 21210 consensus_queue.cc:260] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.687629 21210 ts_tablet_manager.cc:1434] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:58.711160 21232 raft_consensus.cc:493] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.710994 21187 consensus_queue.cc:1048] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.711741 21232 raft_consensus.cc:515] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.713766 21232 leader_election.cc:290] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.714773 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88297a618b894e28866f169c89413c33" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.715588 20910 raft_consensus.cc:2468] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.715768 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88297a618b894e28866f169c89413c33" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.716486 21060 raft_consensus.cc:2468] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 0.
I20260709 12:18:58.717072 20950 leader_election.cc:304] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.718122 21249 raft_consensus.cc:2804] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.718559 21249 raft_consensus.cc:493] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.718916 21249 raft_consensus.cc:3060] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.728715 21249 raft_consensus.cc:515] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.731731 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88297a618b894e28866f169c89413c33" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.732390 20910 raft_consensus.cc:3060] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.740479 20910 raft_consensus.cc:2468] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.741851 20950 leader_election.cc:304] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:58.742751 21232 raft_consensus.cc:2804] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.743238 21232 raft_consensus.cc:697] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:58.744077 21232 consensus_queue.cc:237] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.751320 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88297a618b894e28866f169c89413c33" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:58.751994 21060 raft_consensus.cc:3060] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.752094 21187 raft_consensus.cc:493] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.752257 21249 leader_election.cc:290] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.752738 21187 raft_consensus.cc:515] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.754984 21187 leader_election.cc:290] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.756633 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.758176 21061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.759089 21061 raft_consensus.cc:2393] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8fa47222ab94faea1241a2034c3e7af in current term 1: Already voted for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in this term.
I20260709 12:18:58.761320 20877 leader_election.cc:304] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:58.761439 21241 consensus_queue.cc:1048] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:58.763067 21187 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.771430 21060 raft_consensus.cc:2468] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 1.
I20260709 12:18:58.771948 21187 raft_consensus.cc:2749] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:58.772446 21249 raft_consensus.cc:493] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.779383 21249 raft_consensus.cc:515] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.783327 21249 leader_election.cc:290] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:58.784191 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:58.784334 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.785108 21062 raft_consensus.cc:2393] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7db1e9b4dfe4abaafa0e140bafbc556 in current term 1: Already voted for candidate d8fa47222ab94faea1241a2034c3e7af in this term.
I20260709 12:18:58.786772 20953 leader_election.cc:304] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7db1e9b4dfe4abaafa0e140bafbc556; no voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:58.786459 20807 catalog_manager.cc:5697] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 1 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.788153 21249 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.801560 21249 raft_consensus.cc:2749] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:18:58.811264 20858 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:58.851545 21226 raft_consensus.cc:493] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.852222 21226 raft_consensus.cc:515] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.855276 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af" is_pre_election: true
I20260709 12:18:58.855633 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:58.854916 21226 leader_election.cc:290] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.856225 20910 raft_consensus.cc:2468] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:58.856408 20985 raft_consensus.cc:2468] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 0.
I20260709 12:18:58.857324 21024 leader_election.cc:304] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:58.858155 21226 raft_consensus.cc:2804] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:58.858546 21226 raft_consensus.cc:493] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.858866 21226 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.866776 21226 raft_consensus.cc:515] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.869102 21226 leader_election.cc:290] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:58.870182 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:58.870191 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:58.871111 20910 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.871249 20985 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:58.877419 20910 raft_consensus.cc:2468] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:58.878682 21024 leader_election.cc:304] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:58.879376 21226 raft_consensus.cc:2804] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:58.879431 20985 raft_consensus.cc:2468] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 1.
I20260709 12:18:58.879861 21226 raft_consensus.cc:697] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:58.881386 21226 consensus_queue.cc:237] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:58.890826 20807 catalog_manager.cc:5697] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 0 to 1, leader changed from <none> to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 1 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.896155 21241 consensus_queue.cc:1048] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.908368 21218 consensus_queue.cc:1048] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.919997 21232 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:58.934387 21232 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.023828 21218 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.024833 21226 consensus_queue.cc:1048] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.040275 20910 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:59.047082 21187 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.057152 21232 consensus_queue.cc:1048] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.057281 20985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:18:59.058840 20985 raft_consensus.cc:606] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:59.086236 20985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9685da56a3d45938fc81587d035167e"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:18:59.086870 20985 raft_consensus.cc:606] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:59.087705 21261 consensus_queue.cc:1048] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.097724 21061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:59.098390 21061 raft_consensus.cc:606] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:59.106365 21261 consensus_queue.cc:1048] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.117429 21241 raft_consensus.cc:493] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.118064 21241 raft_consensus.cc:515] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.118685 20911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:39162
I20260709 12:18:59.119501 20911 raft_consensus.cc:606] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:59.121793 21241 leader_election.cc:290] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.123844 21061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc52017e4298417cbac6d1f33ff45def" is_pre_election: true
I20260709 12:18:59.121884 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" is_pre_election: true
I20260709 12:18:59.126508 20911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:39162
I20260709 12:18:59.127135 20911 raft_consensus.cc:606] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:59.127943 20877 leader_election.cc:304] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af; no voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:59.130007 21241 raft_consensus.cc:2749] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:59.138262 21062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
mode: GRACEFUL
new_leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:41352
I20260709 12:18:59.139153 21062 raft_consensus.cc:606] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Received request to transfer leadership to TS f7db1e9b4dfe4abaafa0e140bafbc556
I20260709 12:18:59.143476 21242 consensus_queue.cc:1048] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.156405 20987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:60026
I20260709 12:18:59.157065 20987 raft_consensus.cc:606] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:18:59.167070 21232 raft_consensus.cc:993] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.167718 21232 raft_consensus.cc:1081] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.169597 20909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9685da56a3d45938fc81587d035167e"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39150
I20260709 12:18:59.170178 20909 raft_consensus.cc:493] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.170624 20909 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.172904 21196 raft_consensus.cc:993] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.173452 21196 raft_consensus.cc:1081] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.175753 20912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39146
I20260709 12:18:59.176368 20912 raft_consensus.cc:493] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.176744 20912 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.180995 21261 consensus_queue.cc:1048] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.191700 20909 raft_consensus.cc:515] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.192059 20912 raft_consensus.cc:515] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.193095 20911 raft_consensus.cc:1240] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Rejecting Update request from peer f7db1e9b4dfe4abaafa0e140bafbc556 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:59.201092 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:59.201192 21232 consensus_queue.cc:1059] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.201795 20987 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.203024 21173 raft_consensus.cc:3055] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.203465 21173 raft_consensus.cc:740] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.204321 21173 consensus_queue.cc:260] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.205242 21173 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.209975 20987 raft_consensus.cc:2468] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:59.212630 21249 consensus_queue.cc:1048] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.216291 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0853d9b602946428be0b54d8db3fba5" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.217026 21062 raft_consensus.cc:3055] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.217332 21062 raft_consensus.cc:740] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:59.218076 21062 consensus_queue.cc:260] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.220715 21062 raft_consensus.cc:3060] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.220659 20877 leader_election.cc:304] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:59.221662 21187 raft_consensus.cc:2804] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.222119 21187 raft_consensus.cc:697] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:59.222954 21187 consensus_queue.cc:237] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.226881 20912 leader_election.cc:290] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.229353 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:59.231688 20909 leader_election.cc:290] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.233283 21061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9685da56a3d45938fc81587d035167e" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.244068 20985 raft_consensus.cc:2468] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:59.247733 21261 consensus_queue.cc:1048] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:59.249482 20877 leader_election.cc:304] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: bc52017e4298417cbac6d1f33ff45def
I20260709 12:18:59.256116 21241 raft_consensus.cc:2804] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.256717 21241 raft_consensus.cc:697] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:59.257656 21241 consensus_queue.cc:237] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.228468 21062 raft_consensus.cc:2468] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:59.296947 20807 catalog_manager.cc:5697] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.298604 20807 catalog_manager.cc:5697] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.331712 21242 consensus_queue.cc:1048] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.343447 21242 raft_consensus.cc:993] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.343920 21242 raft_consensus.cc:1081] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.349206 20987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:18:59.350386 20987 raft_consensus.cc:493] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.350852 20987 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.351354 21226 consensus_queue.cc:1048] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:59.360044 20987 raft_consensus.cc:515] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.364153 20987 leader_election.cc:290] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.365783 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:59.370143 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18be5f23c22e4079b3e2e4058b1f6841" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.370782 21062 raft_consensus.cc:3055] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.371111 21062 raft_consensus.cc:740] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:59.371863 21062 consensus_queue.cc:260] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.373379 21062 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.379410 21062 raft_consensus.cc:2468] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:59.380410 20953 leader_election.cc:304] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: d8fa47222ab94faea1241a2034c3e7af
I20260709 12:18:59.381157 21249 raft_consensus.cc:2804] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.381686 21249 raft_consensus.cc:697] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.382546 21249 consensus_queue.cc:237] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.391117 20810 catalog_manager.cc:5697] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from bc52017e4298417cbac6d1f33ff45def (127.8.178.195) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.476157 21187 raft_consensus.cc:993] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.476649 21241 raft_consensus.cc:1081] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.478120 20987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60018
I20260709 12:18:59.478578 20987 raft_consensus.cc:493] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.478842 20987 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.484702 20987 raft_consensus.cc:515] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.486336 20987 leader_election.cc:290] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.487365 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:59.487452 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c86138da8b040c5aa6085094c26e9c1" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.488242 20910 raft_consensus.cc:3055] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.488286 21062 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.488756 20910 raft_consensus.cc:740] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:59.489646 20910 consensus_queue.cc:260] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.490984 20910 raft_consensus.cc:3060] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.493578 21062 raft_consensus.cc:2468] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:59.494802 20953 leader_election.cc:304] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:59.495507 21249 raft_consensus.cc:2804] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.495899 21249 raft_consensus.cc:697] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.496611 21249 consensus_queue.cc:237] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.498962 20910 raft_consensus.cc:2468] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:59.504127 20810 catalog_manager.cc:5697] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from d8fa47222ab94faea1241a2034c3e7af (127.8.178.193) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.524873 21232 raft_consensus.cc:993] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.525413 21249 raft_consensus.cc:1081] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Signalling peer d8fa47222ab94faea1241a2034c3e7af to start an election
I20260709 12:18:59.527041 20910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
 from {username='slave'} at 127.0.0.1:39150
I20260709 12:18:59.527637 20910 raft_consensus.cc:493] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.528002 20910 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.528188 21187 raft_consensus.cc:993] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: : Instructing follower f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.528677 21241 raft_consensus.cc:1081] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Signalling peer f7db1e9b4dfe4abaafa0e140bafbc556 to start an election
I20260709 12:18:59.530261 20987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
 from {username='slave'} at 127.0.0.1:60018
I20260709 12:18:59.530902 20987 raft_consensus.cc:493] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.531332 20987 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.539060 20987 raft_consensus.cc:515] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.542299 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:59.542536 21062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.543201 21062 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.543002 20909 raft_consensus.cc:3055] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.542896 20910 raft_consensus.cc:515] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.543766 20909 raft_consensus.cc:740] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:59.545397 20910 leader_election.cc:290] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.544775 20909 consensus_queue.cc:260] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.547312 20909 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.547564 21060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
I20260709 12:18:59.547693 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "d8fa47222ab94faea1241a2034c3e7af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:59.548398 21060 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.548597 20985 raft_consensus.cc:3055] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.548961 20985 raft_consensus.cc:740] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.549753 20985 consensus_queue.cc:260] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.551013 20985 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.543771 20987 leader_election.cc:290] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), bc52017e4298417cbac6d1f33ff45def (127.8.178.195:36281)
I20260709 12:18:59.557420 21060 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:59.558398 20909 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:59.558920 20878 leader_election.cc:304] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:59.560024 21241 raft_consensus.cc:2804] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.560531 21241 raft_consensus.cc:697] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Leader. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:18:59.561136 20950 leader_election.cc:304] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa47222ab94faea1241a2034c3e7af, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:18:59.561416 21241 consensus_queue.cc:237] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.562049 21249 raft_consensus.cc:2804] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.562767 21249 raft_consensus.cc:697] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Leader. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.563586 21249 consensus_queue.cc:237] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.564673 21062 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7db1e9b4dfe4abaafa0e140bafbc556 in term 2.
I20260709 12:18:59.560556 20985 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa47222ab94faea1241a2034c3e7af in term 2.
I20260709 12:18:59.572386 20810 catalog_manager.cc:5697] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af reported cstate change: term changed from 1 to 2, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to d8fa47222ab94faea1241a2034c3e7af (127.8.178.193). New cstate: current_term: 2 leader_uuid: "d8fa47222ab94faea1241a2034c3e7af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.574393 20807 catalog_manager.cc:5697] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 reported cstate change: term changed from 1 to 2, leader changed from d8fa47222ab94faea1241a2034c3e7af (127.8.178.193) to f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194). New cstate: current_term: 2 leader_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.618599 21232 raft_consensus.cc:993] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:18:59.619074 21232 raft_consensus.cc:1081] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:18:59.621094 21062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41338
I20260709 12:18:59.621549 21062 raft_consensus.cc:493] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.621826 21062 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.626834 21062 raft_consensus.cc:515] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.628355 21062 leader_election.cc:290] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 2 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:18:59.629211 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:18:59.629494 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a321279a53849279fab7ee3a0d68049" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:18:59.629892 20909 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.630153 20985 raft_consensus.cc:3055] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:59.630534 20985 raft_consensus.cc:740] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:18:59.631289 20985 consensus_queue.cc:260] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.632483 20985 raft_consensus.cc:3060] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.635502 20909 raft_consensus.cc:2468] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 2.
I20260709 12:18:59.636587 21024 leader_election.cc:304] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:18:59.637259 21242 raft_consensus.cc:2804] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:59.637663 21242 raft_consensus.cc:697] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 2 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:18:59.638484 21242 consensus_queue.cc:237] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:18:59.639199 20985 raft_consensus.cc:2468] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 2.
I20260709 12:18:59.647840 20810 catalog_manager.cc:5697] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 1 to 2, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 2 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.744761 20987 raft_consensus.cc:1275] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.746070 21187 consensus_queue.cc:1048] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.754886 21062 raft_consensus.cc:1275] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.756310 21218 consensus_queue.cc:1048] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.830025 20987 raft_consensus.cc:1275] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.831408 21218 consensus_queue.cc:1048] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.841444 21060 raft_consensus.cc:3060] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.852316 21060 raft_consensus.cc:1275] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.855304 21218 consensus_queue.cc:1048] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.892014 21060 raft_consensus.cc:1275] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.893237 21261 consensus_queue.cc:1048] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.898411 20909 raft_consensus.cc:3060] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:59.906306 20910 raft_consensus.cc:1275] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.908717 21232 consensus_queue.cc:1048] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.906306 20909 raft_consensus.cc:1275] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.911195 21232 consensus_queue.cc:1048] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:59.921064 21060 raft_consensus.cc:1275] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:59.922817 21249 consensus_queue.cc:1048] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.047010 21060 raft_consensus.cc:1275] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.048422 21218 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.058233 20987 raft_consensus.cc:1275] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer d8fa47222ab94faea1241a2034c3e7af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.060458 21276 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.071053 20909 raft_consensus.cc:1275] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.073218 20910 raft_consensus.cc:1275] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.073601 21249 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:00.074952 21242 consensus_queue.cc:1048] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.093924 20985 raft_consensus.cc:1275] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.097970 21281 consensus_queue.cc:1048] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.127051 21060 raft_consensus.cc:1275] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Refusing update from remote peer f7db1e9b4dfe4abaafa0e140bafbc556: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:00.128856 21249 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:02.163164 20809 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42306:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:19:02.182610 20809 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42306:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:19:02.231966  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:19:02.343981 21297 log.cc:927] Time spent T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:19:02.324373 21303 log.cc:927] Time spent T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:19:02.360961 20953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:36281, user_credentials={real_user=slave}} blocked reactor thread for 49208.6us
W20260709 12:19:02.367332 21294 log.cc:927] Time spent T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:19:02.396938 21301 log.cc:927] Time spent T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:19:02.538614 20877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:41215, user_credentials={real_user=slave}} blocked reactor thread for 76014.2us
I20260709 12:19:02.559587 20984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41896
W20260709 12:19:02.560078 21322 log.cc:927] Time spent T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:19:02.567387 21337 tablet.cc:1724] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.538137 21328 tablet.cc:1724] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.596972 21344 tablet.cc:1724] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.624665 20938 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d0853d9b602946428be0b54d8db3fba5)
I20260709 12:19:02.629451 21346 tablet.cc:1724] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.633006 20938 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d0853d9b602946428be0b54d8db3fba5)
W20260709 12:19:02.636556 20938 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d0853d9b602946428be0b54d8db3fba5)
I20260709 12:19:02.652535 21337 tablet.cc:1724] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.646174 20877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.194:41215, user_credentials={real_user=slave}} blocked reactor thread for 86791.5us
I20260709 12:19:02.658144 21342 tablet.cc:1724] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.659060 21335 log.cc:927] Time spent T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:19:02.682065 20878 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:36281, user_credentials={real_user=slave}} blocked reactor thread for 82372.1us
I20260709 12:19:02.698143 21350 tablet.cc:1724] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.699587 21340 log.cc:927] Time spent T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:19:02.696175 21349 tablet.cc:1724] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.707634 21351 tablet.cc:1724] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.713104 21337 tablet.cc:1724] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.722494 21341 log.cc:927] Time spent T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:19:02.723204 21355 tablet.cc:1724] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:02.716748 21338 log.cc:927] Time spent T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:19:02.722447 20950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.193:41035, user_credentials={real_user=slave}} blocked reactor thread for 81034.3us
I20260709 12:19:02.751560 20984 raft_consensus.cc:606] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:19:02.755652 21356 tablet.cc:1724] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.745216 21344 tablet.cc:1724] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.775831 21354 tablet.cc:1724] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.778133 21344 tablet.cc:1724] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.785423 21328 tablet.cc:1724] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.764201 21346 tablet.cc:1724] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.794291 21357 tablet.cc:1724] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.808530 21349 tablet.cc:1724] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.805609 21342 tablet.cc:1724] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.816300 21355 tablet.cc:1724] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.817529 21357 tablet.cc:1724] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.823446 21351 tablet.cc:1724] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.824537 21349 tablet.cc:1724] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.820305 21337 tablet.cc:1724] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.831213 21356 tablet.cc:1724] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.835189 21350 tablet.cc:1724] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:02.876783 20909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:35560
I20260709 12:19:02.877427 20909 raft_consensus.cc:606] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:19:02.879132  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:19:02.880329  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.896034 20909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209"
dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:35560
I20260709 12:19:02.896811 20909 raft_consensus.cc:606] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:19:02.899572 20984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481"
dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
mode: GRACEFUL
new_leader_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41896
I20260709 12:19:02.900223 20984 raft_consensus.cc:606] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Received request to transfer leadership to TS bc52017e4298417cbac6d1f33ff45def
I20260709 12:19:02.901753  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:02.902416  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.901172 20807 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: soft_deleted_table [id=65995fda6e114c809da092d667321ddf] alter complete (version 1)
I20260709 12:19:02.943558 21358 raft_consensus.cc:993] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:02.944111 21316 raft_consensus.cc:1081] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:02.945686 21056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41338
I20260709 12:19:02.946163 21056 raft_consensus.cc:493] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.946482 21056 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.951802 21056 raft_consensus.cc:515] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:02.953543 21056 leader_election.cc:290] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:19:02.954279 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:19:02.954625 20984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7e43f6ff54d9fb212745f8165acbd" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:19:02.955039 20909 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.955248 20984 raft_consensus.cc:3055] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:02.955628 20984 raft_consensus.cc:740] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:19:02.956315 20984 consensus_queue.cc:260] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:02.957424 20984 raft_consensus.cc:3060] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.961659 20909 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:02.962783 21024 leader_election.cc:304] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:19:02.963675 21332 raft_consensus.cc:2804] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:02.963828 20984 raft_consensus.cc:2468] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:02.964121 21332 raft_consensus.cc:697] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:19:02.964946 21332 consensus_queue.cc:237] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:02.971541 20807 catalog_manager.cc:5697] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 2 to 3, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 3 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.115485 21336 raft_consensus.cc:993] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.115999 21348 raft_consensus.cc:1081] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.117398 21056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41330
I20260709 12:19:03.118006 21056 raft_consensus.cc:493] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.118323 21056 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.123739 21056 raft_consensus.cc:515] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:19:03.125638 21056 leader_election.cc:290] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Requested vote from peers f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215), d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035)
I20260709 12:19:03.126360 20984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:19:03.126748 20910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e52116ce6412fa1e5c84bf5a14209" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:19:03.127086 20984 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.127321 20910 raft_consensus.cc:3055] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:03.127647 20910 raft_consensus.cc:740] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:19:03.128304 20910 consensus_queue.cc:260] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:19:03.129266 20910 raft_consensus.cc:3060] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.132673 20984 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.133868 21026 leader_election.cc:304] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:19:03.134564 21332 raft_consensus.cc:2804] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:03.134706 20910 raft_consensus.cc:2468] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.135136 21332 raft_consensus.cc:697] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:19:03.136088 21332 consensus_queue.cc:237] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } }
I20260709 12:19:03.143711 20807 catalog_manager.cc:5697] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 2 to 3, leader changed from d8fa47222ab94faea1241a2034c3e7af (127.8.178.193) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 3 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.304752 21352 raft_consensus.cc:993] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.305850 21336 raft_consensus.cc:993] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: : Instructing follower bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.306854 21336 raft_consensus.cc:1081] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.305943 21352 raft_consensus.cc:1081] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Signalling peer bc52017e4298417cbac6d1f33ff45def to start an election
I20260709 12:19:03.309737 21056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41330
I20260709 12:19:03.310292 21059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481"
dest_uuid: "bc52017e4298417cbac6d1f33ff45def"
 from {username='slave'} at 127.0.0.1:41338
I20260709 12:19:03.310796 21056 raft_consensus.cc:493] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.311197 21059 raft_consensus.cc:493] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.311317 21056 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.311728 21059 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.321887 21056 raft_consensus.cc:515] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.323066 21059 raft_consensus.cc:515] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.324342 21056 leader_election.cc:290] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:19:03.325276 21059 leader_election.cc:290] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Requested vote from peers d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035), f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215)
I20260709 12:19:03.325423 20909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:19:03.326213 20985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b9380511ec48b38bacedb1d48f2a67" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:19:03.326372 20909 raft_consensus.cc:3055] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:03.326967 20985 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.327605 20984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556"
I20260709 12:19:03.326944 20909 raft_consensus.cc:740] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8fa47222ab94faea1241a2034c3e7af, State: Running, Role: LEADER
I20260709 12:19:03.328328 20984 raft_consensus.cc:3055] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:03.328685 20984 raft_consensus.cc:740] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7db1e9b4dfe4abaafa0e140bafbc556, State: Running, Role: LEADER
I20260709 12:19:03.328346 20906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945e7aee947b4000b3adb3a542e97481" candidate_uuid: "bc52017e4298417cbac6d1f33ff45def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8fa47222ab94faea1241a2034c3e7af"
I20260709 12:19:03.329197 20909 consensus_queue.cc:260] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.329845 20984 consensus_queue.cc:260] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.331112 20909 raft_consensus.cc:3060] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.331640 20984 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.333173 20906 raft_consensus.cc:3060] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:03.336825 20985 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.338301 21026 leader_election.cc:304] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, f7db1e9b4dfe4abaafa0e140bafbc556; no voters: 
I20260709 12:19:03.339426 21367 raft_consensus.cc:2804] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:03.339887 21367 raft_consensus.cc:697] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:19:03.341209 20909 raft_consensus.cc:2468] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.340993 21367 consensus_queue.cc:237] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.344241 20906 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.346053 21024 leader_election.cc:304] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc52017e4298417cbac6d1f33ff45def, d8fa47222ab94faea1241a2034c3e7af; no voters: 
I20260709 12:19:03.347039 21367 raft_consensus.cc:2804] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:03.347604 21367 raft_consensus.cc:697] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Becoming Leader. State: Replica: bc52017e4298417cbac6d1f33ff45def, State: Running, Role: LEADER
I20260709 12:19:03.348002 20984 raft_consensus.cc:2468] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc52017e4298417cbac6d1f33ff45def in term 3.
I20260709 12:19:03.348882 21367 consensus_queue.cc:237] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } }
I20260709 12:19:03.361618 20807 catalog_manager.cc:5697] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 2 to 3, leader changed from d8fa47222ab94faea1241a2034c3e7af (127.8.178.193) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 3 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.363080 20807 catalog_manager.cc:5697] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def reported cstate change: term changed from 2 to 3, leader changed from f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194) to bc52017e4298417cbac6d1f33ff45def (127.8.178.195). New cstate: current_term: 3 leader_uuid: "bc52017e4298417cbac6d1f33ff45def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc52017e4298417cbac6d1f33ff45def" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.515211 20984 raft_consensus.cc:1275] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.516466 21367 consensus_queue.cc:1048] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.530172 20906 raft_consensus.cc:1275] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.531625 21226 consensus_queue.cc:1048] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.540640 20909 raft_consensus.cc:1275] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:03.544605 21332 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:03.555357 20984 raft_consensus.cc:1275] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:03.557268 21332 consensus_queue.cc:1048] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:03.730490 20910 raft_consensus.cc:1275] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:03.731837 21332 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:03.744417 20984 raft_consensus.cc:1275] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:19:03.746245 21332 consensus_queue.cc:1048] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:03.789172 20910 raft_consensus.cc:1275] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.790385 21332 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fa47222ab94faea1241a2034c3e7af" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.799630 20984 raft_consensus.cc:1275] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Refusing update from remote peer bc52017e4298417cbac6d1f33ff45def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:03.801241 21332 consensus_queue.cc:1048] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7db1e9b4dfe4abaafa0e140bafbc556" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 41215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:03.903826  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:03.910681  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.911325  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.918475  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.918973  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.920169  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:04.925315  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:04.925761  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.931795  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:04.932281  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.933259  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:05.939109  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:05.939519  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.944811  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:05.945227  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.946122  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:06.951499  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:06.951936  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.956938  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:06.957383  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.958397  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:07.963865  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:07.964372  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.968986  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:07.969427  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:08.970618  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:08.976385  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:08.976799  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.981634  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:08.982028  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.982990  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:09.987855  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:09.988287  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.992867  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:09.993261  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.994251  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:10.999622  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:11.000043  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:11.004916  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:11.005316  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:12.006213  8907 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:19:12.011550  8907 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:19:12.011953  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:12.016490  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:12.016969  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.070716  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
I20260709 12:19:13.107990  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:13.108983  8907 tablet_replica.cc:333] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.110046  8907 raft_consensus.cc:2243] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.110783  8907 raft_consensus.cc:2272] T 4a321279a53849279fab7ee3a0d68049 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:13.110826 21024 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 42 similar messages]
I20260709 12:19:13.113772  8907 tablet_replica.cc:333] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
W20260709 12:19:13.113957 21024 consensus_peers.cc:597] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.114528  8907 raft_consensus.cc:2243] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.115058  8907 raft_consensus.cc:2272] T 80b9380511ec48b38bacedb1d48f2a67 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.118225  8907 tablet_replica.cc:333] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.119052  8907 raft_consensus.cc:2243] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:13.119514 20950 consensus_peers.cc:597] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.119652  8907 raft_consensus.cc:2272] T 88297a618b894e28866f169c89413c33 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.122044  8907 tablet_replica.cc:333] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.122716  8907 raft_consensus.cc:2243] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.123224  8907 raft_consensus.cc:2272] T 64d7e43f6ff54d9fb212745f8165acbd P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.125463  8907 tablet_replica.cc:333] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.126111  8907 raft_consensus.cc:2243] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.126645  8907 raft_consensus.cc:2272] T b92fe9272504412e8cb26f3d6b87d96f P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.128952  8907 tablet_replica.cc:333] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.129534  8907 raft_consensus.cc:2243] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.130021  8907 raft_consensus.cc:2272] T 18be5f23c22e4079b3e2e4058b1f6841 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.133049  8907 tablet_replica.cc:333] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.133733  8907 raft_consensus.cc:2243] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.134126  8907 raft_consensus.cc:2272] T 421e52116ce6412fa1e5c84bf5a14209 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.136394  8907 tablet_replica.cc:333] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.136941  8907 raft_consensus.cc:2243] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.137782  8907 raft_consensus.cc:2272] T d0853d9b602946428be0b54d8db3fba5 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.140161  8907 tablet_replica.cc:333] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.140741  8907 raft_consensus.cc:2243] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.141647  8907 raft_consensus.cc:2272] T dd86a68c0bdd4232bf8fa4b61c20a869 P d8fa47222ab94faea1241a2034c3e7af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.144028  8907 tablet_replica.cc:333] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.144572  8907 raft_consensus.cc:2243] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.145025  8907 raft_consensus.cc:2272] T 3d425f635b4f4ca08a7e064630f35748 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.147994  8907 tablet_replica.cc:333] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.148990  8907 raft_consensus.cc:2243] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:19:13.149340 20950 consensus_peers.cc:597] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.149977  8907 raft_consensus.cc:2272] T a9685da56a3d45938fc81587d035167e P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:13.152475 20950 consensus_peers.cc:597] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.153187  8907 tablet_replica.cc:333] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.153831  8907 raft_consensus.cc:2243] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.154312  8907 raft_consensus.cc:2272] T 945e7aee947b4000b3adb3a542e97481 P d8fa47222ab94faea1241a2034c3e7af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.156642  8907 tablet_replica.cc:333] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.157274  8907 raft_consensus.cc:2243] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.158190  8907 raft_consensus.cc:2272] T 96c0be00a95a4b55a3cb57ee1cdadb0c P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.160766  8907 tablet_replica.cc:333] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.161382  8907 raft_consensus.cc:2243] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.161917  8907 raft_consensus.cc:2272] T e3be1e129ca7450b865739ce755c8b05 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.164667  8907 tablet_replica.cc:333] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.165232  8907 raft_consensus.cc:2243] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.166085  8907 raft_consensus.cc:2272] T 95a4e4f8e5b848e88ebfb909cb429b7a P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.168394  8907 tablet_replica.cc:333] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.168931  8907 raft_consensus.cc:2243] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.169914  8907 raft_consensus.cc:2272] T a0f075ff99b34bd4bcefbec68c736f96 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.172281  8907 tablet_replica.cc:333] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.172772  8907 raft_consensus.cc:2243] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.173321  8907 raft_consensus.cc:2272] T 9c86138da8b040c5aa6085094c26e9c1 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.175539  8907 tablet_replica.cc:333] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af: stopping tablet replica
I20260709 12:19:13.176151  8907 raft_consensus.cc:2243] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.176697  8907 raft_consensus.cc:2272] T 9358ee83f89640d5bdf3a594b9e5cb57 P d8fa47222ab94faea1241a2034c3e7af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:13.224399 20876 connection.cc:466] server connection from 127.0.0.1:39146 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39146 (request call id 209) could send its response
W20260709 12:19:13.231501 21024 consensus_peers.cc:597] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:13.234051 21024 consensus_peers.cc:597] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:13.257578 21024 consensus_peers.cc:597] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:13.269599 20950 consensus_peers.cc:597] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.271876  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
I20260709 12:19:13.341996  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:19:13.374941  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:13.376019  8907 tablet_replica.cc:333] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.377664  8907 raft_consensus.cc:2243] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.378360  8907 raft_consensus.cc:2272] T 80b9380511ec48b38bacedb1d48f2a67 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.381323  8907 tablet_replica.cc:333] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.381942  8907 raft_consensus.cc:2243] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.382598  8907 raft_consensus.cc:2272] T 64d7e43f6ff54d9fb212745f8165acbd P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.385313  8907 tablet_replica.cc:333] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.385989  8907 raft_consensus.cc:2243] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.387363  8907 raft_consensus.cc:2272] T 88297a618b894e28866f169c89413c33 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.389746  8907 tablet_replica.cc:333] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.390453  8907 raft_consensus.cc:2243] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.391090  8907 raft_consensus.cc:2272] T 4a321279a53849279fab7ee3a0d68049 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.393810  8907 tablet_replica.cc:333] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.394915  8907 raft_consensus.cc:2243] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.395578  8907 raft_consensus.cc:2272] T d0853d9b602946428be0b54d8db3fba5 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.398041  8907 tablet_replica.cc:333] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.398895  8907 raft_consensus.cc:2243] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.399525  8907 raft_consensus.cc:2272] T 3d425f635b4f4ca08a7e064630f35748 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.402012  8907 tablet_replica.cc:333] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.402655  8907 raft_consensus.cc:2243] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.403249  8907 raft_consensus.cc:2272] T dd86a68c0bdd4232bf8fa4b61c20a869 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.405805  8907 tablet_replica.cc:333] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.406389  8907 raft_consensus.cc:2243] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.407655  8907 raft_consensus.cc:2272] T 18be5f23c22e4079b3e2e4058b1f6841 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.410356  8907 tablet_replica.cc:333] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.411070  8907 raft_consensus.cc:2243] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.412588  8907 raft_consensus.cc:2272] T b92fe9272504412e8cb26f3d6b87d96f P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.415208  8907 tablet_replica.cc:333] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.415953  8907 raft_consensus.cc:2243] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.416584  8907 raft_consensus.cc:2272] T 96c0be00a95a4b55a3cb57ee1cdadb0c P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.419091  8907 tablet_replica.cc:333] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.419737  8907 raft_consensus.cc:2243] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.420851  8907 raft_consensus.cc:2272] T 9c86138da8b040c5aa6085094c26e9c1 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.423486  8907 tablet_replica.cc:333] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.424165  8907 raft_consensus.cc:2243] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.425511  8907 raft_consensus.cc:2272] T 9358ee83f89640d5bdf3a594b9e5cb57 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.428139  8907 tablet_replica.cc:333] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.428730  8907 raft_consensus.cc:2243] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.429332  8907 raft_consensus.cc:2272] T 95a4e4f8e5b848e88ebfb909cb429b7a P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.431874  8907 tablet_replica.cc:333] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.432410  8907 raft_consensus.cc:2243] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.433722  8907 raft_consensus.cc:2272] T e3be1e129ca7450b865739ce755c8b05 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.436246  8907 tablet_replica.cc:333] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.436779  8907 raft_consensus.cc:2243] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.437397  8907 raft_consensus.cc:2272] T a0f075ff99b34bd4bcefbec68c736f96 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.439949  8907 tablet_replica.cc:333] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.440486  8907 raft_consensus.cc:2243] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.441035  8907 raft_consensus.cc:2272] T a9685da56a3d45938fc81587d035167e P f7db1e9b4dfe4abaafa0e140bafbc556 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.443527  8907 tablet_replica.cc:333] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.444094  8907 raft_consensus.cc:2243] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.444726  8907 raft_consensus.cc:2272] T 945e7aee947b4000b3adb3a542e97481 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.447417  8907 tablet_replica.cc:333] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556: stopping tablet replica
I20260709 12:19:13.448042  8907 raft_consensus.cc:2243] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.448776  8907 raft_consensus.cc:2272] T 421e52116ce6412fa1e5c84bf5a14209 P f7db1e9b4dfe4abaafa0e140bafbc556 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:13.466565 21026 consensus_peers.cc:597] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def -> Peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Couldn't send request to peer f7db1e9b4dfe4abaafa0e140bafbc556. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:13.496047 21024 consensus_peers.cc:597] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.496429  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
W20260709 12:19:13.503216 21024 consensus_peers.cc:597] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def -> Peer d8fa47222ab94faea1241a2034c3e7af (127.8.178.193:41035): Couldn't send request to peer d8fa47222ab94faea1241a2034c3e7af. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:41035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.541939  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
W20260709 12:19:13.570536 21026 consensus_peers.cc:597] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def -> Peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Couldn't send request to peer f7db1e9b4dfe4abaafa0e140bafbc556. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:41215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.573423  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:13.574246  8907 tablet_replica.cc:333] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.575081  8907 raft_consensus.cc:2243] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.576227  8907 raft_consensus.cc:2272] T 4a321279a53849279fab7ee3a0d68049 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.578789  8907 tablet_replica.cc:333] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.579497  8907 raft_consensus.cc:2243] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.580154  8907 raft_consensus.cc:2272] T 88297a618b894e28866f169c89413c33 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.582628  8907 tablet_replica.cc:333] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.583202  8907 raft_consensus.cc:2243] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.584195  8907 raft_consensus.cc:2272] T 64d7e43f6ff54d9fb212745f8165acbd P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.586580  8907 tablet_replica.cc:333] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.587181  8907 raft_consensus.cc:2243] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.588140  8907 raft_consensus.cc:2272] T 80b9380511ec48b38bacedb1d48f2a67 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.590408  8907 tablet_replica.cc:333] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.591058  8907 raft_consensus.cc:2243] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.591650  8907 raft_consensus.cc:2272] T 9358ee83f89640d5bdf3a594b9e5cb57 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.594048  8907 tablet_replica.cc:333] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.594753  8907 raft_consensus.cc:2243] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.595283  8907 raft_consensus.cc:2272] T 9c86138da8b040c5aa6085094c26e9c1 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.597608  8907 tablet_replica.cc:333] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.598178  8907 raft_consensus.cc:2243] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.599228  8907 raft_consensus.cc:2272] T 945e7aee947b4000b3adb3a542e97481 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.601573  8907 tablet_replica.cc:333] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.602203  8907 raft_consensus.cc:2243] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.602773  8907 raft_consensus.cc:2272] T a9685da56a3d45938fc81587d035167e P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.605253  8907 tablet_replica.cc:333] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.605855  8907 raft_consensus.cc:2243] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.606457  8907 raft_consensus.cc:2272] T 18be5f23c22e4079b3e2e4058b1f6841 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.609473  8907 tablet_replica.cc:333] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.610263  8907 raft_consensus.cc:2243] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.611032  8907 raft_consensus.cc:2272] T b92fe9272504412e8cb26f3d6b87d96f P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:13.612658 21026 consensus_peers.cc:597] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def -> Peer f7db1e9b4dfe4abaafa0e140bafbc556 (127.8.178.194:41215): Couldn't send request to peer f7db1e9b4dfe4abaafa0e140bafbc556. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:41215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:13.613760  8907 tablet_replica.cc:333] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.614396  8907 raft_consensus.cc:2243] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.615036  8907 raft_consensus.cc:2272] T d0853d9b602946428be0b54d8db3fba5 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.617175  8907 tablet_replica.cc:333] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.617699  8907 raft_consensus.cc:2243] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.618234  8907 raft_consensus.cc:2272] T dd86a68c0bdd4232bf8fa4b61c20a869 P bc52017e4298417cbac6d1f33ff45def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.620437  8907 tablet_replica.cc:333] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.620937  8907 raft_consensus.cc:2243] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.621888  8907 raft_consensus.cc:2272] T 3d425f635b4f4ca08a7e064630f35748 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.624086  8907 tablet_replica.cc:333] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.624629  8907 raft_consensus.cc:2243] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.625136  8907 raft_consensus.cc:2272] T e3be1e129ca7450b865739ce755c8b05 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.627259  8907 tablet_replica.cc:333] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.627842  8907 raft_consensus.cc:2243] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.628326  8907 raft_consensus.cc:2272] T 95a4e4f8e5b848e88ebfb909cb429b7a P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.630591  8907 tablet_replica.cc:333] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.631081  8907 raft_consensus.cc:2243] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.631574  8907 raft_consensus.cc:2272] T 96c0be00a95a4b55a3cb57ee1cdadb0c P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.633739  8907 tablet_replica.cc:333] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.634210  8907 raft_consensus.cc:2243] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.635139  8907 raft_consensus.cc:2272] T 421e52116ce6412fa1e5c84bf5a14209 P bc52017e4298417cbac6d1f33ff45def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.637526  8907 tablet_replica.cc:333] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def: stopping tablet replica
I20260709 12:19:13.638021  8907 raft_consensus.cc:2243] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:13.638585  8907 raft_consensus.cc:2272] T a0f075ff99b34bd4bcefbec68c736f96 P bc52017e4298417cbac6d1f33ff45def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.681742  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:19:13.720759  8907 master.cc:562] Master@127.8.178.254:38643 shutting down...
I20260709 12:19:13.744342  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:13.745010  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:13.745325  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P 77d35b0e4365486eb156ce26b2e211c6: stopping tablet replica
I20260709 12:19:13.766929  8907 master.cc:584] Master@127.8.178.254:38643 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21199 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:19:13.820466  8907 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.178.254:34155
I20260709 12:19:13.821558  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:13.826932 21398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:13.826977 21399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:13.828073 21401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:13.829182  8907 server_base.cc:1061] running on GCE node
I20260709 12:19:13.830031  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:13.830214  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:13.830349  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599553830339 us; error 0 us; skew 500 ppm
I20260709 12:19:13.830839  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:13.832955  8907 webserver.cc:533] Webserver started at http://127.8.178.254:36297/ using document root <none> and password file <none>
I20260709 12:19:13.833381  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:13.833536  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:13.833736  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:13.834843  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/master-0-root/instance:
uuid: "c64065ef65494b86842b2c97bc93c0ad"
format_stamp: "Formatted at 2026-07-09 12:19:13 on dist-test-slave-jlx4"
I20260709 12:19:13.839032  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:13.842221 21406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:13.842914  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:19:13.843171  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/master-0-root
uuid: "c64065ef65494b86842b2c97bc93c0ad"
format_stamp: "Formatted at 2026-07-09 12:19:13 on dist-test-slave-jlx4"
I20260709 12:19:13.843444  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:13.886384  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:13.887624  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:13.924067  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.254:34155
I20260709 12:19:13.924178 21457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.254:34155 every 8 connection(s)
I20260709 12:19:13.928355 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.940047 21458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: Bootstrap starting.
I20260709 12:19:13.944999 21458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.949172 21458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: No bootstrap required, opened a new log
I20260709 12:19:13.951429 21458 raft_consensus.cc:359] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER }
I20260709 12:19:13.951874 21458 raft_consensus.cc:385] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.952091 21458 raft_consensus.cc:740] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c64065ef65494b86842b2c97bc93c0ad, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.952670 21458 consensus_queue.cc:260] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER }
I20260709 12:19:13.953111 21458 raft_consensus.cc:399] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:13.953308 21458 raft_consensus.cc:493] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:13.953553 21458 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.958128 21458 raft_consensus.cc:515] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER }
I20260709 12:19:13.958634 21458 leader_election.cc:304] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c64065ef65494b86842b2c97bc93c0ad; no voters: 
I20260709 12:19:13.959720 21458 leader_election.cc:290] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:13.960117 21461 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.961392 21461 raft_consensus.cc:697] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 1 LEADER]: Becoming Leader. State: Replica: c64065ef65494b86842b2c97bc93c0ad, State: Running, Role: LEADER
I20260709 12:19:13.962056 21461 consensus_queue.cc:237] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER }
I20260709 12:19:13.962440 21458 sys_catalog.cc:565] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:13.968343 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c64065ef65494b86842b2c97bc93c0ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER } }
I20260709 12:19:13.968405 21463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader c64065ef65494b86842b2c97bc93c0ad. Latest consensus state: current_term: 1 leader_uuid: "c64065ef65494b86842b2c97bc93c0ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c64065ef65494b86842b2c97bc93c0ad" member_type: VOTER } }
I20260709 12:19:13.969044 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:13.969177 21463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:13.970883 21469 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:13.975708 21469 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:13.978245  8907 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:13.985540 21469 catalog_manager.cc:1383] Generated new cluster ID: 5028c86ab2e54e159859a1df3990021c
I20260709 12:19:13.985915 21469 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:14.001075 21469 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:14.002380 21469 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:14.016981 21469 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: Generated new TSK 0
I20260709 12:19:14.017568 21469 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:14.049365  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:14.055473 21479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:14.057004 21480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:14.058365  8907 server_base.cc:1061] running on GCE node
W20260709 12:19:14.058676 21482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:14.059597  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:14.059827  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:14.059993  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599554059976 us; error 0 us; skew 500 ppm
I20260709 12:19:14.060509  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:14.062863  8907 webserver.cc:533] Webserver started at http://127.8.178.193:39545/ using document root <none> and password file <none>
I20260709 12:19:14.063329  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:14.063514  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:14.063760  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:14.064883  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-0-root/instance:
uuid: "26e330f9e9d14b5f9bbabca43d18d285"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.069422  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:14.072785 21487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.073514  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:14.073805  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-0-root
uuid: "26e330f9e9d14b5f9bbabca43d18d285"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.074075  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:14.088958  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:14.090152  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:14.091596  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:14.093722  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:14.093906  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.094121  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:14.094290  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.134580  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.193:38131
I20260709 12:19:14.134712 21549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.193:38131 every 8 connection(s)
I20260709 12:19:14.139533  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:14.147374 21554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:14.147962 21555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:14.148885 21557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:14.152442  8907 server_base.cc:1061] running on GCE node
I20260709 12:19:14.153987  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:14.154188  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:14.154371  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599554154351 us; error 0 us; skew 500 ppm
I20260709 12:19:14.155119  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:14.156980 21550 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34155
I20260709 12:19:14.157382 21550 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:14.157859  8907 webserver.cc:533] Webserver started at http://127.8.178.194:45645/ using document root <none> and password file <none>
I20260709 12:19:14.158209 21550 heartbeater.cc:507] Master 127.8.178.254:34155 requested a full tablet report, sending...
I20260709 12:19:14.158473  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:14.158752  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:14.159010  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:14.160511  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-1-root/instance:
uuid: "d06e23f1c8dd483db7981081531621cc"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.160518 21423 ts_manager.cc:194] Registered new tserver with Master: 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131)
I20260709 12:19:14.163333 21423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49708
I20260709 12:19:14.166706  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:19:14.170415 21562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.171316  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:19:14.171612  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-1-root
uuid: "d06e23f1c8dd483db7981081531621cc"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.171917  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:14.184481  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:14.185631  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:14.187003  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:14.189178  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:14.189380  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.189594  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:14.189739  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.227813  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.194:34125
I20260709 12:19:14.227923 21624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.194:34125 every 8 connection(s)
I20260709 12:19:14.232980  8907 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:14.240376 21628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:14.243016 21629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:14.246527 21625 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34155
I20260709 12:19:14.246520  8907 server_base.cc:1061] running on GCE node
W20260709 12:19:14.246649 21631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:14.247205 21625 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:14.248049  8907 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:14.248210 21625 heartbeater.cc:507] Master 127.8.178.254:34155 requested a full tablet report, sending...
W20260709 12:19:14.248351  8907 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:14.248692  8907 hybrid_clock.cc:648] HybridClock initialized: now 1783599554248662 us; error 0 us; skew 500 ppm
I20260709 12:19:14.249418  8907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:14.250499 21423 ts_manager.cc:194] Registered new tserver with Master: d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:14.251921  8907 webserver.cc:533] Webserver started at http://127.8.178.195:37211/ using document root <none> and password file <none>
I20260709 12:19:14.252097 21423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49718
I20260709 12:19:14.252465  8907 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:14.252717  8907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:14.252962  8907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:14.254405  8907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-2-root/instance:
uuid: "549656fc52dc4d32b95e86a38f654b61"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.258715  8907 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:19:14.261927 21636 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.262713  8907 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:19:14.263161  8907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-2-root
uuid: "549656fc52dc4d32b95e86a38f654b61"
format_stamp: "Formatted at 2026-07-09 12:19:14 on dist-test-slave-jlx4"
I20260709 12:19:14.263563  8907 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZXN_tu/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599162605813-8907-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:14.282277  8907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:14.283438  8907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:14.284854  8907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:14.287055  8907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:14.287254  8907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.287475  8907 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:14.287628  8907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:14.331851  8907 rpc_server.cc:307] RPC server started. Bound to: 127.8.178.195:38537
I20260709 12:19:14.331976 21698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.178.195:38537 every 8 connection(s)
I20260709 12:19:14.347343 21699 heartbeater.cc:344] Connected to a master server at 127.8.178.254:34155
I20260709 12:19:14.347810 21699 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:14.348585 21699 heartbeater.cc:507] Master 127.8.178.254:34155 requested a full tablet report, sending...
I20260709 12:19:14.350621 21423 ts_manager.cc:194] Registered new tserver with Master: 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:14.350879  8907 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015829602s
I20260709 12:19:14.351996 21423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49720
I20260709 12:19:14.375409 21423 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49728:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:14.378099 21423 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:14.448482 21514 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8ff4e26bbe44e299e122b1c15ada0c (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:14.449204 21515 tablet_service.cc:1511] Processing CreateTablet for tablet a611119bad27426bbc7613183a3d517e (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:14.450026 21514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8ff4e26bbe44e299e122b1c15ada0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.450758 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a611119bad27426bbc7613183a3d517e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.451606 21513 tablet_service.cc:1511] Processing CreateTablet for tablet 794d5791aa754559b25397fc62e54fc9 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:14.453035 21513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794d5791aa754559b25397fc62e54fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.454648 21512 tablet_service.cc:1511] Processing CreateTablet for tablet aaa87a406370408e82ce446f558bca22 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:14.456095 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa87a406370408e82ce446f558bca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.465739 21590 tablet_service.cc:1511] Processing CreateTablet for tablet a611119bad27426bbc7613183a3d517e (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:14.467593 21589 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8ff4e26bbe44e299e122b1c15ada0c (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:14.472659 21590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a611119bad27426bbc7613183a3d517e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.475086 21587 tablet_service.cc:1511] Processing CreateTablet for tablet aaa87a406370408e82ce446f558bca22 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:14.476439 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa87a406370408e82ce446f558bca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.476848 21664 tablet_service.cc:1511] Processing CreateTablet for tablet a611119bad27426bbc7613183a3d517e (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:14.478140 21664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a611119bad27426bbc7613183a3d517e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.469421 21588 tablet_service.cc:1511] Processing CreateTablet for tablet 794d5791aa754559b25397fc62e54fc9 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:14.481021 21588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794d5791aa754559b25397fc62e54fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.483053 21511 tablet_service.cc:1511] Processing CreateTablet for tablet 87a6f73e36084930a34b6e0b152ff246 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:14.484926 21511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a6f73e36084930a34b6e0b152ff246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.487128 21586 tablet_service.cc:1511] Processing CreateTablet for tablet 87a6f73e36084930a34b6e0b152ff246 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:14.488494 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a6f73e36084930a34b6e0b152ff246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.492014 21510 tablet_service.cc:1511] Processing CreateTablet for tablet e3129265e8b34ec091bbd167ec6c6f42 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:14.492774 21585 tablet_service.cc:1511] Processing CreateTablet for tablet e3129265e8b34ec091bbd167ec6c6f42 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:14.493451 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3129265e8b34ec091bbd167ec6c6f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.494168 21585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3129265e8b34ec091bbd167ec6c6f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.494802 21589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8ff4e26bbe44e299e122b1c15ada0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.499688 21663 tablet_service.cc:1511] Processing CreateTablet for tablet 5f8ff4e26bbe44e299e122b1c15ada0c (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:14.501101 21663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f8ff4e26bbe44e299e122b1c15ada0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.507091 21509 tablet_service.cc:1511] Processing CreateTablet for tablet 1a661dcb6c014713951f579345cc4e4a (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:14.508524 21509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a661dcb6c014713951f579345cc4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.509415 21584 tablet_service.cc:1511] Processing CreateTablet for tablet 1a661dcb6c014713951f579345cc4e4a (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:14.510885 21584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a661dcb6c014713951f579345cc4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.514699 21583 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1cd01ba7d24b56ad62b41190aa7e60 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:14.516108 21583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1cd01ba7d24b56ad62b41190aa7e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.514699 21508 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1cd01ba7d24b56ad62b41190aa7e60 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:14.519953 21508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1cd01ba7d24b56ad62b41190aa7e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.539939 21662 tablet_service.cc:1511] Processing CreateTablet for tablet 794d5791aa754559b25397fc62e54fc9 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:14.541451 21662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794d5791aa754559b25397fc62e54fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.543680 21661 tablet_service.cc:1511] Processing CreateTablet for tablet aaa87a406370408e82ce446f558bca22 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:14.546146 21660 tablet_service.cc:1511] Processing CreateTablet for tablet 87a6f73e36084930a34b6e0b152ff246 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:14.548614 21659 tablet_service.cc:1511] Processing CreateTablet for tablet e3129265e8b34ec091bbd167ec6c6f42 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:14.551128 21658 tablet_service.cc:1511] Processing CreateTablet for tablet 1a661dcb6c014713951f579345cc4e4a (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:14.555589 21661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa87a406370408e82ce446f558bca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.555367 21507 tablet_service.cc:1511] Processing CreateTablet for tablet 936ce13740d34c11ac1159a7671c16f2 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:14.556308 21715 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.556895 21660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a6f73e36084930a34b6e0b152ff246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.557061 21507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936ce13740d34c11ac1159a7671c16f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.559777 21658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a661dcb6c014713951f579345cc4e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.560933 21659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3129265e8b34ec091bbd167ec6c6f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.567099 21715 tablet_bootstrap.cc:654] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.572108 21663 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1cd01ba7d24b56ad62b41190aa7e60 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:14.574273 21586 tablet_service.cc:1511] Processing CreateTablet for tablet 936ce13740d34c11ac1159a7671c16f2 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:14.575799 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936ce13740d34c11ac1159a7671c16f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.576704 21657 tablet_service.cc:1511] Processing CreateTablet for tablet 936ce13740d34c11ac1159a7671c16f2 (DEFAULT_TABLE table=test-workload [id=db7298be7ca1409b94b3676bd1ce3fac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:14.585253 21663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1cd01ba7d24b56ad62b41190aa7e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.586006 21657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936ce13740d34c11ac1159a7671c16f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:14.637279 21714 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.643829 21714 tablet_bootstrap.cc:654] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.645865 21715 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:14.646397 21715 ts_tablet_manager.cc:1403] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.008s
I20260709 12:19:14.650339 21717 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:14.649120 21715 raft_consensus.cc:359] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.654413 21715 raft_consensus.cc:385] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.654795 21715 raft_consensus.cc:740] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.655687 21715 consensus_queue.cc:260] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.658308 21625 heartbeater.cc:499] Master 127.8.178.254:34155 was elected leader, sending a full tablet report...
I20260709 12:19:14.659686 21714 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:14.660547 21717 tablet_bootstrap.cc:654] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.661634 21715 ts_tablet_manager.cc:1434] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:14.660635 21714 ts_tablet_manager.cc:1403] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:19:14.662734 21715 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.665555 21714 raft_consensus.cc:359] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.666276 21714 raft_consensus.cc:385] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.666577 21714 raft_consensus.cc:740] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.667291 21714 consensus_queue.cc:260] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.670250 21715 tablet_bootstrap.cc:654] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.689275 21714 ts_tablet_manager.cc:1434] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.018s
I20260709 12:19:14.689822 21699 heartbeater.cc:499] Master 127.8.178.254:34155 was elected leader, sending a full tablet report...
I20260709 12:19:14.690496 21714 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.691138 21717 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:14.691710 21717 ts_tablet_manager.cc:1403] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.016s
I20260709 12:19:14.694825 21717 raft_consensus.cc:359] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.695572 21717 raft_consensus.cc:385] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.695725 21714 tablet_bootstrap.cc:654] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.695892 21717 raft_consensus.cc:740] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.696024 21715 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:14.696746 21715 ts_tablet_manager.cc:1403] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 12:19:14.696926 21717 consensus_queue.cc:260] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.700124 21715 raft_consensus.cc:359] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.701031 21715 raft_consensus.cc:385] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.701402 21715 raft_consensus.cc:740] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.702469 21715 consensus_queue.cc:260] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.704946 21715 ts_tablet_manager.cc:1434] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:19:14.705977 21715 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.706815 21717 ts_tablet_manager.cc:1434] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.010s
I20260709 12:19:14.707620 21550 heartbeater.cc:499] Master 127.8.178.254:34155 was elected leader, sending a full tablet report...
I20260709 12:19:14.712724 21715 tablet_bootstrap.cc:654] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.718659 21717 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:14.718894 21721 raft_consensus.cc:493] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.719496 21721 raft_consensus.cc:515] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.720136 21714 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:14.720695 21714 ts_tablet_manager.cc:1403] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.012s
I20260709 12:19:14.723888 21714 raft_consensus.cc:359] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.724670 21714 raft_consensus.cc:385] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.724954 21714 raft_consensus.cc:740] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.725700 21714 consensus_queue.cc:260] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.726262 21717 tablet_bootstrap.cc:654] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.729347 21715 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:14.729918 21715 ts_tablet_manager.cc:1403] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.011s
W20260709 12:19:14.732393 21626 tablet.cc:2406] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:14.731736 21721 leader_election.cc:290] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:14.736287 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
W20260709 12:19:14.738222 21639 leader_election.cc:343] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:14.742494 21714 ts_tablet_manager.cc:1434] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 12:19:14.743559 21714 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.750355 21714 tablet_bootstrap.cc:654] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.751241 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
W20260709 12:19:14.753079 21640 leader_election.cc:343] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:14.754194 21640 leader_election.cc:304] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61; no voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc
I20260709 12:19:14.755084 21721 raft_consensus.cc:2749] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:14.755864 21715 raft_consensus.cc:359] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.756572 21714 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:14.756633 21715 raft_consensus.cc:385] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.757200 21715 raft_consensus.cc:740] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.757225 21714 ts_tablet_manager.cc:1403] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:19:14.758236 21717 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:14.758174 21715 consensus_queue.cc:260] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.758855 21717 ts_tablet_manager.cc:1403] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.012s
I20260709 12:19:14.760456 21715 ts_tablet_manager.cc:1434] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:19:14.760499 21714 raft_consensus.cc:359] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.761387 21714 raft_consensus.cc:385] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.761656 21714 raft_consensus.cc:740] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.761965 21715 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.761902 21717 raft_consensus.cc:359] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.762496 21714 consensus_queue.cc:260] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.763010 21717 raft_consensus.cc:385] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.763469 21717 raft_consensus.cc:740] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.764611 21719 raft_consensus.cc:493] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.764916 21714 ts_tablet_manager.cc:1434] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:14.764499 21717 consensus_queue.cc:260] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.767180 21717 ts_tablet_manager.cc:1434] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:14.768239 21717 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:14.768306 21714 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.771493 21719 raft_consensus.cc:515] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.775100 21717 tablet_bootstrap.cc:654] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.776755 21714 tablet_bootstrap.cc:654] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.780733 21719 leader_election.cc:290] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:14.788450 21714 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:14.789106 21714 ts_tablet_manager.cc:1403] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:19:14.791065 21715 tablet_bootstrap.cc:654] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.792287 21714 raft_consensus.cc:359] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.793200 21714 raft_consensus.cc:385] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.793493 21714 raft_consensus.cc:740] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.794574 21714 consensus_queue.cc:260] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.799707 21714 ts_tablet_manager.cc:1434] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:19:14.800732 21714 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.803311 21717 tablet_bootstrap.cc:492] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:14.803987 21717 ts_tablet_manager.cc:1403] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 12:19:14.807024 21714 tablet_bootstrap.cc:654] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.807524 21717 raft_consensus.cc:359] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.808416 21717 raft_consensus.cc:385] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.808763 21717 raft_consensus.cc:740] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.809753 21717 consensus_queue.cc:260] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.814124 21717 ts_tablet_manager.cc:1434] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:14.815351 21717 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:14.823310 21717 tablet_bootstrap.cc:654] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.830185 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a6f73e36084930a34b6e0b152ff246" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:14.831049 21525 raft_consensus.cc:2468] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:14.832444 21565 leader_election.cc:304] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:14.833421 21719 raft_consensus.cc:2804] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:14.833806 21719 raft_consensus.cc:493] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.834136 21719 raft_consensus.cc:3060] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.849190 21719 raft_consensus.cc:515] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.852419 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a6f73e36084930a34b6e0b152ff246" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:14.853072 21525 raft_consensus.cc:3060] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.861032 21525 raft_consensus.cc:2468] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:14.862356 21565 leader_election.cc:304] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:14.872104 21723 raft_consensus.cc:493] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.872843 21723 raft_consensus.cc:515] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.877187 21723 leader_election.cc:290] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:14.879469 21715 tablet_bootstrap.cc:492] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:14.880179 21715 ts_tablet_manager.cc:1403] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.118s	user 0.048s	sys 0.037s
I20260709 12:19:14.881309 21736 raft_consensus.cc:2804] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:14.883451 21715 raft_consensus.cc:359] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.884289 21715 raft_consensus.cc:385] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.884594 21715 raft_consensus.cc:740] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.885507 21715 consensus_queue.cc:260] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.889950 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a6f73e36084930a34b6e0b152ff246" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:14.890785 21673 raft_consensus.cc:3060] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.894804 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a6f73e36084930a34b6e0b152ff246" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:14.895443 21715 ts_tablet_manager.cc:1434] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.007s
I20260709 12:19:14.898941 21715 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.903020 21721 raft_consensus.cc:493] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.903746 21721 raft_consensus.cc:515] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.908816 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:14.909049 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8ff4e26bbe44e299e122b1c15ada0c" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:14.909900 21599 raft_consensus.cc:2468] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
W20260709 12:19:14.910733 21640 leader_election.cc:343] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:14.906283 21721 leader_election.cc:290] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:14.911388 21491 leader_election.cc:304] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:14.912154 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:14.912482 21723 raft_consensus.cc:2804] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:14.912923 21723 raft_consensus.cc:493] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.913419 21723 raft_consensus.cc:3060] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.915393 21673 raft_consensus.cc:2468] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:14.916558 21715 tablet_bootstrap.cc:654] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.912961 21525 raft_consensus.cc:2468] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:14.918257 21639 leader_election.cc:304] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: d06e23f1c8dd483db7981081531621cc
I20260709 12:19:14.919677 21721 raft_consensus.cc:2804] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:14.920543 21721 raft_consensus.cc:493] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.920882 21721 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.922300 21723 raft_consensus.cc:515] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.924881 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8ff4e26bbe44e299e122b1c15ada0c" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:14.925698 21674 raft_consensus.cc:2468] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:14.883538 21719 leader_election.cc:290] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:14.930017 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8ff4e26bbe44e299e122b1c15ada0c" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:14.930223 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f8ff4e26bbe44e299e122b1c15ada0c" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:14.930780 21599 raft_consensus.cc:3060] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.931166 21674 raft_consensus.cc:3060] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.928532 21723 leader_election.cc:290] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:14.939877 21599 raft_consensus.cc:2468] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:14.941630 21491 leader_election.cc:304] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:14.942600 21723 raft_consensus.cc:2804] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:14.943725 21736 raft_consensus.cc:697] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:14.946555 21723 raft_consensus.cc:697] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:14.947989 21714 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:14.947376 21674 raft_consensus.cc:2468] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:14.948570 21714 ts_tablet_manager.cc:1403] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.148s	user 0.044s	sys 0.096s
I20260709 12:19:14.949494 21721 raft_consensus.cc:515] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.952006 21714 raft_consensus.cc:359] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.952998 21714 raft_consensus.cc:385] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.954288 21721 leader_election.cc:290] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:14.954836 21715 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:14.953441 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:14.955453 21715 ts_tablet_manager.cc:1403] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.025s
I20260709 12:19:14.956156 21717 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:14.954066 21714 raft_consensus.cc:740] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.953140 21736 consensus_queue.cc:237] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
W20260709 12:19:14.956453 21640 leader_election.cc:343] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:14.952831 21723 consensus_queue.cc:237] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.953145 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:14.958110 21525 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.956705 21717 ts_tablet_manager.cc:1403] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.142s	user 0.042s	sys 0.023s
I20260709 12:19:14.959968 21714 consensus_queue.cc:260] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.962327 21714 ts_tablet_manager.cc:1434] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:19:14.963068 21717 raft_consensus.cc:359] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.963822 21717 raft_consensus.cc:385] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.964141 21717 raft_consensus.cc:740] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:14.965137 21717 consensus_queue.cc:260] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.963426 21714 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:14.967935 21717 ts_tablet_manager.cc:1434] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:19:14.968271 21525 raft_consensus.cc:2468] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:14.968983 21717 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:14.969619 21639 leader_election.cc:304] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: d06e23f1c8dd483db7981081531621cc
I20260709 12:19:14.960595 21715 raft_consensus.cc:359] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.970921 21715 raft_consensus.cc:385] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:14.971258 21715 raft_consensus.cc:740] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
W20260709 12:19:14.973680 21471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:14.974597 21714 tablet_bootstrap.cc:654] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.976097 21721 raft_consensus.cc:2804] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:14.975708 21715 consensus_queue.cc:260] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.976660 21721 raft_consensus.cc:697] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:14.977522 21721 consensus_queue.cc:237] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:14.978324 21715 ts_tablet_manager.cc:1434] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:19:14.979504 21715 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:14.974071 21419 catalog_manager.cc:5697] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.981858 21717 tablet_bootstrap.cc:654] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.985909 21715 tablet_bootstrap.cc:654] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:14.996130 21717 tablet_bootstrap.cc:492] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:14.996763 21717 ts_tablet_manager.cc:1403] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.006s
I20260709 12:19:14.999909 21715 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:15.000515 21715 ts_tablet_manager.cc:1403] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:19:15.001211 21717 raft_consensus.cc:359] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.004468 21715 raft_consensus.cc:359] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.005359 21715 raft_consensus.cc:385] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.005648 21715 raft_consensus.cc:740] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.002050 21717 raft_consensus.cc:385] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.019040 21715 consensus_queue.cc:260] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.018656 21717 raft_consensus.cc:740] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.020936 21717 consensus_queue.cc:260] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.023736 21717 ts_tablet_manager.cc:1434] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:19:15.022836 21421 catalog_manager.cc:5697] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.022853 21715 ts_tablet_manager.cc:1434] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 12:19:15.025789 21714 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:15.025943 21715 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:15.026280 21714 ts_tablet_manager.cc:1403] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.032s
I20260709 12:19:15.026908 21717 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:15.029388 21714 raft_consensus.cc:359] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.030077 21714 raft_consensus.cc:385] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.030318 21714 raft_consensus.cc:740] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.031062 21714 consensus_queue.cc:260] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.033187 21715 tablet_bootstrap.cc:654] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.033699 21717 tablet_bootstrap.cc:654] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.033843 21714 ts_tablet_manager.cc:1434] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:15.035158 21714 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:15.041940 21714 tablet_bootstrap.cc:654] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.045812 21717 tablet_bootstrap.cc:492] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:15.046077 21715 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:15.046411 21717 ts_tablet_manager.cc:1403] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:19:15.046669 21715 ts_tablet_manager.cc:1403] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:19:15.049660 21717 raft_consensus.cc:359] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.050515 21717 raft_consensus.cc:385] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.050830 21717 raft_consensus.cc:740] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.051813 21717 consensus_queue.cc:260] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.054390 21717 ts_tablet_manager.cc:1434] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:15.055418 21717 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:15.058126 21423 catalog_manager.cc:5697] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.061812 21717 tablet_bootstrap.cc:654] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.063195 21715 raft_consensus.cc:359] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.064145 21715 raft_consensus.cc:385] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.064458 21715 raft_consensus.cc:740] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.065483 21715 consensus_queue.cc:260] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.068334 21715 ts_tablet_manager.cc:1434] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:19:15.069567 21715 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:15.078570 21736 raft_consensus.cc:493] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.083731 21736 raft_consensus.cc:515] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.083782 21717 tablet_bootstrap.cc:492] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:15.085536 21717 ts_tablet_manager.cc:1403] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.015s
I20260709 12:19:15.085880 21714 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:15.086419 21714 ts_tablet_manager.cc:1403] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.018s
I20260709 12:19:15.086592 21736 leader_election.cc:290] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.083688 21715 tablet_bootstrap.cc:654] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.087257 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:15.087971 21525 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:15.088567 21717 raft_consensus.cc:359] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.089340 21717 raft_consensus.cc:385] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.089627 21717 raft_consensus.cc:740] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.089816 21714 raft_consensus.cc:359] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.090628 21714 raft_consensus.cc:385] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.090384 21717 consensus_queue.cc:260] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.090958 21714 raft_consensus.cc:740] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.091450 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:15.092120 21673 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:15.091814 21714 consensus_queue.cc:260] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.093297 21717 ts_tablet_manager.cc:1434] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:15.093879 21714 ts_tablet_manager.cc:1434] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:19:15.094496 21717 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:15.095010 21714 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:15.095714 21565 leader_election.cc:304] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.096660 21736 raft_consensus.cc:2804] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.097011 21736 raft_consensus.cc:493] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.097347 21736 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.098481 21715 tablet_bootstrap.cc:492] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:15.099030 21715 ts_tablet_manager.cc:1403] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 12:19:15.102094 21714 tablet_bootstrap.cc:654] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.101886 21715 raft_consensus.cc:359] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.102725 21715 raft_consensus.cc:385] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.103003 21715 raft_consensus.cc:740] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.103185 21717 tablet_bootstrap.cc:654] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.103849 21715 consensus_queue.cc:260] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.106338 21715 ts_tablet_manager.cc:1434] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:15.107411 21715 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:15.109741 21736 raft_consensus.cc:515] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.112998 21715 tablet_bootstrap.cc:654] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.114033 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:15.117342 21525 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.119302 21736 leader_election.cc:290] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.120357 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.120985 21673 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.124904 21525 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:15.126129 21565 leader_election.cc:304] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.127700 21736 raft_consensus.cc:2804] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.128465 21736 raft_consensus.cc:697] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:15.129287 21736 consensus_queue.cc:237] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.129886 21714 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:15.130560 21714 ts_tablet_manager.cc:1403] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 12:19:15.133378 21714 raft_consensus.cc:359] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.134110 21714 raft_consensus.cc:385] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.134459 21714 raft_consensus.cc:740] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.135520 21714 consensus_queue.cc:260] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.137146 21717 tablet_bootstrap.cc:492] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:15.134312 21673 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:15.137804 21717 ts_tablet_manager.cc:1403] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.016s
I20260709 12:19:15.141033 21717 raft_consensus.cc:359] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.141762 21717 raft_consensus.cc:385] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.142022 21717 raft_consensus.cc:740] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.145802 21717 consensus_queue.cc:260] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.148365 21714 ts_tablet_manager.cc:1434] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:19:15.149535 21714 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:15.152326 21421 catalog_manager.cc:5697] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.155166 21714 tablet_bootstrap.cc:654] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.157401 21715 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:15.158058 21715 ts_tablet_manager.cc:1403] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.013s
I20260709 12:19:15.160538 21717 ts_tablet_manager.cc:1434] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.007s
I20260709 12:19:15.160777 21715 raft_consensus.cc:359] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.161484 21715 raft_consensus.cc:385] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.161731 21715 raft_consensus.cc:740] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.162545 21715 consensus_queue.cc:260] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.164965 21715 ts_tablet_manager.cc:1434] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:19:15.167027 21717 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:15.167744 21714 tablet_bootstrap.cc:492] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:15.168274 21714 ts_tablet_manager.cc:1403] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 12:19:15.170291 21714 raft_consensus.cc:359] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.170869 21714 raft_consensus.cc:385] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.171073 21714 raft_consensus.cc:740] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.171669 21714 consensus_queue.cc:260] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.173329 21717 tablet_bootstrap.cc:654] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:15.175401 21714 ts_tablet_manager.cc:1434] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:15.178920 21717 tablet_bootstrap.cc:492] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:15.179490 21717 ts_tablet_manager.cc:1403] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:19:15.182224 21717 raft_consensus.cc:359] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.182946 21717 raft_consensus.cc:385] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:15.183153 21717 raft_consensus.cc:740] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:15.183713 21717 consensus_queue.cc:260] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.185240 21717 ts_tablet_manager.cc:1434] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:15.186368 21723 raft_consensus.cc:493] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.186972 21723 raft_consensus.cc:515] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.188962 21723 leader_election.cc:290] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.190210 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:15.190919 21673 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.192010 21491 leader_election.cc:304] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:15.192263 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:15.192862 21723 raft_consensus.cc:2804] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.193259 21723 raft_consensus.cc:493] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.193459 21599 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.193626 21723 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.200971 21723 raft_consensus.cc:515] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.202708 21723 leader_election.cc:290] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.203632 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.203631 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.204293 21599 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.204346 21673 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.209448 21673 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.209547 21599 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.210650 21491 leader_election.cc:304] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:15.211318 21723 raft_consensus.cc:2804] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.211786 21723 raft_consensus.cc:697] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.212452 21742 raft_consensus.cc:493] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.212571 21723 consensus_queue.cc:237] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.212903 21742 raft_consensus.cc:515] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.214725 21742 leader_election.cc:290] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.215476 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:15.216274 21599 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.216809 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:15.217427 21491 leader_election.cc:304] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.217568 21673 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.218276 21723 raft_consensus.cc:2804] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.218760 21723 raft_consensus.cc:493] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.219134 21723 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.220577 21421 catalog_manager.cc:5697] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.225390 21723 raft_consensus.cc:515] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.227414 21723 leader_election.cc:290] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.228542 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.228655 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.229251 21599 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.229735 21673 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.234503 21599 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.234874 21673 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.235563 21491 leader_election.cc:304] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.236356 21723 raft_consensus.cc:2804] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.236828 21723 raft_consensus.cc:697] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.237653 21723 consensus_queue.cc:237] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.245402 21421 catalog_manager.cc:5697] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.310546 21721 raft_consensus.cc:493] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.311101 21721 raft_consensus.cc:515] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.312970 21721 leader_election.cc:290] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:15.313784 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:15.313934 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:15.314394 21525 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:15.314594 21599 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:15.315385 21639 leader_election.cc:304] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:15.316082 21721 raft_consensus.cc:2804] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.316430 21721 raft_consensus.cc:493] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.316672 21721 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.321609 21721 raft_consensus.cc:515] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.323370 21721 leader_election.cc:290] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:15.324065 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:15.324712 21525 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.324651 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.325320 21599 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.330122 21525 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:15.330324 21599 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:15.331281 21639 leader_election.cc:304] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:15.331930 21721 raft_consensus.cc:2804] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.332392 21721 raft_consensus.cc:697] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:15.333074 21721 consensus_queue.cc:237] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.337386 21723 raft_consensus.cc:493] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.337860 21723 raft_consensus.cc:515] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.339555 21723 leader_election.cc:290] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.340265 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:15.340756 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:15.340965 21599 raft_consensus.cc:2468] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.341432 21673 raft_consensus.cc:2468] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:15.340960 21421 catalog_manager.cc:5697] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.342233 21491 leader_election.cc:304] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.342969 21723 raft_consensus.cc:2804] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.343374 21723 raft_consensus.cc:493] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.343679 21723 raft_consensus.cc:3060] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.349242 21723 raft_consensus.cc:515] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.350899 21723 leader_election.cc:290] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.351579 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.351882 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a611119bad27426bbc7613183a3d517e" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.352236 21599 raft_consensus.cc:3060] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.352512 21673 raft_consensus.cc:3060] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.359165 21599 raft_consensus.cc:2468] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.359169 21673 raft_consensus.cc:2468] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:15.360337 21491 leader_election.cc:304] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.360906 21723 raft_consensus.cc:2804] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.361287 21723 raft_consensus.cc:697] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.361997 21723 consensus_queue.cc:237] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.368924 21421 catalog_manager.cc:5697] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.381145 21736 consensus_queue.cc:1048] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.391814 21738 consensus_queue.cc:1048] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.392830 21736 raft_consensus.cc:493] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.393464 21736 raft_consensus.cc:515] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.396680 21736 leader_election.cc:290] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.397440 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1cd01ba7d24b56ad62b41190aa7e60" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:15.398159 21525 raft_consensus.cc:2468] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:15.398563 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1cd01ba7d24b56ad62b41190aa7e60" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:15.399220 21674 raft_consensus.cc:2468] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:15.399405 21565 leader_election.cc:304] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.400538 21736 raft_consensus.cc:2804] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:15.400915 21736 raft_consensus.cc:493] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.401283 21736 raft_consensus.cc:3060] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.407902 21599 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.408816 21736 raft_consensus.cc:515] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.410414 21723 consensus_queue.cc:1048] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.411717 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1cd01ba7d24b56ad62b41190aa7e60" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:15.412377 21525 raft_consensus.cc:3060] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.416523 21721 consensus_queue.cc:1048] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.419020 21736 leader_election.cc:290] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.419800 21525 raft_consensus.cc:2468] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:15.421000 21565 leader_election.cc:304] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.421942 21738 raft_consensus.cc:2804] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:15.422472 21738 raft_consensus.cc:697] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:15.423346 21738 consensus_queue.cc:237] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.429133 21742 consensus_queue.cc:1048] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.434542 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1cd01ba7d24b56ad62b41190aa7e60" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.435474 21674 raft_consensus.cc:3060] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:15.444751 21674 raft_consensus.cc:2468] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:15.455047 21726 consensus_queue.cc:1048] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.461900 21419 catalog_manager.cc:5697] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.595762 21674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
mode: GRACEFUL
new_leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:38568
I20260709 12:19:15.596309 21674 raft_consensus.cc:606] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Received request to transfer leadership to TS 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:15.600746 21674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa87a406370408e82ce446f558bca22"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
mode: GRACEFUL
new_leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:38568
I20260709 12:19:15.601209 21674 raft_consensus.cc:606] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Received request to transfer leadership to TS 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:15.616008 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
mode: GRACEFUL
new_leader_uuid: "d06e23f1c8dd483db7981081531621cc"
 from {username='slave'} at 127.0.0.1:48944
I20260709 12:19:15.616487 21525 raft_consensus.cc:606] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Received request to transfer leadership to TS d06e23f1c8dd483db7981081531621cc
I20260709 12:19:15.625175 21738 consensus_queue.cc:1048] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.625813 21525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
mode: GRACEFUL
new_leader_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:48944
I20260709 12:19:15.626371 21525 raft_consensus.cc:606] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Received request to transfer leadership to TS 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:15.635506 21738 consensus_queue.cc:1048] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.693912 21742 consensus_queue.cc:1048] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.704530 21785 consensus_queue.cc:1048] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.712332 21742 raft_consensus.cc:993] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: : Instructing follower d06e23f1c8dd483db7981081531621cc to start an election
I20260709 12:19:15.712790 21785 raft_consensus.cc:1081] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Signalling peer d06e23f1c8dd483db7981081531621cc to start an election
I20260709 12:19:15.714267 21599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
 from {username='slave'} at 127.0.0.1:48918
I20260709 12:19:15.714774 21599 raft_consensus.cc:493] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:15.715041 21599 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.719764 21599 raft_consensus.cc:515] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.721638 21599 leader_election.cc:290] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 2 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.721946 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:15.722218 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3129265e8b34ec091bbd167ec6c6f42" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.722651 21524 raft_consensus.cc:3055] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:15.722819 21674 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.722994 21524 raft_consensus.cc:740] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.723834 21524 consensus_queue.cc:260] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.725096 21524 raft_consensus.cc:3060] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.729790 21674 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 2.
I20260709 12:19:15.730983 21566 leader_election.cc:304] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.731670 21738 raft_consensus.cc:2804] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:15.731801 21524 raft_consensus.cc:2468] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 2.
I20260709 12:19:15.732076 21738 raft_consensus.cc:697] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 2 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:15.732949 21738 consensus_queue.cc:237] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.739213 21421 catalog_manager.cc:5697] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 1 to 2, leader changed from 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193) to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 2 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.805164 21785 consensus_queue.cc:1048] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.809252 21742 consensus_queue.cc:1048] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.811650 21742 consensus_queue.cc:1048] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.823554 21788 consensus_queue.cc:1048] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.825071 21742 raft_consensus.cc:993] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: : Instructing follower 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:15.825683 21723 raft_consensus.cc:1081] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Signalling peer 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:15.833848 21673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:19:15.834497 21673 raft_consensus.cc:493] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:15.834897 21673 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.843474 21777 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.844376 21673 raft_consensus.cc:515] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.846760 21673 leader_election.cc:290] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:15.847436 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:15.848116 21524 raft_consensus.cc:3055] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:15.848434 21524 raft_consensus.cc:740] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.849255 21524 consensus_queue.cc:260] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.850601 21524 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.853147 21736 consensus_queue.cc:1048] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:15.856848 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936ce13740d34c11ac1159a7671c16f2" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.857515 21600 raft_consensus.cc:3060] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.863729 21721 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:15.866040 21600 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:15.868801 21640 leader_election.cc:304] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.869722 21721 raft_consensus.cc:2804] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:15.870250 21721 raft_consensus.cc:697] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:15.871176 21721 consensus_queue.cc:237] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.880874 21777 raft_consensus.cc:993] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: : Instructing follower 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:15.881398 21726 raft_consensus.cc:1081] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Signalling peer 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:15.884174 21522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa87a406370408e82ce446f558bca22"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:48930
I20260709 12:19:15.885354 21522 raft_consensus.cc:493] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:15.885743 21522 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.886830 21524 raft_consensus.cc:2468] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:15.886130 21421 catalog_manager.cc:5697] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 1 to 2, leader changed from 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193) to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.893833 21522 raft_consensus.cc:515] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.905898 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.906539 21598 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.907876 21522 leader_election.cc:290] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.908196 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.908789 21673 raft_consensus.cc:3055] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:15.909106 21673 raft_consensus.cc:740] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:15.909909 21673 consensus_queue.cc:260] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.910988 21673 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.914186 21598 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:15.916067 21491 leader_election.cc:304] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.917300 21785 raft_consensus.cc:2804] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:15.917780 21785 raft_consensus.cc:697] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.918607 21785 consensus_queue.cc:237] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.921051 21673 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:15.915988 21719 consensus_queue.cc:1048] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:15.925341 21726 raft_consensus.cc:993] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: : Instructing follower 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:15.925761 21726 raft_consensus.cc:1081] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Signalling peer 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:15.928371 21525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:48930
I20260709 12:19:15.929023 21525 raft_consensus.cc:493] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:15.929522 21525 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.932932 21419 catalog_manager.cc:5697] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 1 to 2, leader changed from 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195) to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.936065 21525 raft_consensus.cc:515] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.938059 21525 leader_election.cc:290] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:15.938695 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:15.939337 21598 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.939666 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794d5791aa754559b25397fc62e54fc9" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:15.940223 21673 raft_consensus.cc:3055] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:15.940510 21673 raft_consensus.cc:740] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:15.941246 21673 consensus_queue.cc:260] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.942363 21673 raft_consensus.cc:3060] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:15.947875 21598 raft_consensus.cc:2468] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:15.948596 21673 raft_consensus.cc:2468] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:15.949021 21491 leader_election.cc:304] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:15.949736 21785 raft_consensus.cc:2804] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:15.950106 21785 raft_consensus.cc:697] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:15.950757 21785 consensus_queue.cc:237] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:15.956943 21423 catalog_manager.cc:5697] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 1 to 2, leader changed from 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195) to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:16.168547 21525 raft_consensus.cc:1275] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Refusing update from remote peer d06e23f1c8dd483db7981081531621cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.170024 21736 consensus_queue.cc:1048] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.177744 21673 raft_consensus.cc:1275] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer d06e23f1c8dd483db7981081531621cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.180048 21797 consensus_queue.cc:1048] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.305547 21598 raft_consensus.cc:1275] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.306754 21785 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.319180 21673 raft_consensus.cc:1275] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.320492 21723 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.372742 21598 raft_consensus.cc:1275] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.374047 21788 consensus_queue.cc:1048] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.383699 21673 raft_consensus.cc:1275] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.385123 21742 consensus_queue.cc:1048] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.437610 21598 raft_consensus.cc:1275] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.438862 21721 consensus_queue.cc:1048] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:16.447835 21525 raft_consensus.cc:1275] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:16.450273 21721 consensus_queue.cc:1048] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:18.652643 21419 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58544:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:18.654784 21419 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:18.704038 21512 tablet_service.cc:1511] Processing CreateTablet for tablet 2aea977479d64b5091426279b52cf890 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.705358 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea977479d64b5091426279b52cf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.705094 21584 tablet_service.cc:1511] Processing CreateTablet for tablet 2aea977479d64b5091426279b52cf890 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.706562 21584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea977479d64b5091426279b52cf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.706395 21661 tablet_service.cc:1511] Processing CreateTablet for tablet 2aea977479d64b5091426279b52cf890 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.707664 21661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aea977479d64b5091426279b52cf890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.717166 21507 tablet_service.cc:1511] Processing CreateTablet for tablet a1b7f230d8414fc98242a88e9d178a09 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.718590 21507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b7f230d8414fc98242a88e9d178a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.718448 21587 tablet_service.cc:1511] Processing CreateTablet for tablet a1b7f230d8414fc98242a88e9d178a09 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.719802 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b7f230d8414fc98242a88e9d178a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.720510 21659 tablet_service.cc:1511] Processing CreateTablet for tablet a1b7f230d8414fc98242a88e9d178a09 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.721844 21659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b7f230d8414fc98242a88e9d178a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.725970 21515 tablet_service.cc:1511] Processing CreateTablet for tablet d34ef136a21440acbb99ea660e3bf39a (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.727411 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34ef136a21440acbb99ea660e3bf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.727101 21586 tablet_service.cc:1511] Processing CreateTablet for tablet d34ef136a21440acbb99ea660e3bf39a (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.728446 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34ef136a21440acbb99ea660e3bf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.741883 21657 tablet_service.cc:1511] Processing CreateTablet for tablet d34ef136a21440acbb99ea660e3bf39a (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.743374 21657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34ef136a21440acbb99ea660e3bf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.745199 21590 tablet_service.cc:1511] Processing CreateTablet for tablet e6c79eceb05d4a7b9126c122c1220c85 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:18.746516 21590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c79eceb05d4a7b9126c122c1220c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.752277 21507 tablet_service.cc:1511] Processing CreateTablet for tablet e6c79eceb05d4a7b9126c122c1220c85 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:18.753744 21507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c79eceb05d4a7b9126c122c1220c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.759114 21663 tablet_service.cc:1511] Processing CreateTablet for tablet e6c79eceb05d4a7b9126c122c1220c85 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:18.760512 21663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c79eceb05d4a7b9126c122c1220c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.764329 21508 tablet_service.cc:1511] Processing CreateTablet for tablet 3c95b24fe1dd4e49a2241e53b5484cae (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.765722 21508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c95b24fe1dd4e49a2241e53b5484cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.765682 21583 tablet_service.cc:1511] Processing CreateTablet for tablet 3c95b24fe1dd4e49a2241e53b5484cae (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.767217 21583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c95b24fe1dd4e49a2241e53b5484cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.767838 21658 tablet_service.cc:1511] Processing CreateTablet for tablet 3c95b24fe1dd4e49a2241e53b5484cae (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.769121 21658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c95b24fe1dd4e49a2241e53b5484cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.769848 21509 tablet_service.cc:1511] Processing CreateTablet for tablet 66fb05fd5cc04566ad610471a6824f82 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.771113 21509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fb05fd5cc04566ad610471a6824f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.771596 21588 tablet_service.cc:1511] Processing CreateTablet for tablet 66fb05fd5cc04566ad610471a6824f82 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.776336 21588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fb05fd5cc04566ad610471a6824f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.782488 21664 tablet_service.cc:1511] Processing CreateTablet for tablet 66fb05fd5cc04566ad610471a6824f82 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.783886 21664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fb05fd5cc04566ad610471a6824f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.784492 21510 tablet_service.cc:1511] Processing CreateTablet for tablet d27def25e82d4b04804a7c01d0bad511 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.785843 21510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27def25e82d4b04804a7c01d0bad511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.786208 21586 tablet_service.cc:1511] Processing CreateTablet for tablet d27def25e82d4b04804a7c01d0bad511 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.787585 21586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27def25e82d4b04804a7c01d0bad511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.797858 21660 tablet_service.cc:1511] Processing CreateTablet for tablet d27def25e82d4b04804a7c01d0bad511 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.799387 21660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27def25e82d4b04804a7c01d0bad511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.807370 21515 tablet_service.cc:1511] Processing CreateTablet for tablet 1166087a85aa4ba7b2afa44366e76cc8 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.808806 21515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166087a85aa4ba7b2afa44366e76cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.813783 21587 tablet_service.cc:1511] Processing CreateTablet for tablet 1166087a85aa4ba7b2afa44366e76cc8 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.815349 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166087a85aa4ba7b2afa44366e76cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.834303 21815 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:18.847316 21659 tablet_service.cc:1511] Processing CreateTablet for tablet 1166087a85aa4ba7b2afa44366e76cc8 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.850838 21813 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:18.851207 21659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1166087a85aa4ba7b2afa44366e76cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.855386 21814 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:18.857367 21587 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccc178f77f24b3c946787419e759896 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.858760 21587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccc178f77f24b3c946787419e759896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.856650 21512 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccc178f77f24b3c946787419e759896 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.860852 21512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccc178f77f24b3c946787419e759896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.862665 21815 tablet_bootstrap.cc:654] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.876282 21814 tablet_bootstrap.cc:654] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.864732 21660 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccc178f77f24b3c946787419e759896 (DEFAULT_TABLE table=soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.877689 21660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccc178f77f24b3c946787419e759896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.868631 21813 tablet_bootstrap.cc:654] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.881970 21815 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:18.882658 21815 ts_tablet_manager.cc:1403] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.005s
I20260709 12:19:18.884209 21814 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:18.884773 21814 ts_tablet_manager.cc:1403] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.006s
I20260709 12:19:18.885059 21815 raft_consensus.cc:359] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.885645 21815 raft_consensus.cc:385] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.885865 21815 raft_consensus.cc:740] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.886497 21815 consensus_queue.cc:260] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.887676 21814 raft_consensus.cc:359] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.888512 21815 ts_tablet_manager.cc:1434] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:19:18.889984 21813 tablet_bootstrap.cc:492] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:18.890847 21813 ts_tablet_manager.cc:1403] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 12:19:18.891180 21815 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:18.896839 21813 raft_consensus.cc:359] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.890369 21814 raft_consensus.cc:385] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.897894 21813 raft_consensus.cc:385] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.898031 21814 raft_consensus.cc:740] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.898283 21813 raft_consensus.cc:740] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.898870 21814 consensus_queue.cc:260] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.899070 21813 consensus_queue.cc:260] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.901387 21813 ts_tablet_manager.cc:1434] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:19:18.899662 21815 tablet_bootstrap.cc:654] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.903091 21814 ts_tablet_manager.cc:1434] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:19:18.904147 21813 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:18.905197 21814 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:18.912195 21814 tablet_bootstrap.cc:654] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.914963 21813 tablet_bootstrap.cc:654] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.932897 21815 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:18.933449 21815 ts_tablet_manager.cc:1403] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.006s
I20260709 12:19:18.933547 21813 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:18.933792 21814 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:18.934090 21813 ts_tablet_manager.cc:1403] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:19:18.934362 21814 ts_tablet_manager.cc:1403] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 12:19:18.936623 21813 raft_consensus.cc:359] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.936584 21815 raft_consensus.cc:359] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.937446 21813 raft_consensus.cc:385] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.937600 21815 raft_consensus.cc:385] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.937327 21814 raft_consensus.cc:359] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.937909 21813 raft_consensus.cc:740] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.938045 21815 raft_consensus.cc:740] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.938172 21814 raft_consensus.cc:385] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.938575 21814 raft_consensus.cc:740] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.938900 21815 consensus_queue.cc:260] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.938760 21813 consensus_queue.cc:260] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.939307 21814 consensus_queue.cc:260] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.941284 21813 ts_tablet_manager.cc:1434] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:18.941612 21814 ts_tablet_manager.cc:1434] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:19:18.942224 21813 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:18.942588 21814 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:18.943995 21815 ts_tablet_manager.cc:1434] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:18.945032 21815 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:18.949682 21814 tablet_bootstrap.cc:654] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.951122 21815 tablet_bootstrap.cc:654] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.953800 21813 tablet_bootstrap.cc:654] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.956148 21797 raft_consensus.cc:493] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.956700 21797 raft_consensus.cc:515] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.973613 21825 raft_consensus.cc:493] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.974711 21797 leader_election.cc:290] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:18.978557 21813 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:18.979242 21813 ts_tablet_manager.cc:1403] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.005s
I20260709 12:19:18.976480 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
W20260709 12:19:18.980903 21565 leader_election.cc:343] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.974543 21825 raft_consensus.cc:515] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.983281 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:18.983666 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:18.984357 21525 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:18.985553 21565 leader_election.cc:304] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:18.988521 21825 leader_election.cc:290] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:18.992393 21813 raft_consensus.cc:359] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:18.993005 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:18.997905 21673 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:18.999020 21813 raft_consensus.cc:385] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.999768 21813 raft_consensus.cc:740] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.001271 21813 consensus_queue.cc:260] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.004465 21813 ts_tablet_manager.cc:1434] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:19:19.007238 21813 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
W20260709 12:19:18.994695 21566 leader_election.cc:343] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:18.993729 21825 raft_consensus.cc:2804] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.009308 21825 raft_consensus.cc:493] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.009234 21566 leader_election.cc:304] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d06e23f1c8dd483db7981081531621cc; no voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:19.011155 21797 raft_consensus.cc:2749] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.009824 21825 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.012342 21471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:19.019886 21815 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.020558 21815 ts_tablet_manager.cc:1403] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.076s	user 0.038s	sys 0.030s
I20260709 12:19:19.022909 21813 tablet_bootstrap.cc:654] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.023561 21815 raft_consensus.cc:359] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.024041 21814 tablet_bootstrap.cc:492] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.024328 21815 raft_consensus.cc:385] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.024638 21815 raft_consensus.cc:740] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.025298 21815 consensus_queue.cc:260] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.024649 21814 ts_tablet_manager.cc:1403] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.082s	user 0.045s	sys 0.029s
I20260709 12:19:19.030519 21815 ts_tablet_manager.cc:1434] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:19:19.031610 21815 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.034289 21813 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.034868 21813 ts_tablet_manager.cc:1403] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.010s
I20260709 12:19:19.037562 21814 raft_consensus.cc:359] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.037750 21813 raft_consensus.cc:359] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.039063 21814 raft_consensus.cc:385] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.039152 21813 raft_consensus.cc:385] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.038473 21825 raft_consensus.cc:515] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.039455 21815 tablet_bootstrap.cc:654] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.039512 21813 raft_consensus.cc:740] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.040503 21813 consensus_queue.cc:260] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.041757 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.042339 21525 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.042830 21813 ts_tablet_manager.cc:1434] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:19:19.043834 21813 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:19.046883 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:19.047529 21673 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.049810 21813 tablet_bootstrap.cc:654] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.053488 21525 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.053877 21815 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.055420 21815 ts_tablet_manager.cc:1403] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:19:19.055612 21565 leader_election.cc:304] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.039407 21814 raft_consensus.cc:740] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.056563 21826 raft_consensus.cc:2804] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.057049 21826 raft_consensus.cc:697] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:19.057194 21814 consensus_queue.cc:260] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.058591 21815 raft_consensus.cc:359] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.059393 21815 raft_consensus.cc:385] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.059731 21815 raft_consensus.cc:740] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.060037 21814 ts_tablet_manager.cc:1434] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.005s
I20260709 12:19:19.060616 21815 consensus_queue.cc:260] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.061153 21814 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.061815 21813 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.062558 21813 ts_tablet_manager.cc:1403] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:19:19.063001 21815 ts_tablet_manager.cc:1434] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:19:19.064137 21815 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.066056 21813 raft_consensus.cc:359] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.066948 21813 raft_consensus.cc:385] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.067301 21813 raft_consensus.cc:740] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.068081 21813 consensus_queue.cc:260] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.070587 21813 ts_tablet_manager.cc:1434] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:19:19.071480 21814 tablet_bootstrap.cc:654] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.055272 21673 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.071597 21813 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:19.078663 21815 tablet_bootstrap.cc:654] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.079953 21813 tablet_bootstrap.cc:654] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.083465 21814 tablet_bootstrap.cc:492] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.057862 21826 consensus_queue.cc:237] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.084069 21814 ts_tablet_manager.cc:1403] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:19:19.055788 21825 leader_election.cc:290] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.093416 21814 raft_consensus.cc:359] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.094290 21814 raft_consensus.cc:385] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.094614 21814 raft_consensus.cc:740] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.095777 21814 consensus_queue.cc:260] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.098309 21814 ts_tablet_manager.cc:1434] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:19.099444 21814 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.103482 21815 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.104071 21815 ts_tablet_manager.cc:1403] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.002s
I20260709 12:19:19.104207 21423 catalog_manager.cc:5697] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.107602 21814 tablet_bootstrap.cc:654] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.112666 21815 raft_consensus.cc:359] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.113471 21815 raft_consensus.cc:385] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.114297 21813 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.115038 21813 ts_tablet_manager.cc:1403] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.018s
I20260709 12:19:19.113775 21815 raft_consensus.cc:740] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.118804 21813 raft_consensus.cc:359] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.119614 21813 raft_consensus.cc:385] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.119952 21813 raft_consensus.cc:740] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.120730 21814 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.119824 21815 consensus_queue.cc:260] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.120949 21813 consensus_queue.cc:260] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.122888 21815 ts_tablet_manager.cc:1434] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:19:19.126475 21813 ts_tablet_manager.cc:1434] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:19:19.128638 21813 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:19.128774 21815 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.123879 21814 ts_tablet_manager.cc:1403] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:19:19.136201 21815 tablet_bootstrap.cc:654] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.137691 21814 raft_consensus.cc:359] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.138325 21814 raft_consensus.cc:385] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.138636 21814 raft_consensus.cc:740] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.139971 21814 consensus_queue.cc:260] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.141718 21813 tablet_bootstrap.cc:654] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.142339 21814 ts_tablet_manager.cc:1434] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:19:19.143627 21814 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.154062 21814 tablet_bootstrap.cc:654] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.156994 21815 tablet_bootstrap.cc:492] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.157410 21815 ts_tablet_manager.cc:1403] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.003s
I20260709 12:19:19.159210 21814 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.160641 21814 ts_tablet_manager.cc:1403] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:19:19.160816 21815 raft_consensus.cc:359] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.161355 21813 tablet_bootstrap.cc:492] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.161667 21815 raft_consensus.cc:385] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.162062 21815 raft_consensus.cc:740] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.162112 21813 ts_tablet_manager.cc:1403] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:19:19.163041 21815 consensus_queue.cc:260] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.164052 21814 raft_consensus.cc:359] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.164844 21814 raft_consensus.cc:385] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.165124 21814 raft_consensus.cc:740] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.165602 21813 raft_consensus.cc:359] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.166392 21813 raft_consensus.cc:385] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.165941 21814 consensus_queue.cc:260] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.166706 21813 raft_consensus.cc:740] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.167443 21813 consensus_queue.cc:260] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.168697 21814 ts_tablet_manager.cc:1434] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:19:19.169696 21813 ts_tablet_manager.cc:1434] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:19:19.169987 21814 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.173135 21813 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:19.178033 21814 tablet_bootstrap.cc:654] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.180002 21813 tablet_bootstrap.cc:654] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.189621 21802 raft_consensus.cc:493] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.190228 21802 raft_consensus.cc:515] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.191347 21814 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.192035 21814 ts_tablet_manager.cc:1403] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:19:19.192392 21802 leader_election.cc:290] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.193517 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b7f230d8414fc98242a88e9d178a09" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:19.194058 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b7f230d8414fc98242a88e9d178a09" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.194233 21598 raft_consensus.cc:2468] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:19.194756 21673 raft_consensus.cc:2468] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:19.196722 21491 leader_election.cc:304] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.197425 21830 raft_consensus.cc:493] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.197984 21830 raft_consensus.cc:515] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.198714 21802 raft_consensus.cc:2804] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.199208 21802 raft_consensus.cc:493] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.199592 21802 raft_consensus.cc:3060] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.200299 21830 leader_election.cc:290] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.201133 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fb05fd5cc04566ad610471a6824f82" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.201869 21525 raft_consensus.cc:2468] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.203159 21565 leader_election.cc:304] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.205040 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fb05fd5cc04566ad610471a6824f82" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.205763 21673 raft_consensus.cc:2468] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.208307 21830 raft_consensus.cc:2804] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.208774 21830 raft_consensus.cc:493] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.209116 21830 raft_consensus.cc:3060] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.209658 21813 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.210194 21813 ts_tablet_manager.cc:1403] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 12:19:19.213003 21813 raft_consensus.cc:359] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.213677 21813 raft_consensus.cc:385] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.213955 21813 raft_consensus.cc:740] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.196911 21814 raft_consensus.cc:359] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.215021 21814 raft_consensus.cc:385] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.214780 21813 consensus_queue.cc:260] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.215334 21814 raft_consensus.cc:740] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.216313 21814 consensus_queue.cc:260] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.213284 21802 raft_consensus.cc:515] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.218722 21814 ts_tablet_manager.cc:1434] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 12:19:19.222270 21815 ts_tablet_manager.cc:1434] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.065s	user 0.035s	sys 0.019s
I20260709 12:19:19.222859 21814 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.223449 21815 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.220582 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b7f230d8414fc98242a88e9d178a09" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:19.227885 21598 raft_consensus.cc:3060] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.230000 21814 tablet_bootstrap.cc:654] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.221640 21826 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.230897 21826 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.233049 21826 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.217128 21813 ts_tablet_manager.cc:1434] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:19.233882 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.234579 21672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.235024 21813 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: Bootstrap starting.
I20260709 12:19:19.221622 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b7f230d8414fc98242a88e9d178a09" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
W20260709 12:19:19.235569 21565 leader_election.cc:343] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.235533 21673 raft_consensus.cc:3060] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.236106 21566 leader_election.cc:343] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.236594 21566 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d06e23f1c8dd483db7981081531621cc; no voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:19.236904 21801 raft_consensus.cc:493] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.237417 21801 raft_consensus.cc:515] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.237850 21826 raft_consensus.cc:2749] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.219854 21802 leader_election.cc:290] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.239778 21801 leader_election.cc:290] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:19.241004 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:19.241349 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.241711 21599 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.242197 21525 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.243137 21813 tablet_bootstrap.cc:654] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.243098 21640 leader_election.cc:304] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.244117 21801 raft_consensus.cc:2804] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.244182 21815 tablet_bootstrap.cc:654] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.244558 21801 raft_consensus.cc:493] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.244951 21801 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.247753 21673 raft_consensus.cc:2468] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:19.249189 21491 leader_election.cc:304] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:19.250154 21802 raft_consensus.cc:2804] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.250671 21802 raft_consensus.cc:697] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:19.251529 21802 consensus_queue.cc:237] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.253197 21815 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.253556 21801 raft_consensus.cc:515] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.255959 21598 raft_consensus.cc:2468] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 1.
I20260709 12:19:19.256614 21813 tablet_bootstrap.cc:492] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: No bootstrap required, opened a new log
I20260709 12:19:19.256907 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.253782 21815 ts_tablet_manager.cc:1403] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 12:19:19.257560 21525 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.227124 21830 raft_consensus.cc:515] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.260279 21830 leader_election.cc:290] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.260408 21815 raft_consensus.cc:359] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.261037 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fb05fd5cc04566ad610471a6824f82" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.261171 21815 raft_consensus.cc:385] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.257122 21813 ts_tablet_manager.cc:1403] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 12:19:19.261679 21522 raft_consensus.cc:3060] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.264405 21813 raft_consensus.cc:359] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.265036 21813 raft_consensus.cc:385] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.265288 21813 raft_consensus.cc:740] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.265947 21813 consensus_queue.cc:260] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.261627 21815 raft_consensus.cc:740] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.266870 21421 catalog_manager.cc:5697] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 1 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.267376 21815 consensus_queue.cc:260] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.267993 21813 ts_tablet_manager.cc:1434] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:19.270129 21815 ts_tablet_manager.cc:1434] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:19:19.271147 21815 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.274143 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fb05fd5cc04566ad610471a6824f82" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:19.274910 21673 raft_consensus.cc:3060] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.281627 21525 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:19.283046 21639 leader_election.cc:304] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:19.284338 21673 raft_consensus.cc:2468] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.285741 21566 leader_election.cc:304] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.286845 21826 raft_consensus.cc:2804] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.287308 21826 raft_consensus.cc:697] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:19.288235 21826 consensus_queue.cc:237] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.295533 21830 raft_consensus.cc:493] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.298116 21815 tablet_bootstrap.cc:654] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.296264 21830 raft_consensus.cc:515] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.302875 21522 raft_consensus.cc:2468] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.303134 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c95b24fe1dd4e49a2241e53b5484cae" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.303750 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c95b24fe1dd4e49a2241e53b5484cae" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.303999 21524 raft_consensus.cc:2468] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.304473 21673 raft_consensus.cc:2468] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.305568 21566 leader_election.cc:304] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.309448 21830 leader_election.cc:290] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.310046 21846 raft_consensus.cc:2804] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.310281 21830 raft_consensus.cc:2804] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.310750 21830 raft_consensus.cc:493] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.311129 21830 raft_consensus.cc:3060] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.313199 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:19.313890 21598 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.318745 21830 raft_consensus.cc:515] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.323194 21598 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:19.324671 21830 leader_election.cc:290] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.325353 21673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c95b24fe1dd4e49a2241e53b5484cae" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:19.326112 21673 raft_consensus.cc:3060] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.325321 21801 leader_election.cc:290] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:19.330171 21846 raft_consensus.cc:697] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:19.331849 21846 consensus_queue.cc:237] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.333519 21673 raft_consensus.cc:2468] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.334854 21566 leader_election.cc:304] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.335665 21814 tablet_bootstrap.cc:492] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.336279 21814 ts_tablet_manager.cc:1403] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.003s
I20260709 12:19:19.339354 21814 raft_consensus.cc:359] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.340050 21814 raft_consensus.cc:385] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.340337 21814 raft_consensus.cc:740] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.335807 21825 raft_consensus.cc:2804] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.341995 21825 raft_consensus.cc:697] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:19.342962 21825 consensus_queue.cc:237] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.345402 21814 consensus_queue.cc:260] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.348585 21815 tablet_bootstrap.cc:492] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.349259 21815 ts_tablet_manager.cc:1403] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.031s
I20260709 12:19:19.352658 21815 raft_consensus.cc:359] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.353317 21797 raft_consensus.cc:493] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.353447 21815 raft_consensus.cc:385] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.353988 21815 raft_consensus.cc:740] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.353945 21797 raft_consensus.cc:515] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.355026 21815 consensus_queue.cc:260] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.355835 21814 ts_tablet_manager.cc:1434] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:19:19.358026 21815 ts_tablet_manager.cc:1434] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:19.359668 21815 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: Bootstrap starting.
I20260709 12:19:19.360574 21814 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: Bootstrap starting.
I20260709 12:19:19.360986 21797 leader_election.cc:290] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.503409 21849 raft_consensus.cc:493] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.502475 21801 raft_consensus.cc:493] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.510954 21801 raft_consensus.cc:515] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.513149 21801 leader_election.cc:290] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:19.516816 21815 tablet_bootstrap.cc:654] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.517041 21849 raft_consensus.cc:515] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.551584 21814 tablet_bootstrap.cc:654] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.549522 21849 leader_election.cc:290] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:19.560629 21815 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: No bootstrap required, opened a new log
I20260709 12:19:19.820643 21855 raft_consensus.cc:493] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.821163 21855 raft_consensus.cc:515] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.824276 21855 leader_election.cc:290] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.833369 21858 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.833878 21858 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.836123 21858 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.837132 21858 raft_consensus.cc:493] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.837661 21858 raft_consensus.cc:515] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.839752 21858 leader_election.cc:290] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.849222 21522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.849696 21522 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.850600 21565 leader_election.cc:304] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.851408 21825 raft_consensus.cc:2804] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.851766 21825 raft_consensus.cc:493] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.852085 21825 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.859524 21825 raft_consensus.cc:515] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.862066 21825 leader_election.cc:290] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.864064 21825 consensus_queue.cc:1048] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.865358 21522 raft_consensus.cc:3060] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.870643 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.871399 21523 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.883751 21523 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:19.561053 21814 tablet_bootstrap.cc:492] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: No bootstrap required, opened a new log
I20260709 12:19:19.890316 21814 ts_tablet_manager.cc:1403] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: Time spent bootstrapping tablet: real 0.530s	user 0.009s	sys 0.006s
I20260709 12:19:19.889106 21826 consensus_queue.cc:1048] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.893059 21814 raft_consensus.cc:359] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.896375 21826 raft_consensus.cc:493] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.897092 21826 raft_consensus.cc:515] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.897694 21830 raft_consensus.cc:493] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.898263 21830 raft_consensus.cc:515] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.561112 21815 ts_tablet_manager.cc:1403] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.002s
I20260709 12:19:19.906320 21830 leader_election.cc:290] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.910872 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c95b24fe1dd4e49a2241e53b5484cae" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.914225 21419 catalog_manager.cc:5697] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.920979 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.921823 21668 raft_consensus.cc:2468] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:19.922852 21849 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.923327 21849 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.924930 21670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.925427 21849 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:19.925700 21670 raft_consensus.cc:2468] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:19.927009 21669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:19.927661 21669 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 0.
I20260709 12:19:19.928184 21520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.928962 21520 raft_consensus.cc:2393] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549656fc52dc4d32b95e86a38f654b61 in current term 1: Already voted for candidate d06e23f1c8dd483db7981081531621cc in this term.
I20260709 12:19:19.902479 21518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.907335 21825 consensus_queue.cc:1048] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.907665 21815 raft_consensus.cc:359] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.909539 21521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.930186 21521 raft_consensus.cc:2468] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.928761 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:19.931143 21598 raft_consensus.cc:2468] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.931321 21525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.931948 21815 raft_consensus.cc:385] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.932008 21525 raft_consensus.cc:2468] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.932267 21815 raft_consensus.cc:740] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.932950 21815 consensus_queue.cc:260] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.933863 21518 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:19.935089 21846 consensus_queue.cc:1048] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.935952 21815 ts_tablet_manager.cc:1434] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:19:19.937022 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:19.937212 21639 leader_election.cc:304] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:19.937841 21599 raft_consensus.cc:2393] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 549656fc52dc4d32b95e86a38f654b61 in current term 1: Already voted for candidate d06e23f1c8dd483db7981081531621cc in this term.
I20260709 12:19:19.938155 21852 raft_consensus.cc:2804] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.938556 21852 raft_consensus.cc:493] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.938869 21852 raft_consensus.cc:3060] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.941380 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:19.941985 21599 raft_consensus.cc:2468] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.943967 21640 leader_election.cc:304] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61; no voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc
I20260709 12:19:19.944849 21801 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.946411 21846 consensus_queue.cc:1048] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.947551 21518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285" is_pre_election: true
I20260709 12:19:19.948226 21518 raft_consensus.cc:2468] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 0.
I20260709 12:19:19.953920 21565 leader_election.cc:304] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.957245 21859 raft_consensus.cc:2804] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.957720 21859 raft_consensus.cc:493] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.958025 21859 raft_consensus.cc:3060] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.959878 21640 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.899175 21826 leader_election.cc:290] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.960763 21846 raft_consensus.cc:2804] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.961302 21846 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.961766 21846 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.899585 21814 raft_consensus.cc:385] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.965978 21814 raft_consensus.cc:740] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.957304 21565 leader_election.cc:304] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:19.966800 21814 consensus_queue.cc:260] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.967849 21826 raft_consensus.cc:2804] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.968302 21826 raft_consensus.cc:493] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.968694 21826 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.969436 21814 ts_tablet_manager.cc:1434] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.000s
I20260709 12:19:19.965696 21859 raft_consensus.cc:515] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.973837 21802 consensus_queue.cc:1048] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.974584 21859 leader_election.cc:290] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.976364 21491 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:19.977278 21802 raft_consensus.cc:2804] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.977694 21802 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.978085 21802 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.969480 21801 raft_consensus.cc:2749] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.985505 21826 raft_consensus.cc:515] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:19.989419 21521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.990074 21521 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.996061 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:19.996881 21524 raft_consensus.cc:3060] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.999337 21565 leader_election.cc:304] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.000168 21797 raft_consensus.cc:2804] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.000666 21797 raft_consensus.cc:697] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.001539 21797 consensus_queue.cc:237] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.003280 21521 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:20.005434 21565 leader_election.cc:304] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.005930 21491 leader_election.cc:304] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:20.006412 21859 raft_consensus.cc:2804] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.007047 21859 raft_consensus.cc:697] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:19.960824 21852 raft_consensus.cc:515] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.008008 21859 consensus_queue.cc:237] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.012005 21599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.012818 21599 raft_consensus.cc:2393] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 549656fc52dc4d32b95e86a38f654b61 in current term 1: Already voted for candidate d06e23f1c8dd483db7981081531621cc in this term.
I20260709 12:19:20.014586 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:20.016251 21639 leader_election.cc:304] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61; no voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc
W20260709 12:19:20.018158 21471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:20.020460 21802 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.021152 21865 raft_consensus.cc:2749] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:20.029247 21669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:20.039657 21669 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:20.031376 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.040688 21802 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:20.042443 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:20.043187 21668 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 0.
I20260709 12:19:20.045284 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61" is_pre_election: true
I20260709 12:19:20.046643 21524 raft_consensus.cc:2468] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:20.038731 21852 leader_election.cc:290] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:20.048810 21668 raft_consensus.cc:2393] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d06e23f1c8dd483db7981081531621cc in current term 1: Already voted for candidate 549656fc52dc4d32b95e86a38f654b61 in this term.
I20260709 12:19:20.047652 21674 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:20.007091 21491 leader_election.cc:304] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:20.049984 21839 raft_consensus.cc:2764] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:19:20.050515 21802 raft_consensus.cc:2764] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:19:20.051156 21491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.178.195:38537, user_credentials={real_user=slave}} blocked reactor thread for 44145.6us
I20260709 12:19:20.056229 21674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.059137 21565 leader_election.cc:304] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.060621 21830 raft_consensus.cc:2804] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.061147 21830 raft_consensus.cc:697] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.062000 21830 consensus_queue.cc:237] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.060622 21419 catalog_manager.cc:5697] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } } }
I20260709 12:19:20.068610 21419 catalog_manager.cc:5697] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } } }
I20260709 12:19:20.066937 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.078390 21668 raft_consensus.cc:2393] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d06e23f1c8dd483db7981081531621cc in current term 1: Already voted for candidate 549656fc52dc4d32b95e86a38f654b61 in this term.
I20260709 12:19:20.080065 21826 leader_election.cc:290] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:19.989105 21846 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.085328 21674 raft_consensus.cc:2393] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26e330f9e9d14b5f9bbabca43d18d285 in current term 1: Already voted for candidate 549656fc52dc4d32b95e86a38f654b61 in this term.
I20260709 12:19:20.094318 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.095029 21598 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.096094 21596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27def25e82d4b04804a7c01d0bad511" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:20.096356 21846 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:20.099062 21594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:20.100819 21594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.104031 21595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d06e23f1c8dd483db7981081531621cc" is_pre_election: true
I20260709 12:19:20.105588 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.106304 21668 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:20.111761 21802 consensus_queue.cc:1048] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.113705 21598 raft_consensus.cc:2468] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 1.
I20260709 12:19:20.120170 21491 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285; no voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc
I20260709 12:19:20.120939 21830 consensus_queue.cc:1048] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.121176 21802 raft_consensus.cc:2749] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:20.115307 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:20.124970 21830 consensus_queue.cc:1048] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.127926 21523 raft_consensus.cc:2393] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 549656fc52dc4d32b95e86a38f654b61 in current term 1: Already voted for candidate 26e330f9e9d14b5f9bbabca43d18d285 in this term.
I20260709 12:19:20.128135 21640 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.129155 21846 raft_consensus.cc:2804] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:20.129655 21846 raft_consensus.cc:697] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:20.130497 21846 consensus_queue.cc:237] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.131726 21797 consensus_queue.cc:1048] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.137640 21668 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 1.
I20260709 12:19:20.157392 21420 catalog_manager.cc:5697] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.178143 21420 catalog_manager.cc:5697] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.180126 21420 catalog_manager.cc:5697] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 0 to 1, leader changed from <none> to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 1 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.190531 21419 catalog_manager.cc:5697] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 1 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.249449 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aea977479d64b5091426279b52cf890"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
mode: GRACEFUL
new_leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:19:20.250033 21598 raft_consensus.cc:606] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Received request to transfer leadership to TS 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:20.258046 21668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
mode: GRACEFUL
new_leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:38568
I20260709 12:19:20.258628 21668 raft_consensus.cc:606] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Received request to transfer leadership to TS 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:20.263618 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
mode: GRACEFUL
new_leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:19:20.264210 21598 raft_consensus.cc:606] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Received request to transfer leadership to TS 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:20.276724 21668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
mode: GRACEFUL
new_leader_uuid: "d06e23f1c8dd483db7981081531621cc"
 from {username='slave'} at 127.0.0.1:38568
I20260709 12:19:20.277241 21668 raft_consensus.cc:606] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Received request to transfer leadership to TS d06e23f1c8dd483db7981081531621cc
I20260709 12:19:20.281883 21598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ccc178f77f24b3c946787419e759896"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
mode: GRACEFUL
new_leader_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:19:20.282403 21598 raft_consensus.cc:606] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Received request to transfer leadership to TS 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:20.489774 21830 raft_consensus.cc:993] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: : Instructing follower 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.490167 21797 raft_consensus.cc:1081] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Signalling peer 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.491475 21523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aea977479d64b5091426279b52cf890"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:48940
I20260709 12:19:20.491911 21523 raft_consensus.cc:493] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.492187 21523 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.496881 21523 raft_consensus.cc:515] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.498510 21523 leader_election.cc:290] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:20.499233 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.499604 21669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aea977479d64b5091426279b52cf890" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.499953 21598 raft_consensus.cc:3055] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.500273 21669 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.500429 21598 raft_consensus.cc:740] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.501858 21598 consensus_queue.cc:260] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.503274 21598 raft_consensus.cc:3060] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.509486 21669 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.511307 21491 leader_election.cc:304] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:20.511864 21598 raft_consensus.cc:2468] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.512264 21802 raft_consensus.cc:2804] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.512859 21802 raft_consensus.cc:697] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:20.513703 21802 consensus_queue.cc:237] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.521139 21420 catalog_manager.cc:5697] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 1 to 2, leader changed from d06e23f1c8dd483db7981081531621cc (127.8.178.194) to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.546092 21797 consensus_queue.cc:1048] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.552651 21797 raft_consensus.cc:993] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: : Instructing follower 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:20.553122 21861 raft_consensus.cc:1081] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Signalling peer 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:20.554708 21669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ccc178f77f24b3c946787419e759896"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:38548
I20260709 12:19:20.555526 21669 raft_consensus.cc:493] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.555915 21669 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.560600 21861 consensus_queue.cc:1048] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.562119 21861 consensus_queue.cc:1048] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:20.566321 21454 debug-util.cc:398] Leaking SignalData structure 0x7b0800034cc0 after lost signal to thread 8910
I20260709 12:19:20.565790 21669 raft_consensus.cc:515] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
W20260709 12:19:20.569833 21454 debug-util.cc:398] Leaking SignalData structure 0x7b080008e4e0 after lost signal to thread 21457
I20260709 12:19:20.570658 21826 consensus_queue.cc:1048] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:20.571302 21454 debug-util.cc:398] Leaking SignalData structure 0x7b080022c2a0 after lost signal to thread 21549
I20260709 12:19:20.571834 21669 leader_election.cc:290] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:20.572635 21518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:20.573314 21518 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:20.573648 21454 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffa60 after lost signal to thread 21698
I20260709 12:19:20.574844 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccc178f77f24b3c946787419e759896" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.575603 21598 raft_consensus.cc:3055] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.575932 21598 raft_consensus.cc:740] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.576707 21598 consensus_queue.cc:260] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.577675 21598 raft_consensus.cc:3060] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.590358 21598 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:20.594383 21846 consensus_queue.cc:1048] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.594789 21640 leader_election.cc:304] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.595906 21846 raft_consensus.cc:2804] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.596400 21846 raft_consensus.cc:697] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:20.597214 21846 consensus_queue.cc:237] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.601014 21849 raft_consensus.cc:993] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: : Instructing follower 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.601464 21849 raft_consensus.cc:1081] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Signalling peer 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.603469 21524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:48930
I20260709 12:19:20.604156 21524 raft_consensus.cc:493] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.604552 21524 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.603282 21518 raft_consensus.cc:2468] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:20.619055 21859 consensus_queue.cc:1048] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.622911 21419 catalog_manager.cc:5697] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 1 to 2, leader changed from d06e23f1c8dd483db7981081531621cc (127.8.178.194) to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.626128 21524 raft_consensus.cc:515] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.629725 21852 raft_consensus.cc:993] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: : Instructing follower d06e23f1c8dd483db7981081531621cc to start an election
I20260709 12:19:20.630226 21852 raft_consensus.cc:1081] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Signalling peer d06e23f1c8dd483db7981081531621cc to start an election
I20260709 12:19:20.630892 21524 leader_election.cc:290] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:20.632556 21598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
 from {username='slave'} at 127.0.0.1:48910
I20260709 12:19:20.635609 21846 consensus_queue.cc:1048] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.636129 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.636749 21668 raft_consensus.cc:3055] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.637059 21668 raft_consensus.cc:740] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:20.637845 21600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34ef136a21440acbb99ea660e3bf39a" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.638444 21600 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.638068 21668 consensus_queue.cc:260] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.639437 21668 raft_consensus.cc:3060] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.639709 21598 raft_consensus.cc:493] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.640117 21598 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.636993 21797 consensus_queue.cc:1048] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.647730 21598 raft_consensus.cc:515] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.648207 21668 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.655586 21491 leader_election.cc:304] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:20.656505 21802 raft_consensus.cc:2804] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.656973 21802 raft_consensus.cc:697] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:20.657029 21600 raft_consensus.cc:2468] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.657802 21802 consensus_queue.cc:237] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.670666 21598 leader_election.cc:290] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 2 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:20.671393 21524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:20.672748 21668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1166087a85aa4ba7b2afa44366e76cc8" candidate_uuid: "d06e23f1c8dd483db7981081531621cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.676908 21797 raft_consensus.cc:993] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: : Instructing follower 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.677353 21797 raft_consensus.cc:1081] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Signalling peer 26e330f9e9d14b5f9bbabca43d18d285 to start an election
I20260709 12:19:20.686539 21420 catalog_manager.cc:5697] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 1 to 2, leader changed from 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195) to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.689026 21518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
 from {username='slave'} at 127.0.0.1:48940
I20260709 12:19:20.689663 21518 raft_consensus.cc:493] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.690016 21518 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.696381 21668 raft_consensus.cc:3055] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.696838 21668 raft_consensus.cc:740] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:20.697762 21668 consensus_queue.cc:260] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.699108 21668 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.701085 21518 raft_consensus.cc:515] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.703919 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:20.704504 21598 raft_consensus.cc:3055] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.704806 21598 raft_consensus.cc:740] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.705574 21598 consensus_queue.cc:260] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.706492 21598 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.707868 21518 leader_election.cc:290] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Requested vote from peers d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125), 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195:38537)
I20260709 12:19:20.715071 21598 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.716058 21668 raft_consensus.cc:2468] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e23f1c8dd483db7981081531621cc in term 2.
I20260709 12:19:20.716302 21669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c79eceb05d4a7b9126c122c1220c85" candidate_uuid: "26e330f9e9d14b5f9bbabca43d18d285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
I20260709 12:19:20.716481 21491 leader_election.cc:304] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:20.717445 21566 leader_election.cc:304] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 26e330f9e9d14b5f9bbabca43d18d285
I20260709 12:19:20.717583 21802 raft_consensus.cc:2804] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.718247 21802 raft_consensus.cc:697] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Leader. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:20.719095 21802 consensus_queue.cc:237] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.720054 21669 raft_consensus.cc:3060] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.721562 21861 raft_consensus.cc:2804] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.722087 21861 raft_consensus.cc:697] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 2 LEADER]: Becoming Leader. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:20.722900 21861 consensus_queue.cc:237] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:20.725883 21669 raft_consensus.cc:2468] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26e330f9e9d14b5f9bbabca43d18d285 in term 2.
I20260709 12:19:20.731426 21421 catalog_manager.cc:5697] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc reported cstate change: term changed from 1 to 2, leader changed from 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195) to d06e23f1c8dd483db7981081531621cc (127.8.178.194). New cstate: current_term: 2 leader_uuid: "d06e23f1c8dd483db7981081531621cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.732847 21420 catalog_manager.cc:5697] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 reported cstate change: term changed from 1 to 2, leader changed from d06e23f1c8dd483db7981081531621cc (127.8.178.194) to 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193). New cstate: current_term: 2 leader_uuid: "26e330f9e9d14b5f9bbabca43d18d285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.909710 21669 raft_consensus.cc:1275] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.910887 21802 consensus_queue.cc:1048] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.920478 21598 raft_consensus.cc:1275] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.922057 21858 consensus_queue.cc:1048] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.013773 21600 raft_consensus.cc:1275] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.015122 21846 consensus_queue.cc:1048] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.028066 21518 raft_consensus.cc:1275] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.030611 21852 consensus_queue.cc:1048] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.058811 21669 raft_consensus.cc:1275] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.060364 21802 consensus_queue.cc:1048] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.068514 21600 raft_consensus.cc:1275] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.070024 21802 consensus_queue.cc:1048] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.123529 21668 raft_consensus.cc:1275] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer d06e23f1c8dd483db7981081531621cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.124956 21830 consensus_queue.cc:1048] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.133158 21523 raft_consensus.cc:3060] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:21.139158 21523 raft_consensus.cc:1275] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Refusing update from remote peer d06e23f1c8dd483db7981081531621cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.140594 21861 consensus_queue.cc:1048] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.146059 21600 raft_consensus.cc:1275] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.147341 21858 consensus_queue.cc:1048] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:21.156847 21668 raft_consensus.cc:1275] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Refusing update from remote peer 26e330f9e9d14b5f9bbabca43d18d285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:21.158529 21802 consensus_queue.cc:1048] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.288925 21419 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58544:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:19:23.329960 21419 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58544:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:19:23.353101  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.629539 21600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a"
dest_uuid: "d06e23f1c8dd483db7981081531621cc"
mode: GRACEFUL
new_leader_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:50406
I20260709 12:19:23.630681 21600 raft_consensus.cc:606] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Received request to transfer leadership to TS 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:23.634493 21943 tablet.cc:1724] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:23.637377 21491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.178.195:38537, user_credentials={real_user=slave}} blocked reactor thread for 47416.5us
I20260709 12:19:23.580111 21944 tablet.cc:1724] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.655164 21949 tablet.cc:1724] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:23.755548 21965 log.cc:927] Time spent T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:19:23.746369 21958 tablet.cc:1724] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.759487 21966 tablet.cc:1724] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:23.754055 21955 log.cc:927] Time spent T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 12:19:23.757931 21944 tablet.cc:1724] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.789289 21964 tablet.cc:1724] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.791762 21943 tablet.cc:1724] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.821374 21970 tablet.cc:1724] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.823042 21971 tablet.cc:1724] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.809684 21975 tablet.cc:1724] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.826212 21949 tablet.cc:1724] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.852627 21964 tablet.cc:1724] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.858054 21943 tablet.cc:1724] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.778065 21972 tablet.cc:1724] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.852847 21974 tablet.cc:1724] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.863770 21900 raft_consensus.cc:993] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: : Instructing follower 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:23.864223 21900 raft_consensus.cc:1081] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Signalling peer 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:23.866490 21669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:38548
I20260709 12:19:23.867142 21669 raft_consensus.cc:493] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.867615 21669 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.904924 21977 tablet.cc:1724] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.910861 21944 tablet.cc:1724] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.920015 21972 tablet.cc:1724] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.920117 21970 tablet.cc:1724] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.889930 21964 tablet.cc:1724] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.923233 21949 tablet.cc:1724] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.935236 21975 tablet.cc:1724] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.935971 21523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa87a406370408e82ce446f558bca22"
dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
mode: GRACEFUL
new_leader_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:37706
I20260709 12:19:23.944247 21523 raft_consensus.cc:606] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Received request to transfer leadership to TS 549656fc52dc4d32b95e86a38f654b61
I20260709 12:19:23.917796 21943 tablet.cc:1724] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.946822  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:23.947456  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:23.968384 21970 tablet.cc:1724] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.974547 21949 tablet.cc:1724] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.981101 21966 tablet.cc:1724] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:23.941025 21669 raft_consensus.cc:515] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:23.990851 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:23.991669 21523 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.003849 21523 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:24.011219 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a661dcb6c014713951f579345cc4e4a" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:24.015395 21598 raft_consensus.cc:3055] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:24.015681 21598 raft_consensus.cc:740] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d06e23f1c8dd483db7981081531621cc, State: Running, Role: LEADER
I20260709 12:19:24.011090 21669 leader_election.cc:290] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:24.016702 21639 leader_election.cc:304] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26e330f9e9d14b5f9bbabca43d18d285, 549656fc52dc4d32b95e86a38f654b61; no voters: 
I20260709 12:19:24.018467 21897 raft_consensus.cc:2804] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:24.019018 21897 raft_consensus.cc:697] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:24.019034 21598 consensus_queue.cc:260] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:24.020589 21598 raft_consensus.cc:3060] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:24.020290 21897 consensus_queue.cc:237] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:24.021129 21423 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: soft_deleted_table [id=e4a32a46585941b8b7910483dc19d259] alter complete (version 1)
I20260709 12:19:24.027248 21598 raft_consensus.cc:2468] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 2.
I20260709 12:19:24.045948 21419 catalog_manager.cc:5697] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 1 to 2, leader changed from d06e23f1c8dd483db7981081531621cc (127.8.178.194) to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 2 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:24.122144 21960 raft_consensus.cc:993] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: : Instructing follower 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:24.122931 21960 raft_consensus.cc:1081] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Signalling peer 549656fc52dc4d32b95e86a38f654b61 to start an election
I20260709 12:19:24.124779 21673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaa87a406370408e82ce446f558bca22"
dest_uuid: "549656fc52dc4d32b95e86a38f654b61"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:19:24.129196 21673 raft_consensus.cc:493] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.129642 21673 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.137856 21673 raft_consensus.cc:515] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:24.139683 21673 leader_election.cc:290] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 3 election: Requested vote from peers 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131), d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125)
I20260709 12:19:24.140700 21598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d06e23f1c8dd483db7981081531621cc"
I20260709 12:19:24.140628 21523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa87a406370408e82ce446f558bca22" candidate_uuid: "549656fc52dc4d32b95e86a38f654b61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26e330f9e9d14b5f9bbabca43d18d285"
I20260709 12:19:24.141438 21598 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.141721 21523 raft_consensus.cc:3055] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:24.142088 21523 raft_consensus.cc:740] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26e330f9e9d14b5f9bbabca43d18d285, State: Running, Role: LEADER
I20260709 12:19:24.142958 21523 consensus_queue.cc:260] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:24.144425 21523 raft_consensus.cc:3060] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:24.146826 21598 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 3.
I20260709 12:19:24.148034 21640 leader_election.cc:304] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 549656fc52dc4d32b95e86a38f654b61, d06e23f1c8dd483db7981081531621cc; no voters: 
I20260709 12:19:24.151628 21523 raft_consensus.cc:2468] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 549656fc52dc4d32b95e86a38f654b61 in term 3.
I20260709 12:19:24.153358 21897 raft_consensus.cc:2804] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:24.153959 21897 raft_consensus.cc:697] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 3 LEADER]: Becoming Leader. State: Replica: 549656fc52dc4d32b95e86a38f654b61, State: Running, Role: LEADER
I20260709 12:19:24.154986 21897 consensus_queue.cc:237] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } }
I20260709 12:19:24.164036 21419 catalog_manager.cc:5697] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 reported cstate change: term changed from 2 to 3, leader changed from 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193) to 549656fc52dc4d32b95e86a38f654b61 (127.8.178.195). New cstate: current_term: 3 leader_uuid: "549656fc52dc4d32b95e86a38f654b61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "549656fc52dc4d32b95e86a38f654b61" member_type: VOTER last_known_addr { host: "127.8.178.195" port: 38537 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:24.566052 21523 raft_consensus.cc:1275] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 3 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:24.567489 21897 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:24.587952 21598 raft_consensus.cc:1275] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:24.590706 21897 consensus_queue.cc:1048] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:24.597848 21595 raft_consensus.cc:1275] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 3 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:24.607085 21897 consensus_queue.cc:1048] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d06e23f1c8dd483db7981081531621cc" member_type: VOTER last_known_addr { host: "127.8.178.194" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:24.611765 21523 raft_consensus.cc:1275] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Refusing update from remote peer 549656fc52dc4d32b95e86a38f654b61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:24.613516 21897 consensus_queue.cc:1048] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26e330f9e9d14b5f9bbabca43d18d285" member_type: VOTER last_known_addr { host: "127.8.178.193" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:24.948439  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.953645  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:24.954082  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.955013  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.960424  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:25.960810  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.961669  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.966760  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:26.967164  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.968056  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.973582  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:27.974108  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.975052  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.979873  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:28.980203  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:29.981212  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.988108  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:29.988508  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.989485  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.994402  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:30.994812  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.995661  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.000594  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:32.001034  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.001999  8907 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:33.009999  8907 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:33.010737  8907 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:34.068332  8907 tablet_server.cc:179] TabletServer@127.8.178.193:0 shutting down...
W20260709 12:19:34.090282 21565 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 12:19:34.095814 21565 consensus_peers.cc:597] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.108289  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:34.109115  8907 tablet_replica.cc:333] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.110237  8907 raft_consensus.cc:2243] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.111050  8907 raft_consensus.cc:2272] T 1166087a85aa4ba7b2afa44366e76cc8 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.113886  8907 tablet_replica.cc:333] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.114634  8907 raft_consensus.cc:2243] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.115253  8907 raft_consensus.cc:2272] T 3c95b24fe1dd4e49a2241e53b5484cae P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.118369  8907 tablet_replica.cc:333] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.119500  8907 raft_consensus.cc:2243] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.120357  8907 raft_consensus.cc:2272] T 66fb05fd5cc04566ad610471a6824f82 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.123163  8907 tablet_replica.cc:333] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.123912  8907 raft_consensus.cc:2243] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.124439  8907 raft_consensus.cc:2272] T aaa87a406370408e82ce446f558bca22 P 26e330f9e9d14b5f9bbabca43d18d285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.127141  8907 tablet_replica.cc:333] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.127746  8907 raft_consensus.cc:2243] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.128261  8907 raft_consensus.cc:2272] T 936ce13740d34c11ac1159a7671c16f2 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.130825  8907 tablet_replica.cc:333] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.131439  8907 raft_consensus.cc:2243] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.132450  8907 raft_consensus.cc:2272] T a611119bad27426bbc7613183a3d517e P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.135120  8907 tablet_replica.cc:333] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.135712  8907 raft_consensus.cc:2243] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.136296  8907 raft_consensus.cc:2272] T d27def25e82d4b04804a7c01d0bad511 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.138841  8907 tablet_replica.cc:333] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.139421  8907 raft_consensus.cc:2243] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.140379  8907 raft_consensus.cc:2272] T 2aea977479d64b5091426279b52cf890 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.142987  8907 tablet_replica.cc:333] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.143584  8907 raft_consensus.cc:2243] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.144066  8907 raft_consensus.cc:2272] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.146896  8907 tablet_replica.cc:333] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.147617  8907 raft_consensus.cc:2243] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.148325  8907 raft_consensus.cc:2272] T 1a661dcb6c014713951f579345cc4e4a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.151674  8907 tablet_replica.cc:333] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.152498  8907 raft_consensus.cc:2243] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.153600  8907 raft_consensus.cc:2272] T a1b7f230d8414fc98242a88e9d178a09 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.156618  8907 tablet_replica.cc:333] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.157197  8907 raft_consensus.cc:2243] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.157792  8907 raft_consensus.cc:2272] T 3ccc178f77f24b3c946787419e759896 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.160382  8907 tablet_replica.cc:333] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.160955  8907 raft_consensus.cc:2243] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.161962  8907 raft_consensus.cc:2272] T 794d5791aa754559b25397fc62e54fc9 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.164777  8907 tablet_replica.cc:333] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.165354  8907 raft_consensus.cc:2243] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.165860  8907 raft_consensus.cc:2272] T 87a6f73e36084930a34b6e0b152ff246 P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.168349  8907 tablet_replica.cc:333] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.168882  8907 raft_consensus.cc:2243] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.169803  8907 raft_consensus.cc:2272] T e6c79eceb05d4a7b9126c122c1220c85 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.172343  8907 tablet_replica.cc:333] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.172874  8907 raft_consensus.cc:2243] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.173413  8907 raft_consensus.cc:2272] T e3129265e8b34ec091bbd167ec6c6f42 P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.175944  8907 tablet_replica.cc:333] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.176450  8907 raft_consensus.cc:2243] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.177397  8907 raft_consensus.cc:2272] T d34ef136a21440acbb99ea660e3bf39a P 26e330f9e9d14b5f9bbabca43d18d285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.179946  8907 tablet_replica.cc:333] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285: stopping tablet replica
I20260709 12:19:34.180441  8907 raft_consensus.cc:2243] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.181406  8907 raft_consensus.cc:2272] T 5f8ff4e26bbe44e299e122b1c15ada0c P 26e330f9e9d14b5f9bbabca43d18d285 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:34.231134 21565 consensus_peers.cc:597] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.231271  8907 tablet_server.cc:196] TabletServer@127.8.178.193:0 shutdown complete.
W20260709 12:19:34.233013 21565 consensus_peers.cc:597] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.286230  8907 tablet_server.cc:179] TabletServer@127.8.178.194:0 shutting down...
I20260709 12:19:34.322625  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:34.323570  8907 tablet_replica.cc:333] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.324775  8907 raft_consensus.cc:2243] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:19:34.325179 21639 consensus_peers.cc:597] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.326018  8907 raft_consensus.cc:2272] T 66fb05fd5cc04566ad610471a6824f82 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.329782  8907 tablet_replica.cc:333] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
W20260709 12:19:34.330067 21639 consensus_peers.cc:597] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.330703  8907 raft_consensus.cc:2243] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.331648  8907 raft_consensus.cc:2272] T 1166087a85aa4ba7b2afa44366e76cc8 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.333972  8907 tablet_replica.cc:333] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.334573  8907 raft_consensus.cc:2243] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.335520  8907 raft_consensus.cc:2272] T 3c95b24fe1dd4e49a2241e53b5484cae P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.337779  8907 tablet_replica.cc:333] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.338384  8907 raft_consensus.cc:2243] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.338882  8907 raft_consensus.cc:2272] T a1b7f230d8414fc98242a88e9d178a09 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.340955  8907 tablet_replica.cc:333] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.341497  8907 raft_consensus.cc:2243] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.341929  8907 raft_consensus.cc:2272] T 5f8ff4e26bbe44e299e122b1c15ada0c P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.344161  8907 tablet_replica.cc:333] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.344758  8907 raft_consensus.cc:2243] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.345315  8907 raft_consensus.cc:2272] T d34ef136a21440acbb99ea660e3bf39a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.347404  8907 tablet_replica.cc:333] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.347921  8907 raft_consensus.cc:2243] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.348304  8907 raft_consensus.cc:2272] T aaa87a406370408e82ce446f558bca22 P d06e23f1c8dd483db7981081531621cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.350513  8907 tablet_replica.cc:333] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.350994  8907 raft_consensus.cc:2243] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.351444  8907 raft_consensus.cc:2272] T 3ccc178f77f24b3c946787419e759896 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.353461  8907 tablet_replica.cc:333] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.353971  8907 raft_consensus.cc:2243] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.354951  8907 raft_consensus.cc:2272] T 87a6f73e36084930a34b6e0b152ff246 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.357584  8907 tablet_replica.cc:333] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.358413  8907 raft_consensus.cc:2243] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.359036  8907 raft_consensus.cc:2272] T 794d5791aa754559b25397fc62e54fc9 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.362207  8907 tablet_replica.cc:333] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
W20260709 12:19:34.362396 21639 consensus_peers.cc:597] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.362826  8907 raft_consensus.cc:2243] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.363399  8907 raft_consensus.cc:2272] T 936ce13740d34c11ac1159a7671c16f2 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.365914  8907 tablet_replica.cc:333] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.366529  8907 raft_consensus.cc:2243] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.367502  8907 raft_consensus.cc:2272] T d27def25e82d4b04804a7c01d0bad511 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.370570  8907 tablet_replica.cc:333] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.371274  8907 raft_consensus.cc:2243] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.371857  8907 raft_consensus.cc:2272] T 2aea977479d64b5091426279b52cf890 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.374174  8907 tablet_replica.cc:333] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.374751  8907 raft_consensus.cc:2243] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.375617  8907 raft_consensus.cc:2272] T 4b1cd01ba7d24b56ad62b41190aa7e60 P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.377738  8907 tablet_replica.cc:333] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.378261  8907 raft_consensus.cc:2243] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.378801  8907 raft_consensus.cc:2272] T e6c79eceb05d4a7b9126c122c1220c85 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.380949  8907 tablet_replica.cc:333] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.381461  8907 raft_consensus.cc:2243] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.382325  8907 raft_consensus.cc:2272] T e3129265e8b34ec091bbd167ec6c6f42 P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.384796  8907 tablet_replica.cc:333] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.385313  8907 raft_consensus.cc:2243] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.385776  8907 raft_consensus.cc:2272] T a611119bad27426bbc7613183a3d517e P d06e23f1c8dd483db7981081531621cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.387984  8907 tablet_replica.cc:333] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc: stopping tablet replica
I20260709 12:19:34.388453  8907 raft_consensus.cc:2243] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.388901  8907 raft_consensus.cc:2272] T 1a661dcb6c014713951f579345cc4e4a P d06e23f1c8dd483db7981081531621cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:34.417125 21639 consensus_peers.cc:597] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 -> Peer 26e330f9e9d14b5f9bbabca43d18d285 (127.8.178.193:38131): Couldn't send request to peer 26e330f9e9d14b5f9bbabca43d18d285. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.193:38131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.432714  8907 tablet_server.cc:196] TabletServer@127.8.178.194:0 shutdown complete.
W20260709 12:19:34.434674 21640 consensus_peers.cc:597] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 -> Peer d06e23f1c8dd483db7981081531621cc (127.8.178.194:34125): Couldn't send request to peer d06e23f1c8dd483db7981081531621cc. Status: Network error: Client connection negotiation failed: client connection to 127.8.178.194:34125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.474327  8907 tablet_server.cc:179] TabletServer@127.8.178.195:0 shutting down...
I20260709 12:19:34.500978  8907 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:34.501629  8907 tablet_replica.cc:333] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.502303  8907 raft_consensus.cc:2243] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.502925  8907 raft_consensus.cc:2272] T 1166087a85aa4ba7b2afa44366e76cc8 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.505334  8907 tablet_replica.cc:333] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.505934  8907 raft_consensus.cc:2243] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.506469  8907 raft_consensus.cc:2272] T 66fb05fd5cc04566ad610471a6824f82 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.508859  8907 tablet_replica.cc:333] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.509508  8907 raft_consensus.cc:2243] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.510059  8907 raft_consensus.cc:2272] T a1b7f230d8414fc98242a88e9d178a09 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.512533  8907 tablet_replica.cc:333] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.513072  8907 raft_consensus.cc:2243] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.513585  8907 raft_consensus.cc:2272] T 3c95b24fe1dd4e49a2241e53b5484cae P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.515900  8907 tablet_replica.cc:333] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.516477  8907 raft_consensus.cc:2243] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.517369  8907 raft_consensus.cc:2272] T aaa87a406370408e82ce446f558bca22 P 549656fc52dc4d32b95e86a38f654b61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.519650  8907 tablet_replica.cc:333] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.520224  8907 raft_consensus.cc:2243] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.521143  8907 raft_consensus.cc:2272] T 936ce13740d34c11ac1159a7671c16f2 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.523598  8907 tablet_replica.cc:333] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.524132  8907 raft_consensus.cc:2243] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.524706  8907 raft_consensus.cc:2272] T d27def25e82d4b04804a7c01d0bad511 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.526985  8907 tablet_replica.cc:333] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.527597  8907 raft_consensus.cc:2243] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.528092  8907 raft_consensus.cc:2272] T 2aea977479d64b5091426279b52cf890 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.530411  8907 tablet_replica.cc:333] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.531001  8907 raft_consensus.cc:2243] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.531463  8907 raft_consensus.cc:2272] T 4b1cd01ba7d24b56ad62b41190aa7e60 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.534010  8907 tablet_replica.cc:333] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.534611  8907 raft_consensus.cc:2243] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.535458  8907 raft_consensus.cc:2272] T 1a661dcb6c014713951f579345cc4e4a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.537626  8907 tablet_replica.cc:333] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.538164  8907 raft_consensus.cc:2243] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.539093  8907 raft_consensus.cc:2272] T 3ccc178f77f24b3c946787419e759896 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.541263  8907 tablet_replica.cc:333] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.541810  8907 raft_consensus.cc:2243] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.542249  8907 raft_consensus.cc:2272] T 87a6f73e36084930a34b6e0b152ff246 P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.544571  8907 tablet_replica.cc:333] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.545096  8907 raft_consensus.cc:2243] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.545608  8907 raft_consensus.cc:2272] T 794d5791aa754559b25397fc62e54fc9 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.547641  8907 tablet_replica.cc:333] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.548163  8907 raft_consensus.cc:2243] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.548664  8907 raft_consensus.cc:2272] T e6c79eceb05d4a7b9126c122c1220c85 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.550747  8907 tablet_replica.cc:333] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.551256  8907 raft_consensus.cc:2243] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.551697  8907 raft_consensus.cc:2272] T e3129265e8b34ec091bbd167ec6c6f42 P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.553814  8907 tablet_replica.cc:333] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.554275  8907 raft_consensus.cc:2243] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.554788  8907 raft_consensus.cc:2272] T d34ef136a21440acbb99ea660e3bf39a P 549656fc52dc4d32b95e86a38f654b61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.556857  8907 tablet_replica.cc:333] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.557308  8907 raft_consensus.cc:2243] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.557750  8907 raft_consensus.cc:2272] T 5f8ff4e26bbe44e299e122b1c15ada0c P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.559882  8907 tablet_replica.cc:333] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61: stopping tablet replica
I20260709 12:19:34.560338  8907 raft_consensus.cc:2243] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:34.560793  8907 raft_consensus.cc:2272] T a611119bad27426bbc7613183a3d517e P 549656fc52dc4d32b95e86a38f654b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.601943  8907 tablet_server.cc:196] TabletServer@127.8.178.195:0 shutdown complete.
I20260709 12:19:34.639732  8907 master.cc:562] Master@127.8.178.254:34155 shutting down...
I20260709 12:19:34.663331  8907 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:34.663992  8907 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:34.664311  8907 tablet_replica.cc:333] T 00000000000000000000000000000000 P c64065ef65494b86842b2c97bc93c0ad: stopping tablet replica
I20260709 12:19:34.709098  8907 master.cc:584] Master@127.8.178.254:34155 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20939 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42139 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (411992 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.TestMaintenanceMode

 1 FAILED TEST
I20260709 12:19:34.763576  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2236 messages since previous log ~32 seconds ago
I20260709 12:19:34.763777  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2235 messages since previous log ~32 seconds ago
I20260709 12:19:34.763916  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2234 messages since previous log ~32 seconds ago
I20260709 12:19:34.764073  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:19:34.764231  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:19:34.764382  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 7 messages since previous log ~210 seconds ago
I20260709 12:19:34.764524  8907 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 7 messages since previous log ~260 seconds ago
I20260709 12:19:34.764698  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 7 messages since previous log ~260 seconds ago
I20260709 12:19:34.764887  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 12:19:34.765125  8907 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
